docs(oss): add difficult-user simulation tutorial - #182
Draft
davidberenstein1957 wants to merge 7 commits into
Draft
docs(oss): add difficult-user simulation tutorial#182davidberenstein1957 wants to merge 7 commits into
davidberenstein1957 wants to merge 7 commits into
Conversation
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Deploying with
|
| Status | Name | Latest Commit | Preview URL | Updated (UTC) |
|---|---|---|---|---|
| ✅ Deployment successful! View logs |
giskard-docs | f79bc83 | Commit Preview URL Branch Preview URL |
Aug 13 2026, 06:01 AM |
davidberenstein1957
had a problem deploying
to
docs-deploy
August 13, 2026 05:20 — with 
GitHub Actions
Failure
GitHub Actions
Failure
Re-ran simulate-difficult-users.ipynb on a fresh kernel: all three personas pass and the weak-bot section still fails as advertised. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
davidberenstein1957
had a problem deploying
to
docs-deploy
August 13, 2026 05:35 — with
GitHub Actions
Failure
GitHub Actions
Failure
Use the Azure generator/client pattern the passing notebooks use, so the notebook runs with the AZURE_AI_* credentials CI provides. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
davidberenstein1957
marked this pull request as ready for review
August 13, 2026 05:48
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Member
|
Out of scope for this cycle, let's postpone the review of this PR |
henchaves
marked this pull request as draft
August 13, 2026 06:29
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
how-to/simulate-usersteaches the mechanics ofUserSimulator(persona,max_steps, plugging it intoScenario.interact) but stops at a single cooperative persona, andreference/generators.mdxshows only a flight-booking persona. Nothing shows the interesting case — a hostile user, one who drifts out of scope, or one who social-engineers the agent — which is the whole reason multi-turn simulation exists.Changes
checks/tutorials/simulate-difficult-users.ipynb(+ generated.mdx): one support agent tested against three escalating personas, each its own section with reusable module-level persona constants.max_steps.FnCheckon forbidden strings.goal_reached is Falseas the pass condition where the goal is one the agent should deny, with prose explaining the inversion — a pattern absent from the docs today.how-to/simulate-usersfor parameter details.Verification
gpt-4o-mini..mdxregenerated viascripts/convert-notebooks.mjs;npm run buildpasses.Notes / risks
sidebar.order: 6— renumber on merge.🤖 Generated with Claude Code