Evaluating agent behavior
Skill build-with-dhiraj/ai-workflow-framework-portability-kit/Skills/evaluating-agent-behavior
Portable, self-contained snapshot of a complete Claude Code setup — 36 specialist agents, 134 skills, plugins, MCP servers & host tooling. Clone, claude login, run one script, restore the whole orchestration stack in ~20 min.
npx -y skills add build-with-dhiraj/ai-workflow-framework-portability-kit --skill evaluating-agent-behaviorAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Build agent behavioral evals — tool choice, steerability, constraint compliance. Triggers on "behavioral eval".
SKILL.md
1.0 KB, as published. Nobody here has run it
Evaluating Agent Behavior
Behavioral evaluations (evals) validate the agent's decision-making, such as tool choice and steerability.
Workflow Decision Tree
- Does it need validation?: If a prompt or tool change affects decision-making, it requires an eval.
- Choosing the Rig:
- appEvalTest (AppRig): For UI-heavy or complex interactive flows.
- evalTest (TestRig): For logic-focused behavior.
- Policy Setting:
- USUALLY_PASSES: For new tests.
- ALWAYS_PASSES: For established tests to lock in regressions.
Checklist
- Setup Workspace: Initialize the test environment.
- Write Assertions: Define the expected tool calls or behavioral markers.
- Verify: Run the eval suite and analyze failures.