Evaluating agent behavior
Skill build-with-dhiraj/ai-workflow-framework-portability-kit/Skills/evaluating-agent-behavior
Build agent behavioral evals — tool choice, steerability, constraint compliance. Triggers on "behavioral eval".From its SKILL.md
npx -y skills add build-with-dhiraj/ai-workflow-framework-portability-kit --skill evaluating-agent-behaviorAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
1.0 KB, 202 tokens by cl100k_base, as published. Nobody here has run it
Evaluating Agent Behavior
Behavioral evaluations (evals) validate the agent's decision-making, such as tool choice and steerability.
Workflow Decision Tree
- Does it need validation?: If a prompt or tool change affects decision-making, it requires an eval.
- Choosing the Rig:
- appEvalTest (AppRig): For UI-heavy or complex interactive flows.
- evalTest (TestRig): For logic-focused behavior.
- Policy Setting:
- USUALLY_PASSES: For new tests.
- ALWAYS_PASSES: For established tests to lock in regressions.
Checklist
- Setup Workspace: Initialize the test environment.
- Write Assertions: Define the expected tool calls or behavioral markers.
- Verify: Run the eval suite and analyze failures.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.