Capture eval issues
Skill Codagent-AI/agent-validator/.agents/skills/capture-eval-issues
Capture noteworthy review violations for the eval framework. Use when validator-run finds review failures — judges violations and saves notable ones to evals/inventory.yml.From its SKILL.md
npx -y skills add Codagent-AI/agent-validator --skill capture-eval-issuesAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
SKILL.md
1.1 KB, as published. Nobody here has run it
/capture-eval-issues
Capture noteworthy review violations into the eval inventory.
Input
This skill receives one or more review JSON file paths as arguments (space-separated).
Example: /capture-eval-issues validator_logs/[email protected] validator_logs/[email protected]
Procedure
- Read
judge-prompt.mdfrom this skill's directory - Spawn a subagent to judge and capture violations:
- Task tool:
Taskwithsubagent_type="general-purpose",model="sonnet",prompt=judge-prompt content +"\n\nReview JSON files: <file paths>\n\nSkill directory: <this skill's directory path>" - The subagent handles everything: reading files, judging, calling the append script
- Task tool:
- Report the subagent's capture summary (the
CAPTURED:line)