agentsclimarketplace

Capture eval issues

Skill Codagent-AI/agent-validator/.agents/skills/capture-eval-issues

Capture noteworthy review violations for the eval framework. Use when validator-run finds review failures — judges violations and saves notable ones to evals/inventory.yml.From its SKILL.md

Install
npx -y skills add Codagent-AI/agent-validator --skill capture-eval-issues

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

SKILL.md

1.1 KB, as published. Nobody here has run it

/capture-eval-issues

Capture noteworthy review violations into the eval inventory.

Input

This skill receives one or more review JSON file paths as arguments (space-separated). Example: /capture-eval-issues validator_logs/[email protected] validator_logs/[email protected]

Procedure

  1. Read judge-prompt.md from this skill's directory
  2. Spawn a subagent to judge and capture violations:
    • Task tool: Task with subagent_type="general-purpose", model="sonnet", prompt= judge-prompt content + "\n\nReview JSON files: <file paths>\n\nSkill directory: <this skill's directory path>"
    • The subagent handles everything: reading files, judging, calling the append script
  3. Report the subagent's capture summary (the CAPTURED: line)

Keep looking

Skills are one crate of 613,872. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.