Eval output
An opinionated Claude operating system for PM-led engineering. Planning, enrichment, delegated execution, staged review, ship decisions, durable handoffs.
npx -y skills add dbc-oduffy/coordinator-claude --skill eval-outputAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
2 things to look at
- no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
- 5 stars5 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Score a research output against the 5-criteria eval rubric. Dispatches a Sonnet evaluator.
SKILL.md
1.1 KB, as published. Nobody here has run it
Evaluate Research Output
Usage
/coordinator:eval-output <path-to-research-output>
Process
- Read the eval rubric at
${CLAUDE_PLUGIN_ROOT}/pipelines/deep-research/eval-rubric.md
- Read the research output at the provided path
- Dispatch a Sonnet agent (model: sonnet, tools: Read, WebFetch, Write) with:
- The rubric
- The research output
- Instruction to: read the output, sample 3-5 cited URLs via WebFetch to verify citation accuracy, score each of the 5 criteria with a 0.0-1.0 score and 2-3 sentence justification, provide overall pass/marginal/fail grade
- Present the scores to the PM
Notes
- This is a post-hoc quality check, not a gate. Use it to calibrate prompt improvements.
- Start by running it on recent pipeline outputs to establish a baseline.
- Anthropic found a single LLM call with a single prompt was most consistent.