Evidence review
Skill Touchdown-Labs/inference-optimization-agent-pack/skills/evidence-review
Review inference optimization claims against task success, p95/p99 latency, cost, cache behavior, retries, quality gates, and artifact-backed evidence.From its SKILL.md
npx -y skills add Touchdown-Labs/inference-optimization-agent-pack --skill evidence-reviewAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
1.6 KB, 316 tokens by cl100k_base, as published. Nobody here has run it
Evidence Review
Use this when someone claims an optimization worked.
The goal is to decide whether the result is real, useful, and safe to keep.
Required Metrics
Ask for:
- cost per successful task, completed call, or accepted asset;
- success rate;
- quality score or human acceptance;
- p50/p95/p99 latency;
- retry rate;
- tool-call count;
- cache hit rate;
- model/provider cost;
- human rework;
- traffic shape;
- failure examples.
Evidence Artifacts
Look for:
- traces;
- logs;
- eval outputs;
- invoice or usage export;
- benchmark config;
- prompt/context versions;
- route decisions;
- cache keys and hit/miss logs;
- sandbox or tool logs;
- before/after samples.
Claim Labels
Label every conclusion:
- measured;
- source-backed;
- inferred;
- assumed;
- not_found.
Red Flags
- Token cost improved but success rate fell.
- Average latency improved but p99 got worse.
- A faster model caused more retries.
- A cache hit is counted without correctness or freshness checks.
- A self-hosted benchmark excludes operations cost.
- A media workflow reports render latency but not accepted asset rate.
- A voice workflow reports time-to-first-audio but not completed call outcome.
Output
Return:
- What is proven.
- What is not proven.
- What changed.
- Whether the change should ship, rollback, or run as an experiment.
- The next evidence packet needed.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.