agentsclimarketplace

Benchmark

Skill keep-starknet-strange/starknet-skills/.claude/skills/benchmark

Run evaluation benchmarks and report precision/recallFrom its SKILL.md

Install
npx -y skills add keep-starknet-strange/starknet-skills --skill benchmark

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 2 stars2 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

1.1 KB, as published. Nobody here has run it

Benchmark Skill

Quick Start

  1. Run auditor benchmark: python3 scripts/quality/benchmark_cairo_auditor.py --cases evals/cases/cairo_auditor_benchmark.jsonl --output /tmp/bench-auditor.md --min-precision 0.90 --min-recall 0.90
  2. Run contract benchmark: python3 scripts/quality/benchmark_contract_skills.py --cases evals/cases/contract_skill_benchmark.jsonl --output /tmp/bench-contracts.md --min-precision 0.95 --min-recall 0.95
  3. If $ARGUMENTS contains --save, append --save to both commands to copy scorecards into evals/scorecards/.
  4. Report precision/recall and fail conditions per suite.
  5. Follow the full workflow: Benchmark Workflow

When to Use

  • You changed skills, references, datasets, or evaluation logic.
  • You need comparable KPI numbers before/after a PR.

When NOT to Use

  • You only need schema/structure validation (use validate skill instead).
  • Benchmark inputs or dependencies are missing.

Keep looking

Skills are one crate of 609,689. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.