Report

Skill PSPDFKit-labs/agentic-usability/skills/report

Display a terminal scorecard of benchmark results showing pass rates, scores by difficulty, and per-test breakdowns. Use when the user asks about benchmark results, scores, or wants to see how their SDK performed.From its SKILL.md

Install

npx -y skills add PSPDFKit-labs/agentic-usability --skill report

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

21 stars21 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

1.9 KB, as published. Nobody here has run it

Benchmark Report

Display the benchmark scorecard for the pipeline.

agentic-usability report -p $ARGUMENTS

Options

--json: Output raw structured JSON instead of the colored table
--run <runId>: Show results for a specific run (default: latest)

Where Results Live

results/<runId>/
  report.json                        # Aggregate scorecard
  <targetName>/<testId>/
    judge.json                       # Per-test judge scores
    generated-solution.json          # Agent's solution
    agent-notes.md                   # Agent's working notes

Scoring Dimensions

Dimension	Range	What it measures
`apiDiscovery`	0-100	Found correct SDK endpoints/methods?
`callCorrectness`	0-100	API calls constructed correctly?
`completeness`	0-100	All requirements handled?
`functionalCorrectness`	0-100	Code runs and produces correct output?
`overallVerdict`	boolean	Solution works? (pass/fail)

The report aggregates these across all test cases and breaks them down by difficulty (easy/medium/hard).

Finding Runs

Runs are stored as subdirectories in results/ containing run.json:

{ "id": "run-2026-04-25T10-30-00-000Z", "createdAt": "...", "targets": [...], "testCount": 15, "label": "..." }

To list all runs, look for results/*/run.json files.

Present the results to the user. If they want deeper analysis, suggest using the insights skill.

For detailed file inventory, see pipeline-guide.md.