Aoa eval
Bounded agent-facing skill bundles for coding agents and humans: reviewable execution workflows composed from reusable techniques.
npx -y skills add 8Dionysus/aoa-skills --skill aoa-evalAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Select or apply an owner-local or cross-repository eval, route a confirmed no-fit to intake/design, or classify supplied session hits as eval candidates. Use aoa-evals for central proof bundles, named results or verdicts, reports, and lifecycle. Do not use for ordinary tests, undefined invariants, or generic session harvesting.
SKILL.md
5.2 KB, as published. Nobody here has run it
aoa-eval
Intent
Route one evaluation need to the narrowest procedure that preserves its real owner, input contract, output, and proof limit. Consolidation here is a shared front door, not a collapse of five different capabilities into generic prose.
Trigger boundary
Use this skill when:
- an eval surface must be selected or applied
- an established no-fit needs a local intake packet or a bounded suite design
- researched eval-trigger classes and supplied or retrieved session hits need eval-owned candidate classification
Do not use this skill when:
- the task is an ordinary test run, the invariant is still unknown, the real need is generic session harvesting, or the requested effect is central proof promotion
Inputs
- one mode intent plus its owner, source ref, acceptance target, relevant evidence or inventory, effect authority, and required environment details
Outputs
- one mode-specific result defined by
references/contract.yaml, including owner, evidence class, proof limit, next route, and stop line
Procedure
Record <bundle_dir> as the directory containing this loaded SKILL.md.
Choose exactly one mode
| Mode | Use when | Required procedure |
|---|---|---|
select | No exact evidence surface has been selected. | references/select.md |
apply | The exact surface and acceptance contract are explicit. | references/apply.md |
local-need | Selection proved no fit and an existing local eval port should receive pressure. | references/local-need.md |
design | Selection proved no fit and a stable invariant needs a bounded local suite or report design. | references/design.md |
session-mining | Prior research defined eval-trigger classes that need real session examples. | references/session-mining.md |
Mode: select
Read and follow references/select.md.
Mode: apply
Read and follow references/apply.md.
Mode: local-need
Read and follow references/local-need.md.
Mode: design
Read and follow references/design.md.
Mode: session-mining
Read and follow references/session-mining.md.
- Read
references/contract.yamland the selected mode reference completely before acting. Do not load unrelated mode references. - Read the target owner's route law and preserve source, environment, freshness, evidence class, effect posture, and proof authority.
- If a required mode input cannot be obtained from permitted sources, stop as
blocked_missing_input; do not guess, substitute a broader action, or relabel absence as an owner-boundary deferral. Inapply, the mode reference's complete dotted-field preflight must be observed before reading or executing the selected target; a summary claim that the contract is complete is not a preflight. - Execute each chosen procedure as one task-local node and return its typed
output. A request that explicitly asks to find and run may form
select -> applyonly after an exact fit provides the complete apply ABI. Other later modes remain explicit handoffs, never automatic continuation. - When the task asks what an applied observation actually constrains, hand the
evaluation-observationtoaoa-verification; do not reinterpret command success as proof inside this bundle. - When prior-session evidence still must be found, let the session-memory
evidence route retrieve and ground it, then consume the bounded packet here.
The evidence route owns retrieval;
session-miningowns eval-trigger classification and its local eval handoff.
Contracts
- selection, execution, intake, design, session evidence, and proof promotion are different effects
- eval discovery/application and interpretation of invariant coverage are distinct but composable nodes
- local evidence stays local until a stronger proof owner accepts it
- Eval Forge health, command success, and generated dashboards are not result proof
.aoaevidence is optional candidate evidence and never overrides owner source truth- technique records may explain provenance but are not runtime dependencies
Risks and anti-patterns
- choosing by keyword or replacing the selected action with a broader green gate
- collapsing local pressure and executable design into one vague proposal
- mining sessions before trigger classes and owner routes are known
- creating a permanent validator before manual cases establish a durable invariant
Verification
- confirm one mode, exact owner/source/environment posture, required inputs, output type, effect, and termination condition
- inspect commands and artifacts manually against the declared acceptance target
- state what the result proves, what it does not prove, skipped checks, drift, and the next owner route
Adaptation points
Owners supply local eval ports, schemas, command runners, artifacts, acceptance criteria, privacy rules, session providers, and proof-promotion workflows.