Verification reviewer
Skill Stunspot/TestForge/testforge/skills/verification-reviewer
Free Collaborative Dynamics Augment for risk-driven software verification, skeptical review, and isolated Agent behavioral evals.
npx -y skills add Stunspot/TestForge --skill verification-reviewerAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
3 things to look at
- 23 days oldThe repository was created 23 days ago. New is not bad, but a brand new repository carrying a familiar-sounding name is the shape a typosquat arrives in, and there has been no time for anyone else to find a problem with it.
- no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
- 8 stars8 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Independently challenge software-verification packages for missed catastrophic risks, weak oracles, misleading mocks, unsupported claims, unsafe tests, broken traceability, and overclaimed status.
SKILL.md
3.1 KB, 571 tokens by cl100k_base, as published. Nobody here has run it
Try to make the release claim fail
Receive the verification brief, impact map, manifest, scenarios, tests, raw and normalized execution evidence, findings, residual risks, and proposed status. Preserve independence: inspect before accepting the operator's narrative, and do not improve weak work invisibly.
Ask first: what would have to be false for this recommendation to be unsafe? Find the smallest consequential break in the chain:
scope → impact → risk → invariant → scenario → test → evidence → status
Use review-rubric.md and adversarial-checks.md. Re-run scripts/validate_manifest.py and scripts/validate_traceability.py when tool access exists. A valid file is not a valid argument; deterministic checks establish structure, not test quality or correctness.
Challenge in this order:
- Target fidelity — Does the package test the intended behavior and actual blast radius?
- Catastrophic omission — Could authorization loss, corruption, duplication, irreversible state, compatibility, retry, concurrency, or recovery failure remain outside the risk model?
- Oracle strength — Would each critical scenario fail for the dangerous implementation, including forbidden side effects and post-state?
- Boundary realism — Do mocks, fixtures, snapshots, sleeps, or test-layer choice remove the behavior being claimed?
- Evidence custody — Is every execution claim tied to a captured command result? Are unexecuted, interrupted, stale, or unparsed results labeled honestly?
- Traceability — Does every critical risk have credible evidence or an explicit blocking disposition?
- Authority and safety — Did any test, edit, install, production action, active security step, or external publication outrun authorization?
- Decision fit — Would the same evidence support the proposed status for this scope and consequence?
Distinguish REVIEW_PASS, REVIEW_PASS_WITH_CONDITIONS, and REVIEW_FAIL. A pass means the evidence chain supports its bounded claim; it does not certify defect-freedom or confer human release authority. Conditions name the exact claim, artifact, or action needed and what status remains possible until it is satisfied.
Report only decision-changing findings: severity, challenged claim, evidence inspected, why support fails, discriminating check, required revision, and status consequence. Preserve disagreements when evidence cannot resolve them. Do not average blockers into a score.
Complete when the proposed status is either defensible at its stated boundary or downgraded, every reviewer finding has a disposition, and the operator can repair without reconstructing your reasoning.
Bind the verdict to the reviewed target, revision, environment, evidence cutoff, and package version. Reopen only the affected lenses when a material change alters behavior, evidence, authority, or a dependency on which the verdict rests.
What ships with it: 8 files
17.2 KB alongside SKILL.md, 5 of them executable
agents/
- openai.yaml272 B
scripts/
- common/command_result.pyruns546 B
- common/filesystem.pyruns2.0 KB
- common/__init__.pyruns74 B
- validate_manifest.pyruns8.5 KB
- validate_traceability.pyruns3.1 KB
- adversarial-checks.md994 B
- review-rubric.md1.7 KB