Skilltrust audit
Audit an Agent Skill or Skill repository before installation, release, or inclusion in a curated marketplace. Use for reviewing SKILL.md packages, checking opaque or hidden files, prompt-injection indicators, credential and environment access, command or network execution, dependency-source changes, oversized context payloads, symlinks, and release integrity; also use to create or verify a SHA-256 file manifest and produce a human-review trust report.From its SKILL.md
npx -y skills add poofang1986/skilltrust-audit --skill skilltrust-auditAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
3.1 KB, 566 tokens by cl100k_base, as published. Nobody here has run it
SkillTrust Audit
Establish inspectable evidence about an Agent Skill before trusting it. Never describe a clean report as proof that a Skill is safe.
Audit Workflow
-
Identify the exact Skill directory or repository and its source.
-
Run the deterministic audit:
python3 scripts/skilltrust.py audit /path/to/skill --format markdown -
Treat every
criticalorhighfinding as a release blocker until a human reviews the exact file and line. -
Review
mediumfindings against the declared purpose and trust boundary. Legitimate capability still requires explicit disclosure. -
Read
references/risk-model.mdbefore making a trust recommendation. -
For a release candidate, create and commit an integrity manifest:
python3 scripts/skilltrust.py manifest /path/to/skill --output /path/to/skill/skilltrust-manifest.json python3 scripts/skilltrust.py verify /path/to/skill --manifest /path/to/skill/skilltrust-manifest.json -
Report the evidence, unresolved risks, and a decision:
reject,quarantine,manual_review, oreligible_for_curated_install.
Decision Rules
- Use
rejectfor unexplained credential collection, data exfiltration, destructive execution, or a manifest mismatch in a published release. - Use
quarantinefor opaque executable content, symlinks, hidden payloads, or unreviewed package-source overrides. - Use
manual_reviewwhen behavior is powerful but plausibly required, including network access, subprocess execution, environment access, or arbitrary output paths. - Use
eligible_for_curated_installonly when the source and maintainer are known, all files are inspectable, high findings are resolved, medium findings are documented, dependencies are pinned, and the manifest verifies.
Do not recommend public one-click installation for Skills that operate on credentials, private messages, personal records, production systems, or financial data. Prefer a curated source and a pinned revision.
Custom Policy
Pass --policy policy.json to override size limits, allowed opaque files, ignored paths, or approved registry domains. Read references/policy.md before adding exceptions. Keep exceptions narrow and explain each one in review notes.
Output Contract
Return:
- target and source revision,
- finding counts by severity,
- blocking findings with file and line,
- declared capability versus observed execution surface,
- manifest status,
- unresolved human-review questions,
- trust decision and exact remediation.
Preserve the distinction inherited from DaoCui's evidence protocol: repository fact, declared intent, detected behavior, human validation, and trust decision are separate layers.
What ships with it: 4 files
16.8 KB alongside SKILL.md, 1 of them executable
agents/
- openai.yaml215 B
references/
- policy.md697 B
- risk-model.md1.8 KB
scripts/
- skilltrust.pyruns14.1 KB