agentsclimarketplace

Foundry audit

Skill xiaolai/eou-foundry/skills/foundry-audit

Audit the EOU Foundry as a whole — not individual EOUs, but the system: schema drift across rule/validator/skill/docs layers, self-approval risk, generation overreach, weakened validators, missing trace, orphan EOUs, stale active EOUs without ECP history. <example> Context: Owner wants a portfolio-level health check before a quarterly release. user: "$foundry-audit" assistant: "I'll audit the whole Foundry. Checks include schema/validator/skill consistency, no-self-approval enforcement across active EOUs, vocabulary drift in canonical functions, and lifecycle/evidence triangle compliance (trace gate, activation evidence, maturity claim vs evidence)." </example> <example> Context: User wants to find which active EOUs have no run traces or no-trace justifications. user: "$foundry-audit" assistant: "Among other checks, I'll surface every EOU at lifecycle_stage active that fails the ECP-0014 trace gate. Report goes to foundry/audits/foundry-audits/." </example>From its SKILL.md

Install
npx -y skills add xiaolai/eou-foundry --skill foundry-audit

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 9 stars9 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

6.1 KB, as published. Nobody here has run it

Foundry Audit

Audit the whole Foundry. Read all governance files first, then execute each check category in order.

Required reading

  1. foundry/constitution.yml — top-level invariants
  2. foundry/registry.yml — current EOU registration and lifecycle stages
  3. foundry/governance.yml — approval authority and promotion rules
  4. schemas/*.schema.yml — all schema files (authority for valid field names and values)
  5. foundry/eous/*.yml — all standard EOU specs
  6. foundry/meta-eous/*.yml — all meta/generating EOU specs
  7. foundry/self-evolution/ecp/implemented/ — approved and implemented ECPs (for check 6)

Stop conditions

Stop and record a critical finding before checks if:

  • foundry/constitution.yml does not exist — the Foundry is unconfigured.
  • schemas/eou.schema.yml does not exist — schema drift cannot be checked.

Check categories

1. Faceted classification completeness

Every EOU spec must declare all six facet fields: function, target_object, automation_mode, authority_level, risk_level, lifecycle_stage. Flag any spec with missing or placeholder values.

2. Generating EOU envelope safety

For each EOU with function: generate: verify generation_envelope.forbidden_outputs contains active_eou, approved_eou, and constitution_change. Flag any envelope that permits outputs outside its stated scope.

3. Self-approval risk

For each EOU: verify responsibility.executor ≠ responsibility.approver. A single role cannot both produce and approve outputs. Flag any EOU where this boundary is absent or ambiguous.

4. Registry / spec consistency

Every EOU in registry.yml with lifecycle_stage: active or pilot must have a corresponding spec file in foundry/eous/ or foundry/meta-eous/. Every spec file at those stages must be registered. Flag orphan specs and unregistered active EOUs.

5. Schema drift

Load each schema from schemas/*.schema.yml. For each active or pilot EOU spec, validate it against the schema. Flag missing required fields and type mismatches.

6. ECP discipline

Any EOU spec that changed authority_level, blast_radius.forbidden_scope, or removed a validator must have a corresponding approved ECP. Determine prior state from versioning.changelog entries in the spec. Check foundry/self-evolution/ecp/implemented/ for the approved ECP. Flag spec changes with no matching implemented ECP.

7. Regression memory

For each active EOU: at least one regression fixture must exist in foundry/self-evolution/regression/cases/. Flag EOUs with zero regression coverage.

8. Authority and blast radius

For each EOU: authority_level must match blast_radius.allowed_scope. An EOU with authority_level: write_candidate or lower must not have allowed_scope containing any of: foundry/constitution.yml, foundry/governance.yml, foundry/registry.yml, foundry/self-evolution/ecp/implemented/, schemas/. Flag any mismatch between authority level and the governance files in the allowed scope.

9. High-risk escalation

For each EOU with risk_level: high or critical: escalation.require_human_when must be non-empty and responsibility.approver must be a named human role (not "Claude" or "script"). Flag violations.

10. Operational value

For each EOU: purpose.statement must name a concrete failure prevented or decision improved — not a process description. Flag EOUs with purpose statements that describe what the EOU does without naming what failure it prevents.

Output

Write the audit report to foundry/audits/foundry-audits/{YYYYMMDD}.foundry-audit.yml:

audit_date:
findings:
  - check:         # check category name
    severity:      # critical | high | medium | low
    eou_id:        # or "foundry-wide"
    description:   # what was found
    required_fix:  # specific change required
summary:
  total_findings:
  by_severity:
    critical:
    high:
    medium:
    low:
  pass_rate:       # checks passed / total checks
  verdict:         # PASS | FAIL | CONDITIONAL_PASS

Constraints

  • Do not modify any EOU spec, schema, registry, or governance file — produce the audit report only.
  • Treat missing required fields as failures, not warnings.
  • If a check cannot be executed (e.g., no EOU specs exist yet), record it as skipped with a reason, not as pass.
  • Zero findings for a Foundry with more than 5 specs is suspicious — record it as a low-severity warning finding.

Scope Note

Upstream: no specific input — audits the whole Foundry. Typically invoked at release milestones, after schema changes, or when portfolio bloat is suspected.

Downstream: produces a foundry-wide audit report under foundry/audits/foundry-audits/. Findings feed $eou-diagnose, $eou-refactor, or directly an ECP via $ecp-propose when policy gaps surface.

Related: $eou-audit (sibling — per-EOU); $eou-validate (sibling — structural-only); $audit-candidate-eou-set (sibling — candidate sets only).

Pipeline: release milestone | schema change → foundry-audit → (findings) eou-diagnose | eou-refactor | ecp-propose

Keep looking

Skills are one crate of 627,801. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.