agentsclimarketplace

Coherence audit

Skill fabioc-aloha/Alex_Skill_Mall/plugins/supervisor-fleet/coherence-audit

Detect coherence violations between Alex_ACT_Edition (brain) and Alex_Skill_Mall (marketplace) — broken references, tag mismatches, deprecated install snippetsFrom its SKILL.md

Install
npx -y skills add fabioc-aloha/Alex_Skill_Mall --skill coherence-audit

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

4.7 KB, ~1.1k tokens by cl100k_base, as published. Nobody here has run it

Coherence Audit

The brain (Edition) and the Mall must agree. Coherence drift is silent — Edition can recommend a store the Mall has pruned, or the Mall can list a store with a tag the brain contradicts.

When to Use

  • Periodic full audit (recommended monthly, fired by /audit-coherence)
  • Before any Mall prune that touches a referenced entry
  • Before tagging an Edition release (preflight check)
  • When a heir reports "the brain told me to use X but the Mall doesn't have it"

The Three Coherence Checks

#ViolationDetection
1Broken reference — Edition cites a store that's no longer in the MallGrep Alex_ACT_Edition/.github/ for store URLs and names; intersect with current STORES.md
2Tag mismatch — Edition tags a store "primary" but Mall doesn't list it as First-PartyCross-check the brain's "primary" or "recommended" tags against Mall's category headings
3Deprecated snippet — Mall install snippet uses a command the brain says is deprecatedCross-grep MCP install snippets in Mall against any deprecated: flag in brain instructions

Procedure

  1. Run node scripts/coherence-check.cjs (mechanical sweep — covers Check 1, partial Check 2)
  2. For each finding, classify:
    • Hard violation — broken reference, must fix before any release
    • Soft violation — tag drift, fix in next routine sweep
    • False positive — string match without semantic meaning (e.g., a URL in a code example)
  3. Run an ACT pass on the verdict — coherence fixes touch both repos
  4. For each hard violation, decide which side fixes:
    • Edition references a pruned store → fix Edition (remove or replace reference)
    • Mall pruned a store Edition still legitimately needs → re-add to Mall (run store-evaluation)
    • Tag mismatch → align the side that's wrong (usually Edition, since Mall is the catalog of record)
  5. Open coordinated PRs (Edition + Mall) when both sides need changes
  6. Record in decisions/curation-log.md

Hard Rules

  1. Mall is the catalog of record — when names or URLs disagree, the Mall wins (it's the marketplace; Edition consumes it).
  2. Edition is the doctrine of record — when capability claims disagree (deprecated, primary, recommended), the Edition's brain wins.
  3. Coherence-check is a release gate — Edition releases must pass coherence-check; if a violation exists, either fix it or document the exception in the release notes.
  4. No silent suppressions — every "false positive" finding gets a one-line note in the audit report explaining why.

Decision Matrix

Edition saysMall saysVerdict
Cites store XHas X in catalogOK
Cites store XNo XHard violation — fix Edition or re-add to Mall
Tags X "primary"Lists X in First-PartyOK
Tags X "primary"Lists X in CommunitySoft violation — align tags
Says command Y deprecatedMall snippet uses YSoft violation — refresh Mall snippet
Recommends X for use case ZNo XHard violation

Output Template

# Coherence Audit — YYYY-MM-DD

## Scope

- Edition: <commit SHA>
- Mall: <commit SHA>

## Mechanical Findings

| Finding | Type | Side to fix | Severity |
|---|---|---|---|

## Semantic Findings

| Finding | Type | Side to fix | Severity |
|---|---|---|---|

## Coordinated PRs

- Edition: <PR link or "none">
- Mall: <PR link or "none">

## False Positives

| Finding | Why it's not a violation |
|---|---|

## ACT Pass Trail

<markers>

Anti-Patterns

Anti-patternCorrection
Fixing Edition only when Mall is the catalog of recordCatalog-of-record rule decides which side moves
Suppressing findings without rationaleEvery dismissed finding gets a one-line note
Running coherence-check on stale Mall dataAlways run after a Mall pull, not before
Treating string-match as definitiveSome matches are illustrative URLs in examples; classify as false positive

Related

Keep looking

Skills are one crate of 326,861. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.