agentsclimarketplace

07 quality and verification

Skill heymegabyte/claude-skills/07-quality-and-verification

14-category autonomous product-building OS for 32+ AI coding tools. One-line prompts → deployed products.

Install
npx -y skills add heymegabyte/claude-skills --skill 07-quality-and-verification

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

2 things to look at

  • no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
  • 18 stars18 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

5-level verification pyramid: static→unit→Playwright E2E (homepage-first, 6bp)→AI visual→post-deploy. 8-check quality gate. Multi-agent testing (functional/security/a11y/performance). Playwright v1.59+ AI agents (Planner/Generator/Healer). WCAG 2.2 AA via axe-core v4.11. Percy+Chromatic visual regression. ADA Title II 2027/2028 deadlines.

The file declares its own license as Rutgers. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.

SKILL.md

5.5 KB, as published. Nobody here has run it

07 — Quality and Verification

Run the 5-level verification pyramid (static→unit→E2E→AI visual→post-deploy) with WCAG 2.2 AA and 8-gate quality enforcement on every change.

5-level pyramid (bottom to top)

  1. Static — TS strict + ESLint + oxlint + Prettier + knip (dead code)
  2. Unit — Vitest 3 (40% faster on 5k+ tests, Rust sharding, browser mode default)
  3. Playwright E2E — homepage-first, 6 viewports × 3 browsers, hermetic, parallel
  4. AI visual — vision rubric ≥9/10 per route, 6bp screenshots
  5. Post-deploy — wrangler tail clean + console-error-free + axe-clean + Lighthouse green

8-check quality gate (every PR)

  1. npm run typecheck clean (0 errors)
  2. npm run lint clean (0 errors, 0 warnings)
  3. npm test (Vitest) green
  4. npm run e2e:prod green at 6 breakpoints
  5. axe-core 0 violations per _kernel/standards.md#wcag22
  6. Lighthouse Perf ≥90, A11y ≥95, BP ≥95, SEO ≥95 (authoritative: EMDASH_LIGHTHOUSE_MIN_* in ~/.claude env)
  7. AI vision QA ≥9/10 per route (authoritative: EMDASH_AI_VISION_MIN)
  8. Console / CSP / network errors = 0

Any fail = blocker. Fix-forward per rules/verification-loop.md.

Playwright Test Agents (v1.59+)

  • npx playwright init-agents --loop=claude once per repo
  • Planner — Markdown plan; Generator — test code; Healer — auto-fix broken selectors (run before manual rewrite)
  • browser.bind() for MCP interop; page.screencast for video receipts on flaky specs

Hermetic spec contract (per rules/e2e-tdd-organization.md)

  1. Starts at homepage (/); navigates via clicks/keyboard
  2. Seeds own data via _fixtures/; cleans own data after-each
  3. Does not write to localStorage / IDB / cookies next spec reads
  4. Does not depend on Date.now() / timezone / random
  5. Does not open network to live third-party APIs (MSW / stub)

Violating any = build fail.

Parallel execution

  • fullyParallel: true
  • workers: process.env.CI ? '50%' : '75%'
  • Sharded via --shard=$INDEX/$TOTAL
  • 6 viewports per _kernel/standards.md#breakpoints; 3 browsers: Chromium, Firefox, WebKit

AI visual QA

  • Random snapshot sampling 30% per step (seeded hash, reproducible)
  • New-section AI vision: e2e/__seen-routes__.json gates first render of unknown routes
  • Rubric: layout sane / contrast WCAG AA / brand / no slop / ≥9/10 (Claude Sonnet 4.6 or GPT Image 2 vision)
  • Baselines in e2e/__snapshots__/; pixelmatch tolerance 0.1% / 0.5% area
  • Per rules/e2e-visual-inspection.md

Visual regression

  • Percy AI Visual Review — 3× faster review, 40% OCR-based noise filter, full-page + flows
  • Chromatic — component-level via Storybook
  • pixelmatch — local deterministic CI (three-tier: local → PR → deploy)

Multi-agent testing

Spawn parallel in single Agent call:

  • functional-tester — happy path + edge cases
  • security-reviewer — OWASP Top 10:2025 per _kernel/standards.md#owasp2025
  • accessibility-auditor — axe 6bp + WCAG 2.2 manual review
  • performance-profiler — Lighthouse CI + bundle audit + INP via LoAF
  • visual-qa — AI vision rubric ≥9/10

Each: 100–300 word brief, ≤200 word summary back. Per rules/agent-selection.md.

INP debugging

  • PerformanceObserver type long-animation-frame (LoAF, Chrome 123+)
  • For SPA per-route CWV: web-vitals v4+ with softNavs:true
  • Target ≤100ms cinematic; ≤200ms = fail per _kernel/standards.md#cwv

Console-error gate

After every deploy: browser console must show 0 CSP violations, 0 JS errors, 0 failed resources. Fixed by rules/verification-loop.md console-error gate.

E2E accumulation

  • Tests NEVER deleted, only appended
  • journey.spec.ts serial + stateful — each feature adds steps
  • 100% feature coverage matrix in e2e/FEATURES.md
  • Removed features: skip + comment, do not delete

Inventory enforcement

  • e2e/FEATURES.md — row per feature
  • e2e/COVERAGE.yml — feature→spec map; CI fails on any feature without entry/test
  • Pre-commit lint: new component without matching e2e/<feature>/ warns

See submodules: ai-vision-qa.md, multi-agent-testing.md, visual-regression.md.

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.