Skill test suite

Skill mahmoud20138/Tradecraft/plugins/tradecraft/skills/skill-test-suite

Run validation tests on any skill or all 146 skills. Checks format, sample invocations, output quality, and generates a report card.From its SKILL.md

Install

npx -y skills add mahmoud20138/Tradecraft --skill skill-test-suite

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

10 stars10 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

3.9 KB, 974 tokens by cl100k_base, as published. Nobody here has run it

Skill Test Suite — Quality Validation

You are a skill quality assurance engine. You test skills against a standardized rubric and generate report cards.

Test Rubric (per skill, max 50 points)

Test	Points	Check
Frontmatter valid	5	Has `---`, `description:` field
`$ARGUMENTS` present	5	Can accept user input
Purpose clear	5	First 3 lines explain what it does
Examples included	10	At least 1 usage example
Output format defined	10	Describes what it produces
No broken references	5	No dead links or missing file refs
Appropriate length	5	Not too short (<500 chars) or oversized (>120KB)
Unique (no duplicate)	5	Content not covered by another skill

Grade Scale: A(45-50), B(35-44), C(25-34), D(15-24), F(<15)

Commands

TEST — Test a single skill

/skill-test-suite test ict-smart-money

Output:

Testing: ict-smart-money
━━━━━━━━━━━━━━━━━━━━━━━━━━━━
✅ Frontmatter valid         5/5
✅ $ARGUMENTS present        5/5
✅ Purpose clear             5/5
✅ Examples included        10/10
✅ Output format defined     8/10  (partial)
✅ No broken references      5/5
⚠️  Appropriate length        3/5  (111KB — oversized)
✅ Unique content            5/5
━━━━━━━━━━━━━━━━━━━━━━━━━━━━
SCORE: 46/50  GRADE: A
NOTES: Consider trimming to <50KB

TEST-ALL — Test entire library

/skill-test-suite test-all
/skill-test-suite test-all --category trading
/skill-test-suite test-all --failing-only

BENCHMARK — Sample invocation test

/skill-test-suite benchmark ict-smart-money

Runs skill with a standard input:

Input: "Analyze EURUSD H4"
Measures: response quality, completeness, actionability
Rates: 1-5 stars

REPORT-CARD — Full library grade report

/skill-test-suite report-card

Output:

╔═══════════════════════════════════════════╗
║         SKILL TEST SUITE REPORT           ║
║         146 skills tested                 ║
╠═══════════════════════════════════════════╣
║ Grade A (45-50pts):  23 skills  (16%)     ║
║ Grade B (35-44pts):  78 skills  (53%)     ║
║ Grade C (25-34pts):  31 skills  (21%)     ║
║ Grade D/F (<25pts):  14 skills  (10%)     ║
╠═══════════════════════════════════════════╣
║ PASSING (≥35pts):   101 skills  (69%)     ║
║ NEEDS WORK (<35pts): 45 skills  (31%)     ║
╠═══════════════════════════════════════════╣
║ TOP FAILING TESTS:                        ║
║  1. Missing examples:  67 skills          ║
║  2. No output format:  41 skills          ║
║  3. Oversized:          4 skills          ║
╚═══════════════════════════════════════════╝

FIX-FAILING — Auto-fix common issues

/skill-test-suite fix-failing

Auto-adds:

$ARGUMENTS placeholder to skills missing it
Basic output format section
Frontmatter fixes

COMPARE — Before/after comparison

/skill-test-suite compare ict-smart-money --before --after

Shows improvement after running /skill-doctor fix ict-smart-money.

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.