Umbraco skill test runner
Skill umbraco/Umbraco-CMS-Backoffice-Skills/.claude/skills/umbraco-skill-test-runner
Run tests from skill examples and generate a report (project)From its SKILL.md
npx -y skills add umbraco/Umbraco-CMS-Backoffice-Skills --skill umbraco-skill-test-runnerAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
SKILL.md
1.9 KB, as published. Nobody here has run it
Skill Test Runner
Runs all tests from skill examples (unit, mocked, E2E) and outputs a JSON report.
Usage
cd .claude/skills/umbraco-skill-test-runner/scripts
npm install --silent
npx tsx run-tests.ts
Test Types
| Type | Description | Runner |
|---|---|---|
| Unit | Component tests with @open-wc/testing | Web Test Runner |
| Mocked | Integration tests against mocked backoffice | Playwright |
| E2E | Full end-to-end against real Umbraco | Playwright |
Environment Variables
| Variable | Default | Description |
|---|---|---|
UMBRACO_USER_LOGIN | - | Admin email for E2E authentication |
UMBRACO_USER_PASSWORD | - | Admin password for E2E authentication |
UMBRACO_URL | https://localhost:44325 | Umbraco instance URL |
Auto-Start Umbraco
If E2E tests are needed and Umbraco is not running, the script will automatically:
- Start Umbraco from
./Umbraco-CMS.Skills/usingdotnet run - Wait for the instance to be ready
- Run E2E tests
- Stop Umbraco when done (if it was started by the script)
Output
Generates test-report.json in the project root with structure:
{
"timestamp": "2024-12-26T12:00:00Z",
"umbracoStarted": true,
"summary": {
"total": 10,
"passed": 8,
"failed": 1,
"skipped": 1
},
"results": [
{
"example": "counter-dashboard",
"path": "plugins/umbraco-testing-skills/.../counter-dashboard",
"type": "unit",
"status": "passed",
"duration": 1234
}
]
}
Integration
This skill is Phase 3 of the validate-skills command, running after:
- Link validation (
umbraco-skill-validator) - Code analysis (
umbraco-skill-code-analyzer)