Robots sitemap validator
Skill justhandledlabs/skills/skills/robots-sitemap-validator
Free agent skills for Claude Code and SKILL.md agents. Add with: /plugin marketplace add justhandledlabs/skills. Eleven focused tools by JustHandled Labs.
npx -y skills add justhandledlabs/skills --skill robots-sitemap-validatorAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
The file declares its own license as MIT. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.
SKILL.md
1.2 KB, 186 tokens by cl100k_base, as published. Nobody here has run it
Robots Sitemap Validator
Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.
Workflow
- Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
- Review findings by rule id, severity, file, and line.
- Treat missing sibling sitemap files as review flags when robots.txt references them.
Guardrails
- Read local files or stdin only.
- Do not fetch live URLs or submit sitemaps.
- Do not modify robots.txt or sitemap files.
Verification
Run tests/test_robots_sitemap.py. Risky fixture must produce findings and clean fixture must produce zero findings.
Commercial Terms
Price: $0 / 0 credits. Free commercial use for personal or internal team workflows. Do not resell or redistribute the package as-is.
What ships with it: 3 files
5.9 KB alongside SKILL.md, 1 of them executable
references/
scripts/
- scan_robots_sitemap.pyruns4.8 KB