agentsclimarketplace
Sign in

Robots sitemap validator

Skill aiskillstore/marketplace/skills/justhandledlabs/robots-sitemap-validator

Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".From its SKILL.md

Install
npx -y skills add aiskillstore/marketplace --skill robots-sitemap-validator

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.

SKILL.md

1.2 KB, 186 tokens by cl100k_base, as published. Nobody here has run it

Robots Sitemap Validator

Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.

Workflow

  1. Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
  2. Review findings by rule id, severity, file, and line.
  3. Treat missing sibling sitemap files as review flags when robots.txt references them.

Guardrails

  • Read local files or stdin only.
  • Do not fetch live URLs or submit sitemaps.
  • Do not modify robots.txt or sitemap files.

Verification

Run tests/test_robots_sitemap.py. Risky fixture must produce findings and clean fixture must produce zero findings.

Commercial Terms

Price: $0 / 0 credits. Free commercial use for personal or internal team workflows. Do not resell or redistribute the package as-is.

What ships with it: 4 files

14.7 KB alongside SKILL.md, 1 of them executable

references/

scripts/

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.