agentsclimarketplace

Robots txt validator

Skill vistabylara-dev/vista-claude-skills/skills/robots-txt-validator

Free Claude Skills for AI developers, Shopify experts, marketers, and businesses. Built by Vista by Lara.

Install
npx -y skills add vistabylara-dev/vista-claude-skills --skill robots-txt-validator

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

0.7 KB, 174 tokens by cl100k_base, as published. Nobody here has run it

robots.txt Validator Skill

Purpose

Analyze and validate a website's robots.txt file for correctness, crawlability, SEO best practices, and AI accessibility.

Input

  • Website URL
  • robots.txt content (optional)

Analyze

  1. Syntax validity
  2. User-agent directives
  3. Allow rules
  4. Disallow rules
  5. Sitemap declarations
  6. Crawl-delay directives
  7. Wildcard usage
  8. Blocked important pages
  9. Duplicate directives
  10. AI crawler accessibility
  11. Search engine compatibility
  12. Security risks
  13. Performance considerations
  14. Best practices
  15. Common mistakes

Output

Generate:

  • Validation Status
  • Errors
  • Warnings
  • SEO Impact
  • AI Visibility Impact
  • Recommended robots.txt
  • Improvement Checklist

Return everything in Markdown.

What ships with it: 1 file

401 B alongside SKILL.md

Keep looking

Skills are one crate of 326,984. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.