Ai bot rules

Skill whiteknightonhorse/aipush-agent-skills/skills/ai-bot-rules

Free, open, security-verified agent skills for AEO (Answer Engine Optimization) — make any site ready for AI agents. Live: aipush.app

Install

npx -y skills add whiteknightonhorse/aipush-agent-skills --skill ai-bot-rules

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

1.5 KB, as published. Nobody here has run it

Declare AI crawler rules in robots.txt

AIPUSH agent skill · Category: Agent Discovery · Slug: ai-bot-rules

AI assistants (ChatGPT, Claude, Perplexity, Gemini) crawl with named user-agents. Explicit rules let you control whether they may read and cite your content — silence means inconsistent behavior across providers.

Why it matters

How to detect

Check robots.txt for User-agent: groups naming the major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.).

How to implement

Add per-crawler groups. To allow AI citation of your public pages:

User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Google-Extended
Allow: /

To disallow training while allowing answer citation, set Disallow: / only under the training crawlers you want to block.

How to verify

curl -s https://YOURDOMAIN/robots.txt | grep -iE 'GPTBot|ClaudeBot|PerplexityBot' shows your rules.

References

Part of the AIPUSH agent skills catalog. Scan your site free at https://aipush.app.