Robotstxt ai

MCP server sharozdawa/robotstxt-ai/io.github.sharozdawa/robotstxt-ai

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.From the repository description

InstallClaude Code

claude mcp add robotstxt-ai -- npx -y robotstxt-ai-mcp

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

Keep looking

MCP servers are one crate of 326,144. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.