Robotstxt Ai

io.github.sharozdawa/robotstxt-ai · v1.0.1

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Source code Set it up

Connect Runs on your machine

Terminal

claude mcp add robotstxt-ai -- npx -y [email protected]

claude_desktop_config.json

{
  "mcpServers": {
    "robotstxt-ai": {
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ]
    }
  }
}

~/.cursor/mcp.json

{
  "mcpServers": {
    "robotstxt-ai": {
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ]
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "robotstxt-ai": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ]
    }
  }
}

Tools

This server runs locally, so its tools are listed by your MCP client once it starts.

Details

Package	`[email protected]` (NPM, stdio)
First published	21 Mar 2026
Last updated	21 Mar 2026
Registry name	`io.github.sharozdawa/robotstxt-ai`

More search and web servers See all

Live status

Local install

Installed and run on your own machine, so there is no public endpoint to check.

Pair it with live search

Agents that use Robotstxt Ai often also need current facts. NestDaddy MCP gives your AI today's internet: web search, real-time breaking news and full page reading in one connector.

See NestDaddy MCP

For maintainers

[![NestDaddy MCP](https://nestdaddy.com/mcp/servers/io-github-sharozdawa-robotstxt-ai/badge.svg)](https://nestdaddy.com/mcp/servers/io-github-sharozdawa-robotstxt-ai)

Add the badge to your README. It turns green while your server passes our daily check. Listing details come from the official MCP registry; update them there.

Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.