AI Crawler Access Check by Citant.ai

Connect Remote server

claude mcp add --transport http ai-crawler-check https://check.citant.ai/mcp?src=registry

{
  "mcpServers": {
    "ai-crawler-check": {
      "url": "https://check.citant.ai/mcp?src=registry"
    }
  }
}

{
  "servers": {
    "ai-crawler-check": {
      "type": "http",
      "url": "https://check.citant.ai/mcp?src=registry"
    }
  }
}

Settings > Connectors > Add custom connector
URL: https://check.citant.ai/mcp?src=registry

Tools 1 found in our last check

• check_ai_crawler_access

  Checks whether AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and others) can actually reach a website. Goes beyond robots.txt: fetches the site as each crawler and detects firewall/CDN blocks (Cloudflare, Akamai, Imperva), challenge…

Details

More search and web servers See all

• Live Sports Scores & Betting Odds MCP Server

  Keyless sports scores, betting odds, injuries & news: NFL NBA MLB NHL soccer. No API key.

• Knowra

  Search arXiv papers and read Scout reports with methods, evidence and verification points.

• Contract Compass

  Korean public procurement law: rule-engine rulings, statutes search, live court precedents

• Korea Realty

  Korean real estate: court auctions, 10M+ MOLIT records, subscription notice facts, loan/DSR rules

• 校招宝 · 中国校园招聘岗位数据

  中国校园招聘（秋招/春招/实习/提前批）在招岗位、企业档案、投递截止与求职攻略数据。免 API Key、免注册、只读。

• IBDÅ

  Ask about IBDÅ, a design-led R&D and innovation studio in Dubai, and prepare a project enquiry.