Robots Txt Checker

Connect Remote server

claude mcp add --transport http robots-txt-checker https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "servers": {
    "robots-txt-checker": {
      "type": "http",
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

Settings > Connectors > Add custom connector
URL: https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp

Tools 1 found in our last check

• robots_txt_checker

  Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).

Details

More finance and crypto servers See all

• RightCard

  Which of your credit cards to use at any store, from verified bank data. No bank login.

• Africa Compliance Data

  African holidays, business days, VAT, withholding tax, tax treaties, tax IDs and filing deadlines

• BusCalc Business Calculators

  Business calculators, data lookups, replayable receipts, and documentation for enterprise pilots.

• CarLoanMath

  US car loan math: monthly payment, compare loans, max price for your budget, amortization. Free.

• InfinityVolume

  Dollar volume across 13 stock markets and US sectors, against each one's own normal. No prices.

• xytara MCP Executor

  Pay-per-call MCP tools and signed on-chain attestations: 20 free/day, then x402 or a spend key.