NestDaddybot

NestDaddybot is the web crawler of NestDaddy, an independent search engine with its own index. This page tells website owners how to recognise it, how fast it crawls and how to limit or block it.

How to recognise it

User agentNestDaddybot/1.0.0 (+https://nestdaddy.com/bot)
robots.txt tokenNestDaddybot (matched without regard to case)
IPv4 address85.190.243.162
IPv6 address2a02:c202:2263:3507::1
Other addressesNone. A request that uses our name from any other address is not from us.

How it crawls

What it keeps

For each page: the address, title, description, headings, language, publication date and links, plus the text needed to match searches and show a short snippet in results.

To keep pages out of NestDaddy, use robots.txt (below). The noindex robots meta tag is not read yet; until it is, email us and we will remove the pages by hand.

Limit or block it

Block NestDaddybot completely

User-agent: NestDaddybot Disallow: /

Keep it out of some folders

User-agent: NestDaddybot Disallow: /private/ Disallow: /admin/

Changes to robots.txt are picked up within a day. Crawl-delay is not supported yet; if you would like us to crawl your site more slowly, email us and we will set a lower rate for it.

Contact

To report a problem, ask us to slow down, remove pages or verify a request, email [email protected] with your domain and, if you have it, the time and address of the requests. We read every message.

Back to NestDaddy · About NestDaddy