SiteDolphinBot

Spotted SiteDolphinBot/1.0 in your logs? That's our crawler, and it was there on the site owner's behalf — our customers ask us to watch their own websites for broken links, broken images and certificate problems.

How the bot behaves

• Fully respects robots.txt.
• At most two concurrent requests, with a pause between pages.
• Reads the sitemap first and crawls at most a few hundred pages, once a week.
• Stores no page content — only link status and technical measurements.

Want to block it?

Add this to your robots.txt and it will stay away:

User-agent: SiteDolphinBot
Disallow: /

Questions or complaints? Email hello@sitedolphin.com and a human will reply.