BoostSEO-Audit crawler
Information about the crawler that fetches pages when a user runs a BoostSEO audit.
When someone runs an audit of a website on BoostSEO, our server fetches the public pages of that site on their behalf. Requests are made at a modest rate, follow robots.txt rules for the BoostSEO user agent, and identify themselves with this user agent:
Mozilla/5.0 (compatible; BoostSEO-Audit/1.0; +https://seo.toolcmb.com/bot)
Audits are started by people, not on a schedule. To stop BoostSEO from crawling your site, add this to robots.txt:
User-agent: BoostSEO
Disallow: /
If you think our crawler caused a problem, please Contact.