Crawler policy
SixvitalsBot
Sixvitals reads websites from the outside on behalf of their owners. Every request we make identifies itself, is rate-limited, and only happens for domains someone has verified — or for a single homepage fetch when someone types a domain into the quick-scan box.
User agent
Mozilla/5.0 (compatible; SixvitalsBot/1.0; +https://sixvitals.com/bot)
Full audits also open a small sample of pages in a headless Chromium to measure what a visitor sees. Those requests carry the same token in the user agent string.
What we fetch, and how often
- Quick scan — one fetch of the homepage, robots.txt and the sitemap index. Nothing is stored.
- Weekly audit — typically 20–60 page fetches plus their sub-resources, spread over a few minutes, at most 2 requests per second per host. Once a week per verified site; a manual re-run is limited to one every six hours.
- We honour robots.txt for page fetches; we still read the headers of the homepage so security grading works.
- We never submit forms, log in, or fetch anything behind authentication.
How to block it
Add this to your robots.txt. We check it before every run.
User-agent: SixvitalsBot Disallow: /
To stop audits for a domain you do not control, or to report abuse, write to bot@sixvitals.com with the domain; we remove it within one business day.