Our crawler
ReyseAudit, our website checker
If you’ve seen ReyseAudit in your website’s logs, this is who it is.
Jump to a section
1. What it is
ReyseAudit is the crawler behind the Found First Audit. It reads an estate or letting agency's website the way a search engine does, so we can check it against the checklists in our free SEO and GEO courses. It visits a website only when we're auditing it.
2. How you'll recognise it
Its requests carry this user agent:
Mozilla/5.0 (compatible; ReyseAudit/1.0; +https://reyse.co.uk/audit-bot)3. How it behaves
- It follows your robots.txt: rules for ReyseAudit, or for all crawlers.
- It reads at most about 300 pages and 25 property listings, three requests at a time, with a pause after each.
- It never fills in a form, logs in, books a valuation or downloads anything it doesn't need.
- It opens a few key pages in a normal browser, on a phone and a computer, to see what visitors see.
- It asks for your homepage once as each search and AI crawler (OAI-SearchBot, PerplexityBot, Claude-SearchBot, Googlebot, Bingbot and a few others) and once as a normal browser, to compare what each one is shown. Those few requests use those names, not ReyseAudit.
4. How to stop it
Add these two lines to your robots.txt and it won't read your site again:
User-agent: ReyseAudit
Disallow: /5. Questions
Email hello@reyse.co.uk. A person reads every message and replies within 1 working day.