Back to SEO Glossary
Technical SEO

What Is Crawl Stats Report?

The Crawl stats report, found under Settings in Search Console, records 90 days of Googlebot activity on a site: total crawl requests, total download size and average response time, broken down by response code, file type, purpose (discovery or refresh) and Googlebot type. It also reports host status for robots.txt, DNS and server connectivity.

Why Crawl Stats Report matters for SEO

It is the only place Google shows what its crawler physically did rather than what it concluded. The relationship between average response time and crawl requests is the clearest cause and effect in Search Console: when a server slows down, Google crawls less, which makes a hosting problem present as an SEO one.

Pro tip on Crawl Stats Report

Read patterns, never the headline number, which has no good value. Check host status first, then look for sustained 5xx responses, a redirect share that grew after a migration, and discovery near zero on a site that publishes regularly. Ensure robots.txt returns 200 or 404 and never a 5xx.

Related terms

Crawl BudgetCrawl stats is where a crawl budget problem becomes visibleRobots.txtHost status reports whether Google could fetch it at allLog File AnalysisLogs cover the crawlers and detail this report aggregates away

Learn more

The Crawl Stats Report Explained Free Redirect Checker

Crawl stats counts wasted requests without naming a single URL. CrawlRaven crawls your site and returns the redirect chains and error pages behind the chart.

Try CrawlRaven Free