Google has claimed that consistently fast server responses can allow Googlebot to increase its crawl rate or fetch more content with available connections.

Sources

• Optimize your crawl budget | Google Crawling Infrastructure

  Google for Developers · primary source · retrieved 2026-08-18

  “response times (including latency and Time-to-First Byte) remain stable or improve, the limit goes up” — Section: Crawl capacity limit, Crawl health bullet (current text)

• Crawl Budget Management For Large Sites | Google Search Central

  Google Search Central (developers.google.com) · primary source · retrieved 2026-08-18

  “If the site responds quickly for a while, the limit goes up, meaning more connections can be used to crawl.” — Section: Crawl capacity limit, Crawl health bullet

• Google Updates Its Optimize Your Crawl Budget Document: Conservative Crawl Capacity Limit

  Search Engine Roundtable · retrieved 2026-08-18

  “If there is demand to crawl more and the site remains healthy, Google's systems will automatically adjust this limit over time.” — Coverage of Google's documentation update

• What is server response time, and how it affects Google's crawl rate

  Nati Elimelech · retrieved 2026-08-18

  “response time drops from around 500ms to around 120ms, and crawl volume climbs from about 15,000 a day to about 100,000 a day” — lines 33-42