Google Shares More Information On Googlebot Crawl Limits
By Roger Montti
Published on March 16, 2026.
Google's Gary Ilyes and Martin Splitt discussed Googlebot's crawl limits, providing more details about why limits exist and how they can be adjusted upward or down depending on needs and what is being accomplished. Gary Illyes revealed that any crawler within Google has a 15 megabyte limit, which can be overridden or switched off. He also mentioned instances where the limit is increased to increase the crawl limit for PDFs. Other Google crawlers also have different limits and the limits are not hard limits across all of Google’s crawlers. Martin Splatt confirmed that Google's infrastructure is flexible and flexible, and that the company's software is not monolithic.
Read Original Article