Google’s Gary Illyes and Martin Splitt published a podcast about Googlebot, explaining that the company operates hundreds of crawlers across different products and services, most of which are not publicly documented. The name “Googlebot” was a historical name from the early days when Google had only a single crawler. However, the name ‘gadbot’ stuck, even though it is now not one thing but a system that connects with a larger internal crawling service, the infrastructure. Gary explained that Googlebot is not the crawling infrastructure itself but an internal name within Google. He also mentioned that there are potentially dozens or hundreds of internal crawlers. Smaller or low-volume crawlers are often not documented due to practical limitations and may be reviewed and documented if a large enough size becomes large enough.