What is Crawl budget?
Nati Elimelech·Updated 24.07.2026 Crawl budget is the amount of crawling Google is willing to spend on a site in a given period. It's set by the combination of crawl capacity and crawl demand.
Crawl budget is really a time budget: Google is willing to spend a certain amount of Googlebot time on your site, and every request the bot sends counts against it. On small sites it’s almost never a constraint. On sites with hundreds of thousands of URLs, it decides which pages get crawled today and which wait until next week.
The budget has two sides worth knowing separately: crawl capacity, how much load your server can absorb, and crawl demand, how much Google actually wants to crawl you. Capacity sets the ceiling, demand decides how close Google tries to get to it.
How it relates to SEO and GEO
On a large site, crawl budget management is the difference between an article indexed in minutes and one that waits hours. Budget wasted on parameter pages, redirect chains and low-value URLs is budget that never reaches the content that matters. And it’s no longer just Google: AI engine bots also crawl with limited resources, and a site that respects its budget gets crawled deeper by all of them.