What is Crawl demand?
Nati Elimelech·Updated 27.07.2026 Crawl demand is how much Google wants to crawl a site, separate from how much Google can crawl it.
The server is fine, response time is flat, and crawling drops anyway. What changed is crawl demand: Google’s appetite for your pages, which comes from the content and the links pointing at it rather than from the server. Crawl demand is the other half of crawl budget: crawl capacity sets the ceiling, and demand decides how close Google even tries to get to it.
How crawl demand works
For Googlebot, demand derives from a site’s size, update frequency, page quality, and relevance compared to other sites. Google names three factors you can influence. The first is the URL inventory Google knows about, which Google singles out as the one you can positively control the most. The second is how popular those URLs are across the web. The third is staleness, because Google’s systems want to catch changes in time.
What crawl demand looks like in server logs
Popularity and staleness produce the pattern every news site knows from its server logs: Googlebot hits the homepage dozens of times a day while an archive page from 2019 gets one visit a month. Same server, same capacity, completely different demand per page.
How crawl demand relates to SEO and GEO
Low crawl demand costs you time: a page with low demand waits longer for a crawl, so its updates enter the index later, and the stale version is what keeps showing in results and answers. A faster server does not shorten that wait, because demand is raised in the content and the links. And not every bot visit is crawl demand: when ChatGPT-User arrives, no system scheduled a refresh. A user asked a question, and the answer lives on your site.
The difference between crawl demand and crawl capacity
Demand is how much Google wants, capacity is how much it can. Demand is built with content and links, capacity is built in the server. Actual crawling is what Google both can and wants to do: a high ceiling does not help without demand, and high demand does not pass the ceiling.
Questions about Crawl demand
How do you raise crawl demand?▼
Crawl demand rises through the three factors Google documents. The first is URL inventory, and Google writes it is the one you can control the most. Cleaning out duplicates and worthless URLs keeps Google from burning visits on pages that do not matter.
The second is popularity: URLs that are more popular across the web tend to get crawled more often, so the copy in Google's systems stays current. The third is staleness: Google wants to recrawl often enough to pick up changes. Links feed popularity, and genuine updates feed staleness.
Why did crawling drop when the server is fine?▼
A crawl drop while the server answers fast, with no 5xx errors and no 429s, is probably a demand drop: content aging out, pages Google lost interest in, or fewer new URLs being discovered. When all three of those signals are clean and crawling still declines, the problem is not the server.
Does a sitemap affect crawl demand?▼
A sitemap affects crawl demand on the discovery side: a current sitemap with reliable lastmod dates tells Google what changed and what deserves a revisit. It does not create interest in the content, but it aims the interest that exists.
Does each Google crawler have its own demand?▼
Each Google crawler has its own crawl demand, set by factors unique to it. Google gives examples: AdsBot generally raises demand when a site runs dynamic ad targets, and Google Shopping raises demand for products in your merchant feeds. There is only one capacity limit, though: every Google crawler shares it, and high demand from one crawler reduces what is left for the others.
Does a site move raise crawl demand?▼
Google writes that site-wide events, like site moves, may trigger an increase in crawl demand so Google can reprocess the content under the new URLs. That is behavior around an event, not a lever you can pull on an ordinary day.