Crawl budget

Crawl budget refers to the number of pages a search engine will crawl on your website within a given time. Search engines allocate more crawl budget to larger, more authoritative sites that update frequently. By optimising your crawl budget through efficient site structure, removing low-value pages, and fixing broken links, you help search engines find and index your most important content.

See also: Indexing, Crawling, Content pruning