MIGUEL.REGO // SEO+GEO Get in touch ↗

Glossary

Crawl Budget

Definition

Crawl budget is the number of pages a search engine will crawl on your site in a given period, shaped by site size, health and demand.

For small sites it is rarely a constraint. For large ones, wasting it on duplicate URLs, infinite filters or broken pages means important content gets crawled less often.

You protect it with clean internal linking, a tidy sitemap, correct robots.txt rules and by removing or consolidating low-value URLs.