Crawl allowance or crawl budget refers to the amount of time a search engine spider is allocated to crawl a site (per day). Established sites with authority experience significantly higher crawl allowances.