Indexing & Spidering Schedule

Spidering and indexing run independently once an hour, 24 hours a day, for new and resubmitted websites. Most sites become searchable within 1 to 2 hours after submission.

What Is Spidering?

Spidering is when Active Search Results sends spiders to crawl new and resubmitted websites. The spiders visit those pages, gather their content, and prepare it for indexing.

When Does Spidering Run?

Spidering and indexing are independent tasks. Spidering runs once an hour on new and resubmitted websites 24 hours a day.

What Is Indexing?

Indexing is when a crawled page is added to the Active Search Results search index so it can appear in ASR's SERPs, Active Search Results' Search Engine's Results Pages.

When Does Indexing Run?

Spidering and indexing are independent tasks. Indexing runs once an hour after spidering on new and resubmitted websites 24 hours a day.

When Is Indexing Completed?

Indexing is complete after the website has been spidered and indexed. When processes overlap, it usually takes from within 1 hour up to 2 hours.

When Will My Site Be Searchable?

After you submit or re-submit your website, it is typically searchable once spidering and indexing have finished—usually within 1 to 2 hours. Timing can vary slightly when those processes overlap.

When Are Removed Sites Taken Out of the Index?

If you delete or temporarily remove your website from Active Search Results, it is taken out of the search index on the next indexing cycle. Removal follows the same hourly indexing schedule as new and resubmitted sites.