SEO · Website glossary

Crawling

Quick answer · What is Crawling?

The discovery and fetching of pages or resources by an automated crawler.

IN PRACTICE

Crawling: an example

A search crawler follows a normal link from a category page to a newly published guide.

KEEP IN MIND

Being crawled does not guarantee a page will be indexed or shown for a query.

Put the idea to work

Frequently asked questions

What is a practical example of Crawling?

A search crawler follows a normal link from a category page to a newly published guide.

Does being crawled guarantee indexing or search visibility?

Being crawled does not guarantee a page will be indexed or shown for a query.

Which concepts should I read alongside Crawling?

Indexing: The processing and potential storage of page information in a search engine's searchable index.
Internal link: A hyperlink connecting one page to another within the same website.