SEO & Search
What is indexing?
Indexing is the process by which a search engine adds a page to its database after discovering and crawling it. Only indexed pages can appear in search results, which makes indexing the gatekeeper for all organic visibility. A page can fail to be indexed for many reasons: blocking directives, poor internal linking, duplication or quality issues, or simply not having been discovered yet.
How discovery, crawling and indexing differ
Three stages, often conflated. Discovery: the search engine learns a URL exists, through links or a sitemap. Crawling: it fetches the page and reads it. Indexing: it decides to store the page and make it eligible to appear in results. A page can be discovered but not crawled, or crawled but not indexed, and indexing is never guaranteed, particularly for pages judged thin, duplicative or low-value.
Why pages fail to be indexed
Blocking directives, a noindex tag or robots.txt rule, sometimes left over from development
Weak internal linking, leaving the page effectively orphaned
Duplication or near-duplication of content that is already indexed
Quality thresholds, pages offering little that the index does not already hold
Simple recency, new pages on new sites can take time to be picked up
Why it matters
Indexing is binary gatekeeping: a page that is not indexed does not exist as far as searchers are concerned, regardless of its quality. Checking what is actually indexed, via Search Console or a site: query, is therefore the first diagnostic whenever content seems invisible.
Related terms
Indexing is the technical floor of SEO: internal linking aids discovery, and only indexed pages can appear on the SERP or earn organic traffic.