Google Indexing Guide (2025) — Get Every Page Found | Rank Up
◎ Free Resource
11 min read · Updated June 2025

Why your pages aren't indexed (and the fastest way to fix it)

Indexed pages can rank. Unindexed pages can't — no matter how good the content is. Here's how to diagnose exactly why Google isn't finding your pages and fix it for good.

Indexing basics: crawling vs. indexing

These two terms get used interchangeably, but they're different stages:

  • Crawling — Googlebot visits your page and reads its content.
  • Indexing — Google decides the page is worth storing in its index, where it becomes eligible to rank.

A page can be crawled but not indexed. This is one of the most common (and most confusing) issues site owners run into — and it's exactly what "Crawled, not indexed" in Search Console means.

How to diagnose indexing issues

Start in Google Search Console's Page Indexing report (formerly Coverage). This shows every URL Google knows about and its current status.

StatusWhat it meansAction
IndexedGood — eligible to rankNone needed
Crawled, not indexedGoogle saw it, decided not to indexImprove content quality or fix duplication
Discovered, not indexedGoogle knows it exists, hasn't crawled yetUsually crawl budget — improve internal linking
Excluded by noindex tagIntentionally or accidentally blockedRemove the tag if unintentional
Duplicate, canonical not selectedGoogle picked a different canonicalFix canonical tags or differentiate content
Server error (5xx)Server failed to respond properlyFix server/hosting issue immediately

For individual URLs, the URL Inspection tool gives a live look at indexing status and lets you request indexing directly — useful for one-off pages, but not a substitute for fixing the root cause.

Common causes (and fixes)

1. Accidental noindex tags

The single most common cause we see in audits. A noindex tag left over from a staging environment, a CMS default setting, or a plugin misconfiguration can silently block entire sections of a site.

<meta name="robots" content="noindex"> <!-- This single tag prevents indexing entirely -->

2. Thin or low-value content

Google increasingly declines to index pages it judges as low-value — thin product pages, near-duplicate location pages, or auto-generated content with little unique value.

3. Crawl budget exhaustion

Large sites with many low-value pages (filtered URLs, tag pages, pagination) can exhaust the crawl budget Google allocates, leaving important pages undiscovered. See the crawl budget section below.

4. Poor internal linking

Pages with no internal links pointing to them ("orphan pages") are much harder for Google to discover, even if they're in the sitemap.

5. Canonical tag conflicts

If multiple pages have conflicting or self-referencing canonical signals, Google may choose a different canonical than you intended — or simply decline to index the version you want ranked.

Common mistake

Re-submitting a URL through the Inspection tool over and over without fixing the underlying cause won't help — Google will keep arriving at the same conclusion until something actually changes.

Sitemap best practices

Your XML sitemap doesn't force indexing, but it does guide discovery. Keep it clean:

  • Only include canonical, indexable URLs — never include noindexed or redirected pages
  • Keep sitemaps under 50,000 URLs per file (split into multiple sitemaps with a sitemap index if needed)
  • Update it automatically as content changes — stale sitemaps cause confusion
  • Submit it in Search Console and verify it shows no errors

Understanding crawl budget

Crawl budget is the number of pages Googlebot is willing to crawl on your site within a given timeframe. For small sites, this is rarely a constraint. For large sites (10,000+ pages), it matters significantly.

Ways to protect your crawl budget:

  • Block low-value URL patterns (filters, sort parameters, internal search results) via robots.txt
  • Consolidate or prune thin/duplicate pages rather than leaving them live
  • Fix server response times — slow servers reduce how much Googlebot will crawl per visit
  • Reduce redirect chains, which waste crawl requests

How long indexing actually takes

For a healthy site with no underlying issues, new pages are often indexed within a few days to two weeks. If a page hasn't indexed after 2–3 weeks, that's a signal something specific is blocking it — not just a matter of waiting longer.

Reality check

Manually requesting indexing through the URL Inspection tool can speed up individual pages, but Search Console limits how many manual requests you can submit per day — it's not a scalable fix for site-wide indexing problems.

Quick indexing checklist

Check the Page Indexing report in Search Console for the real status of every URL
Remove any unintentional noindex tags
Verify canonical tags point to the correct, intended URL
Add internal links to any orphan pages
Submit a clean, updated XML sitemap
Improve or remove thin/low-value pages dragging down site quality

Want us to handle this for you?

Get a free 200-point website analysis and we'll show you exactly where you stand — no guesswork required.

No credit card needed Delivered in 48 hours 100% confidential