Why your pages aren't indexed (and the fastest way to fix it)
Indexed pages can rank. Unindexed pages can't — no matter how good the content is. Here's how to diagnose exactly why Google isn't finding your pages and fix it for good.
Indexing basics: crawling vs. indexing
These two terms get used interchangeably, but they're different stages:
- Crawling — Googlebot visits your page and reads its content.
- Indexing — Google decides the page is worth storing in its index, where it becomes eligible to rank.
A page can be crawled but not indexed. This is one of the most common (and most confusing) issues site owners run into — and it's exactly what "Crawled, not indexed" in Search Console means.
How to diagnose indexing issues
Start in Google Search Console's Page Indexing report (formerly Coverage). This shows every URL Google knows about and its current status.
| Status | What it means | Action |
|---|---|---|
| Indexed | Good — eligible to rank | None needed |
| Crawled, not indexed | Google saw it, decided not to index | Improve content quality or fix duplication |
| Discovered, not indexed | Google knows it exists, hasn't crawled yet | Usually crawl budget — improve internal linking |
| Excluded by noindex tag | Intentionally or accidentally blocked | Remove the tag if unintentional |
| Duplicate, canonical not selected | Google picked a different canonical | Fix canonical tags or differentiate content |
| Server error (5xx) | Server failed to respond properly | Fix server/hosting issue immediately |
For individual URLs, the URL Inspection tool gives a live look at indexing status and lets you request indexing directly — useful for one-off pages, but not a substitute for fixing the root cause.
Common causes (and fixes)
1. Accidental noindex tags
The single most common cause we see in audits. A noindex tag left over from a staging environment, a CMS default setting, or a plugin misconfiguration can silently block entire sections of a site.
2. Thin or low-value content
Google increasingly declines to index pages it judges as low-value — thin product pages, near-duplicate location pages, or auto-generated content with little unique value.
3. Crawl budget exhaustion
Large sites with many low-value pages (filtered URLs, tag pages, pagination) can exhaust the crawl budget Google allocates, leaving important pages undiscovered. See the crawl budget section below.
4. Poor internal linking
Pages with no internal links pointing to them ("orphan pages") are much harder for Google to discover, even if they're in the sitemap.
5. Canonical tag conflicts
If multiple pages have conflicting or self-referencing canonical signals, Google may choose a different canonical than you intended — or simply decline to index the version you want ranked.
Re-submitting a URL through the Inspection tool over and over without fixing the underlying cause won't help — Google will keep arriving at the same conclusion until something actually changes.
Sitemap best practices
Your XML sitemap doesn't force indexing, but it does guide discovery. Keep it clean:
- Only include canonical, indexable URLs — never include noindexed or redirected pages
- Keep sitemaps under 50,000 URLs per file (split into multiple sitemaps with a sitemap index if needed)
- Update it automatically as content changes — stale sitemaps cause confusion
- Submit it in Search Console and verify it shows no errors
Understanding crawl budget
Crawl budget is the number of pages Googlebot is willing to crawl on your site within a given timeframe. For small sites, this is rarely a constraint. For large sites (10,000+ pages), it matters significantly.
Ways to protect your crawl budget:
- Block low-value URL patterns (filters, sort parameters, internal search results) via robots.txt
- Consolidate or prune thin/duplicate pages rather than leaving them live
- Fix server response times — slow servers reduce how much Googlebot will crawl per visit
- Reduce redirect chains, which waste crawl requests
How long indexing actually takes
For a healthy site with no underlying issues, new pages are often indexed within a few days to two weeks. If a page hasn't indexed after 2–3 weeks, that's a signal something specific is blocking it — not just a matter of waiting longer.
Manually requesting indexing through the URL Inspection tool can speed up individual pages, but Search Console limits how many manual requests you can submit per day — it's not a scalable fix for site-wide indexing problems.
Quick indexing checklist
Want us to handle this for you?
Get a free 200-point website analysis and we'll show you exactly where you stand — no guesswork required.