Whiteseo

Page Indexing Report and URL Inspection in Search Console

Page Indexing Report and URL Inspection in Search Console

"My page isn't showing up in Google" is the most frequently asked question in SEO, and the answer is almost always in Search Console's Page indexing report. This report splits every URL Google knows about on your site into two groups — indexed and not indexed — and groups the second one by reason.

That word, reason, is the key. "Not indexed" is not one problem; behind it sit around fifteen completely different situations: a technical block, duplication, a canonical decision, a quality judgement, or simply a queue. Each has its own fix, so the rule is read the reason first, act second.

This article works through every status using Google's official explanations and shows how to use the URL Inspection tool for diagnosis. For the tool as a whole, see what Google Search Console is and how it works.

Short answerThree things must happen for a page to appear in Google: the URL must be discovered, crawled and indexed. The report tells you which stage it stalled at. "Discovered — currently not indexed" is a queue and crawl-budget issue; "Crawled — currently not indexed" is a quality judgement and no button will fix it. Requesting indexing adds a URL to a queue; it guarantees nothing.

Crawling versus indexing

These two words are constantly mixed up, yet they are separate processes:

Crawling is Googlebot downloading the URL. It is simply fetching a file.

Indexing is Google processing that content, storing it in the index and making it a candidate for results. That is a decision — and Google may decide against it.

The distinction underpins all diagnosis: a crawled page can go unindexed even when everything is technically correct. Google never guarantees indexing.

All URLs on your siteURLs Google has discoveredsources: sitemap, internal links, external linksURLs crawledcrawl budget, server response, priorityURLs indexedquality, duplication, canonical choice
Figure 1 — The number of URLs shrinks at every stage. The report tells you which stage lost them.

How the report is structured

The report has three blocks:

Indexed pages. URLs in Google's index. The number itself is not a target — 500 indexed pages on a 500-page site is not a good sign if half of them are filter URLs and empty categories.

Not indexed pages. A list grouped by reason. Note that not every line here is a problem. "Alternate page with proper canonical tag", for example, is entirely normal and correct.

Warnings. Indexed, but with an issue — for instance a page indexed despite being blocked by robots.txt.

Understanding this split saves time. The practical rule: a large "not indexed" number is not bad in itself — what matters is for which reason and whether those URLs are pages you wanted in the index at all.

Every status and what it really means

The table below pairs Google's official explanation with the practical translation.

Status Google's explanation What it means in practice
Server error (5xx) "Your server returned a 500-level error when the page was requested." A server problem. Urgent — it also slows crawling
Redirect error A chain too long, a loop, an over-long URL or a bad redirect Shorten the redirect chain
URL blocked by robots.txt "This page was blocked by your site's robots.txt file." Google cannot get in. Remove the rule unless it is deliberate
URL marked 'noindex' "When Google tried to index the page it encountered a 'noindex' directive" A tag or header says no. Remove it unless deliberate
Soft 404 "It returns a user-friendly 'not found' message but not a 404 HTTP response code" The code contradicts the content
Blocked due to unauthorized request (401) "The page was blocked to Googlebot by a request for authorization." It sits behind a login
Blocked due to access forbidden (403) "The user agent provided credentials, but was not granted access." The server rejects Googlebot
Not found (404) "This page returned a 404 error when requested." The page is gone. If it is an old URL, add a 301
Page with redirect "This is a non-canonical URL that redirects to another page." Normal — the target page gets indexed
Alternate page with proper canonical tag "This page is marked as an alternate of another page... correctly points to the canonical page." Not a problem. Canonicalisation working as intended
Duplicate without user-selected canonical "This page is a duplicate of another page, although it doesn't indicate a preferred canonical page." Add a canonical tag
Duplicate, Google chose different canonical than user "This page is marked as canonical... but Google thinks another URL makes a better canonical." Your signals contradict each other
Crawled — currently not indexed "The page was crawled by Google but not indexed." A quality/value judgement
Discovered — currently not indexed "The page was found by Google, but not crawled yet." A queue and budget matter
Indexed, though blocked by robots.txt "The page was indexed despite being blocked by your website's robots.txt file." Contradictory signals — to apply noindex you must unblock robots.txt
Page indexed without content "This page appears in the Google index, but for some reason Google could not read the content." A rendering or cloaking problem

Sorting these into three families makes the work easier:

1. Technical blocks (401, 403, 404, 5xx, robots.txt, noindex, redirect errors) — the fix is in your hands and is precise. Most relate to server responses: HTTP status codes and SEO and 404, 410 and soft 404.

2. The canonical/duplicate group — Google sees the same content on several URLs and picks one. The fix: align canonical tags, internal links and redirects.

3. The quality and queue group ("Crawled/Discovered — currently not indexed") — the two hardest. The next section is devoted to them.

The two hardest statuses

"Discovered — currently not indexed" — Google knows the URL but has not crawled it. Officially: "The page was found by Google, but not crawled yet." The usual causes:

  • The site is new, or the URL count grew fast — crawl budget does not stretch.
  • The server is slow to respond, so Googlebot has reduced its pace.
  • Few or no internal links point at the URL, so Google does not treat it as a priority.
  • It exists in the sitemap but not in the site structure (an "orphan page").

What to do: strengthen internal linking (the single most effective step — see topical authority and content clusters), improve server response time, clean the sitemap (no 404s or redirected URLs), and reduce pointless URL variants such as filter and sort parameters.

"Crawled — currently not indexed" — Google has seen the page and chose not to index it. Officially: "The page was crawled by Google but not indexed." This is not a technical error but a value judgement. The most common causes:

  • The content is thin or repeats your other pages.
  • The page adds nothing to what already ranks.
  • Template content dominates (identical text, one word changed).
  • The page is machine-generated (filter combinations, empty categories).

What to do: strengthen the page (original data, depth, real questions answered), consolidate near-duplicates, and noindex or delete pages that add nothing. For how to structure the topic: what is semantic SEO.

Worth stressingRepeatedly "submitting for indexing" a page with the status "Crawled — currently not indexed" does not work. Google has already seen the page; the problem is not visibility but the value or the redundancy of the content. Without changing the page, nothing changes.

The URL Inspection tool

URL Inspection shows everything Google knows about a single URL. In Google's description, it "provides information about Google's indexed version of a specific page, and also allows you to test whether a URL might be indexable".

There are two distinct sets of data here, and confusing them is the most common mistake:

The indexed version The live test
What it shows The state at Google's last crawl The page as it is right now
When to use it "What does Google know?" "Did my fix work?"
Google's wording "the results shown are from most recently indexed version of a page, not the live version on the web" "fetches and examines the URL in real time"

So immediately after a fix, the indexed version will still show the old problem — that is expected. To verify the fix you must press Test live URL.

Request indexing. This button places the URL in a priority crawl queue. Google states plainly: "submitting a request does not guarantee that the page will appear in the Google Index." There are also daily limits, both on inspection requests and on indexing requests. Submitting hundreds of URLs by hand is not a workflow; at scale the right tool is the sitemap.

On waiting times, Google says: "Indexing typically takes only a day or so, but can take much longer in some cases" — in some cases you should allow a week or two. On new sites it can take longer still.

The tool also reports the page's canonical URL (both your declared one and the one Google selected — they can differ), mobile usability, structured data, and which sitemap it was found in. A canonical mismatch shows up here faster than anywhere else.

A diagnostic sequence

Page not in Google → run URL Inspection and read the statusSTATUSACTIONBlocked by robots.txtor returning 401 / 403Open the rule or server permission,then confirm with a live testnoindex presentmeta tag or X-Robots-TagRemove the tag. Note: if robots.txt blocks it,Google cannot see the tag — unblock firstDuplicate / canonicalGoogle chose another URLPoint the canonical tag, internal linksand sitemap at the same URLDiscovered — not indexedfound, not yet crawledAdd internal links, clean the sitemap,speed up server responseCrawled — not indexedseen, not selectedStrengthen or consolidate the content —no button solves this one
Figure 2 — Whatever the status says, that is the action. The two outlined in red are strategy problems, not technical ones.

Keep the sequence in this order:

  1. Inspect the URL to read the status of the specific page.
  2. If the status is a technical block (robots.txt, noindex, 4xx, 5xx) — remove the block and run a live test.
  3. If the status is canonical/duplicate — make sure the canonical tag, internal links and sitemap all point at the same URL.
  4. If the status is "Discovered" or "Crawled — not indexed" — work on structure and content instead of pressing a button.
  5. After the fix, request indexing once and allow a week or two.
  6. If the report offers a Validate fix button, use it — Google will re-check the whole group.

Common mistakes

1. Combining noindex with a robots.txt block. If robots.txt blocks the page, Google cannot read the noindex inside it, and the URL may stay in the index. The correct order: unblock robots.txt, let the noindex be seen, then block if you still want to.

2. Trying to drive "not indexed" to zero. That number includes perfectly normal cases (canonical alternates, redirects). The target is not zero but a sensible distribution of reasons.

3. Requesting indexing for the same URL over and over. It does not speed up the queue and it burns your daily limit.

4. Reading a live test result as index status. A live test says "could be indexed", not "is indexed".

5. Not cleaning the sitemap. A sitemap containing 404s, redirects or noindex URLs erodes trust and wastes crawl budget.

6. Expecting results in a day on a new site. Google says indexing typically takes about a day but can take much longer — on new domains, weeks are normal.

Frequently asked questions

What does "Crawled — currently not indexed" mean?

Google crawled the page and decided not to index it. This is not a technical error but a judgement about the value, originality or redundancy of the content. The fix is to strengthen the page or merge it with a similar one.

What does "Discovered — currently not indexed" mean?

Google knows the URL but has not crawled it yet. Usually a matter of crawl budget, weak internal linking or a slow server. Adding internal links is the most effective step.

Does requesting indexing help my rankings?

No. The button only adds the URL to a crawl queue. Google states plainly that submitting a request does not guarantee the page will appear in the index, and it has no effect on ranking at all.

My page is indexed but I can't find it in search. Why?

Being indexed and ranking are different things. A page can sit in the index at position 50 for a competitive query. Check the reality with impressions and position in the Performance report.

How long does indexing take?

In Google's words: "Indexing typically takes only a day or so, but can take much longer in some cases" — sometimes a week or two. On new sites it can take longer.

Does submitting a sitemap guarantee indexing?

No. A sitemap helps with discovery; it does not change the indexing decision. But a clean sitemap — only canonical URLs that return 200 — speeds the process up noticeably.

Is "Alternate page with proper canonical tag" a problem?

No. It reports that canonicalisation is working: the page is an alternate of another URL and points at it correctly. Leave it alone.

How do I remove a page from the index?

For permanent removal, put noindex on the page (and do not block it in robots.txt), or return 404/410. The Removals tool in Search Console only hides a URL temporarily — see 404, 410 and soft 404.

The rest of this clusterDiagnosing and fixing indexing problems is a core part of our technical SEO and SEO audit services.
Official sources used
  1. Page Indexing report — the official explanation of every status
  2. URL Inspection tool — indexed version, live test, request indexing
  3. Sitemaps report
  4. Search Console overview
  5. Large site owner's guide to managing crawl budget
Whiteseo SEO Team
SEO specialists · 8+ years of experience · Reviewed and edited

The Whiteseo team has been doing search optimization for local and international brands since 2016. Our articles are based on real project experience.

WhatsApp Blog