Crawled, Currently Not Indexed: Why Google Is Ignoring Some of Your Pages

Opening the Page Indexing report in Google Search Console and seeing hundreds of URLs marked “crawled, currently not indexed” is enough to make any marketing manager uneasy. When important pages aren’t showing up in Google, that status looks like an outright rejection. In reality, it is a triage signal rather than an automatic alarm bell. Every website has URLs that Google chooses to leave out of its search results, and many of them do not belong there anyway. The real skill lies in separating harmless technical clutter from commercial or editorial pages that genuinely need attention.

What “crawled, currently not indexed” actually means

To understand this status, it helps to separate two distinct stages of how search engines work: crawling and indexing. Crawling is when Googlebot (Google’s automated web crawler) visits a URL and reads its content. Indexing is the next step, where Google decides the page is useful enough to store in its main database and show in search results. When a URL is marked “crawled, currently not indexed”, Google has visited the page, read what is on it, and chosen not to add it to the index for now.

This differs from “discovered, currently not indexed”, another common status in the Page Indexing report. With “discovered, currently not indexed”, Google knows the URL exists (usually from your XML sitemap or an internal link) but has not crawled it yet, often because it is pacing crawl activity or considers the URL a low priority.

It also differs from deliberate exclusions. If you add a noindex tag (an instruction telling search engines not to list a page), set up a 301 permanent redirect, or use a canonical tag to point Google towards another URL, Search Console groups those under separate exclusion reasons. Here, nothing is blocking Google; it simply chose not to index the page after inspecting it.

Google’s latest guidance, and what it leaves out

In early November 2026, Google updated its Page Indexing report help documentation for this exact status. The revised guidance states that Google does not index every page on the web, that seeing URLs in this bucket is common, and that the status does not necessarily require any action. Instead, Google advises site owners to use the URL Inspection tool in Search Console to check individual pages that matter to their business.

What the updated help text leaves out is any mention of content or site quality. That omission is worth noting because Google’s Gary Illyes has previously commented that a very high volume of “crawled, currently not indexed” URLs can hint at wider site quality problems. Those remarks are not official documentation, and this status is not a manual penalty.

Both viewpoints hold water when you look at real websites. Seeing technical URLs sit unindexed is normal background noise, whereas watching core service pages pile up in the same report points to a deeper structural or content issue.

First question: should these pages be indexed at all?

Before changing a single line of copy or altering your site architecture, look at whether the excluded URLs actually deserve a place in Google. Search Console reports on every address Googlebot encounters, not just the pages you consider part of your website. On most business sites, a large share of “crawled, currently not indexed” URLs were never meant to bring in organic traffic.

When you review your report, expect to see several categories of low-value clutter:

• Tag and author archives that duplicate your main blog feed. Category pages can earn their place if they are well curated, but many don’t.
• Thin media attachment pages created automatically every time you upload an image.
• Filter, sort and parameter URLs generated when shoppers narrow down product listings by price, size or colour.
• Internal site search result pages triggered by visitors using your search bar.
• Paginated archive URLs (such as /blog/page/2/ or /blog/page/3/).

Pagination is the one to handle with care. Paginated pages often appear in this report harmlessly, but they help Google find your older posts and products, so leave them crawlable rather than blocking or noindexing them.

Content management systems often generate archive and attachment URLs automatically, which is a common housekeeping issue we see when handling WordPress SEO for growing businesses. Online shops face a similar challenge whenever faceted navigation creates thousands of near-identical product grids. Managing how search engines crawl those filter combinations is a core part of effective ecommerce SEO. If the excluded URLs fall into these buckets, Google is doing you a favour by leaving them out.

Why important pages end up crawled but not indexed

Once you filter out background noise, you may still find product pages, service pages or helpful guides sitting unindexed. When pages that should drive traffic end up here, one of six issues is usually behind it.

Thin or near-duplicate content

Google avoids filling its search results with pages that repeat the same information. This frequently affects online stores with separate URLs for minor product variants, or service businesses that publish dozens of local landing pages where only the town name changes. If you are building regional landing pages as part of a multi-location SEO campaign, each page needs local proof, unique service details and relevant case examples rather than a recycled template.

Weak internal linking and orphan pages

Google uses internal links to discover pages and gauge how important they are within your site structure. An orphan page (a page with zero internal links pointing to it) or a page buried five clicks deep signals to Googlebot that even you do not treat it as a priority. Even if the URL sits inside your XML sitemap, weak internal navigation makes it far less likely to be indexed.

Low-value content published at scale, including unedited AI content

Publishing large batches of shallow articles, or pushing out unedited AI drafts that rephrase what already ranks on page one, quickly erodes Google’s appetite to index new URLs. Search engines look for original insight, practical experience and clear usefulness. A sustainable content strategy focuses on depth, real expertise and answering genuine customer questions rather than hitting an arbitrary publishing quota.

Canonical and duplicate URL confusion

A canonical tag is a snippet of HTML code that tells search engines which version of a URL is the primary one when multiple paths show the same page. If your internal links point to one URL, your sitemap lists another, and your canonical tag points somewhere else, Google gets mixed signals. Shopify, for example, often creates separate collection-based URLs for the same product, which is why canonical management is one of the first things we check in any Shopify SEO project.

Rendering problems, where content relies on JavaScript Google struggles to process

Rendering is the process Google uses to execute a page’s code and load its visual content before indexing. When key copy, product descriptions or internal links only appear after heavy client-side JavaScript runs in the browser, Googlebot can sometimes capture an incomplete or empty version of the page. Resolving script bottlenecks and server-side rendering setups usually calls for targeted technical SEO support.

If your website relies heavily on modern front-end frameworks, it is worth reading our guide on JavaScript rendering issues to see how search bots experience your pages.

Site-wide quality signals dragging down borderline pages

Google does not evaluate pages in complete isolation; it also assesses the overall helpfulness and trustworthiness of your domain. If your site carries hundreds of outdated, thin or neglected pages, borderline URLs that might otherwise squeak into the index often get left out. Pruning or consolidating dead weight across the wider site frequently lifts indexing rates for your best pages.

How to diagnose it, step by step

Working through a long list of unindexed URLs one by one wastes hours. Instead, use this structured process to find the root cause across your site:

1. Export the list from Search Console: Open the Page Indexing report, click into “Crawled, currently not indexed”, and export the URLs to a spreadsheet. Keep in mind that Search Console caps exports at 1,000 rows, so filter by sitemap or folder if you have a larger site.
2. Group URLs by template or folder: Sort your spreadsheet by URL path (such as /blog/, /products/ or /locations/) to see whether the issue is isolated to one page template or spread across the whole domain.
3. Inspect a sample in URL Inspection: Paste five to ten representative URLs into the URL Inspection tool in Search Console. Check the last crawl date, the referring page where Google found the link, and whether Google agrees with your declared canonical URL.
4. Compare against similar indexed pages: Put an unindexed page side by side with a comparable page on your site that is indexed. Look closely at word count, unique detail, page speed and search intent.
5. Check internal links and sitemap inclusion: Run a site crawl using a tool such as Screaming Frog to count how many internal links point to the affected URLs and verify whether they appear in your XML sitemap.

If your site has thousands of URLs across complex templates, commissioning a technical SEO audit will usually reveal the root cause far faster than manual checks.

How to fix it

Getting the right pages indexed comes down to making clear decisions about what belongs in search and upgrading the pages that earn their spot. While no technical tweak can guarantee Google will index every URL, these steps remove the main blockers:

• Improve, merge or remove weak pages: Where a page targets genuine search demand but lacks substance, invest in thorough on-page optimisation by adding clearer headings, practical detail and answers to related buyer questions. If two or three thin pages cover the same topic, merge them into one stronger guide and set up 301 redirects from the old URLs.
• Strengthen internal links from indexed pages: Link to your important unindexed pages from established, high-traffic pages on your site using natural, descriptive anchor text.
• Noindex or block genuinely low-value URLs: Apply a noindex meta tag to thin tag archives or attachment pages so Google stops evaluating them for search results, and use robots.txt rules to stop bots crawling endless filter parameters. Don’t do both on the same URL, though. If a page is blocked in robots.txt, Google can’t see its noindex tag, and blocked URLs can occasionally still appear in search results without a description.
• Keep your XML sitemap clean: Your sitemap should only include clean, indexable, canonical URLs that return a 200 status code, never redirects or noindexed pages.
• Request indexing selectively: Use the “Request indexing” button in Search Console only after you have made meaningful improvements to a page. Clicking it repeatedly without changing anything will not force Google to index the URL.

When it’s worth getting a second opinion

Most site owners can tidy up obvious archive bloat and strengthen internal links in-house. However, it makes sense to bring in specialist help if the number of “crawled, currently not indexed” URLs keeps climbing despite no new pages being published, or if core commercial pages that generate leads and sales start dropping out of the index.

Timing matters as well. Google’s November 2026 core update began rolling out on 10 November, and indexing or ranking swings are common while an update is still underway. Avoid making reactive structural changes mid-rollout; wait until things settle so you can see how a Google core update has actually affected your visibility. Once the rollout finishes, if important pages remain excluded and organic traffic has dipped, structured algorithm update recovery work can help pinpoint what needs rebuilding.

If you would like a practical second pair of eyes on your Page Indexing report, get in touch with our SEO team and we will help you separate harmless technical noise from issues holding back your growth.