Understanding the ‘Crawled Currently Not Indexed’ Issue
If you manage a website, you may have encountered the term crawled currently not indexed in Google Search Console. This status means that Google has visited the page but has chosen not to include it in its search index yet. For small businesses, this can be frustrating because it prevents your pages from appearing in search results and attracting potential customers.
Why Does Google Crawl Pages but Not Index Them?
There are several reasons why Google might crawl a page but decide not to index it immediately or at all:
- Low-quality or thin content: Pages with very little useful or unique content may be skipped.
- Duplicate content: If the content is very similar to other pages, Google might choose only one to index.
- Technical issues: Problems like incorrect meta tags, noindex directives, or poor site structure can prevent indexing.
- Temporary crawl budget limitations: Google may delay indexing if your site is large or has recent changes.
- Spammy or low-value content: Pages with keyword stuffing or irrelevant content are likely to be excluded.
Step-By-Step Guide to Fix ‘Crawled Currently Not Indexed’ Pages
Step 1: Identify Affected Pages
Begin by logging into your Google Search Console account. Navigate to the Coverage report, and filter by the status crawled currently not indexed. This will list all pages Google has crawled but not indexed.
Step 2: Analyse the Content Quality
Review each page flagged. Ask yourself:
- Does the page provide unique, valuable information to visitors?
- Is the content comprehensive enough to satisfy user intent?
If a page is very short or duplicates content from other pages, consider enhancing it or consolidating it with related pages.
Step 3: Check for Technical Issues
Use the SEO Scan Lab SEO Score Checker to run a free analysis of your page. Look specifically for:
- Meta robots tags set to
noindex - Canonical tags pointing elsewhere incorrectly
- Robots.txt blocking the page
- Slow loading times or server errors
Correct any issues found. For example, if the meta robots tag is set to noindex, remove it to allow indexing.
Step 4: Improve Internal Linking
Google discovers pages better and understands their importance through internal links. Ensure the affected pages are linked from other relevant pages on your website using descriptive anchor text.
Step 5: Request Indexing
After making improvements, go back to Google Search Console, use the URL Inspection tool, enter the page URL, and click Request Indexing. This prompts Google to recrawl and reconsider the page for indexing.
Troubleshooting Example
Hypothetical example: A small UK-based bakery website has a page titled “Cupcake Flavour Options” showing as crawled currently not indexed.
Issue: The page has only a short list of flavours with no unique descriptions or images, and the meta robots tag inadvertently included noindex.
Steps to fix:
- Remove the
noindextag from the page’s HTML. - Expand the content by adding detailed descriptions of each cupcake flavour and include high-quality images.
- Add internal links to this page from the homepage and the main products page.
- Use the SEO Scan Lab SEO Score Checker to verify there are no other technical issues.
- Submit the URL for reindexing via Google Search Console.
Within a few days or weeks, depending on Google’s crawl schedule, the page should appear in the index if all issues are resolved.
Additional Tips to Avoid Future Indexing Issues
- Regularly audit your site: Use free tools like the SEO Scan Lab SEO Score Checker to monitor your website health.
- Maintain quality content: Avoid thin or duplicated pages by merging or improving similar content.
- Manage crawl budget: For larger sites, ensure your important pages are easy to access and avoid unnecessary URL parameters.
- Use sitemap.xml: Keep your sitemap updated and submit it to Google Search Console.
Frequently Asked Questions
Why does Google crawl my page but not index it?
Google may crawl a page but not index it because it considers the content low quality, duplicate, or sees technical issues that prevent indexing. Sometimes it is a temporary delay as Google prioritises other pages.
How long does it take for a page to be indexed after fixing issues?
Indexing times vary but generally can take from a few days to several weeks. Requesting indexing via Google Search Console can speed up the process.
Can I force Google to index a page?
While you cannot force indexing, you can encourage it by fixing content and technical issues, improving internal links, and submitting the page through Google Search Console.
Is it harmful if many pages remain ‘crawled but not indexed’?
It depends on the pages. If they are low-value or duplicate, it is normal. However, if important pages are not indexed, it can limit your website’s visibility and traffic.
What free tools can help diagnose indexing issues?
Tools like the SEO Scan Lab SEO Score Checker offer free reports on technical SEO factors that impact indexing.
Conclusion
Understanding and fixing crawled currently not indexed pages is essential for small business websites aiming to improve their Google search presence. By auditing your pages for quality content, checking for technical issues, improving internal links, and using free tools like SEO Scan Lab, you can enhance your chances of getting your pages indexed. Remember to be patient and methodical in your approach.
Try a full SEO Scan Lab scan today to identify potential issues and start improving your website’s indexing and overall SEO performance.
