Fix the robots directive blocking Google
A noindex or robots.txt rule is telling search engines to stay away.
What it means
A meta robots tag (noindex/nofollow) or a robots.txt rule is instructing search engines not to index this page. Sometimes that's intentional (admin pages), but on a public page it means Google cannot rank it at all.
Why it matters
A noindex on your homepage or key service pages makes every other SEO effort pointless — the page is invisible to search no matter how good it is.
How to fix it
- Search the page source for 'noindex' — it usually appears in a <meta name="robots"> tag.
- Remove the noindex directive from pages that should rank (CMS 'discourage search engines' settings and staging plugins are common culprits).
- Check yoursite.com/robots.txt for Disallow rules covering important paths.
- After fixing, request re-indexing in Google Search Console.
Common mistakes
- Leaving 'Disallow: /' or a site-wide noindex on after launching from staging.
- Blocking CSS or JavaScript files, which stops Google rendering the page properly.
- Using robots.txt to hide a page: blocked pages can still appear in results, so use noindex instead.
How to check it worked
Open yourdomain.com/robots.txt and read it, then run the page through URL Inspection in Search Console. It reports whether crawling and indexing are allowed.
Helpful tools
- Google Search Console → URL Inspection
- Robots.txt tester
Not sure if this affects your site? Analyze your website for free or compare it with a competitor.
Related guides
- Create and submit an XML sitemap: Tell search engines exactly which pages to index with a machine-readable sitemap.
- Set a canonical URL: Tell Google which version of a page is the real one when several URLs serve it.
- Write a proper page title: The single most important on-page SEO element — 50–60 characters that sell the click.
- Add a meta description: Your 150-character pitch shown under the title in search results.