Snoika
Glossary·Technical SEO

What is a noindex tag

Definition

A noindex tag is a rule in a page's HTML or HTTP header that lets search engines crawl the page but tells them to keep it out of search results.

The page stays live, and anyone with the link can still open it. So the short answer to what is a noindex tag is that it hides one URL from search without deleting it.

TermNoindex tag3 min read · reviewed by the Snoika team

Noindex defined

Noindex is one value of the robots directive, and its only job is to control indexing. A search engine reads it after fetching the page, then drops the URL from results or never adds it. Noindex applies only to indexing; other directives govern links and whether a bot may visit.

How noindex actually works

Noindex works only when a crawler can reach the page and read the tag. Googlebot finds the rule when it fetches the URL and removes the page the next time it processes that URL. If robots.txt blocks the page, the crawler never sees the tag. Google's documentation says the page must not be blocked by robots.txt, and Google doesn't support noindex inside robots.txt at all.

Noindex vs nofollow

Noindex keeps the page itself out of search results, while nofollow tells search engines not to follow the links on that page. A page with only noindex still lets crawlers follow its links, so the pages it points to can still be found. A page with only nofollow can rank, but its outbound links pass no endorsement. Use noindex when the page is the problem and nofollow when its links are. You can also combine the two.

Does Google crawl noindex pages

Yes. Google fetches a page to read the tag and visits long-term noindex pages less often. John Mueller, Search Advocate at Google, said Google treats a page noindexed "for a longer period of time" as "kind of like a 404 page," as reported by Search Engine Journal. He has also said Google eventually stops following links on those pages.

How AI crawlers treat noindex

Google's AI features respect noindex, but other AI crawlers are less predictable. AI Overviews and AI Mode only link to pages that are indexed and eligible for a snippet, so a noindex page won't show up there. Seer Interactive, a search agency, tells site owners not to rely on noindex to control language models. It recommends blocking bots such as GPTBot in robots.txt instead.

When to use noindex

Use noindex on pages that visitors need but searchers don't. Common cases:

Thank-you and order confirmation pages
Internal site search results
Staging pages on a public server
Thin tag or filter archives
Login and account pages

For duplicate pages, a canonical tag does a better job. It points ranking signals at one preferred URL. Noindex only removes the copy.

How to implement noindex

You can add noindex in the page's HTML head or in the HTTP response header. Google's documentation says both methods have the same effect, so pick the one that fits the file type.

The robots meta tag

Put this line inside the `<head>` of an HTML page:

`<meta name="robots" content="noindex">`

If you want only Google to obey it, replace "robots" with "googlebot". In WordPress, SEO plugins add the same tag through a checkbox on each page, so you don't have to edit the template.

The X-Robots-Tag header

Files without an HTML head, such as PDFs and images, need the rule in the server response instead:

`X-Robots-Tag: noindex`

You set this header in the server or CDN configuration. Check it with your browser's developer tools or a header checker, because a typo here fails silently and the file stays indexed.

Auditing your noindex tags

To audit noindex, compare the pages that carry the tag with the pages you meant to hide. Work through these steps in order:

  1. 011Crawl the site and export every URL with noindex in the meta tag or the header.
  2. 022Open the Page indexing report in Google Search Console and review "Excluded by 'noindex' tag".
  3. 033Remove noindex URLs from your XML sitemap.
  4. 044Confirm robots.txt doesn't block any of those pages.

A noindex tag left over from a staging site can remove an entire live site from Google. Repeat the check after every launch.

Related SEO directives

Each directive below controls something different from noindex:

Nofollowcontrols whether crawlers follow links while indexing remains unchanged.
Robots.txt disallowblocks crawling, but Google can still index the bare URL if other sites link to it.
Canonicalnames the preferred version of a page and merges its signals into that version.
Nosnippetkeeps the page in results but hides its text preview.

Now that you know what is a noindex tag and what it can't do, look at your own site. Find the pages that should stay out of search results and pick the directive that matches each one.

Look up more AI search and SEO terms in our glossary.

Related terms

All terms
Reverse proxyA reverse proxy is a server that sits in front of a website and gets every request before the site's own server does. It decides where each request goes, then sends the answer back to the visitor. A reverse proxy is a gatekeeper on the website's side of the connection. Visitors and crawlers only eveStructured dataStructured data is information arranged in fixed, labeled fields, so a machine can read it without guessing what it means. On a website, the term means schema markup. That's code in a format such as JSON-LD that tells search engines and AI assistants exactly what a page describes, such as a product SubdomainA subdomain is a label added to the left of a registered domain name. It creates a separate address under that domain, such as blog.example.com under example.com. The domain owner can create subdomains at no extra cost and point each one to its own server. A subdomain is a named branch of a domain tOrphan pageAn orphan page is a live page on a website that no other page on the same site links to. Visitors and search engine crawlers can reach it through a direct URL or a sitemap entry. A link from another domain provides the only other route. In SEO, orphan content sits outside the site's internal link structure.Robots.txtRobots.txt is a plain text file at the root of a website. It tells crawlers which URLs they may request. Search engines and AI bots fetch it before they crawl anything else, and the file uses it to ask them to skip certain paths. It can't force a bot to obey, and it doesn't remove pages from search results. Robots.txt contains crawl requests that well-behaved bots choose to follow.HreflangHreflang is an HTML attribute that tells search engines which language and region each version of a page is written for. If you're asking what is hreflang, you mean the hreflang tag in a page's head. It lists every translated or regional copy of a page so Google can show each searcher the copy in their language.

See how AI talks about your brand

Get free audit