A noindex tag is a rule in a page's HTML or HTTP header that lets search engines crawl the page but tells them to keep it out of search results.
The page stays live, and anyone with the link can still open it. So the short answer to what is a noindex tag is that it hides one URL from search without deleting it.
Noindex is one value of the robots directive, and its only job is to control indexing. A search engine reads it after fetching the page, then drops the URL from results or never adds it. Noindex applies only to indexing; other directives govern links and whether a bot may visit.
Noindex works only when a crawler can reach the page and read the tag. Googlebot finds the rule when it fetches the URL and removes the page the next time it processes that URL. If robots.txt blocks the page, the crawler never sees the tag. Google's documentation says the page must not be blocked by robots.txt, and Google doesn't support noindex inside robots.txt at all.
Noindex keeps the page itself out of search results, while nofollow tells search engines not to follow the links on that page. A page with only noindex still lets crawlers follow its links, so the pages it points to can still be found. A page with only nofollow can rank, but its outbound links pass no endorsement. Use noindex when the page is the problem and nofollow when its links are. You can also combine the two.
Yes. Google fetches a page to read the tag and visits long-term noindex pages less often. John Mueller, Search Advocate at Google, said Google treats a page noindexed "for a longer period of time" as "kind of like a 404 page," as reported by Search Engine Journal. He has also said Google eventually stops following links on those pages.
Google's AI features respect noindex, but other AI crawlers are less predictable. AI Overviews and AI Mode only link to pages that are indexed and eligible for a snippet, so a noindex page won't show up there. Seer Interactive, a search agency, tells site owners not to rely on noindex to control language models. It recommends blocking bots such as GPTBot in robots.txt instead.
Use noindex on pages that visitors need but searchers don't. Common cases:
For duplicate pages, a canonical tag does a better job. It points ranking signals at one preferred URL. Noindex only removes the copy.
You can add noindex in the page's HTML head or in the HTTP response header. Google's documentation says both methods have the same effect, so pick the one that fits the file type.
Put this line inside the `<head>` of an HTML page:
`<meta name="robots" content="noindex">`
If you want only Google to obey it, replace "robots" with "googlebot". In WordPress, SEO plugins add the same tag through a checkbox on each page, so you don't have to edit the template.
Files without an HTML head, such as PDFs and images, need the rule in the server response instead:
`X-Robots-Tag: noindex`
You set this header in the server or CDN configuration. Check it with your browser's developer tools or a header checker, because a typo here fails silently and the file stays indexed.
To audit noindex, compare the pages that carry the tag with the pages you meant to hide. Work through these steps in order:
A noindex tag left over from a staging site can remove an entire live site from Google. Repeat the check after every launch.
Each directive below controls something different from noindex:
Now that you know what is a noindex tag and what it can't do, look at your own site. Find the pages that should stay out of search results and pick the directive that matches each one.
Look up more AI search and SEO terms in our glossary.
Related terms
All termsSee how AI talks about your brand