Robots Meta Tag
01 Definition
Robots Meta Tag meaning: An HTML tag in the page head that tells search engines how to index and follow a page.
The robots meta tag is placed in a page's head and gives crawlers page-level instructions using values like index, noindex, follow, and nofollow. It controls whether the page can appear in results and whether its links are followed. The page must be crawlable for engines to read the tag.
Also called
Why it matters
How Robots Meta Tag fits the work
It gives you precise, per-page control over what appears in search results, which is essential for keeping thin or private pages out of the index.
In context
We added a noindex, follow robots meta tag to the internal search results pages so they stayed out of Google while still passing link signals.
Practical note
A page blocked in robots.txt cannot be crawled, so its noindex tag may never be read; allow crawling if you need a noindex to take effect.