What’s meta robots tag?
It’s an HTML tag that you inserted between the code which would instruct search engines on how to interpret the page-specific content
< meta name =”robots”content=”noindex”>
Let’s search engine know not to index the page. Also, this page can be use to index or not index images,pages follow or nofollow.
Why robots tag is essential?
If accidentally the developer inserts “noindex” directives on an important page, this could low the site index rate.
If there are duplicate contents on your websites, noindex tags could help avoid duplicate penalty.
Where to find my robot tags?
1-Insert your URL into Screaming Frog
2-Under internal, scroll to the right
3- Will see meta robots 1 and 2
4- Find directives and see which columns have a specific instruction
