Skip to main content

Noindex




The command "Noindex" it is placed in meta tags to inform search engine crawlers that the page visited should not be indexed. With this feature, webmasters have the opportunity to manipulate the indexing procedure of their pages.

Implementation

The meta tag "Noindex" is incorporated into the source code of a web portal at the end of the and in the Metadata area. It appears as follows:


The content of this page will not be indexed and in this way it will not be shown in the SERPs.

600x400-noindex-en-01.png

To check if the meta tag has been read correctly by the crawlers the webmasters can carry out the Search command site: for that page in the search engines. If it has been done correctly the page should not appear in the results, SERPs.

Apps

With the command "Noindex" search engines exclude the indicated pages and do not save your information in the database. This is very useful for, for example:

  • Internal search results
  • Duplicate content / pages
  • Copyright content

Pages marked by the "Noindex" are in the "Deep Web".

Noindex vs. disallow

In many cases webmasters are not clear about the difference between the commands "Disallow" from the Robots.txt file and the meta tag "Noindex". Generally speaking it is not recommended to use the two commands simultaneously.

The difference is simply that with the command "Disallow" search engines are not allowed to access the URL and with the command "Noindex", they can get access but the crawlers cannot index the page.

Disallow

Content should not be parsed as:

  • Sensitive content such as log data
  • For very high data volumes, image database

Regardless, it is feasible for the page to be indexed.

Noindex

  • Content can be parsed but not indexed
  • Internal search results
  • It does not enter the index

"Noindex, follow"

If what is intended is that a domain is not indexed but that the link is crawled, the meta tag must be used "Noindex", "follow":


This command is useful for categories that contain many pages. The robot can enter the link but can only index the first page of each category, for example.

Relevance for SEO

The meta tag '"Noindex" ' is a very useful SEO tool to prevent duplicate content from being indexed and, in this way, to avoid possible penalties and consequent deterioration in positioning. At the same time, adding the command "Follow" crawlers have the opportunity to follow but not to index the pages.

Many CMS (Content Management Systems) create many pages automatically to be indexed quickly. In extreme cases this increase in pages is considered a spam technique but with the command "Noindex" you can avoid being penalized.

When the relaunch of a web portal is carried out the command "Noindex" makes work easier: while the functionality of the new site is checked, its indexing is blocked so as not to create duplicate content.

Web links