Robots Label Concept
What is the Robots Tag?
The robots Tag, or rather, the Meta Robots tag, is one that is included to tell search engines that a page is not indexed or positioned in them, as well as highlighting other guidelines such as collecting the web through the links in it, and so on. In short, it consists of a label used to tell search engine robots what to do with the page in question.
This task is something that could also be carried out with the robots.txt file that is usually linked to a web; However, using this plain text document, it is feasible to tell Google and other search engines not to even crawl the web. But beware!! With the robots tag, bots crawl the web and waste time (crawl budget), so if you are going to put the pages in no index / no follow it is better to add it to the robots.txt and that the bots do not waste time reading the headers of the page. You will save tracking time and improve your positioning.
Among the indicators that can be included in this label, we find:
- Index / noindex (to index the page or not in search engines).
- Follow / nofollow (to follow the rest of the web through the links that appear on the tagged page).
- Archive / noarchive (to pass or not to the search engine's cache).
- Snippet / nosnippet (to show or not the description of the web).
- Odp / noodp (show or not the title and description of the page).
- Ydir / noydir (same as the previous case, but adapted for Yahoo!).
Its understanding and correct use is essential to obtain a better or worse positioning, so knowing it is a good first step in developing a website.
What is the Robots Label for?
Even though it has some versatility thanks to the different parameters that can be configured, in general its main task is to limit the work of search engine robots when entering an online portal. And it is that, by default, the parameters are generally as permissive as possible, so including the robots tag is only used to impose restrictions, with no indexing or link tracking being the first to be used for positioning purposes.
Examples of Robots Label
There are many examples of robots tag, depending on the restrictions and freedoms offered to search engine spiders like Google. To make a sample, the following example can be quite illustrative. This is what a robots meta tag looks like when built:
.
In this case, in particular, it would index in search engines, but it would not go to their cache in case someone wanted to enter a version prior to the one available at the moment from the network of networks.
More information about the Robots Tag
To learn more about the robots tag, in case you want to get more information, we bring you several links to articles that may be interesting to you. We hope you find them useful and learn more about this search engine-oriented add-on.
