{"id":69420,"date":"2022-09-12T05:38:06","date_gmt":"2022-09-12T03:38:06","guid":{"rendered":"https:\/\/rmarketingdigital.com\/wiki\/crawler\/"},"modified":"2024-10-28T22:46:16","modified_gmt":"2024-10-28T21:46:16","slug":"crawler","status":"publish","type":"glossary","link":"https:\/\/rmarketingdigital.com\/en\/wiki\/crawler\/","title":{"rendered":"Crawler"},"content":{"rendered":"

<\/p>\n

\n

A crawler<\/i>, commonly known as tracker<\/b>, is a program that analyzes documents on websites. Search engines have very powerful crawlers that navigate and analyze websites and create a database with the information collected. The term crawler<\/i> comes from the first internet search engine, the Web Crawler<\/b>. It is also known as crawler spider<\/b> or robot<\/b>.\n<\/p>\n

\nFunctioning<\/span>
\n<\/h2>\n

In principle a crawler<\/b> it is like a librarian. It searches for information on the web portal, categorizes it and indexes it before it is analyzed.\n<\/p>\n

The operations of this program must be established before the crawler<\/b> start going through a web portal. The crawler<\/b> processes these orders automatically and, thus, the type of information obtained by the crawler<\/b> it depends exclusively on the rules that have been established for it.\n<\/p>\n

\"600x400-Crawler\n<\/p>\n

\nUse<\/span>
\n<\/h2>\n

The main objective of crawler<\/b> is to create a database. In this way, crawlers<\/b> They are the work tools that search engines use to extract the information they need to examine websites and establish their positioning in the SERPs. The Focused Crawler<\/i> they concentrate, for example, on reviewing websites and looking for specific and relevant information, depending on the orders that have been placed on them.\n<\/p>\n

Some of the apps of the crawlers<\/b> are:\n<\/p>\n