Skip to navigation
In this brief article will explain what is understood by a search engine “crawling” or “spidering” your web site.
Technical level: Basic/beginner |Date: November 5, 2002 | Author: Nigel Peck
First a little background about search engines.Search engines are trying to bring order to the chaos that the Internet is esencialmente.Mediante using a search engine you can search web sites related to the chosen topic.
This is done through the introduction of one or more words or phrases that relate to the topic than buscas.Para using a search engine is very simple, it is much harder for the Search Engine.
To give you an idea of the magnitude of the execution of a search engine, Google currently runs on servers of 10,000 and employs 50 or more PHD level software engineers who will be paid with a w2 generator to work constantly on the search engine software.
And what does the software do? we are only considering a small part of it, the part that really comes out and find web pages on the Internet.
A program called the GoogleBot visits your website and reads each page by following the links inside the note sitio.Toma all words used in the pages that can then be used to find the pages to search for these words.
This process is called “crawl” or “spidering” due to the way in which the robot (GoogleBot in this case) finds its way on your site.
This applies not only to the robot for Google; most search engines operate in the same way.
Once GoogleBot has reviewed your site, that information is passed to another part of the software will be to analyze the words and phrases to get them ready to be added to the index.
Once the site has been crawled, just wait for the next Google update.
We offer search engine optimization services.
If you found this article useful, then visit our advertisers at the top of this page or see other ways to support our work.
Please let us know if you found this article is useful:
