Sometimes one has to hunt down for good articles in the Internet, as in Google Search,Bing.
The content may be excellent authentic, yet it does not appear with out very specific search.
As the volume of internet material is very huge, people are not used.
Instead,Search Engines use bots*
These are the tools that locate your site.
What do they do?
1.The bot will first look into your file names.
The file must be bot friendly.
This is for people who write on HTML format.
Check with qualified people on this subject for more.
If you are writing on WordPress or blog spot, they will take care.
2.Once this is over, the bot moves onto Meta descriptions.
This is nothing but a Note, preferably in short words,about what the site contain/ is about..
It is recommended that the Meta descriptions do not exceed 60 characters.
However the search engines have recently sopped this step as there was Spamming.
However it is better to have neat and short description of what you plan to say in your site.
4.The bot , then checks for duplicate content.
If your contents are duplicate to some other contents on the web then there is a chance that your rankings for that particular page will be low or it will be included in the supplementary index.
We use a huge set of computers to fetch (or “crawl”) billions of pages on the web. The program that does the fetching is called Googlebot (also known as a robot, bot, or spider). Googlebot uses an algorithmic process: computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.
Google’s crawl process begins with a list of web page URLs, generated from previous crawl processes, and augmented with Sitemap data provided by webmasters. As Googlebot visits each of these websites it detects links on each page and adds them to its list of pages to crawl. New sites, changes to existing sites, and dead links are noted and used to update the Google index.
Google doesn’t accept payment to crawl a site more frequently, and we keep the search side of our business separate from our revenue-generating AdWords service.
Googlebot processes each of the pages it crawls in order to compile a massive index of all the words it sees and their location on each page. In addition, we process information included in key content tags and attributes, such as Title tags and ALT attributes. Googlebot can process many, but not all, content types. For example, we cannot process the content of some rich media files or dynamic pages.
Internet bots, also known as web robots, WWW robots or simply bots, are software applications that run automated tasks over the Internet. Typically, bots perform tasks that are both simple and structurally repetitive, at a much higher rate than would be possible for a human alone. The largest use of bots is in web spidering, in which an automated script fetches, analyses and files information from web servers at many times the speed of a human. Each server can have a file called
robots.txt, containing rules for the spidering of that server that the bot is supposed to obey or be removed.
In addition to their uses outlined above, bots may also be implemented where a response speed faster than that of humans is required (e.g., gaming bots and auction-site robots) or less commonly in situations where the emulation of human activity is required, for example chat bots.
Bots are also being used as organization and content access applications for media delivery. Webot.com is one recent example of utilizing bots to deliver personal media across the web from multiple sources. In this case the bots track content updates on host computers and deliver live streaming access to a browser based logged in user.(wiki)
- The Key Elements of Great Google (zohrbak.com)