- Adsense
- What is Adsense?
- Different Ad Types
- Ad Position and number of ad units per page
- Pick the right colors for your ads
- Improve Ad relevancy
- Ad filtering
- High paying keywords
- Site targeting ads
- Smart Pricing
- Tracking channel performance
- Google Jail
- Publisher Tools
- Cost-per-Click and Cost-per-Impression
- Adsense Teminologies
- Search Engine Optimization
- Your first step - Choosing right keywords!
- Using your Keywords
- Things don't do with your Keywords
- Next - Increasing Your Publicity in Directories and Search Engines
- Getting Back Links to your site
- Ways to get Back Links
- Things MUST not do for SEO!
- Double Identities - Cloaking
- Doorway Page & Spamindexing
- Spamindexing
- SEO for Google
- Google
- What's Google about?
- Its' features you should know for SEO
- How to calculate Page Rank?
- Is Anchor Text important?
- An Architecture Overview
- Crawl the web!
- How does the Ranking System works?
- What does Repository store?
- Your searching keyword - Lexicon
- The breakdown of your page - Hit lists
- Building an Inverted Index!
- References
![]() Do you want to know more about the high paying keywords in your market segment? Check out our latest Keyword Bid Price Tracking Tool. More keywords to watch! |
Google Spider - Googlebots
Submitted by seoearnings on Tue, 2006-03-28 15:59.
When you have you pages ready and after you have submitted your site to Google, how Google is going to collect data from your sites? Yup! Let me introduce to you Google spider - Googlebots
A Googlebot is a search bot, used by Google. It fetches all the web pages from your sites and build the search index for the Google search engine. If you don't want Googlebot to crawl some of your page, you can set up a robots.txt under your root domain of the site.
There are two versions of Googlebot - deepbot and freshbot.
Deepbot, same as the name, it is a deep crawler, it tries to download all the pages from you by following all the links in your pages, it completes this process monthly. Another bot, freshbot, it crawls the updated web pages, it only visits the page that changes frequently. Some rumors suspect that freshbot is the one in which collect the Freshness of the page.
Typically, Freshbot would visit a daily newspaper's website every day and a weekly ezine would get crawled once every 7 days. But Google does not announce the specification of its crawlers so far.
Custom Search

