Reply
Old 05-30-2004, 11:24 AM Googlebot
Junior Talker

Posts: 3
normaly how much does googlebot spend on a website?

Ive had it on my forums just going nuts looking for stuff.
Augie is offline
Reply With Quote
View Public Profile
 
When You Register, These Ads Go Away!
Old 05-30-2004, 11:51 AM
RonnieTheDodger's Avatar
Extreme Talker

Posts: 151
Location: Central USA
Googlebot loves fresh content on ever-changing pages and new pages in general. Thus the seemingly feeding frenzy on forums. You should also notice that MSNbot, Alexa Internet's bot, and Inktomi are feeding pretty aggressively on forum pages -- if not normal ones as well.

On normal sites though, the more backlinks you have on external sites ... the more your site should get crawled. Since these links usually point to your Home Page, then that is what they will hit.

What you want to do is show the spider that there is fresh content. If your Home Page is pretty much static with not much change, then that is usually as far as the spider will go. They will do the occasional check of internal pages on normal runs through your site.

If you have fresh content on the Home Page with links pointing internally to even more fresh content (just like in the forum scenario), then the spiders will be more aggressive to go after that content.
__________________
Ronnie T. Dodger

[Webstractions - Web Development] [Band of Gonzos - Webmaster Forum]
RonnieTheDodger is offline
Reply With Quote
View Public Profile Visit RonnieTheDodger's homepage!
 
Old 05-30-2004, 02:26 PM
Junior Talker

Posts: 3
intresting. now to get my site links in more places
Augie is offline
Reply With Quote
View Public Profile
 
Old 06-02-2004, 12:33 AM
Ultra Talker

Posts: 269
Quote:
Originally Posted by Augie
normaly how much does googlebot spend on a website?

Ive had it on my forums just going nuts looking for stuff.
Here's some info on the Google and MSN bots.

http://www.google.com/bot.html

http://search.msn.com/msnbot.htm

They both hit forums hard. I have a theory that they "follow" users. You can check out that post here.
__________________
Resources for forum owners: The Forum Zone & a Forum Blog

I'll give you $5 for 1 or 2 words - that you already wrote!
GuyFromChicago is offline
Reply With Quote
View Public Profile
 
Old 06-03-2004, 01:43 PM
Skilled Talker

Posts: 53
I agree, and as a matter of fact, MSNbot and Yahho!Slurps are crawling, and re-visiting way faster/more often than Googlebot these days.
atlrus is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to Googlebot
 

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Webmaster Resources Marketplace:
Software Development Company | Webhosting.UK.com | Text Link Brokers 


   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML

 


Page generated in 0.57488 seconds with 12 queries