Reply
how do I slow the crawl rate of yahoo?
Old 04-04-2008, 09:56 AM how do I slow the crawl rate of yahoo?
Webmaster Talker

Posts: 551
Name: Barry O' Brien
Location: Ireland
how do I slow the crawl rate of yahoo? its killing my bandwidth 700 bots a day and putting extra strain on my server.
audiomad is offline
Reply With Quote
View Public Profile Visit audiomad's homepage!
 
When You Register, These Ads Go Away!
Old 04-04-2008, 10:38 AM Re: how do I slow the crawl rate of yahoo?
chrishirst's Avatar
Super Moderator

Posts: 15,334
Location: Blackpool. UK
http://help.yahoo.com/l/us/yahoo/sea.../slurp-03.html
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
Indifference will be the downfall of mankind, but who cares?
Code Samples | People Counting System | Bits & Bobs
chrishirst is online now
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 04-17-2008, 01:02 PM Re: how do I slow the crawl rate of yahoo?
willcode4beer's Avatar
Webmaster Talker

Posts: 696
Name: Paul Davis
Location: San Francisco
Quote:
Originally Posted by audiomad View Post
how do I slow the crawl rate of yahoo? its killing my bandwidth 700 bots a day and putting extra strain on my server.
If 700 bots a day is straining the server it's either time to optimize code or upgrade the server
__________________
Paul Davis
willCode4Beer.com (coding for all the right reasons)
willcode4beer is offline
Reply With Quote
View Public Profile
 
Old 04-22-2008, 08:26 PM Re: how do I slow the crawl rate of yahoo?
seocd's Avatar
Super Talker

Posts: 129
Name: Ryan
Quote:
Originally Posted by willcode4beer View Post
If 700 bots a day is straining the server it's either time to optimize code or upgrade the server
I agree! you should not really be seeing any kind of strain on your server from yahoo bots
seocd is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to how do I slow the crawl rate of yahoo?
 

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Webmaster Resources Marketplace:
Software Development Company | Webhosting.UK.com | Text Link Brokers 


   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML

 


Page generated in 0.12466 seconds with 12 queries