Reply
how do I slow the crawl rate of yahoo?
Old 04-04-2008, 08:56 AM how do I slow the crawl rate of yahoo?
Webmaster Talker

Posts: 514
Name: Barry O' Brien
Location: Ireland
how do I slow the crawl rate of yahoo? its killing my bandwidth 700 bots a day and putting extra strain on my server.
audiomad is offline
Reply With Quote
View Public Profile Visit audiomad's homepage!
 
Sponsored Links (We share ad revenue):
 
Old 04-04-2008, 09:38 AM Re: how do I slow the crawl rate of yahoo?
chrishirst's Avatar
Super Moderator

Posts: 10,599
Location: Blackpool. UK
http://help.yahoo.com/l/us/yahoo/sea.../slurp-03.html
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
Indifference will be the downfall of mankind, but who cares?
Code Samples | People Counting System
chrishirst is online now
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 04-17-2008, 12:02 PM Re: how do I slow the crawl rate of yahoo?
willcode4beer's Avatar
Webmaster Talker

Posts: 525
Name: Paul Davis
Location: San Francisco
Quote:
Originally Posted by audiomad View Post
how do I slow the crawl rate of yahoo? its killing my bandwidth 700 bots a day and putting extra strain on my server.
If 700 bots a day is straining the server it's either time to optimize code or upgrade the server
__________________
Paul Davis
willCode4Beer.com (coding for all the right reasons)
willcode4beer is offline
Reply With Quote
View Public Profile
 
Old 04-22-2008, 07:26 PM Re: how do I slow the crawl rate of yahoo?
seocd's Avatar
Experienced Talker

Posts: 41
Name: Ryan
Quote:
Originally Posted by willcode4beer View Post
If 700 bots a day is straining the server it's either time to optimize code or upgrade the server
I agree! you should not really be seeing any kind of strain on your server from yahoo bots
seocd is offline
Reply With Quote
View Public Profile
 
Sponsored Links (We share ad revenue):
 
Reply     « Reply to how do I slow the crawl rate of yahoo?
 

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off




   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML


Page generated in 0.14786 seconds with 14 queries