Anyone else have MSN bot on their site? So far its been eating my bandwidth, over 6MB this month. I really dont care about it, anyone else have MSN bot eating their bandwidth?

Yes, and it's a good thing, trust me. I have had google on occasions (when I first launch a large website) use nearly 500mb's of my bandwidth in a month.

Wow 500mb? Google has only used about 2MB this month and comes back daily.

MSN Bot has used 600mb of my BW this month, and my site not even that large!

I dont know how often it comes back, but I notice its name popping up in my visitor log every 2 days or so.

google-280mb
msn-270mb
others- around 50mb

Im not to bothered how much they use

How can you tell?

Originally Posted by herbal_ali

How can you tell?

check you website stats search engine spiders have ip address as well so you can check with there ip address but dipends how your stats work on your site

Yes MSN Bot visit my website regulary and keep crawling for more than 20 Mins and It is eating my bandwidth more than any ohter bot

Yup when i first lauch a site MSN will visit a couple of times a day and use up about 50 - 100 mb of bandwidth in a month but then after that first month it will drop to around 10 - 20 mb per month depending on the number of images I have on the site. MSN just starts off indexing faster than say Google or Yahoo and then tapers off but this is a good thing as it allows them to index you whole site faster than the othe bots

Google on the other hand usually starts off slow and picks up pace as it goes deeper on my site when first crawled by G they used 15mb of b/w in the first month now my site is 3 months old and G has used 60mb of b/w in the last 2 weeks of april

Bandwidth eating Bots, sounds like a great title for a film

You must be really happy that msn is indexing your site well. 6 mb is nothing, blieve me. I would have been happy, if it takes 600 mb on my site!! Bandwidth is no more a costly affair, with hosts try to beat each other over selling, so enjoy!!

BTW, MSN is the best thing to happen to a new website. No sandboxing there, unlike G and Y

Ya doesn't happens to me in case of MSN it rarely crawls my site but in the case of Google it does happen.

Akash

Personally, I don`t care about my bandwith.

6m is nothing though, and if those 6m effect you - than you better switch a host my friend

Google has eaten over 2GB of my bandwidth :@
Yahoo 500KB
MSN 20MB

if you want msnbot not to crawl your web site , you can prevent it with your robots.txt file

is there any way of stopping it? :|

Um, I think Trichnosis told you how... robots.txt

You can disallow certain bots, or certain parts of your site for certain bots, or whatever you really want with robots.txt

I've had google around me quite a bit lately. I'm not sure how much bandwidth he's using, and it doesn't bother me too much because one, it's a good thing its on my website, and two, I have 200g of BW per month..

I got MSN bot eating up half of my bandwidth monthly. That's scary