Reply
Robots.txt inclusion for Google Adsense Bot
Old 10-30-2004, 08:05 AM Robots.txt inclusion for Google Adsense Bot
Onur's Avatar
Extreme Talker

Posts: 177
Hi everyone!

I'm trying to include the Google Adsense bot inside my robots.txt file. Adsense FAQs suggest that I need to copy & paste:

User-agent: Mediapartners-Google*
Disallow:

into the robots.txt file to allow the bot complete access. However, being the skeptical type, I wonder if the asterix at the end of the first line is necessary. Does anyone know if the below code is also applicable?

User-agent: Mediapartners-Google
Disallow:

Thanks!
Onur is offline
Reply With Quote
View Public Profile
 
When You Register, These Ads Go Away!
     
Old 10-30-2004, 08:29 AM
Unknown.

Posts: 1,692
If their FAQ's say use..
User-agent: Mediapartners-Google*
Disallow:


Then its best to follow that and use it..
The Asterik is there for a reason.. I think it could be something to do with that the bots each have different names so anything can follow the Mediapartners-Google.. But no sure on that

--James
Dark-Skys99 is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to Robots.txt inclusion for Google Adsense Bot
 

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off




   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML

 


Page generated in 0.10999 seconds with 13 queries