![]() |
| Sponsored Links (We share ad revenue): |
|
|
Re: Question About Robots and Adwords | |
|
Super Moderator
![]() Posts: 10,765
Location: Blackpool. UK
|
Quote:
![]() http://www.webmaster-talk.com/the-go...e-content.html Block your landing pages in robots.txt The adwords bot ignores robots.txt directives for landing pages that are specified in the ads.
__________________
Chris. ->> Links are advertising NOT optimising!! <<- Indifference will be the downfall of mankind, but who cares? Code Samples | People Counting System |
|
|
|
|
|
|
Re: Question About Robots and Adwords |
|
Super Moderator
![]() Posts: 10,765
Location: Blackpool. UK
|
Yes, but that may also stop the Adwords bot and lower the quality score
http://www.robotstxt.org/robotstxt.html http://www.robotstxt.org/meta.html https://adwords.google.com/support/b...y?answer=38197
__________________
Chris. ->> Links are advertising NOT optimising!! <<- Indifference will be the downfall of mankind, but who cares? Code Samples | People Counting System |
|
|
|
|
|
Re: Question About Robots and Adwords |
|
Junior Talker
Posts: 4
Name: Andew Sellers
|
I was just behind the times when it comes to robots.txt. I didn't know about it until today (I thought the meta tags controlled these things). Anyway, I found this help page:
How do I block or allow Googlebot? Based on this, I think this what I should put in the robots.txt file of my ministes (and set the meta tags to follow/index): User-agent: Adsbot-Google Allow: / User-agent: Googlebot Disallow: / User-agent: Googlebot-Mobile Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: * Disallow: /robots.txt This will allow the google adwords bot in (so I won't be penalized for adwwords quality score), but it will keep other bots out so I won't be penalized for duplicate content in relation to SEO. I put Disallow: /robots.txt line so that the robots.txt won't get indexed and cached. If I'm not understanding any of this correctly, please let me know. |
|
|
|
|
|
Re: Question About Robots and Adwords |
|
Super Moderator
![]() Posts: 10,765
Location: Blackpool. UK
|
User-agent: *
Disallow: /robots.txt remove that line as it effectively blocks bots from reading the robots.txt file once they have read it and cached it.
__________________
Chris. ->> Links are advertising NOT optimising!! <<- Indifference will be the downfall of mankind, but who cares? Code Samples | People Counting System |
|
|
|
|
|
Re: Question About Robots and Adwords |
|
Half Man, Half Amazing
![]()
Latest Blog Post:
North Lake Union Posts: 2,928
Name: Forrest Croce
Location: Seattle, WA
|
Google will never show a robots.txt file in their search results. The closes they'll ever come is to show pages that talk about the file when you search for it. It's specifically for 'bots, so that you can tell them how to crawl your site ... it's not a page.
|
|
|
|
| Sponsored Links (We share ad revenue): |
| Thread Tools | |
|
|
| Webmaster Resources Marketplace: |
| Software Development Company | Webhosting.UK.com |
| Web Templates | Text Link Brokers | Stock Photos |