|
I am trying to figure out how many clicks to bill an advertiser for. We have an arranged price per click on an ad. The ad is just standard HTML with an image liked to a PHP page. This PHP page sends an email with the IP, user agent string, and referring URL to a specific address. I have banned robots from the redirect page with the robots.txt file, however I know for sure that at least one spider has already ignored this. (Stupid Cuil!) At this point I am manually going through and removing anything that looks suspicious, but I am concerned that I might accidentally charge for a robot's click. Is there anything I can do to identify spiders and other robots? Also, should I be suspicious when there is no referring URL? Thanks!
|