Unique content software

**alstar70** · 04-08-2008, 08:05 PM

Has any smart programmer come up with a program to see if a new article/post is unique on the web - or would it just take too long to work

I'd love a way when approving articles on my article directory to see it they have already been index by google - i.e. therefore a waste of my time and hosting space?!!!

**Blinky82** · 04-08-2008, 09:03 PM

It has such a software, but the text does not make any sense at all. If you want to build trash sites - well this is just for you. But if you want to put Adsense you will be banned - I am not sure are these "re-written" by this kind of software articles will pass a human editing article directory. All the best.

**ForrestCroce** · 04-08-2008, 10:34 PM

Copyscape?

Take the first sentence and send that off to Google as a query, probably with quotes?

**alstar70** · 04-09-2008, 03:42 AM

Blinky I do human edit my article directory - but of course I have no idea what is duplicate content. Forrest thanks for the suggestion but I think with 200 articles a day it would take to much time.

**ForrestCroce** · 04-09-2008, 03:53 PM

You could write up a script to do either for you. If you use Google, though, use the ajax api they publish ... scraping their serps won't work for very long.

**hosttrde** · 04-14-2008, 08:28 AM

I heard of tools that modify some text to make it look unique.
But its all a one way ticket to spam mainly.

Though the idea to search the first sentence with quotes could work

**hijrah** · 05-12-2008, 12:09 PM

Are you doing it for anyone to actually read the content, because if so these things spit out very poorly worded articles that no one could even stutter through.

**nickohrn** · 05-12-2008, 09:32 PM

I don't think this would be too hard to script. As a previous poster said, simply write something that queries google for the first sentence or two of the article in quotes. Then, if any results are returned, check to see if the text exists verbatim in any of pages that are returned (after stripping HTML, of course.)