I modified the htaccess of funnyassjokes.com so all dynamic urls are now static... made a site map with all 1600 urls in it, and submitted it to Google.
Couple weird things, it shows last downloaded 8 hours ago, and Google has downloaded it multiple times since I originally submitted it (Nov 23rd). When I click "Stats" - "Crawl Stats" the 'sucessfully crawled' bar is entirely red leading me to believe that it's saying it has crawled all 1600 urls. Couple problems though.
In my referrer logs it is showing google bot with about 60-70 queries per day. I am assuming some of these are for AdSense.. and there would be ALOT more if it crawled all of the urls I submitted. Also, when I do a search for
http://www.google.com/search?q=site...okes.com/&hl=en
It brings back only my main domain as I submitted it with a trailing /
The meta tags are fairly weak since I just wanted to do an original submit, get through all of it, then go from there... making tweaks and re-uploading the site map for another crawl etc.. Thing is even with the new index it is not showing any description or ANYTHING for funnyassjokes.com - just
"
www.funnyassjokes.com/
Similar pages
"
and it does have meta keywords and a meta description... even if it didn't there was text at the beginning of the page I would of expected to see.
A couple questions... Has anyone had anything similar happen to them? Does this mean google has crawled everything it is going to, or is there no way to tell ? Also, since I submitted all those urls in the site map shouldn't I eventually see 1600 + seperate queries from the AdSense googlebot queries even if there are errors ? Also this is the one I wonder the most about... Once it shows it has crawled your site, does it mean it has also indexed it.. meaning whatever pages are going to be listed are instantly at that point or are they 2 seperate stages which can be done a lengthy amount of time from each other.
I know this is a long *** post, and some of these questions may have been answered in the past, but any answers would be appreciated though
Optimizing this thing is going to be a ***** because all calls are done by a script with a single template for every joke and every category meaning each page has the same meta tags, title, description, etc.. I am hoping Google doesn't look at it as a Spam of their index. Once I have some money I am going to have the script recoded so I can input seperate titles, met descriptions, and keywords for every joke that is called dynamically (although it shows as a static url)
