Reply
Tramendous daily Bot Activity, But not indexed
Old 10-24-2004, 08:30 PM Tramendous daily Bot Activity, But not indexed
bbott's Avatar
Ultra Talker

Posts: 267
Trades: 0
About 2 weeks ago our company launched the following forum:

Webmaster Forum

... Numerous times during the day we get very heavy bot activity on all forum pages - BUT not a single forum page is indexed yet.

We have also removed the SID from the URLs and also made our URLs search engine friendly.

For example previous URLs would appear like this:

http://ewebdevelopment.net/forum/viewtopic.php?t=36


Now the URLs appear like this:

http://ewebdevelopment.net/forum/google-forum-vf2.html

Anybody have any idea why none of our forum pages are being indexed yet? BOTs are chewing up our bandwidth like no tomorrow!!
bbott is offline
Reply With Quote
View Public Profile Visit bbott's homepage!
 
 
When You Register, These Ads Go Away!
Old 10-26-2004, 05:17 PM
RoN
RoN's Avatar
Super Talker

Posts: 120
Location: Ft Myers, Fl.
Trades: 0
There's an archive script for phpBB that kind of works as a sitemap. Maybe this would help you get spidered quicker.

I think the script is here
__________________
------<<>>----------<<>> ------<<>> ------
Autoresponder **Online Business Opportunity
------<<>>----------<<>> ------<<>> ------
RoN is offline
Reply With Quote
View Public Profile Visit RoN's homepage!
 
Old 10-26-2004, 06:32 PM
Republikin's Avatar
Defies a Status

Posts: 3,190
Trades: 3
Not only that but how long ago did you change the URLS? Are the old ones still viewable? The SE's could very well still be going off their current list of links to follow which is the old URLs, they may have thousands left to do as SID's used to be used. I would give them some time, also using apache error handling could be a good way to force the use of the new urls.
Republikin is offline
Reply With Quote
View Public Profile
 
Old 10-31-2004, 01:36 PM
bbott's Avatar
Ultra Talker

Posts: 267
Trades: 0
Well my forum pages are finally indexed, not all of them though.

Googlebot is on my site about 10 times a day, i'd think more pages would be indexed by now. I guess i'll just have to be patient
bbott is offline
Reply With Quote
View Public Profile Visit bbott's homepage!
 
Reply     « Reply to Tramendous daily Bot Activity, But not indexed
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML

 


Page generated in 0.08974 seconds with 13 queries