Reply
members only forum lock robots
Old 05-09-2004, 09:36 PM members only forum lock robots
Novice Talker

Posts: 10
is there a way to let robots doing their job at members only view pages of my forum for having better optimization?

may be its funny question but i had see some php forums to do this, and when you try to folow the link they send you at login page.
samycat is offline
Reply With Quote
View Public Profile
 
When You Register, These Ads Go Away!
     
Old 05-14-2004, 02:00 PM
cmonkey's Avatar
Ultra Talker

Posts: 268
I'm not sure I understand the question. Are you trying to keep bots from spidering your members only pages?

If so, you should be able to do that with your robots.txt file. Granted its not fool proof, some bots don't play by the rules, but it should work in most cases.
cmonkey is offline
Reply With Quote
View Public Profile
 
Old 05-14-2004, 03:32 PM
Skilled Talker

Posts: 65
of course it is possible. basically you grant search engine spiders a "wild card" to spider your members only forum. however, if users have to register and login first to see the actual content, it might be considered cloaking.

You also have to make sure that the spiders are able to spider your "normal" (ie. ?post=242&session=484242&thread=4384) URLs... in most cases they arent. this is why there are "archive" add-ons for most forums which create an archive of all posts of your forum with search engine friendly links.
__________________
Fresh Proxy Lists
mxlabs is offline
Reply With Quote
View Public Profile Visit mxlabs's homepage!
 
Reply     « Reply to members only forum lock robots
 

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off




   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML

 


Page generated in 0.11676 seconds with 13 queries