I have a tutorials dynamic site, my site is getting bigger so I will write a PHP script to dynamically generate sitemap from database.
My question is: How much and how deep should I generate urls?
In my site, you can view tutorials by sitename, by category, by sub-category...etc which are considered different urls, Should I generate urls for all those?

Also, how about page numbers? should I generate urls for all pages like: http://mysite.com/photoshop/1/, http://mysite.com/photoshop/2/,
http://mysite.com/photoshop/3/ ....etc?

I'm asking because automated sitemap generators seem to do that, they follow every possible url in your site. I just don't know if this is the right thing to do if you have more control.

include any page that has good content or has potential to get links to it. Include any page you want to be considered for indexing.

What about sorting? you can view tutorials by site, category, sub-category ...etc. Those pages return the same content but with different tutorials order spread into multiple pages, should I include all of those or only one form, for example: by category?

Actually if the different URLs are displaying the same content you don't want to include them all. Search engines don't want to present duplicate content in their results. If you have 3 URLs that all show the same content you should block two of them through robots.txt.

If the content on each URL is unique then sure include them all in your sitemap to Google, but if the content is the same pick the URL you think best to include and block the others from getting indexed.

Thank you for your answers, I know about duplicate content but I'm confused because it's not exactly "the same content" it's more like other views of the content because of sorting. compare those three links to have a more clear idea of what I'm talking about:

http://www.tutorialsroom.com/tutoria...otoshop/all/1/
http://www.tutorialsroom.com/tutoria...nline.co.uk/1/
http://www.tutorialsroom.com/tutoria...oto_effects/1/

2 questions to ask yourself.

do the pages have exactly the same text?

if Yes, it's a duplicate.

do the pages have very similar text, or the same text with just the odd wording change?

if Yes there is every chance of it being a "duplicate"

Hard to say based on the links you posted. I can see how you'd end up with very similar pages with the main difference being the results are listed in a different order. They're pretty thin on content in general though.

It looks like each subcategory will be unique when compared to the others and the more general category will share some of the resources with it's subcategories. I would think they'd end up being unique enough and it would be ok to include them.

You're not really going to be penalized if they are determined to be duplicate.

@vangogh, Thank you for your answer, now you know why it was not easy to decide and that's why I have included the links, thanks for your time visiting them instead of providing "general" answer. Google is saying you won't be penalized for duplicate content (maybe except if they think you are trying to trick the system) and the only thing that might happen is they will choose one version which might not be the one you wanted. As you have seen, this won't be a problem in my case.

Following your words, I think I will add them all. I really appreciate your answer and time. Added some green

Glad to help. Doesn't look like the green came through, but no worries.

The links did help clarify why you're having a hard deciding. I was thinking the the pages would be exactly the same at first, but now I see they aren't. One thing you can always try at a later point is blocking one set of URLs (maybe the general category ones) in robots.txt and see if you notice any change in how the other pages rank. You can block and unblock them as you want just to see what effect if any there is.

Doesn't look like the green came through

The cheque (check) is in the post

Funny. I've heard that line before.

Originally Posted by chrishirst

The cheque (check) is in the post

Sent another cheque

I just cashed it. Thanks

Originally Posted by vangogh

I just cashed it. Thanks

I think you mean cached...

Originally Posted by vangogh

I just cashed it. Thanks

I want some cash too.

Will you settle for come cache?