I've noticed that in the last few weeks Google didn't crawl any of my new pages even though I submitted new sitemap. Had anyone else experienced this? My guess is that Google have directed computing power to calculating new pageranks.
For many days, I have seen continues fall in the number of index pages for my sites. All of my site's index pages have dropped. The ranking of sites have dropped a little but the noticeable thing is the big drop of indexed pages. Not sure what the reason might be.
You mean external or internal links or both? What's your strategy if you want your new pages to get crawled? You add a bunch of links to them on other sites?
Even pinging has been resulting in less than stellar responses from google, we update hourly and ping every 24 to 48 hours for months and things seemed to have slowed down on google's end recently for us.
I've noticed that in the last few weeks Google didn't crawl any of my new pages even though I submitted new sitemap. Had anyone else experienced this? My guess is that Google have directed computing power to calculating new pageranks.
Yes here you are correct Google has slowed the crawling of old pages, althought it is indexing new pages, might be some page rank update
links are what get pages crawled NOT XML sitemaps.
I'll have to disagree on this one, even if you do not have links pointing at your inner pages an xml sitemap can help google find those pages just as well. That is why they give you option to upload a sitemap. Let's not forget this "Submit a Sitemap to tell Google about pages on your site we might not otherwise discover" from the sitemap page in the webmasters tools.
Even if you had no links at all google would still index your site if you submitted a sitemap to them. Now of course it might take forever and a day for google to get around to it but it is still possible.
I've experienced a case before, when I edited a page (already indexed), it hasn't re-index nor changed it's cache for the following weeks until when Google PR update comes, it just gain PR and the latest cache.
I'll have to disagree on this one, even if you do not have links pointing at your inner pages an xml sitemap can help google find those pages just as well. That is why they give you option to upload a sitemap. Let's not forget this "Submit a Sitemap to tell Google about pages on your site we might not otherwise discover" from the sitemap page in the webmasters tools.
Even if you had no links at all google would still index your site if you submitted a sitemap to them. Now of course it might take forever and a day for google to get around to it but it is still possible.
And the point of having pages crawled that are never going to be found by searchers is???
My site did not experience this. Google still come to crawl all my pages (old and new) very often just as before. I did not ping and submit any sitemap.
i would say slow for me. can be a few weeks before the link count indexed goes up. somewhat sporadic. I did have one small site get indexed very quickly, strange. overall though, slower that what i have experienced in the past.
How often do you update your site? Crawling time in Google usually depends on how often you add new contents to a site. I suggest you ping your site to notify SEs about a recent update. It helps.
And the point of having pages crawled that are never going to be found by searchers is???
The only point is that it can be done, which is the correct answer to this thread that's all I'm saying. But maybe I would do this for testing purposes.
usually google will crawl the blog who have PR5 and above daily
Side with you, creativeasia
I found many of my pages, even just added, are indexed by Google from some High PR forums. (I checked this via Yahoo siteexplorer).
So, I do think quality backlinks play a big role in faster indexed.
