We have added a feature to the Search tab under the stats box on each Hub that enables you to see when that Hub that has last been crawled by search engines.
When an Idle Hub is crawled, search engines will see that it has a noindex tag, which indicates to search engines that the page should not appear in search results. When a Hub falls into Idle status, it may take some time before the Hub is crawled, so it may remain in search engine results for some time. If you update an Idle Hub quickly, right when you see it is no longer Featured, you may bring it out of Idle status before it is crawled, meaning you can avoid having that Hub removed from search engines' indexes entirely.
Do keep in mind, though, that even after a Hub has been crawled, it might take a search engine some time to take it out of the index or add it back in. Essentially, once a Hub has been crawled and a search engine knows what we say it should do with a Hub, the ball is in the search engine's court.
On the flip side, it may take a while between the point in time at which an Idle Hub becomes Featured again and the point at which it is added back to search engine indexes, as the Hub must be crawled first.
We added this feature to make it easier to see why your Hub is being indexed (or not indexed). We hope you find it useful!
Not only a great idea, but a great help. This is a benefit not only for idle hubs but hubs we are trying to promote! Knowing when (and if) Google or Bing have hits on our hubs is just another great weapon in our arsenal of hub promotions. Thank you, thank you!!!
The last two hubs I published were visited by G bot within 30 minutes, only to be slapped and told to go away! Hiding doesn't work when the hubs are sent to followers, etc. I used to love the way new hubs were indexed so quickly, now this good feature works against us and imposes an indexing delay and lost income. Why is this beneficial to established and trusted writers? I have never had a pending hub fail to get the Prince's Kiss and awaken. This is just a pain.
This "exclusive" page http://janderson99.hubpages.com/hub/Slo … oes-Recipe Is listed as being crawled 7 days ago, with an update to say 22 hours ago. Yet it does not appear in the SERPS using the search term " Slow Roasted Dried Tomatoes Recipe hubpages" and cache:http://janderson99.hubpages.com/hub/Slow-Roasted-Dried-Tomatoes-Recipe produces a 404 error Any clues???
I looked at one of my hubs still in the pending period The tool says it was crawled 14 hours ago - with the NOINDEX tag in place. This means that the bot won't be back for days or weeks This is bad for authors and bad for HP The only way I can get pages indexed is to submit them to webmastercentral Surely there must be a better way. This is extremely annoying! Sending pages to the sin bin tells Google not to index them Does HP have any stats on the proportion of pages that are crawled during the pending period and don't get indexed for days or weeks!
I suspect that EVERY new page gets crawled while pending - the bot sees the NOINDEX tag and goes away - not to return for days or weeks - surely this is bad and should be addressed. The hubber and HP loses income, which can never be regained!!!
In my experience that notion is out of date. Why doesn't HP introduce 'Trusted Authors' who wouldn't have all their new hubs sent to the 'sin bin'. Many other sites do it. It would free-up scarce resources. A Win Win!
Simone....I'm still trying to discover why my traffic hasn't picked back up on my hub (a DIY article) that was, prior to late September, garnering half of my total traffic. I've lost more than half of all hub traffic and half my earnings this month, even after tweaking my "best" hub. It still shows the same Google ranking, so I'm bewildered that its traffic is so decreased. It doesn't help that I'm "technically challenged." Do you have any explanation about the fate of this hub? Thanks in advance for any help you can give me. JAYE
And just how are they supposed to 'mature' if they get hidden in pending status from the get-go? Saying 'it's up to the search engine to re-crawl,' is a cop-out, because it was HP who installed the 'no index' PENALTY!! (For that is what it truly is!) If it's not indexed, the crawler may not come back for weeks, months or at all...lost income ALL AROUND. This was NOT a good move on HP's part! Being able to "see" when it was last crawled does nothing to get rid of a 'no-index' tag. We need information on HOW to do THAT! Re-write the article? Add/change tags or keywords? Or, once it's de-indexed, that's that--too bad, so sad?
Maybe the tool can also now upgrade all that missing information on the measuring of hub Viewing Durations? It seems that half of mine, even though some of the hubs are over two years old haven't yet been measured yet for some rather obscure reason?
This is an excellent feature! I have been away for several months, and coming back, I see many useful tools that the HP team has implemented. It's a great, and wonderful surprise, to come back to a site that has so many useful tools for the writer.
The points DzyMzLzzy and janderson99 made in posts (above) are correct--seeing when hubs are crawled is not helpful if hubbers cannot do anything about indexing. Those are the "tools" HP needs to provide--so we can see if our hubs are indexed and, if not, show us how to ensure they are indexed by Google and other search engines.
By the way, Simone, I used the new feature to see when my "best" hub was last crawled by search engines. Not good news. Even though my title uses words from engine searches, Google last crawled the article THREE DAYS AGO, and Bing, two days ago!