Elsewhere on the forums people are reporting very long delays in getting indexed by Google - the delays seem to be increasing. Obviously this has been caused by the NOINDEX tag added to new hubs when under review and to ZZZ hubs while being reconsidered. Surely this is of concern to HP? As a writer it is extremely frustrating to have a hub accepted to be featured but not indexed for weeks or months. What's the point of writing new hubs? Can one of the staff please reply to these concerns. There must be a better way! These long delays do no occur on other sites!
There is no decline in the overall number of pages crawled per day on webmasters tools.
I know the guys from BuildaSign link to stuff from Google+ when they want it to get indexed quickly. You can try that if you want!
I was just about to post a thread on this. I have published quite a few Hubs since the idle feature was introduced, most are indexed with 48 hours. But two of them are still not indexed and it has been two weeks since I published. Would it be worth tryng to unpublish these and then republish them a week later? Any thoughts?
Sorry for being brief earlier, wanted to confirm something before I was more verbose on the subject. BTW, keep in mind since I don't actually have access to HubPage's server logs and such, some of this is me filling in the blanks with my own personal experience with how Google crawler works.
Ok, here is whats going on. The current problem stems from Adsense, which shares the web crawler bot that Google search uses. When Ads are displayed through Adsense boxes, they call a script which brings the crawler to the page, to put it simply, so Google knows what the page their ads are being displayed on looks like.
Now part of the idea (again from what i understand) with the whole 24 hour pending status is that the Google bot isn't called to crawl the page until those 24 hours are over and the no-index tag is removed, but because of the Adsense ads, it appears that the pages are sometimes still getting crawled while still no-indexed. When this happens, it makes Google ignore the page even after the tag is removed for some time afterwards, till the crawler comes back around again, which could be as little as a few days or longer potentially, depending on a variety of circumstances.
As for how exactly the problem will be fixed, I do not know, but HP staff knows about it for sure and is working on a solution.
In the mean time, as a temporary fix, you can use Google Webmaster tools to request another crawl of your pages that still aren't indexed. There is a limit of 10 requests a month for each user, however if you have more that need to be indexed, you can request it crawl a page that links to many of said hubs with the "crawl page and all pages it links to" request. It's not immediate, but should get your page on search within the next 2-3 days.
In the mean time, as a temporary fix, you can use Google Webmaster tools to request another crawl of your pages that still aren't indexed
But that's not effective, I have tried this repeatedly and WMT's states it cannot find the URL. I've also discussed this with a hubber who states that he keeps trying WMT's and, eventually, they index the hub, but the same hub is de-inedexed within 24 hours.
Using "Fetch as Google" => success shows that Google can find the page. The index request has a varied outcome and time period - hard to know if it works. Linking to various social pages used to hasten the indexing - but not anymore. Maybe the bot gets tired of seeing so many NOINDEX pages and does not visit as often.
Sorry, I wrote that post hastily. I've tried fetch as google, and it can't find the URL's. I recently updated my best performing hub also, added video and more info which I thought would enhance the user experience. It's now down to around two hits a day! I can't find it in the SERPS, when I put the title in my browser I find the hub at number 3, when I click on it it's a 404? redirect. Then I'm shown the summary of my hub (approx 4 in the SERPS) I click on it and it takes me to my profile, not the hub. Somethings very wrong.
My traffic died with the latest algo, and I'm not making excuses because I had a high bounce and low time on page which would probably indicate to Google that my sub is spammy (these were my first thoughts) but not finding your hub, even when you place the exact title in the browser is worrying. So is the 404 redirect.
Septum piercings on girls and there's a few more too!
Yes, but try to putting into the browser the title of the hub, you wont actually find the hub till page 2 or maybe even 3. That was my experience yesterday.
I put this text, "Septum Piercings On Girls, Dangers, Infections, Healing and Cleaning.", into Google. Your link is plastered all over the internet, including my own blog, btw. But you are right, I can't find your actual hub via Google anywhere!
Same damn thing with my newest hub, btw...
It's got to be the noindex fiasco that's causing all this, as stated on other threads. There's not a darn thing we can do about it. Yours truly has quit publishing for the time being.
Heh, same goes for you, may want to pass on slashes, commas and hyphens. I generally use Hypens to separate parts of my title i want to be separate search strings, in a way anyways. Either way, try removing them when you search if you still want them in your titles and see where the same articles show up.
I've never had delimiter problems before... And none of my content strings show up either.
Google problem? Noindex problem? Don't know. Don't care. I will revisit the mess after the dust settles.
Good luck, all.
I searched these three hub titles:
"What Is / Are Human Feelings and Emotions - Emotional Intelligence and Self Awareness"
"How to Remember the Order of the Visible Light / Color Spectrum. Meet Mr. Roy G. Biv. * roygbiv *"
"The Answer to: How do I mentally calculate sales tax, so I don't get cheated?"
The first two showed up number 1 without any edits and the last one showed up #2, right below a feedreader entry of your hub. Your latest one however yes, is not indexed.
Now I'm definitely perturbed... I duplicated your search of, "The Answer to: How do I mentally calculate sales tax, so I don't get cheated?" It was as you said, #2. So far, so good. Then I clicked on the link. The god damn thing took me to my profile!!! In other words, Google wasn't displaying any links directly to the hub at all!!! I wonder how many of my other hubs are screwed up this way!?!
Screw this. I'll keep writing, but I am so out of the publishing business for now...
This has got to be Google's doing, not HP's.
It's possible, I tried just now and the link took me directly to your hub, so this is rather odd indeed. However since I can't replicate it myself, it seems like this is some isolated bug having to do with their search perhaps. It's hard for me to tell without being able to see what you're seeing though.
Do you think you would be able to save the web page, zip or rar it, then send it to my gmail so I can look at the source code? All i need is the html page and I may be able to offer some further insight.
Edit: Or if you have firefox, select the area around the link, with the result included, then right click and say view selection source. You can copy and paste that somewhere online and link it from here or just post it here.
You just stopped me from posting a rant.
Back I go to check again. Stay tuned...
It took me to my profile again...
Additional note: That hub was published over 2 months ago.
2 months ago and still not indexed!!!
Leastwise, now I know why it doesn't get any traffic...
Google only displayed 3 non-ad entries: the feed you mentioned; the title of my profile page (live link to profile page), with the hub title underneath it (which is not a live link); and a twitter reference.
Thanks for your offer. Lets see what happens when all the variables settle down...
Well that's kind of a different issue, but I can tell you posting your link on redgage probably doesn't help. I find that site to come off really spammy and google probably thinks so to.
Also keep in mind, searching your specific title can trick google into thinking that your using search qualifiers instead of a single string, since you use commas along with "and"
Search this instead: Septum Piercings On Girls Dangers Infections Healing Cleaning.
and you're #1
I took a string of text from your content, without commas in it. SOE is right! Your hub showed up, but in a weird way. It came up as your profile name again, but this time when I clicked it, it did go directly to your hub.
Frankly, as to my own situation, I'm walking away from the whole mess until next week.
Yes, I have, and I'm at number one with the redgage link which was posted more than a year ago, but not the hub. As I've said, if G has buried me because of high bounce and low time on page, I get that. I need to make massive improvements. It's the redirect and only linking to my profile which I find really odd.
Plugged URL into the address bar. Worked fine. So far, so good. Though my browser did inquire what the heck I was looking that up for... (just kidding)
When you paste the url into the field for fetch as google, did you make sure to edit out the beginning of the url so it just has everything that comes after the initial url?
as opposed to pasting the whole string.
Sorry if that already occurred to you, just thought I'd check since I've done that accidentally before.
So have I. And I can't figure out how to delete the failed request!!! It stares me in the face every time I go back. I hate that! If there's a delete button anywhere around there, I sure don't see it...
I did do that the first, I admit. Bit tried again several times omitting that those bits of URL and still the same.
Add "hubpages' to the end of the title when you do a search
e.g. Septum Piercings On Girls, Dangers, Infections, Healing and Cleaning hubpages
It shows that the page is indexed.
without this word many other pages appear before it in the SERPS
The same thing happened to one of my Hubs. Right around the time of the zZz invention, some coder at HubPages inserted the word 'next' in hidden text at the beginning of the URL. That Hub of mine (11 months old and not zZz'd) is gone from Google! My reaction was to publish it elsewhere.
Whatever is happening re indexing on Google, it's nothing to do with HP or the new system for Hubs. I'm experiencing exactly the same effect these past few weeks with material on several different, unrelated domains, where indexing has usually happened in hours. The Great G(oogle)od of the Internet seems to have new tricks up his sleeve...
I'll buy that. I'm definitely quitting publishing for awhile. I'll just write and hopefully build up some inventory.
I agree, I don't believe this is just and HP issue. Those so and so's at G at up to something nasty!
@SOE, It's times like these I really wish I know how to take a screen shot On Google.co.uk typing in the same as you, I find that title at number 3, but it takes you to my profile. At number 7, the summary is given but it's 404 page not found, the hub itself can be found at page 2.
Hrm, interesting, I tried searching on the uk version and got the same result as I did before, with the correct link up top and pointing to the hub. Do you have a google account you are normally signed into when you search? If so, it may be worth trying this;
Go to the little gear icon for settings on the right of the page, scroll down on the settings page until you see the "Personal Results" option and check "do not use personal results". Let me know if this helps or changes anything.
I'm no expert on this but did an experiment "live" as such once with a friend in Florida USA (I'm in UK). We were actually talking to one another on the telephone as we tried different options. What we found was that every time I moved to the next page on Google (or refreshed the page) settings were returned to UK standard.
Hollie - at the risk of giving you apoplexy, I just searched for the exact title of your 'piercings' Hub. The first three results are Pinterest Pins of your Hub - they mention both the title and your name. The next two results are unrelated to you. The next result - number 6 on page 1 of Google - is the summary of your Hub and a link to your profile. The NEXT result after your profile is for this very forum.
So the good news is that you're ranking really really well for your exact title. You have the first page of Google sewn up! The bad news is that, like me (and I suspect loads of other people), none of those high ranking results link to the actual Hub itself.
I'm getting the same problems as you with my Hubs - I think it's partly a prob with the new profile, partly the idle Hubs thing, and partly Google tweaking the SERPS.
Before all this I was ranking #1 at Google with this hub, which used to convert to nice amounts of traffic. In some respects I'll be very relieved if it's just a technical problem (and I believe it is) Still losing income though when it comes to the Halloween hubs. Still, there's enough time for the problem to be rectified before the end of October!
Oh, hell. I finally thought to do a content string search. SOE is right. It's indexed.
This goes back to the delimiter issue. That is apparently now in effect as of the latest google upgrade. This will be causing nightmares for people with punctuation in their titles for months until it is common knowledge.
Suddently my backlog of pages are all indexed!!!! Including one 'featured' yesterday and one the day before WOW!!!! - I did submit to webmasters central - maybe HP has done something!!! Nothing to do with delimiters. Happy little fishe
You caused me to go recheck my latest hub. Still not indexed, but you've given me hope.
'How do I mentally calculate sales tax' is indexed!!! but not the one published 2 days ago (but NOINDEX not present).
Hi Every one,
I am also facing same type of problem in the Hub pages. It takes a lot more time to be indexed. I will republish my hubs to get to be noticed by the crawlers. I hope this method will work.
Hubpages' pending status has created an amazing new record for me: I am about to hit seven days without Google crawling a hub!
That's impressive, since right before Pending status was implemented, my new hubs were typically crawled within an hour or two.
The irony is that Google immediately indexed my Tweet pointing to the hub, including the URL in the Tweet, even though Twitter restricts what Tweets may be crawled. Google SERPs also brought up all the places where I linked to the Hub, including other hubs (it's in a group) and my hubber profile page. So Google knows about the hub and simply hasn't added it to the index because of the noindex tag. Now I'm waiting to see how long it takes for Google to recrawl after seeing a noindex tag.
The best way to check and see if a page has been crawled by Google is to Google search for cache:url with the hub's URL.
SOE, you say that the problem is that Google is seeing the NOINDEX tag because of adsense. But there are many other ways for Google to find pending hubs: a Tweet by a follower, a link to the hub shared anywhere, a link to the hub from the next or previous hub in a group, or, in the above example, Google seeing the link to the hub on one's profile.
In fact, removing Adsense would make the problem worse. In the above lens, I got social traffic, but not search traffic. So removing Adsense would simply cut off ad revenue, without preventing Google from seeing the Noindex tag.
Besides, it's not just Google we have to care about. I ran two experiments on Squidoo comparing how quickly new content is found by search engines on different sites. Both new articles were crawled by Google within an hour and started getting search traffic within 3 hours. One of them started getting Bing traffic. I observed similar traffic patterns on Hubpages before Pending status prohibited new hubs from getting search traffic: sometimes the first traffic was from another search engine.
Even if manually submitting hubs to Google worked to trigger a recrawl, that won't help us with other search engines put off by the noindex tag. Most of them recrawl far less frequently than Google. Sure, they provide less search traffic, but I see no point in introducing an arbitrary barrier to block search engines from indexing content.
I get the idea behind the new change, but I'm not a fan with the way it works.
It would be nice for it to work in this fashion (in my opinion):
Allow indexing for brand new hubs, but if (and only if) it fails the requirements for indexing, then add the noindex tag.
If the above doesn't work out for SEO, maybe don't make my new hub live UNTIL it's measured by the algorithm... then stamp it with noindex (if it fails) before going live, otherwise let Google index it.
Otherwise, as is, I feel like I'm being punished for other users' mistakes.
I used to have hubs indexed within a day of publishing and now I have a hub that's a week out without being indexed.
Google suddenly seems to now hate one of my hubs that I was really counting on. I will give it a few days before becoming highly perturbed.
Well the two Hubs that I published about three weeks ago are still not indexed. So today I deleted one of them. I have a copy in word so in a weeks time I am go to republish it with a slightly different title. See what happens then.
by Paul Maplesden 2 years ago
Hi there,I've been hearing discussions that noindexing hubs (because they are idled) impacts their backlinks in some way, and I'd like to find out if this is true.I've been researching this a bit online and have found the following:- According to the Google Webmaster forum, Google *does* count...
by Dr. John Anderson 9 years ago
The Googlebot visits new hubs within 30-60 minutes while they are in 'Pending' mode and the NOINDEX tag is in place for 24 Hours. This means that the bot does not index the page, and does not return for days or weeks. New pages do not get indexed for days or weeks. This causes lost traffic and lost...
by Andrew Orrell 11 years ago
I recently created my first ever website. Was just a bit of fun to see what exactly is involved and to see if I can pull in any traffic. It took about a week for the site to get indexed. As of yet though not of the pages on my site seem to be indexed by Google. I have the...
by Carolee Samuda 8 years ago
I did a little experiment with opting into the EC program for three months. To begin with,last year one of my better performing hubs become Editor's Choice. That hub was getting an average of 20o+ views per day, peak. The day after being selected as EC, the views dropped to zero. I watched it for a...
by Dilip Chandra 9 years ago
After a hub was published, it is taking 24 hours to get that hub featured. After getting featured, now the problem was with Indexing of the same into Google Search-engine. It takes months sometimes for a hub to get indexed into Google search engine and getting fair traffic from the same.I am using...
by karaboga 12 years ago
it's been 10 days and my hubs are not indexed they're not duplicate content and there is nothing wrong about them. do you have any idea why?
Copyright © 2022 Maven Media Brands, LLC and respective content providers on this website. HubPages® is a registered trademark of Maven Coalition, Inc. Other product and company names shown may be trademarks of their respective owners. Maven Media Brands, LLC and respective content providers to this website may receive compensation for some links to products and services on this website.
|HubPages Device ID||This is used to identify particular browsers or devices when the access the service, and is used for security reasons.|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Traffic Pixel||This is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.|
|Remarketing Pixels||We may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.|
|Conversion Tracking Pixels||We may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.|