jump to last post 1-12 of 12 discussions (59 posts)

Delays of 2-3 weeks for pages to get Indexed by Google - Please Fix!

  1. janderson99 profile image85
    janderson99posted 4 years ago

    Elsewhere on the forums people are reporting very long delays in getting indexed by Google - the delays seem to be increasing. Obviously this has been caused by the NOINDEX tag added to new hubs when under review and to ZZZ hubs while being reconsidered. Surely this is of concern to HP? As a writer it is extremely frustrating to have a hub accepted to be featured but not indexed for weeks or months. What's the point of writing new hubs? Can one of the staff please reply to these concerns. There must be a better way! These long delays do no occur on other sites!

    1. janderson99 profile image85
      janderson99posted 4 years ago in reply to this

      There is no decline in the overall number of pages crawled per day on webmasters tools.

    2. thisisoli profile image57
      thisisoliposted 4 years ago in reply to this

      I know the guys from BuildaSign link to stuff from Google+ when they want it to get indexed quickly. You can try that if you want!

  2. Reality Bytes profile image91
    Reality Bytesposted 4 years ago

    I am patiently waiting for a reply.  smile


    http://media.tumblr.com/tumblr_mao7igVIhD1rs3j3f.gif

    1. Xenonlit profile image60
      Xenonlitposted 4 years ago in reply to this

      mad

  3. andyoz profile image88
    andyozposted 4 years ago

    I was just about to post a thread on this.  I have published quite a few Hubs since the idle feature was introduced, most are indexed with 48 hours.  But two of them are still not indexed and it has been two weeks since I published.  Would it be worth tryng to unpublish these and then republish them a week later?  Any thoughts?

  4. SOE profile image90
    SOEposted 4 years ago

    It's already being fixed now.

    1. janderson99 profile image85
      janderson99posted 4 years ago in reply to this

      More info please!

      1. SOE profile image90
        SOEposted 4 years ago in reply to this

        Sorry for being brief earlier, wanted to confirm something before I was more verbose on the subject. BTW, keep in mind since I don't actually have access to HubPage's server logs and such, some of this is me filling in the blanks with my own personal experience with how Google crawler works.

        Ok, here is whats going on. The current problem stems from Adsense, which shares the web crawler bot that Google search uses. When Ads are displayed through Adsense boxes, they call a script which brings the crawler to the page, to put it simply, so Google knows what the page their ads are being displayed on looks like.

        Now part of the idea (again from what i understand) with the whole 24 hour pending status is that the Google bot isn't called to crawl the page until those 24 hours are over and the no-index tag is removed, but because of the Adsense ads, it appears that the pages are sometimes still getting crawled while still no-indexed. When this happens, it makes Google ignore the page even after the tag is removed for some time afterwards, till the crawler comes back around again, which could be as little as a few days or longer potentially, depending on a variety of circumstances.

        As for how exactly the problem will be fixed, I do not know, but HP staff knows about it for sure and is working on a solution.

        In the mean time, as a temporary fix, you can use Google Webmaster tools to request another crawl of your pages that still aren't indexed. There is a limit of 10 requests a month for each user, however if you have more that need to be indexed, you can request it crawl a page that links to many of said hubs with the "crawl page and all pages it links to" request. It's not immediate, but should get your page on search within the next 2-3 days.

        1. Hollie Thomas profile image61
          Hollie Thomasposted 4 years ago in reply to this

          In the mean time, as a temporary fix, you can use Google Webmaster tools to request another crawl of your pages that still aren't indexed

          But that's not effective, I have tried this repeatedly and WMT's states it cannot find the URL. I've also discussed this with a hubber who states that he keeps trying WMT's and, eventually, they index the hub, but the same hub is de-inedexed within 24 hours.

          1. janderson99 profile image85
            janderson99posted 4 years ago in reply to this

            Using "Fetch as Google" => success shows that Google can find the page. The index request has a varied outcome and time period - hard to know if it works. Linking to various social pages used to hasten the indexing - but not anymore. Maybe the bot gets tired of seeing so many NOINDEX pages and does not visit as often.

            1. Hollie Thomas profile image61
              Hollie Thomasposted 4 years ago in reply to this

              Sorry, I wrote that post hastily. I've tried fetch as google, and it can't find the URL's. I recently updated my best performing hub also, added video and more info which I thought would enhance the user experience. It's now down to around two hits a day! I can't find it in the SERPS, when I put the title in my browser I find the hub at number 3, when I click on it it's a 404? redirect. Then I'm shown the summary of my hub (approx 4 in the SERPS) I click on it and it takes me to my profile, not the hub. Somethings very wrong.

              My traffic died with the latest algo, and I'm not making excuses because I had a high bounce and low time on page which would probably indicate to Google that my sub is spammy (these were my first thoughts) but not finding your hub, even when you place the exact title in the browser is worrying. So is the 404 redirect.

              1. paradigmsearch profile image89
                paradigmsearchposted 4 years ago in reply to this

                What's the hub?

                1. Hollie Thomas profile image61
                  Hollie Thomasposted 4 years ago in reply to this

                  Septum piercings on girls and there's a few more too!

                  1. SOE profile image90
                    SOEposted 4 years ago in reply to this

                    That page is showing up as indexed and cached

                  2. paradigmsearch profile image89
                    paradigmsearchposted 4 years ago in reply to this

                    Plugged URL into the address bar. Worked fine. So far, so good. Though my browser did inquire what the heck I was looking that up for... big_smile (just kidding)

                    Stay tuned.

              2. SOE profile image90
                SOEposted 4 years ago in reply to this

                When you paste the url into the field for fetch as google, did you make sure to edit out the beginning of the url so it just has everything that comes after the initial url?

                like "hub/example-hub-name.html"
                as opposed to pasting the whole string.

                Sorry if that already occurred to you, just thought I'd check since I've done that accidentally before.

                1. paradigmsearch profile image89
                  paradigmsearchposted 4 years ago in reply to this

                  So have I. And I can't figure out how to delete the failed request!!! It stares me in the face every time I go back. I hate that! If there's a delete button anywhere around there, I sure don't see it...

                2. Hollie Thomas profile image61
                  Hollie Thomasposted 4 years ago in reply to this

                  I did do that the first, I admit. Bit tried again several times omitting that those bits of URL and still the same.

                  1. janderson99 profile image85
                    janderson99posted 4 years ago in reply to this

                    Add "hubpages' to the end of the title when you do a search
                    e.g.  Septum Piercings On Girls, Dangers, Infections, Healing and Cleaning hubpages
                    It shows that the page is indexed.
                    without this word many other pages appear before it in the SERPS

              3. Writer Fox profile image74
                Writer Foxposted 4 years ago in reply to this

                The same thing happened to one of my Hubs.  Right around the time of the zZz invention, some coder at HubPages inserted the word 'next' in hidden text at the beginning of the URL.  That Hub of mine (11 months old and not zZz'd) is gone from Google!  My reaction was to publish it elsewhere.

  5. Gordon Hamilton profile image95
    Gordon Hamiltonposted 4 years ago

    Whatever is happening re indexing on Google, it's nothing to do with HP or the new system for Hubs. I'm experiencing exactly the same effect these past few weeks with material on several different, unrelated domains, where indexing has usually happened in hours. The Great G(oogle)od of the Internet seems to have new tricks up his sleeve...

    1. paradigmsearch profile image89
      paradigmsearchposted 4 years ago in reply to this

      I'll buy that. I'm definitely quitting publishing for awhile. I'll just write and hopefully build up some inventory.

    2. Hollie Thomas profile image61
      Hollie Thomasposted 4 years ago in reply to this

      I agree, I don't believe this is just and HP issue. Those so and so's at G at up to something nasty!

  6. Hollie Thomas profile image61
    Hollie Thomasposted 4 years ago

    @SOE, It's times like these I really wish I know how to take a screen shot lol On Google.co.uk typing in the same as you, I find that title at number 3, but it takes you to my profile. At number 7, the summary is given but it's 404 page not found, the hub itself can be found at page 2.

    1. SOE profile image90
      SOEposted 4 years ago in reply to this

      Hrm, interesting, I tried searching on the uk version and got the same result as I did before, with the correct link up top and pointing to the hub. Do you have a google account you are normally signed into when you search? If so, it may be worth trying this;

      Go to the little gear icon for settings on the right of the page, scroll down on the settings page until you see the "Personal Results" option and check "do not use personal results". Let me know if this helps or changes anything.

      1. Gordon Hamilton profile image95
        Gordon Hamiltonposted 4 years ago in reply to this

        I'm no expert on this but did an experiment "live" as such once with a friend in Florida USA (I'm in UK). We were actually talking to one another on the telephone as we tried different options. What we found was that every time I moved to the next page on Google (or refreshed the page) settings were returned to UK standard.

      2. Hollie Thomas profile image61
        Hollie Thomasposted 4 years ago in reply to this

        I'll give it a try.

    2. Redberry Sky profile image95
      Redberry Skyposted 4 years ago in reply to this

      Hollie - at the risk of giving you apoplexy, I just searched for the exact title of your 'piercings' Hub.  The first three results are Pinterest Pins of your Hub - they mention both the title and your name.  The next two results are unrelated to you.  The next result - number 6 on page 1 of Google - is the summary of your Hub and a link to your profile.  The NEXT result after your profile is for this very forum. 

      So the good news is that you're ranking really really well for your exact title.  You have the first page of Google sewn up!  The bad news is that, like me (and I suspect loads of other people), none of those high ranking results link to the actual Hub itself.

      I'm getting the same problems as you with my Hubs - I think it's partly a prob with the new profile, partly the idle Hubs thing, and partly Google tweaking the SERPS.

      1. Hollie Thomas profile image61
        Hollie Thomasposted 4 years ago in reply to this

        Before all this I was ranking #1 at Google with this hub, which used to convert to nice amounts of traffic. sad  In some respects I'll be very relieved if it's just a technical problem (and I believe it is) Still losing income though when it comes to the Halloween hubs. Still, there's enough time for the problem to be rectified before the end of October!

  7. paradigmsearch profile image89
    paradigmsearchposted 4 years ago

    Oh, hell. I finally thought to do a content string search. SOE is right. It's indexed.

    This goes back to the delimiter issue. That is apparently now in effect as of the latest google upgrade. This will be causing nightmares for people with punctuation in their titles for months until it is common knowledge.

    1. janderson99 profile image85
      janderson99posted 4 years ago in reply to this

      Suddently my backlog of pages are all indexed!!!!  Including one 'featured' yesterday and one the day before WOW!!!!  - I did submit to webmasters central  - maybe HP has done something!!!  Nothing to do with delimiters. Happy little fishe smile smile smile

      1. paradigmsearch profile image89
        paradigmsearchposted 4 years ago in reply to this

        You caused me to go recheck my latest hub. Still not indexed, but you've given me hope. big_smile

        1. janderson99 profile image85
          janderson99posted 4 years ago in reply to this

          'How do I mentally calculate sales tax'  is indexed!!! but not the one published 2 days ago (but NOINDEX not present).

          1. paradigmsearch profile image89
            paradigmsearchposted 4 years ago in reply to this

            You certainly have perked up. big_smile big_smile big_smile

            Postscript: May all your arrows be red tomorrow. smile

  8. khmohsin profile image61
    khmohsinposted 4 years ago

    Hi Every one,
    I am also facing same type of problem in the Hub pages. It takes a lot more time to be indexed. I will republish my hubs to get to be noticed by the crawlers. I hope this method will work.

    1. Greekgeek profile image96
      Greekgeekposted 4 years ago

      Hubpages' pending status has created an amazing new record for me: I am about to hit seven days without Google crawling a hub!

      That's impressive, since right before Pending status was implemented, my new hubs were typically crawled within an hour or two.

      The irony is that Google immediately indexed my Tweet pointing to the hub, including the URL in the Tweet, even though Twitter restricts what Tweets may be crawled. Google SERPs also brought up all the places where I linked to the Hub, including other hubs (it's in a group) and my hubber profile page. So Google knows about the hub and simply hasn't added it to the index because of the noindex tag. Now I'm waiting to see how long it takes for Google to recrawl after seeing a noindex tag.

      The best way to check and see if a page has been crawled by Google is to Google search for cache:url with the hub's URL.

      SOE, you say that the problem is that Google is seeing the NOINDEX tag because of adsense. But there are many other ways for Google to find pending hubs: a Tweet by a follower, a link to the hub shared anywhere, a link to the hub from the next or previous hub in a group, or, in the above example, Google seeing the link to the hub on one's profile.

      In fact, removing Adsense would make the problem worse. In the above lens, I got social traffic, but not search traffic. So removing Adsense would simply cut off ad revenue, without preventing Google from seeing the Noindex tag.

      Besides, it's not just Google we have to care about. I ran two experiments on Squidoo comparing how quickly new content is found by search engines on different sites. Both new articles were crawled by Google within an hour and started getting search traffic within 3 hours. One of them started getting Bing traffic. I observed similar traffic patterns on Hubpages before Pending status prohibited new hubs from getting search traffic: sometimes the first traffic was from another search engine.

      Even if manually submitting hubs to Google worked to trigger a recrawl, that won't help us with other search engines put off by the noindex tag. Most of them recrawl far less frequently than Google. Sure, they provide less search traffic, but I see no point in introducing an arbitrary barrier to block search engines from indexing content.

    2. melbel profile image93
      melbelposted 4 years ago

      I get the idea behind the new change, but I'm not a fan with the way it works.

      It would be nice for it to work in this fashion (in my opinion):

      Allow indexing for brand new hubs, but if (and only if) it fails the requirements for indexing, then add the noindex tag.

      If the above doesn't work out for SEO, maybe don't make my new hub live UNTIL it's measured by the algorithm... then stamp it with noindex (if it fails) before going live, otherwise let Google index it.

      Otherwise, as is, I feel like I'm being punished for other users' mistakes.

      I used to have hubs indexed within a day of publishing and now I have a hub that's a week out without being indexed.

    3. paradigmsearch profile image89
      paradigmsearchposted 4 years ago

      Google suddenly seems to now hate one of my hubs that I was really counting on. I will give it a few days before becoming highly perturbed.

      1. davenmidtown profile image87
        davenmidtownposted 4 years ago in reply to this

        This is EFFING crazy!!!!! My hubs used to be indexed within hours... HOURs... now if I don't check they could just sit there for ever. I am seriously thinking about pulling my work off of here.... Not one peep from HP?

    4. andyoz profile image88
      andyozposted 4 years ago

      Well the two Hubs that I published about three weeks ago are still not indexed.  So today I deleted one of them.  I have a copy in word so in a weeks time I am go to republish it with a slightly different title.  See what happens then.

     
    working