Delays of 2-3 weeks for pages to get Indexed by Google - Please Fix!

Jump to Last Post 1-12 of 12 discussions (59 posts)
  1. janderson99 profile image53
    janderson99posted 12 years ago

    Elsewhere on the forums people are reporting very long delays in getting indexed by Google - the delays seem to be increasing. Obviously this has been caused by the NOINDEX tag added to new hubs when under review and to ZZZ hubs while being reconsidered. Surely this is of concern to HP? As a writer it is extremely frustrating to have a hub accepted to be featured but not indexed for weeks or months. What's the point of writing new hubs? Can one of the staff please reply to these concerns. There must be a better way! These long delays do no occur on other sites!

    replyreport
    1. janderson99 profile image53
      janderson99posted 12 years agoin reply to this

      There is no decline in the overall number of pages crawled per day on webmasters tools.

      replyreport
    2. thisisoli profile image80
      thisisoliposted 12 years agoin reply to this

      I know the guys from BuildaSign link to stuff from Google+ when they want it to get indexed quickly. You can try that if you want!

      replyreport
  2. Reality Bytes profile image74
    Reality Bytesposted 12 years ago

    I am patiently waiting for a reply.  smile


    http://media.tumblr.com/tumblr_mao7igVIhD1rs3j3f.gif

    replyreport
    1. Xenonlit profile image60
      Xenonlitposted 12 years agoin reply to this

      mad

      replyreport
  3. andyoz profile image87
    andyozposted 12 years ago

    I was just about to post a thread on this.  I have published quite a few Hubs since the idle feature was introduced, most are indexed with 48 hours.  But two of them are still not indexed and it has been two weeks since I published.  Would it be worth tryng to unpublish these and then republish them a week later?  Any thoughts?

    replyreport
  4. SOE profile image66
    SOEposted 12 years ago

    It's already being fixed now.

    replyreport
    1. janderson99 profile image53
      janderson99posted 12 years agoin reply to this

      More info please!

      replyreport
      1. SOE profile image66
        SOEposted 12 years agoin reply to this

        Sorry for being brief earlier, wanted to confirm something before I was more verbose on the subject. BTW, keep in mind since I don't actually have access to HubPage's server logs and such, some of this is me filling in the blanks with my own personal experience with how Google crawler works.

        Ok, here is whats going on. The current problem stems from Adsense, which shares the web crawler bot that Google search uses. When Ads are displayed through Adsense boxes, they call a script which brings the crawler to the page, to put it simply, so Google knows what the page their ads are being displayed on looks like.

        Now part of the idea (again from what i understand) with the whole 24 hour pending status is that the Google bot isn't called to crawl the page until those 24 hours are over and the no-index tag is removed, but because of the Adsense ads, it appears that the pages are sometimes still getting crawled while still no-indexed. When this happens, it makes Google ignore the page even after the tag is removed for some time afterwards, till the crawler comes back around again, which could be as little as a few days or longer potentially, depending on a variety of circumstances.

        As for how exactly the problem will be fixed, I do not know, but HP staff knows about it for sure and is working on a solution.

        In the mean time, as a temporary fix, you can use Google Webmaster tools to request another crawl of your pages that still aren't indexed. There is a limit of 10 requests a month for each user, however if you have more that need to be indexed, you can request it crawl a page that links to many of said hubs with the "crawl page and all pages it links to" request. It's not immediate, but should get your page on search within the next 2-3 days.

        replyreport
        1. Hollie Thomas profile image60
          Hollie Thomasposted 12 years agoin reply to this

          In the mean time, as a temporary fix, you can use Google Webmaster tools to request another crawl of your pages that still aren't indexed

          But that's not effective, I have tried this repeatedly and WMT's states it cannot find the URL. I've also discussed this with a hubber who states that he keeps trying WMT's and, eventually, they index the hub, but the same hub is de-inedexed within 24 hours.

          replyreport
          1. janderson99 profile image53
            janderson99posted 12 years agoin reply to this

            Using "Fetch as Google" => success shows that Google can find the page. The index request has a varied outcome and time period - hard to know if it works. Linking to various social pages used to hasten the indexing - but not anymore. Maybe the bot gets tired of seeing so many NOINDEX pages and does not visit as often.

            replyreport
            1. Hollie Thomas profile image60
              Hollie Thomasposted 12 years agoin reply to this

              Sorry, I wrote that post hastily. I've tried fetch as google, and it can't find the URL's. I recently updated my best performing hub also, added video and more info which I thought would enhance the user experience. It's now down to around two hits a day! I can't find it in the SERPS, when I put the title in my browser I find the hub at number 3, when I click on it it's a 404? redirect. Then I'm shown the summary of my hub (approx 4 in the SERPS) I click on it and it takes me to my profile, not the hub. Somethings very wrong.

              My traffic died with the latest algo, and I'm not making excuses because I had a high bounce and low time on page which would probably indicate to Google that my sub is spammy (these were my first thoughts) but not finding your hub, even when you place the exact title in the browser is worrying. So is the 404 redirect.

              replyreport
              1. paradigmsearch profile image60
                paradigmsearchposted 12 years agoin reply to this

                What's the hub?

                replyreport
                1. Hollie Thomas profile image60
                  Hollie Thomasposted 12 years agoin reply to this

                  Septum piercings on girls and there's a few more too!

                  replyreport
                  1. SOE profile image66
                    SOEposted 12 years agoin reply to this

                    That page is showing up as indexed and cached

                    replyreport
                  2. paradigmsearch profile image60
                    paradigmsearchposted 12 years agoin reply to this

                    Plugged URL into the address bar. Worked fine. So far, so good. Though my browser did inquire what the heck I was looking that up for... big_smile (just kidding)

                    Stay tuned.

                    replyreport
              2. SOE profile image66
                SOEposted 12 years agoin reply to this

                When you paste the url into the field for fetch as google, did you make sure to edit out the beginning of the url so it just has everything that comes after the initial url?

                like "hub/example-hub-name.html"
                as opposed to pasting the whole string.

                Sorry if that already occurred to you, just thought I'd check since I've done that accidentally before.

                replyreport
                1. paradigmsearch profile image60
                  paradigmsearchposted 12 years agoin reply to this

                  So have I. And I can't figure out how to delete the failed request!!! It stares me in the face every time I go back. I hate that! If there's a delete button anywhere around there, I sure don't see it...

                  replyreport
                2. Hollie Thomas profile image60
                  Hollie Thomasposted 12 years agoin reply to this

                  I did do that the first, I admit. Bit tried again several times omitting that those bits of URL and still the same.

                  replyreport
                  1. janderson99 profile image53
                    janderson99posted 12 years agoin reply to this

                    Add "hubpages' to the end of the title when you do a search
                    e.g.  Septum Piercings On Girls, Dangers, Infections, Healing and Cleaning hubpages
                    It shows that the page is indexed.
                    without this word many other pages appear before it in the SERPS

                    replyreport
              3. Writer Fox profile image43
                Writer Foxposted 12 years agoin reply to this

                The same thing happened to one of my Hubs.  Right around the time of the zZz invention, some coder at HubPages inserted the word 'next' in hidden text at the beginning of the URL.  That Hub of mine (11 months old and not zZz'd) is gone from Google!  My reaction was to publish it elsewhere.

                replyreport
  5. Gordon Hamilton profile image98
    Gordon Hamiltonposted 12 years ago

    Whatever is happening re indexing on Google, it's nothing to do with HP or the new system for Hubs. I'm experiencing exactly the same effect these past few weeks with material on several different, unrelated domains, where indexing has usually happened in hours. The Great G(oogle)od of the Internet seems to have new tricks up his sleeve...

    replyreport
    1. paradigmsearch profile image60
      paradigmsearchposted 12 years agoin reply to this

      I'll buy that. I'm definitely quitting publishing for awhile. I'll just write and hopefully build up some inventory.

      replyreport
    2. Hollie Thomas profile image60
      Hollie Thomasposted 12 years agoin reply to this

      I agree, I don't believe this is just and HP issue. Those so and so's at G at up to something nasty!

      replyreport
  6. Hollie Thomas profile image60
    Hollie Thomasposted 12 years ago

    @SOE, It's times like these I really wish I know how to take a screen shot lol On Google.co.uk typing in the same as you, I find that title at number 3, but it takes you to my profile. At number 7, the summary is given but it's 404 page not found, the hub itself can be found at page 2.

    replyreport
    1. SOE profile image66
      SOEposted 12 years agoin reply to this

      Hrm, interesting, I tried searching on the uk version and got the same result as I did before, with the correct link up top and pointing to the hub. Do you have a google account you are normally signed into when you search? If so, it may be worth trying this;

      Go to the little gear icon for settings on the right of the page, scroll down on the settings page until you see the "Personal Results" option and check "do not use personal results". Let me know if this helps or changes anything.

      replyreport
      1. Gordon Hamilton profile image98
        Gordon Hamiltonposted 12 years agoin reply to this

        I'm no expert on this but did an experiment "live" as such once with a friend in Florida USA (I'm in UK). We were actually talking to one another on the telephone as we tried different options. What we found was that every time I moved to the next page on Google (or refreshed the page) settings were returned to UK standard.

        replyreport
      2. Hollie Thomas profile image60
        Hollie Thomasposted 12 years agoin reply to this

        I'll give it a try.

        replyreport
    2. Redberry Sky profile image89
      Redberry Skyposted 12 years agoin reply to this

      Hollie - at the risk of giving you apoplexy, I just searched for the exact title of your 'piercings' Hub.  The first three results are Pinterest Pins of your Hub - they mention both the title and your name.  The next two results are unrelated to you.  The next result - number 6 on page 1 of Google - is the summary of your Hub and a link to your profile.  The NEXT result after your profile is for this very forum. 

      So the good news is that you're ranking really really well for your exact title.  You have the first page of Google sewn up!  The bad news is that, like me (and I suspect loads of other people), none of those high ranking results link to the actual Hub itself.

      I'm getting the same problems as you with my Hubs - I think it's partly a prob with the new profile, partly the idle Hubs thing, and partly Google tweaking the SERPS.

      replyreport
      1. Hollie Thomas profile image60
        Hollie Thomasposted 12 years agoin reply to this

        Before all this I was ranking #1 at Google with this hub, which used to convert to nice amounts of traffic. sad  In some respects I'll be very relieved if it's just a technical problem (and I believe it is) Still losing income though when it comes to the Halloween hubs. Still, there's enough time for the problem to be rectified before the end of October!

        replyreport
  7. paradigmsearch profile image60
    paradigmsearchposted 12 years ago

    Oh, hell. I finally thought to do a content string search. SOE is right. It's indexed.

    This goes back to the delimiter issue. That is apparently now in effect as of the latest google upgrade. This will be causing nightmares for people with punctuation in their titles for months until it is common knowledge.

    replyreport
    1. janderson99 profile image53
      janderson99posted 12 years agoin reply to this

      Suddently my backlog of pages are all indexed!!!!  Including one 'featured' yesterday and one the day before WOW!!!!  - I did submit to webmasters central  - maybe HP has done something!!!  Nothing to do with delimiters. Happy little fishe smile smile smile

      replyreport
      1. paradigmsearch profile image60
        paradigmsearchposted 12 years agoin reply to this

        You caused me to go recheck my latest hub. Still not indexed, but you've given me hope. big_smile

        replyreport
        1. janderson99 profile image53
          janderson99posted 12 years agoin reply to this

          'How do I mentally calculate sales tax'  is indexed!!! but not the one published 2 days ago (but NOINDEX not present).

          replyreport
          1. paradigmsearch profile image60
            paradigmsearchposted 12 years agoin reply to this

            You certainly have perked up. big_smile big_smile big_smile

            Postscript: May all your arrows be red tomorrow. smile

            replyreport
  8. profile image0
    khmohsinposted 12 years ago

    Hi Every one,
    I am also facing same type of problem in the Hub pages. It takes a lot more time to be indexed. I will republish my hubs to get to be noticed by the crawlers. I hope this method will work.

    replyreport
    1. Greekgeek profile image77
      Greekgeekposted 12 years ago

      Hubpages' pending status has created an amazing new record for me: I am about to hit seven days without Google crawling a hub!

      That's impressive, since right before Pending status was implemented, my new hubs were typically crawled within an hour or two.

      The irony is that Google immediately indexed my Tweet pointing to the hub, including the URL in the Tweet, even though Twitter restricts what Tweets may be crawled. Google SERPs also brought up all the places where I linked to the Hub, including other hubs (it's in a group) and my hubber profile page. So Google knows about the hub and simply hasn't added it to the index because of the noindex tag. Now I'm waiting to see how long it takes for Google to recrawl after seeing a noindex tag.

      The best way to check and see if a page has been crawled by Google is to Google search for cache:url with the hub's URL.

      SOE, you say that the problem is that Google is seeing the NOINDEX tag because of adsense. But there are many other ways for Google to find pending hubs: a Tweet by a follower, a link to the hub shared anywhere, a link to the hub from the next or previous hub in a group, or, in the above example, Google seeing the link to the hub on one's profile.

      In fact, removing Adsense would make the problem worse. In the above lens, I got social traffic, but not search traffic. So removing Adsense would simply cut off ad revenue, without preventing Google from seeing the Noindex tag.

      Besides, it's not just Google we have to care about. I ran two experiments on Squidoo comparing how quickly new content is found by search engines on different sites. Both new articles were crawled by Google within an hour and started getting search traffic within 3 hours. One of them started getting Bing traffic. I observed similar traffic patterns on Hubpages before Pending status prohibited new hubs from getting search traffic: sometimes the first traffic was from another search engine.

      Even if manually submitting hubs to Google worked to trigger a recrawl, that won't help us with other search engines put off by the noindex tag. Most of them recrawl far less frequently than Google. Sure, they provide less search traffic, but I see no point in introducing an arbitrary barrier to block search engines from indexing content.

      replyreport
    2. melbel profile image93
      melbelposted 12 years ago

      I get the idea behind the new change, but I'm not a fan with the way it works.

      It would be nice for it to work in this fashion (in my opinion):

      Allow indexing for brand new hubs, but if (and only if) it fails the requirements for indexing, then add the noindex tag.

      If the above doesn't work out for SEO, maybe don't make my new hub live UNTIL it's measured by the algorithm... then stamp it with noindex (if it fails) before going live, otherwise let Google index it.

      Otherwise, as is, I feel like I'm being punished for other users' mistakes.

      I used to have hubs indexed within a day of publishing and now I have a hub that's a week out without being indexed.

      replyreport
    3. paradigmsearch profile image60
      paradigmsearchposted 12 years ago

      Google suddenly seems to now hate one of my hubs that I was really counting on. I will give it a few days before becoming highly perturbed.

      replyreport
      1. davenmidtown profile image70
        davenmidtownposted 12 years agoin reply to this

        This is EFFING crazy!!!!! My hubs used to be indexed within hours... HOURs... now if I don't check they could just sit there for ever. I am seriously thinking about pulling my work off of here.... Not one peep from HP?

        replyreport
    4. andyoz profile image87
      andyozposted 12 years ago

      Well the two Hubs that I published about three weeks ago are still not indexed.  So today I deleted one of them.  I have a copy in word so in a weeks time I am go to republish it with a slightly different title.  See what happens then.

      replyreport
    jump to first post
     
    working

    This website uses cookies

    As a user in the EEA, your approval is needed on a few things. To provide a better website experience, hubpages.com uses cookies (and other similar technologies) and may collect, process, and share personal data. Please choose which areas of our service you consent to our doing so.

     Necessary
     Features
     Marketing
     Statistics

    For more information on managing or withdrawing consents and how we handle data, visit our Privacy Policy at: https://corp.maven.io/privacy-policy

    Show Details
    Necessary
    HubPages Device IDThis is used to identify particular browsers or devices when the access the service, and is used for security reasons.
    LoginThis is necessary to sign in to the HubPages Service.
    Google RecaptchaThis is used to prevent bots and spam. (Privacy Policy)
    AkismetThis is used to detect comment spam. (Privacy Policy)
    HubPages Google AnalyticsThis is used to provide data on traffic to our website, all personally identifyable data is anonymized. (Privacy Policy)
    HubPages Traffic PixelThis is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.
    Amazon Web ServicesThis is a cloud services platform that we used to host our service. (Privacy Policy)
    CloudflareThis is a cloud CDN service that we use to efficiently deliver files required for our service to operate such as javascript, cascading style sheets, images, and videos. (Privacy Policy)
    Google Hosted LibrariesJavascript software libraries such as jQuery are loaded at endpoints on the googleapis.com or gstatic.com domains, for performance and efficiency reasons. (Privacy Policy)
    Features
    Google Custom SearchThis is feature allows you to search the site. (Privacy Policy)
    Google MapsSome articles have Google Maps embedded in them. (Privacy Policy)
    Google ChartsThis is used to display charts and graphs on articles and the author center. (Privacy Policy)
    Google AdSense Host APIThis service allows you to sign up for or associate a Google AdSense account with HubPages, so that you can earn money from ads on your articles. No data is shared unless you engage with this feature. (Privacy Policy)
    Google YouTubeSome articles have YouTube videos embedded in them. (Privacy Policy)
    VimeoSome articles have Vimeo videos embedded in them. (Privacy Policy)
    PaypalThis is used for a registered author who enrolls in the HubPages Earnings program and requests to be paid via PayPal. No data is shared with Paypal unless you engage with this feature. (Privacy Policy)
    Facebook LoginYou can use this to streamline signing up for, or signing in to your Hubpages account. No data is shared with Facebook unless you engage with this feature. (Privacy Policy)
    MavenThis supports the Maven widget and search functionality. (Privacy Policy)
    Marketing
    Google AdSenseThis is an ad network. (Privacy Policy)
    Google DoubleClickGoogle provides ad serving technology and runs an ad network. (Privacy Policy)
    Index ExchangeThis is an ad network. (Privacy Policy)
    SovrnThis is an ad network. (Privacy Policy)
    Facebook AdsThis is an ad network. (Privacy Policy)
    Amazon Unified Ad MarketplaceThis is an ad network. (Privacy Policy)
    AppNexusThis is an ad network. (Privacy Policy)
    OpenxThis is an ad network. (Privacy Policy)
    Rubicon ProjectThis is an ad network. (Privacy Policy)
    TripleLiftThis is an ad network. (Privacy Policy)
    Say MediaWe partner with Say Media to deliver ad campaigns on our sites. (Privacy Policy)
    Remarketing PixelsWe may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.
    Conversion Tracking PixelsWe may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.
    Statistics
    Author Google AnalyticsThis is used to provide traffic data and reports to the authors of articles on the HubPages Service. (Privacy Policy)
    ComscoreComScore is a media measurement and analytics company providing marketing data and analytics to enterprises, media and advertising agencies, and publishers. Non-consent will result in ComScore only processing obfuscated personal data. (Privacy Policy)
    Amazon Tracking PixelSome articles display amazon products as part of the Amazon Affiliate program, this pixel provides traffic statistics for those products (Privacy Policy)
    ClickscoThis is a data management platform studying reader behavior (Privacy Policy)