jump to last post 1-6 of 6 discussions (10 posts)

Why do so many of my hubs have blocked URLs?

  1. habee profile image90
    habeeposted 6 years ago

    What does this really mean? I've tried to email the HP team and the HP editor, but both emails have been returned as "undeliverable."

  2. Misha profile image74
    Mishaposted 6 years ago

    Blocked URLs? WTF?

  3. habee profile image90
    habeeposted 6 years ago

    Hi, Misha. Yep, that's what Google site diagnostics says. It says these hubs are blocked to crawlers.

    1. Misha profile image74
      Mishaposted 6 years ago in reply to this

      Hi Holle. OK, could you post an example of a blocked url?

    2. rebekahELLE profile image91
      rebekahELLEposted 6 years ago in reply to this

      does it give any errors they found?

  4. relache profile image85
    relacheposted 6 years ago

    Usually when someone posts and asks this, Paul Deeds shows up after a while and says HubPages doesn't block Google from crawling any Hubs that are published.  Or something to that effect.

    I've read back over a variety of threads on the same topic, and it would seem it is a strange, transient thing no one has ever truly resolved.

  5. MyWebs profile image84
    MyWebsposted 6 years ago

    'Blocked URL' - that sounds hubpages.com may have a messed up robots.txt possibly.

  6. livelonger profile image90
    livelongerposted 6 years ago

    From the FAQ:

    Why are my Hubs being blocked by AdSense because of the Robots.txt file?

    When you navigate to the Site Diagnostics section of your AdSense account, you might see some links to your Hubs embedded in links that are blocked due to the Robots.txt file. Please be aware that most of the time, these are not direct Hub links, but cached versions of your Hubs on sites like googleusercontent.com which block the AdSense crawler (which detects AdSense code even on cached pages) from spidering their cached versions of your Hubs. Since virtually none of your traffic comes from these pages, and since we have no control over other sites, there's nothing we can do, but, more importantly, there's nothing to worry about, either, since this doesn't affect traffic to your Hubs.

    1. habee profile image90
      habeeposted 6 years ago in reply to this

      Thanks mucho, LL! I'm a tech dummy. lol

      Thanks to everyone else who responded, also!

      1. livelonger profile image90
        livelongerposted 6 years ago in reply to this

        You're no dummy - it's complicated and confusing to a lot of people, hence the FAQ entry. smile

 
working