jump to last post 1-9 of 9 discussions (10 posts)

HubPages Blocked And Not Crawled By Adsense Crawlers?

  1. SunSeven profile image68
    SunSevenposted 10 years ago

    Hi Paul,

    When I checked my adsense account today I found HubPages articles and profile page in listed in the site diagnostics area. Is anyone else having this issue? How do I go about solving this problem?

    http://hubpages.com/hub/ says multiple errors as the reason blocked.

    http://hubpages.com/profile/SunSeven/map  says Robots.txt File as the reason blocked.

    1. jstankevicz profile image85
      jstankeviczposted 10 years agoin reply to this

      Yep. I strongly encourage you all to:

      1. Take a deep breath; this is a common thing amongst successful online writers, and is easy to deal with
      2. File a DMCA complaint (you can use the template we provide in our Learning Center or the template Melbel shared above, which is the same)

      I'm sorry this happened! Just keep in mind, this is a somewhat normal thing. No cause for alarm. Yes, it's frustrating, and it's a hassle to send over the email, but it's no cause for serious concern. smile

  2. paddy_avfc profile image59
    paddy_avfcposted 10 years ago

    I have just checked my account and the same message is appearing in my site diagnostics area.

  3. waynet profile image79
    waynetposted 10 years ago

    Yep the same for me, any help hub mods!!!??

  4. jstankevicz profile image85
    jstankeviczposted 10 years ago

    All gone, none blocked now. Yet another aspect of this online experience that I don't fully understand!

  5. pauldeeds profile image
    83
    pauldeedsposted 10 years ago

    We block certain urls from search engine web crawlers to prevent the same page from getting into the search index under two different urls (which can lower ranking in search results).

    However, there is no reason to block the adsense bot from any pages, since it is just crawling the page to determine what ads to run on it.  I've just made a change to allow that bot on any page.  It should have only been affecting pageviews that had query string parameters in the url (which is normally a very small minority of all pageviews), for instance something like this: "?utm_source=rss".

    Thanks for bringing that to our attention, SunSeven.

  6. SunSeven profile image68
    SunSevenposted 10 years ago

    Thank you for the reply Paul. But the issue still persists.

  7. pauldeeds profile image
    83
    pauldeedsposted 10 years ago

    Google caches the robots.txt file for a period, so it may take a day or two for it to clear up.

  8. SunSeven profile image68
    SunSevenposted 10 years ago

    Thanks a lot Paul. It is cleared now. Sometimes how Google works is beyond me. I have one doubt, though. The adsense ads seem to be away from the context. And CTR has gone down a bit. Perhaps I am seeing different ads. Can you have a look please?

  9. Prince Maak profile image71
    Prince Maakposted 10 years ago

    No, Everything is OK, I didn`t found any blocked page.

 
working