jump to last post 1-20 of 47 posts

Google Adsense blocked due to Robots.txt File

  1. cashmere profile image94
    cashmere
    690 posts
    Joined: 11 months ago
    Hubs: 72
    Followers: 419

    In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.
    Can you tell me how I can unblock my following hubs?

    My favourite Tarot layouts,
    How to teach English
    and
    Multilevel marketing - the good the bad and ugly.

    This has happened since Nov 5, but these hubs have been published months ago.
    What happened and how can I unblock them?

    Posted 2 months ago
  2. Pacal Votan
    748 posts
    Joined: 4 months ago
    Hubs: 0
    Followers: 94

    cashmere wrote:

    In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.
    Can you tell me how I can unblock my following hubs?

    My favourite Tarot layouts,
    How to teach English
    and
    Multilevel marketing - the good the bad and ugly.

    This has happened since Nov 5, but these hubs have been published months ago.
    What happened and how can I unblock them?

    Robots.txt is on hubpages server. It's where hubstaff specifies which pages search robots should not scan. For some reason they chose to hide these hubs of yours from search engines. You have no access to robots.txt so you can do nothing about it.

    Posted 2 months ago
  3. cashmere profile image94
    cashmere
    690 posts
    Joined: 11 months ago
    Hubs: 72
    Followers: 419

    Okay, but why would they suddenly choose to block my hubs now? Three months after publication?

    Posted 2 months ago
  4. Marisa Wright profile image97
    Marisa Wright
    3489 posts
    Joined: 2 years ago
    Hubs: 92
    Followers: 1135

    I never even looked at site diagnostics before!  I just checked and four of my Hubs show as blocked, too.

    The Help screen suggests checking again later, as it may just be that the server was down when they tried to crawl the site.  Let's hope that's the reason.

    Posted 2 months ago
  5. cashmere profile image94
    cashmere
    690 posts
    Joined: 11 months ago
    Hubs: 72
    Followers: 419

    One of my hubs has been tried twice and blocked at both crawls...now what?

    Posted 2 months ago
  6. Pacal Votan
    748 posts
    Joined: 4 months ago
    Hubs: 0
    Followers: 94

    cashmere wrote:

    One of my hubs has been tried twice and blocked at both crawls...now what?

    You posted this in the Report a problem... forum, so hp will answer at some point. Let's wait and see. smile

    Posted 2 months ago
  7. cashmere profile image94
    cashmere
    690 posts
    Joined: 11 months ago
    Hubs: 72
    Followers: 419

    No answer yet...

    Posted 2 months ago
  8. Len Cannon profile image97
    Len Cannon
    331 posts
    Joined: 15 months ago
    Hubs: 43
    Followers: 154

    Huh.  I looked too and most of my top performers are blocked were listed as blocked as well.  I wonder if that has anything to do with my ads suddenly a lot of five cent clicks when I was getting fifty cents or more before.

    Posted 2 months ago
  9. cashmere profile image94
    cashmere
    690 posts
    Joined: 11 months ago
    Hubs: 72
    Followers: 419

    I have not noticed any drop in the price per click...but I do need these hubs unblocked

    Posted 2 months ago
  10. Whitney05 profile image100
    Whitney05
    2298 posts
    Joined: 2 years ago
    Hubs: 678
    Followers: 1952

    How do you check to see if they're blocked?

    Posted 2 months ago
  11. frogdropping profile image100
    frogdropping
    2733 posts
    Joined: 8 months ago
    Hubs: 133
    Followers: 763

    Whitney - just go to your adsense account. Click on the 'site diagnostics' tab. Anything blocked will show up in there.

    I have four pages. None (that I'm aware of) go against the TOS so I too am unsure as to why.

    Posted 2 months ago
  12. Whitney05 profile image100
    Whitney05
    2298 posts
    Joined: 2 years ago
    Hubs: 678
    Followers: 1952

    Gotcha.. Thanks.

    Posted 2 months ago
  13. emievil profile image99
    emievil
    2226 posts
    Joined: 6 months ago
    Hubs: 90
    Followers: 462

    Just checked (thanks froggy for your reply to Whitney). Have seven of mine blocked due to the same reason. But my adsense earnings were still okay during the last crawl attempt.

    Posted 2 months ago
  14. Pacal Votan
    748 posts
    Joined: 4 months ago
    Hubs: 0
    Followers: 94

    We could probably figure out more if someone said which hub is blocked or by which line it is blocked. smile

    Posted 2 months ago
  15. pauldeeds profile image
     
    89
    pauldeeds
    1852 posts
    HubPages Staff
    Joined: 4 years ago
    Hubs: 1
    Followers: 387

    Our robots.txt doesn't block the Google AdSense bot from any page (it's separate from the crawler for search, although they probably do share data).  I suspect these occasional messages are simply errors, but it's hard to tell without seeing the entire blocked URL.

    http://hubpages.com/robots.txt wrote:


    ...
    # allow adsense bot everywhere
    User-agent: Mediapartners-Google
    Disallow:

    Posted 2 months ago
  16. frogdropping profile image100
    frogdropping
    2733 posts
    Joined: 8 months ago
    Hubs: 133
    Followers: 763

    Mine are - in no particular order -

    How To Wear White Jeans

    16 Weeks Pregnant

    Gifts For Teens - Boys

    Trumpett Socks

    You are welcome to the funky .txt if you want it smile

    Paul - thankyou.

    Posted 2 months ago
  17. frogdropping profile image100
    frogdropping
    2733 posts
    Joined: 8 months ago
    Hubs: 133
    Followers: 763

    http://hubpages.com/hub/My-very-First-Pet

    The above (as is) is at the top of the blocked list. I believe the hub is yours pacal?

    Posted 2 months ago
  18. ngureco profile image95
    ngureco
    462 posts
    Joined: 2 years ago
    Hubs: 157
    Followers: 393

    Mine that are listed as blocked are still displaying my adsense id so no need to worry for now.

    Posted 2 months ago
  19. emievil profile image99
    emievil
    2226 posts
    Joined: 6 months ago
    Hubs: 90
    Followers: 462

    frogdropping wrote:


    Mine are - in no particular order -

    How To Wear White Jeans

    16 Weeks Pregnant

    Gifts For Teens - Boys

    Trumpett Socks

    You are welcome to the funky .txt if you want it smile

    Paul - thankyou.

    Uhm, the URLs are a bit long. Will giving just the title (same as froggy) work as well?

    Posted 2 months ago
  20. Pacal Votan
    748 posts
    Joined: 4 months ago
    Hubs: 0
    Followers: 94

    frogdropping wrote:


    http://hubpages.com/hub/My-very-First-Pet

    The above (as is) is at the top of the blocked list. I believe the hub is yours pacal?

    lolol but it's not a commercial hub anyway.

    the only way it was blocked by robots.txt is if the url had been changes, for instance if the hub had been flagged, also I found no noindex attribute in the source

    and how the heck do you see my hub in your analytics?

    Posted 2 months ago
 
working