In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.
Can you tell me how I can unblock my following hubs?
My favourite Tarot layouts,
How to teach English
and
Multilevel marketing - the good the bad and ugly.
This has happened since Nov 5, but these hubs have been published months ago.
What happened and how can I unblock them?
cashmere wrote:
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.
Can you tell me how I can unblock my following hubs?
My favourite Tarot layouts,
How to teach English
and
Multilevel marketing - the good the bad and ugly.
This has happened since Nov 5, but these hubs have been published months ago.
What happened and how can I unblock them?
Robots.txt is on hubpages server. It's where hubstaff specifies which pages search robots should not scan. For some reason they chose to hide these hubs of yours from search engines. You have no access to robots.txt so you can do nothing about it.
Okay, but why would they suddenly choose to block my hubs now? Three months after publication?
I never even looked at site diagnostics before! I just checked and four of my Hubs show as blocked, too.
The Help screen suggests checking again later, as it may just be that the server was down when they tried to crawl the site. Let's hope that's the reason.
One of my hubs has been tried twice and blocked at both crawls...now what?
cashmere wrote:
One of my hubs has been tried twice and blocked at both crawls...now what?
You posted this in the Report a problem... forum, so hp will answer at some point. Let's wait and see. ![]()
No answer yet...
Huh. I looked too and most of my top performers are blocked were listed as blocked as well. I wonder if that has anything to do with my ads suddenly a lot of five cent clicks when I was getting fifty cents or more before.
I have not noticed any drop in the price per click...but I do need these hubs unblocked
How do you check to see if they're blocked?
Whitney - just go to your adsense account. Click on the 'site diagnostics' tab. Anything blocked will show up in there.
I have four pages. None (that I'm aware of) go against the TOS so I too am unsure as to why.
Gotcha.. Thanks.
Just checked (thanks froggy for your reply to Whitney). Have seven of mine blocked due to the same reason. But my adsense earnings were still okay during the last crawl attempt.
We could probably figure out more if someone said which hub is blocked or by which line it is blocked. ![]()
Our robots.txt doesn't block the Google AdSense bot from any page (it's separate from the crawler for search, although they probably do share data). I suspect these occasional messages are simply errors, but it's hard to tell without seeing the entire blocked URL.
http://hubpages.com/robots.txt wrote:
...
# allow adsense bot everywhere
User-agent: Mediapartners-Google
Disallow:
Mine are - in no particular order -
How To Wear White Jeans
16 Weeks Pregnant
Gifts For Teens - Boys
Trumpett Socks
You are welcome to the funky .txt if you want it
Paul - thankyou.
http://hubpages.com/hub/My-very-First-Pet
The above (as is) is at the top of the blocked list. I believe the hub is yours pacal?
Mine that are listed as blocked are still displaying my adsense id so no need to worry for now.
frogdropping wrote:
Mine are - in no particular order -
How To Wear White Jeans
16 Weeks Pregnant
Gifts For Teens - Boys
Trumpett Socks
You are welcome to the funky .txt if you want it![]()
Paul - thankyou.
Uhm, the URLs are a bit long. Will giving just the title (same as froggy) work as well?
frogdropping wrote:
http://hubpages.com/hub/My-very-First-Pet
The above (as is) is at the top of the blocked list. I believe the hub is yours pacal?
lolol but it's not a commercial hub anyway.
the only way it was blocked by robots.txt is if the url had been changes, for instance if the hub had been flagged, also I found no noindex attribute in the source
and how the heck do you see my hub in your analytics?

working