Why is one of my hub URL showing up as blocked due to robots.txt in Adsense report? Where do I find the robots.txt for a particular hub?
robots.txt would be at the root of the server directory.
If you would submit the information from your Adsense report to email@example.com they could probably answer how this could occur.
Put it into Edit and look in the right hand column - click on setting and have a look.. it's a mini C-panel..
If you can't fix it from there.. then it will need to be done from the maxi C-panel...
- I thought that you could attack that problem via the settings on this c-panel... Sorry.. obviously not..
Then It Must be approached via the main C-panel (HQ) - where you may have to file this as a Bug Report.
Test the links on the URL manually.. where else have you posted this URL? Where have you tested it from... or is the link completely broken?
Can another party test this url link?
I have had a similar problem... But I unpublished the hub and then when republished it again it was ok! - That's where I was thinking...
I'm sure you would not be able to access HubPage's robot.txt file.
You could view it, but that would be the most you could do.
Here's another forum post from 15 months ago - http://hubpages.com/forum/topic/32255
It is mentioned that you may have a meta tag somewhere in the Hub and it needs to be removed.
thanks for the link. The discussion was really informative. The best options seems to waits for week. The blocked URL is as following.
http:/ / webcache. googleusercontent. com/ search? q= cache:XFZOuzyciGUJ:hubpages. com/ hub/ Problems-of-learning-English-as-a-foreign-or-second-language+difficulties+in+second+language+acquisition&cd= 6&hl= en&ct= clnk&gl= uk&source= www. google. co. uk
googleusercontent. com is owned by Google and webmasters have weird experience with webcache. googleusercontent. com as far as I have read on adsense forum.
No worries, it will resolve itself.
by Quilligrapher 9 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
by pinkytoky 7 years ago
When I do URL submissions, sometimes I get a message saying my robots.txt is blocking the robot crawlers. Also, it says my robots.txt file does not comply with the current “Robots Exclusion Standard” and this may cause problems for some search engines.Is there anything I can do about...
by Mike Bouska 9 years ago
When I logged into Adsense today, it gave me an Analytics diagnostic warning for hubpages, saying that they could not crawl because of a Robots.txt error.Anyone else getting this?
by Tammy 7 years ago
I tried to asked this question before, but it didn't show up. I logged into Google Webmaster Tools and it said restricted by robots.txt. What is that and how do I fix it? It looks something like this:Show URLs: Restricted by robots.txt (5) URL Detail Detected...
by cashmere 9 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach English and Multilevel marketing - the good the bad and ugly.This has happened since...
by Eileen Hughes 9 years ago
I posted this in a follow up in Maddies article on this. But didnt know if anyone would go there.I went into Diagnostic for first time and some of mine are blocked by the robot.txt fileGooggle adsense ?? says this:Robots.txt file: If you have a robots.txt file, the page requesting Google ads may be...
Copyright © 2019 HubPages Inc. and respective owners. Other product and company names shown may be trademarks of their respective owners. HubPages® is a registered Service Mark of HubPages, Inc. HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.
|HubPages Device ID||This is used to identify particular browsers or devices when the access the service, and is used for security reasons.|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Traffic Pixel||This is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.|
|Remarketing Pixels||We may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.|
|Conversion Tracking Pixels||We may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.|