In my adsense report it says that one of my hubs is blocked because there is a Robots.txt file on it.
The hub in question was written for a Hubmob topic. Its current score is 79. I obtained the information it contained from a number of sources and wrote it from scratch using my own words. It includes one Amazon capsule featuring two products, one video capsule, three picture capsule using public domain images and one links capsule containing a single link to a museum web site.
The hub has not been flagged in any way. Can someone explain what has happened?
This question comes up regularly. Here's a recent answer explaining.
Thank you, Maddie. So it seems I shouldn't worry
BTW, I did do a search for robots.txt on both forums and site to see if there was something already written about this issue, but didn't get any hits.
by Quilligrapher 8 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
by Brinafr3sh 5 years ago
Have any of your Hubs been blocked due to robots.txt file?Did you ever go to one of your Hubs url's and it said "robots.txt file," instead of it showing your hubsite?
by cashmere 8 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach English and Multilevel marketing - the good the bad and ugly.This has happened since...
by Eileen Hughes 8 years ago
I posted this in a follow up in Maddies article on this. But didnt know if anyone would go there.I went into Diagnostic for first time and some of mine are blocked by the robot.txt fileGooggle adsense ?? says this:Robots.txt file: If you have a robots.txt file, the page requesting Google ads may be...
by pinkytoky 6 years ago
When I do URL submissions, sometimes I get a message saying my robots.txt is blocking the robot crawlers. Also, it says my robots.txt file does not comply with the current “Robots Exclusion Standard” and this may cause problems for some search engines.Is there anything I can do about...
by Mike Bouska 8 years ago
When I logged into Adsense today, it gave me an Analytics diagnostic warning for hubpages, saying that they could not crawl because of a Robots.txt error.Anyone else getting this?
|HubPages Device ID|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Google Analytics|
|HubPages Traffic Pixel|
|Google Hosted Libraries|
|Google AdSense Host API|
|Conversion Tracking Pixels|
|Author Google Analytics|
|Amazon Tracking Pixel|