I was looking at Google analytics and it said that one of my hubs (Disney-Snow-White-Birthday-Party-Ideas)is blocked from Google crawler because of a Robots.txt file.
Their help file says:
How can I make sure my robots.txt file grants access to your crawler? Simply add the following two lines of text to the top of your robots.txt file:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.
Will someone at hubpages do that? Thanks.
This was brought up last week or so:
by cashmere 8 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach English and Multilevel marketing - the good the bad and ugly.This has happened since...
by Brinafr3sh 5 years ago
Have any of your Hubs been blocked due to robots.txt file?Did you ever go to one of your Hubs url's and it said "robots.txt file," instead of it showing your hubsite?
by Quilligrapher 8 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
by Vibhavari 8 years ago
Hi I was checking my adsense account and in the reports section a number of my URLs appeared as blocked URL and the reason stated was the Robots.txt file. What is a Robots.txt file?Does a blocked URL mean that the clicks on ads on that page are not counted by google adsense? and in the help section...
by Mike Bouska 8 years ago
When I logged into Adsense today, it gave me an Analytics diagnostic warning for hubpages, saying that they could not crawl because of a Robots.txt error.Anyone else getting this?
by pinkytoky 6 years ago
When I do URL submissions, sometimes I get a message saying my robots.txt is blocking the robot crawlers. Also, it says my robots.txt file does not comply with the current “Robots Exclusion Standard” and this may cause problems for some search engines.Is there anything I can do about...
|HubPages Device ID|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Google Analytics|
|HubPages Traffic Pixel|
|Google Hosted Libraries|
|Google AdSense Host API|
|Conversion Tracking Pixels|
|Author Google Analytics|
|Amazon Tracking Pixel|