When I logged into Adsense today, it gave me an Analytics diagnostic warning for hubpages, saying that they could not crawl because of a Robots.txt error.
Anyone else getting this?
Cute photo! Do a search in the forums, there's been lots of threads about this. Sorry I can't be of more help.
this question pops up a lot.
i think it is just some strange glitch in certain servers sometimes and as long as you have relevant ads appearing on your hubs, it shouldn't be a problem.
i had one hub showing up and i thought 'why is it blocking this hub, there's nothing inappropriate there' then i noticed a couple of the amazon ads links were 'bad', as the products were no longer offered, so i fixed it and it no longer appears in my diagnostics.
i am not sure if that is what the problem was, or if there is even a problem at all - this is just what i observed.
Wait a minute I need help. How are you getting Analytics to work here anyway where did you put the html code? I couldn't figure out where hub pages would except it I use it on my other three blogs but not hubs please help!!
stick analytics code taht you normally put in footer in little box instead ua -XXXXXXXX
as for robot.txt block, pretty much meaningless ..most of thetime its google translator versions of your page...if you see it for a week, than look for a problem, otherwise nothings going on
I just read a google article about the robot.txt thing and FYI it probably won't be an issue moving forward, it was a way that sites told the google robot where it could and couldn't go within the site. It was meant as a way to keep from causing duplicate content problems and the bot finding multiple pages of the same text within the site. more detailed but that is a basic overview of wha I read from Google, as for the analytics issue if youhaven't figured it out the code goes in thesame areas where other affiliate code is and I have a hub about the useful features in analytics.
by cashmere7 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach...
by Quilligrapher7 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
by Tammy6 years ago
I tried to asked this question before, but it didn't show up. I logged into Google Webmaster Tools and it said restricted by robots.txt. What is that and how do I fix it? It looks something like this:Show URLs:...
by Cindy Vine7 years ago
hi Just a quick question, just checking my Adsense, as you do, and see that on three of my hubs the google crawler is blocked because of robot.txt. What the hell is that and how do I fix it?Thanks,Cindy
by Pandoras Box7 years ago
Why am I not getting this? What do I need to do?I click on content and see no place for adsense. No button in the left sidebar or anywhere else.Are my adsense and analytics not 'linked'? I mean they are, near as I can...
by pinkytoky6 years ago
When I do URL submissions, sometimes I get a message saying my robots.txt is blocking the robot crawlers. Also, it says my robots.txt file does not comply with the current “Robots Exclusion Standard” and this...
Copyright © 2017 HubPages Inc. and respective owners.
Other product and company names shown may be trademarks of their respective owners.
HubPages® is a registered Service Mark of HubPages, Inc.
HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.