My two highest-traffic hubs are listed as "Blocked" on the AdSense Site Diagnostics. Reason: "Robots.txt File"
It says that I can grant their crawler access to my pages by adding two lines of text to the top of my robots.txt file.
Do I need to do something here-- or is it something that HubPages handles?
I had this with three of my hubs the other day. I have to say I didn't have a clue what they were on about, so I have simply ignored it and hoped Hubpages would be the ones to act on it. I haven't checked it since to see if has gone away yet.
Might also be worth posting this in the "Report a Problem" forum too Rochelle.
Ok-- thanks Misty. I'll check it later. and see if anything changes. I mentioned it here because I didn't really know if it was a "problem".
And thanks, Haunty-- I thought that might be the case, but it was something I never looked at before. I probably shouldn't read thing I don't really understand.
most of the time when I see a block occurence in adsense (which I have no reason to pay attention to in regards to my hubpages) if you read the block url it will usually contain "google translate" meaning someone read your page in another language...and adsense only includes english language pages hence the block.
Its not a problem
by Brinafr3sh 5 years ago
Have any of your Hubs been blocked due to robots.txt file?Did you ever go to one of your Hubs url's and it said "robots.txt file," instead of it showing your hubsite?
by cashmere 8 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach English and Multilevel marketing - the good the bad and ugly.This has happened since...
by Shinkicker 6 years ago
Hi FolksI tried to post a picture from one of my Hubs.It was one taken by myself and attached to my Hub but Pinterest blocked it and said it was Spam.Has anyone else experienced this problem?CheersStevie
by Suzanne Day 7 years ago
Hi,Everyone might be interested to know that as I was looking through my Adsense (new interface) today, I noticed that there was a crawler error with a Robots.txt file at Hubpages articles I've written. To see it, go to your new Adsense interface, Home/Account Settings/Crawler Access. I'm not sure...
by Vibhavari 8 years ago
Hi I was checking my adsense account and in the reports section a number of my URLs appeared as blocked URL and the reason stated was the Robots.txt file. What is a Robots.txt file?Does a blocked URL mean that the clicks on ads on that page are not counted by google adsense? and in the help section...
by Quilligrapher 8 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
Copyright © 2018 HubPages Inc. and respective owners. Other product and company names shown may be trademarks of their respective owners. HubPages® is a registered Service Mark of HubPages, Inc. HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.
|HubPages Device ID||This is used to identify particular browsers or devices when the access the service, and is used for security reasons.|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Traffic Pixel||This is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.|
|Remarketing Pixels||We may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.|
|Conversion Tracking Pixels||We may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.|