hi Just a quick question, just checking my Adsense, as you do, and see that on three of my hubs the google crawler is blocked because of robot.txt. What the hell is that and how do I fix it?
I don't actually know but I would speculate that google thinks your hubs have been copy/pasted from somewhere else or that you didn't write them by hand...you could try editing them and re-typing maybe? Sorry I'm just guessing here...
I just googled it and this page might help;
to fix this, go to the control panel(cpanel or whatever your hosting site gave you) of your hosted blog, and browse to /public_html/robots.txt using file manager.
Open the robots.txt and then enter these lines here in quote or copy it from the google adsense error page that you got :
Once you done adding these you can save the robots.txt and you'll find adsense bot crawling without any problem.
the robot.txt was added on your side. google does not have the ability to add this to your hubs.
Here's my response to the same question a few days ago...http://hubpages.com/forum/topic/33803#post750921
check the settings for the affected hubs. make sure you have the box checked for the question about " content meets the conditions of the google adsense policy"
not necessarily...google indexes hubs on their owns servers for retrieval and if somebody hit translate then a new"translated" copy with the .txt string is added so that every time a translate request is received, it will always translate from the original and not in series from translation 2 translation so that the meaning is not obscured over time.
robots.txt is used that way to keep the "translated" .doc from being indexed and other requests from grabbing it and so uses the original indexed one every time. otherwise it would look like gleep , glop and ascii code over time probably and look like wingdings hieroglyphic font eventually LOL !
the next time someone orders up your hub from googles search engine in original english, than the message will be gone.Your original copy is still in tact and indexed at googles server waiting for another query request.
in other words. it got translated. and will set itself straight next time someone clicks her on the serps. Google has a translate button on their home search page for ppl in other countries to read in their own language.
I know what the translate feature is. It has absolutely nothing to do with a robots.txt file.
Here, read this from Google
http://www.google.com/support/webmaster … wer=156449
There was a thread about this a few months back Cindy - it may provide you with a solution, quite a few hubbers added to it with what it means, how to work with it etc
by Quilligrapher 9 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
by cashmere 9 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach English and Multilevel marketing - the good the bad and ugly.This has happened since...
by Mike Bouska 9 years ago
When I logged into Adsense today, it gave me an Analytics diagnostic warning for hubpages, saying that they could not crawl because of a Robots.txt error.Anyone else getting this?
by Nathan Bernardo 9 months ago
Adsense sent me a message that says that my publisher ID is not in my Hubpages and HowTheyPlay ads.text files. My earnings are fine generally, not too concerned, just wanted to bring the issue to your attention.
by John Coviello 9 months ago
I just saw a message on Google AdSense this morning, and am wondering if HubPages is aware of this situation and if they are correcting it?ads.txt files doesn't contain your AdSense publisher IDPublisher ID missing from ads.txt filesSites with ads.txt...
by kimkay 14 months ago
I just received the below message from Adsense.Publisher ID missing from ads.txt filesYou need to add your publisher ID to the following ads.txt files: hubpages.com/ads.txtThis will prevent a potentially severe impact on your earnings. Copy and paste the following code snippet into...
Copyright © 2019 HubPages Inc. and respective owners. Other product and company names shown may be trademarks of their respective owners. HubPages® is a registered Service Mark of HubPages, Inc. HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.
|HubPages Device ID||This is used to identify particular browsers or devices when the access the service, and is used for security reasons.|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Traffic Pixel||This is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.|
|Remarketing Pixels||We may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.|
|Conversion Tracking Pixels||We may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.|