I have been checking my site diagnostics for AdSense and saw a robot.txt blocked URL message I just don't understand. What does this mean? The solution involves pasting something on page but i am afraid to mess up the page. Help!
There are three URL's for the same hub that the adsense crawler is unable to access.
This is the message for solving the problem:
If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.
EDIT: Not 3 URL's but the same one shown as blocked on 3 days. Does this explain the reduction in clicks for past couple of days?
if I'm right i beleive its within the meta tag which is there for hub staff only (admin ) to prevent what access a regular hubber has access to. I asked before if I could change the normal (Blu) text ads to another colr in the source code and I was given a resounding NO! I beleive only admin has access to certain criteria within the hub source through locked code. I may be wrong but either way I was given a resounding No! even analytics code was taken care of by admin rather than pasting in code directly ,by pasting to affiliates page. I thnk its to keep people with messing with a uniform look within hubpages overall. I beleive adsense code (outside of hubpages) on a personal website is the only way allowable to mess with code. Hope that helps !
if its only about checking stats then you can set up URL channels to monitor.. this does not involve pasting code to source, just pasting URL to specific channel you want monitored within adsense itself. Can be ( overall hub pages) or an individual URL if checking on only one individual hub. Not sure if I'm answering correctly so i'll let sopmeone else take the question if this is not what you're referring to.
I would post the blocked URL but dont want to run the risk of getting banned.
My concern is that this is now my highest traffic hub (the one on the internet hoax) and I may not be maximising earnings.
Weird URL. Not the simple URL of article but some long weird stuff.
by cashmere7 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach...
by SunSeven9 years ago
I am a little mixed up about this right now. Currently I have individual channels for each Hubs. Can use some help regarding the follows:How do I add a single adsense channel for all my hubs together?How do I add...
by snehamadhuri7 years ago
i have a blog from there i am copying content and pasting here , then in my account tab it is showing that it is a duplicate hub so is there any problem exists because of this duplicate hubs
by SunSeven9 years ago
Hi Paul,When I checked my adsense account today I found HubPages articles and profile page in listed in the site diagnostics area. Is anyone else having this issue? How do I go about solving this...
by Quilligrapher7 years ago
Google AdSense Site Diagnostics reports that a Robots.txt file is blocking their crawler from accessing one of my hubs. Can anyone suggest how I can resolve this issue?
by Mrvoodoo7 years ago
I just thought I'd share this, in case anybody else pastes into hubs directly from Google docs.Apart from the weird spacing thing that seems to be typical of pasting from many word processors, if you paste from Google...
Copyright © 2017 HubPages Inc. and respective owners.
Other product and company names shown may be trademarks of their respective owners.
HubPages® is a registered Service Mark of HubPages, Inc.
HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.