The following message is showing in my google adsense under the section covering blocked url's, I don't understand what I need to do with the code provided- thanks
If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
If you are talking about HubPages, you do not have access to edit "robots.txt," which is placed in the root directory of hubpages.com. What you are reading is relevant for webmasters, not hubbers.
Thank You so much for the explanation Website Examiner. You are the Best!
by cashmere 9 years ago
In my site diagnostics in Google adsense these hubs of mine are being shown as blocked. Reason blocked is Robots.txt File.Can you tell me how I can unblock my following hubs?My favourite Tarot layouts,How to teach English and Multilevel marketing - the good the bad and ugly.This has happened since...
by Rochelle Frank 9 years ago
My two highest-traffic hubs are listed as "Blocked" on the AdSense Site Diagnostics. Reason: "Robots.txt File"It says that I can grant their crawler access to my pages by adding two lines of text to the top of my robots.txt file.User-agent: Mediapartners-GoogleDisallow:Do...
by Rachael Ryhn 3 years ago
Hi Hubbers,After hours of exhaustive searches through webpages and attempting the steps on various HubPage articles that say how to add a HubPages sitemap to no avail, I finally found a service that hosts sitemaps, automatically submits it to Google Webmaster Tools, and updates it regularly....
by ryankett 6 years ago
I only started using this site a week ago, and only had 11 bookmarks, yet they have emailed me to inform me that my account has been blocked - and with no other explanation! I am now awaiting a reply to my email asking why. I have read, and reread, their terms of service and I can see no breach...
by Carolyn Blacknall 9 years ago
I was looking at Google analytics and it said that one of my hubs (Disney-Snow-White-Birthday-Party-Ideas)is blocked from Google crawler because of a Robots.txt file.Their help file says:How can I make sure my robots.txt file grants access to your crawler? Simply add the following two lines of text...
by Suzanne Day 7 years ago
Hi,Everyone might be interested to know that as I was looking through my Adsense (new interface) today, I noticed that there was a crawler error with a Robots.txt file at Hubpages articles I've written. To see it, go to your new Adsense interface, Home/Account Settings/Crawler Access. I'm not sure...
Copyright © 2019 HubPages Inc. and respective owners. Other product and company names shown may be trademarks of their respective owners. HubPages® is a registered Service Mark of HubPages, Inc. HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.
|HubPages Device ID||This is used to identify particular browsers or devices when the access the service, and is used for security reasons.|
|Login||This is necessary to sign in to the HubPages Service.|
|HubPages Traffic Pixel||This is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.|
|Remarketing Pixels||We may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.|
|Conversion Tracking Pixels||We may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.|