Blocked by Robots
In Google Webmaster Tools, it says that 30 URLs Google could not access because they are blocked in your robots.txt file. Please let me know how to fix this problem.
by Rachael M Ryhn2 years ago
Hi Hubbers,After hours of exhaustive searches through webpages and attempting the steps on various HubPage articles that say how to add a HubPages sitemap to no avail, I finally found a service that hosts sitemaps,...
by Dr. John Anderson5 years ago
Elsewhere on the forums people are reporting very long delays in getting indexed by Google - the delays seem to be increasing. Obviously this has been caused by the NOINDEX tag added to new hubs when under review and to...
by Brinafr3sh5 years ago
Have any of your Hubs been blocked due to robots.txt file?Did you ever go to one of your Hubs url's and it said "robots.txt file," instead of it showing your hubsite?
by Rochelle Frank8 years ago
My two highest-traffic hubs are listed as "Blocked" on the AdSense Site Diagnostics. Reason: "Robots.txt File"It says that I can grant their crawler access to my pages by adding two lines of...
by Bill Manning7 years ago
I've been spending more time going over Google stuff and doing more things to help my sites after the big shake-up. One thing I just did was list one of my sites in Google webmaster tools.It takes a few days for them to...
by Vibhavari8 years ago
Hi I was checking my adsense account and in the reports section a number of my URLs appeared as blocked URL and the reason stated was the Robots.txt file. What is a Robots.txt file?Does a blocked URL mean that the...
Copyright © 2018 HubPages Inc. and respective owners.
Other product and company names shown may be trademarks of their respective owners.
HubPages® is a registered Service Mark of HubPages, Inc.