Can you give me an idea of what this means. It is what I found in my webmaster tools robots.txt file for my domain on hubpages.
If the file is supposed to tell the search engines not to crawl certain pages, wouldn't the information in this file mean that the search engines should not be crawling any of the below given hub sections?
Sitemap: http://roohikhan.hubpages.com/sitemaps/ … han.xml.gz
# Google was crawling our custom analytics URLs, so tell them not to
I don't think so. I wouldn't worry until I find a line that says "Disallow: /hub/*" Why do you ask?
by Simone Haruko Smith4 years ago
A couple weeks back, a friend of mine got a $500 ticket for a driving violation I had never even heard of. Granted, I’m not a very frequent driver, but I doubt that all of us know every driving rule out there. Are...
by Gail Meyers4 years ago
This was my site map uploaded into my Webmaster Tools. At roughly the same time I noticed NONE of my hubs were any longer indexed. The site map is generated by HubPages and was found previously found...
by Kristen Howe22 months ago
Yesterday I updated it by adding a new poll. It has two ad capsules and nothing spammy about it. What gives?
by Wendy Iturrizaga6 years ago
Hello, HubMobsters, welcome to a new month and a new exiting HubMob weekly topic. This time after a difficult Diabetes Awareness week we are going to jump to lighter topics and we are going to be writing...
by Wendy Iturrizaga7 years ago
Hello Hubbers, I want to thank all of you who took part in last week’s Mexican HubMob, we had a colourful week with hubs ranging from recipes to historic accounts. Thank you one more week for making the weekly...
by Faye Constantino7 years ago
My hub is probably nothing you haven't heard of, but these numbers fell into my hands today. Help me get this message out. I hope you will see this and read. I have waited and no one is up who knows me now. I must...
Copyright © 2017 HubPages Inc. and respective owners.
Other product and company names shown may be trademarks of their respective owners.
HubPages® is a registered Service Mark of HubPages, Inc.