Robot.txt disallows the following for every topic:
I don't believe that actually stops anything. I believe what is really intended is:
We disallow /search/. That's good. What about /tag/?
I believe I made an error there. You may be trying to exclude one of two things, but neither one works. The following would each work.
In the forums, they are called category rather than topics:
My correction outside the forums inadvertently ommitted the s from topics:
by Tina4 years ago
hello everyone, I am back. After plunging I have taken some time off for other pursuits. I have been exploring webmaster tools a bit to see what the problem is with my traffic flow. I see that many of my...
by Michael Willis5 years ago
It there a way we can allow comments and at the same time "Disallow" the hyperlink? Especially for the non-members of Hubpages.Sometimes the comments are OK to allow, but I may not want the link on my...
by Gail Meyers3 years ago
This was my site map uploaded into my Webmaster Tools. At roughly the same time I noticed NONE of my hubs were any longer indexed. The site map is generated by HubPages and was found previously found...
by Carolee Samuda3 years ago
One of the first things I thought HP would do during the feature changes especially when it came to linking was to disallow other hubbers to leave links in comments.While the more experienced hubber will know how to...
by Roohi Khan4 years ago
Can someone tell me what is a robots.txt file is?
Copyright © 2016 HubPages Inc. and respective owners.
Other product and company names shown may be trademarks of their respective owners.
HubPages® is a registered Service Mark of HubPages, Inc.