sort by best latest
Your question doesn't make sense. Robots txt is not added to urls, it's added to head sections in the html to stop crawlers accessing the page.
I think you are confused about something you've seen in analytics?
You can help the HubPages community highlight top quality content by ranking this answer up or down.
Hmmm... Hard to guess what happened from your question. Can you explain a bit ?
Copyright © 2016 HubPages Inc. and respective owners.
Other product and company names shown may be trademarks of their respective owners.
HubPages® is a registered Service Mark of HubPages, Inc.
HubPages and Hubbers (authors) may earn revenue on this page based on affiliate relationships and advertisements with partners including Amazon, Google, and others.