adsense block url

1. 80

   cindyvineposted 15 years ago

   hi Just a quick question, just checking my Adsense, as you do, and see that on three of my hubs the google crawler is blocked because of robot.txt.  What the hell is that and how do I fix it?
   Thanks,
   Cindy

   replyreport
2. 70

   Happyontheinsideposted 15 years ago

   I don't actually know but I would speculate that google thinks your hubs have been copy/pasted from somewhere else or that you didn't write them by hand...you could try editing them and re-typing maybe? Sorry I'm just guessing here...

   replyreport
3. 70

   Happyontheinsideposted 15 years ago

   I just googled it and this page might help;
   http://www.javascriptkit.com/howto/robots.shtml

   replyreport
4. 76

   skyfireposted 15 years ago

   to fix this, go to the control panel(cpanel or whatever your hosting site gave you) of your hosted blog, and browse to /public_html/robots.txt using file manager.
   
   Open the robots.txt and then enter these lines here in quote or copy it from the google adsense error page that you got :
   
   
   
   Once you done adding these you can save the robots.txt and you'll find adsense bot crawling without any problem.

   replyreport
5. 58

   Greg Cremiaposted 15 years ago

   the robot.txt was added on your side. google does not have the ability to add this to your hubs.

   replyreport
6. 60

   mel22posted 15 years ago

   Here's my response to the same question a few days ago...http://hubpages.com/forum/topic/33803#post750921

   replyreport
7. 58

   Greg Cremiaposted 15 years ago

   check the settings for the affected hubs. make sure you have the box checked for the question about " content meets the conditions of the google adsense policy"

   replyreport
8. 60

   mel22posted 15 years ago

   not necessarily...google indexes hubs on their owns servers for retrieval and if somebody hit translate then a new"translated" copy with the .txt string is added so that every time a translate request is received, it will always translate from the original and not in series from translation 2 translation so that the meaning is not obscured over time.
   
   robots.txt is  used that way to keep the "translated" .doc from being indexed and other requests from grabbing it and so uses the original indexed one every time. otherwise it would look like gleep , glop and ascii code over time probably and look like wingdings hieroglyphic font eventually LOL !
   
   the next time someone orders up your hub from  googles search engine in original english, than the message will be gone.Your original copy is still in tact and indexed at googles server waiting for another query request.

   replyreport
   1. 67

      1974posted 15 years agoin reply to this

      That makes no sense whatsoever.

      replyreport
      1. 60

         mel22posted 15 years agoin reply to this

         in other words. it got translated. and will set itself straight next time someone clicks her on the serps. Google has a translate button on their home search page for ppl in other countries to read in their own language.

         replyreport
         1. 67

            1974posted 15 years agoin reply to this

            I know what the translate feature is.  It has absolutely nothing to do with a robots.txt file.
            
            Here, read this from Google
            http://www.google.com/support/webmaster … wer=156449

            replyreport
9. 75

   frogdroppingposted 15 years ago

   There was a thread about this a few months back Cindy - it may provide you with a solution, quite a few hubbers added to it with what it means, how to work with it etc
   
   http://hubpages.com/forum/topic/26822

   replyreport