Robots.txt file - Hub URL blocked from Google crawler

  1. Carol the Writer profile image75
    Carol the Writerposted 7 years ago

    I was looking at Google analytics and it said that one of my hubs (Disney-Snow-White-Birthday-Party-Ideas)is blocked from Google crawler because of a Robots.txt file.

    Their help file says:
    How can I make sure my robots.txt file grants access to your crawler? Simply add the following two lines of text to the top of your robots.txt file:

    User-agent: Mediapartners-Google
    Disallow:

    This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.

    Will someone at hubpages do that? Thanks.

    replyreport
  2. sunforged profile image68
    sunforgedposted 7 years ago

    This was brought up last week or so:

    http://hubpages.com/forum/topic/26822


    replyreport
  3. Carol the Writer profile image75
    Carol the Writerposted 7 years ago

    Thanks sunforged.

    replyreport
 
working