This website uses cookies

As a user in the EEA, your approval is needed on a few things. To provide a better website experience, uses cookies (and other similar technologies) and may collect, process, and share personal data. Please choose which areas of our service you consent to our doing so.

For more information on managing or withdrawing consents and how we handle data, visit our Privacy Policy at: ""

Show Details
HubPages Device IDThis is used to identify particular browsers or devices when the access the service, and is used for security reasons.
LoginThis is necessary to sign in to the HubPages Service.
Google RecaptchaThis is used to prevent bots and spam. (Privacy Policy)
AkismetThis is used to detect comment spam. (Privacy Policy)
HubPages Google AnalyticsThis is used to provide data on traffic to our website, all personally identifyable data is anonymized. (Privacy Policy)
HubPages Traffic PixelThis is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.
Amazon Web ServicesThis is a cloud services platform that we used to host our service. (Privacy Policy)
CloudflareThis is a cloud CDN service that we use to efficiently deliver files required for our service to operate such as javascript, cascading style sheets, images, and videos. (Privacy Policy)
Google Hosted LibrariesJavascript software libraries such as jQuery are loaded at endpoints on the or domains, for performance and efficiency reasons. (Privacy Policy)
Google Custom SearchThis is feature allows you to search the site. (Privacy Policy)
Google MapsSome articles have Google Maps embedded in them. (Privacy Policy)
Google ChartsThis is used to display charts and graphs on articles and the author center. (Privacy Policy)
Google AdSense Host APIThis service allows you to sign up for or associate a Google AdSense account with HubPages, so that you can earn money from ads on your articles. No data is shared unless you engage with this feature. (Privacy Policy)
Google YouTubeSome articles have YouTube videos embedded in them. (Privacy Policy)
VimeoSome articles have Vimeo videos embedded in them. (Privacy Policy)
PaypalThis is used for a registered author who enrolls in the HubPages Earnings program and requests to be paid via PayPal. No data is shared with Paypal unless you engage with this feature. (Privacy Policy)
Facebook LoginYou can use this to streamline signing up for, or signing in to your Hubpages account. No data is shared with Facebook unless you engage with this feature. (Privacy Policy)
MavenThis supports the Maven widget and search functionality. (Privacy Policy)
Google AdSenseThis is an ad network. (Privacy Policy)
Google DoubleClickGoogle provides ad serving technology and runs an ad network. (Privacy Policy)
Index ExchangeThis is an ad network. (Privacy Policy)
SovrnThis is an ad network. (Privacy Policy)
Facebook AdsThis is an ad network. (Privacy Policy)
Amazon Unified Ad MarketplaceThis is an ad network. (Privacy Policy)
AppNexusThis is an ad network. (Privacy Policy)
OpenxThis is an ad network. (Privacy Policy)
Rubicon ProjectThis is an ad network. (Privacy Policy)
TripleLiftThis is an ad network. (Privacy Policy)
Say MediaWe partner with Say Media to deliver ad campaigns on our sites. (Privacy Policy)
Remarketing PixelsWe may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.
Conversion Tracking PixelsWe may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.
Author Google AnalyticsThis is used to provide traffic data and reports to the authors of articles on the HubPages Service. (Privacy Policy)
ComscoreComScore is a media measurement and analytics company providing marketing data and analytics to enterprises, media and advertising agencies, and publishers. Non-consent will result in ComScore only processing obfuscated personal data. (Privacy Policy)
Amazon Tracking PixelSome articles display amazon products as part of the Amazon Affiliate program, this pixel provides traffic statistics for those products (Privacy Policy)
jump to last post 1-4 of 4 discussions (7 posts)

Google's manual for its unseen humans who rate the web

  1. sabrebIade profile image63
    sabrebIadeposted 5 years ago

    I thought this was pretty interesting....
    "It's widely believed that Google search results are produced entirely by computer algorithms - in large part because Google would like this to be widely believed. But in fact a little-known group of home-worker humans plays a large part in the Google process. The way these raters go about their work has always been a mystery. Now, The Register has seen a copy of the guidelines Google issues to them." … rs_manual/

    1. Greekgeek profile image92
      Greekgeekposted 5 years agoin reply to this

      Hee. The Register just discovered something that many of us have known about for years. I think those guidelines have been leaking every few years since 2007, if not earlier.

      I posted a hub about Google's Quality Rater guideline in 2011, and the leaked 2012 guidelines are floating around the web as well.

      The thing that many people don't understand -- including, perhaps, the author of that article --  is that Google's human quality raters' ratings are NOT used by Google's algorithm. If a Google Rater rated my page as "Useful," for example, that rating would not be considered by or known to Google's online algorithm when someone types a search query. It would not change my site's position up or down in search results.

      Instead, Quality Rater data is used at the R&D stage. Google engineers are using the quality raters' data to help them develop a better algorithm. For example:

      "Our raters seem to agree that A, B and C are great websites, D, E and F, are okay, and X, Y and Z are bad. So, what factors make A, B, C good? What factors make X, Y, Z bad? How can we teach our computer to recognize those factors, for the purpose of making the algorithm's judgment match human tastes?"

      The reason I look at the raters' guidelines -- even if they're only used for in-house R&D -- is that they give me insight into what Google, at least, thinks readers are looking for, or shy away from. They base that on the data they've collected about user behavior. It's yet another piece of info to keep in mind when writing for a web audience.

  2. paradigmsearch profile image91
    paradigmsearchposted 5 years ago

    There just might be some gold nugget nuances in there... Like don't let any content go longer that 4 months without being updated...

    1. sabrebIade profile image63
      sabrebIadeposted 5 years agoin reply to this

      Yep...I noticed that

  3. WriteAngled profile image81
    WriteAngledposted 5 years ago

    This is really old news. The guide was first made public sometime last year.

    I used to answer questions on Google Answers many years ago, and was recruited from there onto the rating panel. At the time, it paid really well. I was in full-time employment so only rating for a couple of hours or so a day, but still cleared hundreds of dollars per month.

    I resigned when they stopped paying UK raters directly into our bank accounts and wanted us to go through an employment agency for manual labourers and blue-collar workers. Not only did I find this deeply insulting, but I also could not be bothered to go through all the bureaucracy involved to sign up with the agency especially since I was starting to expand my translation business, which eventually became my fulltime activity.

    1. sabrebIade profile image63
      sabrebIadeposted 5 years agoin reply to this

      You should have contacted the media then and scooped em!

  4. Rosie2010 profile image74
    Rosie2010posted 5 years ago

    Interesting read.  Thanks for the link, sabreblade.