Find out how Google Search Quality Testers Rate Content

Jump to Last Post 1-4 of 4 discussions (9 posts)
  1. Paul Maplesden profile image68
    Paul Maplesdenposted 5 years ago

    You might not know, but alongside its normal crawling, indexing and automatic algortihms which rank search results and display pages based on user queries, Google also uses human search quality testers.

    These testers (of which there are thousands) will examine different types of search queries and webpages and assign different qualities to them.

    For those of you interested in SEO, it's definitely worth looking into, and Google have released their 'Search Quality Guidelines.'

    It's a fairly hefty document, but definitely worth your time; although human ratings don't impact search results directly, Google does use feedback from these raters to tweak their automatic ranking algorithms. Understanding what the human raters are looking for and creating hubs that meet those needs will almost certainly mean that the algorithms will look more favourably on your writing as well, driving more traffic to your hubs as a result.

    You can see the document here: … elines.pdf

    1. Gail Meyers profile image84
      Gail Meyersposted 5 years agoin reply to this

      I have also done this work.  There is a rather time consuming two-part test.  If you pass the first part, then you are invited to take the second part.  Test is based on properly applying the guidelines to various sample webpages.

  2. WriteAngled profile image80
    WriteAngledposted 5 years ago

    LOL! It must be a couple of years since that document was first leaked, so it amuses me that Google has now "released" for public consumption something that has been widely available for ages!

    I was recruited from Google Answers into doing this work quite a long time ago. It used to pay quite well; several hundred dollars a month for a couple of hours work most days. After a two or so years, I was glad to stop, when I found more profitable activities, as it is intensely boring work.

  3. Randy Godwin profile image92
    Randy Godwinposted 5 years ago

    I distrust any such information from the Big G simply because of their proclivity to be so wrong about which articles they place at the top of their search results.  I assume this is why HP is also choosing to dumb down their systems, simply to fall in lock-step with them.  This not bode well for the future of the internet as far as it being an educational tool of the future.

  4. Greekgeek profile image92
    Greekgeekposted 5 years ago

    Randy, that's the core document used by their own staff to test and refine Google's algorithm. It's not how the algorithm WORKS, but how they're trying to MAKE it work.

    It's the set of guidelines they use to come up with a dataset of, "here's what we think the algorithm should do with these sites," then it's the programmers' job to make the algorithm mimic the quality raters' judgment as closely as possible.

    So even if the algorithm doesn't always succeed, this is exactly what it's working towards. This is the holy grail answering "what, exactly, does Google want?" Forget pontificating by Matt Cutts or SMX interviews with Amit Singh -- this is it. It tends to make a heck of a lot more sense to me than the vague pronouncements and platitudes  we hear from Google spokespundits.

    I find it interesting that they've finally released these guidelines to the public voluntarily. I got in a certain amount of trouble for helping leak the 2011 guidelines, the first that had been seen for several years, which a Google Quality Rater had left lying around on Amazon's cloud in a public folder. Until now, Google has never released them and quickly taken steps (as it did then) to get them taken down when anyone posted them on the web. (After they were taken down, I created a hub summarizing the essentials -- bad GG.)

    It was kind of silly, since it doesn't actually give away how the algorithm works, just what it's aiming for. i'm glad they've finally dispensed with treating it as top secret and released it for people to pore over. It is, after all, basically a manifesto on the subject of quality content.

    1. Randy Godwin profile image92
      Randy Godwinposted 5 years agoin reply to this

      I get that, Greekgeek.  The problem I see is they are pitting good content against results which now make them money despite the lack of quality--the real definition of the word, not HP's--of the top articles.  It's now simply money versus quality as I see it.  As Paul pointed out, the human rater's assessments do not impact search results directly.  And of course, we have no way of knowing what qualities those human raters favor or disfavor in the top results.  They be no better than those here who have no idea what the term "quality" means.

      Still, not very encouraging.

      1. Will Apse profile image88
        Will Apseposted 5 years agoin reply to this

        'And of course, we have no way of knowing what qualities those human raters favor or disfavor in the top results.'

        The guidelines make it clear what they are looking for.  For the most part it is, the degree of relevance of the page to the search query that matters. The highest rating should go to comprehensive, up-to-date and engaging coverage of a topic from an authoritative site, according to the doc.

        With affiliate pages they expect the writer to have worked hard to come up with info that is relevant for a potential buyer but not otherwise easily available.

        It does not give much scope for conspiracy theorists.

        1. wilderness profile image97
          wildernessposted 5 years agoin reply to this

          I didn't catch anything about being up to date, except a brief comment concerning current events.  Was there more?

          I don't think Randy meant google's work, though - just HP's, and those guidelines are freely available as well as being posted in a more general manner in several locations in the forums by an MTurker.

        2. Randy Godwin profile image92
          Randy Godwinposted 5 years agoin reply to this

          I mentioned nothing at all about "conspiracy theories," Will.  Besides, it takes 3 entities for it to qualify as a conspiracy theory.  Try and remember this next time.  roll  My point was that HP is endeavoring to guess what Google wants, with Google not knowing themselves how to get it.  What Google says they want is not necessarily what they seem to get.  But then, they to may have their own form of HubSpeak also.


This website uses cookies

As a user in the EEA, your approval is needed on a few things. To provide a better website experience, uses cookies (and other similar technologies) and may collect, process, and share personal data. Please choose which areas of our service you consent to our doing so.

For more information on managing or withdrawing consents and how we handle data, visit our Privacy Policy at:

Show Details
HubPages Device IDThis is used to identify particular browsers or devices when the access the service, and is used for security reasons.
LoginThis is necessary to sign in to the HubPages Service.
Google RecaptchaThis is used to prevent bots and spam. (Privacy Policy)
AkismetThis is used to detect comment spam. (Privacy Policy)
HubPages Google AnalyticsThis is used to provide data on traffic to our website, all personally identifyable data is anonymized. (Privacy Policy)
HubPages Traffic PixelThis is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.
Amazon Web ServicesThis is a cloud services platform that we used to host our service. (Privacy Policy)
CloudflareThis is a cloud CDN service that we use to efficiently deliver files required for our service to operate such as javascript, cascading style sheets, images, and videos. (Privacy Policy)
Google Hosted LibrariesJavascript software libraries such as jQuery are loaded at endpoints on the or domains, for performance and efficiency reasons. (Privacy Policy)
Google Custom SearchThis is feature allows you to search the site. (Privacy Policy)
Google MapsSome articles have Google Maps embedded in them. (Privacy Policy)
Google ChartsThis is used to display charts and graphs on articles and the author center. (Privacy Policy)
Google AdSense Host APIThis service allows you to sign up for or associate a Google AdSense account with HubPages, so that you can earn money from ads on your articles. No data is shared unless you engage with this feature. (Privacy Policy)
Google YouTubeSome articles have YouTube videos embedded in them. (Privacy Policy)
VimeoSome articles have Vimeo videos embedded in them. (Privacy Policy)
PaypalThis is used for a registered author who enrolls in the HubPages Earnings program and requests to be paid via PayPal. No data is shared with Paypal unless you engage with this feature. (Privacy Policy)
Facebook LoginYou can use this to streamline signing up for, or signing in to your Hubpages account. No data is shared with Facebook unless you engage with this feature. (Privacy Policy)
MavenThis supports the Maven widget and search functionality. (Privacy Policy)
Google AdSenseThis is an ad network. (Privacy Policy)
Google DoubleClickGoogle provides ad serving technology and runs an ad network. (Privacy Policy)
Index ExchangeThis is an ad network. (Privacy Policy)
SovrnThis is an ad network. (Privacy Policy)
Facebook AdsThis is an ad network. (Privacy Policy)
Amazon Unified Ad MarketplaceThis is an ad network. (Privacy Policy)
AppNexusThis is an ad network. (Privacy Policy)
OpenxThis is an ad network. (Privacy Policy)
Rubicon ProjectThis is an ad network. (Privacy Policy)
TripleLiftThis is an ad network. (Privacy Policy)
Say MediaWe partner with Say Media to deliver ad campaigns on our sites. (Privacy Policy)
Remarketing PixelsWe may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.
Conversion Tracking PixelsWe may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.
Author Google AnalyticsThis is used to provide traffic data and reports to the authors of articles on the HubPages Service. (Privacy Policy)
ComscoreComScore is a media measurement and analytics company providing marketing data and analytics to enterprises, media and advertising agencies, and publishers. Non-consent will result in ComScore only processing obfuscated personal data. (Privacy Policy)
Amazon Tracking PixelSome articles display amazon products as part of the Amazon Affiliate program, this pixel provides traffic statistics for those products (Privacy Policy)