ArtsAutosBooksBusinessEducationEntertainmentFamilyFashionFoodGamesGenderHealthHolidaysHomeHubPagesPersonal FinancePetsPoliticsReligionSportsTechnologyTravel

Web Search Evaluator - Appen Butler Hill - India: Details And Review

Updated on June 30, 2014
Work With Appen From Home And Make Money Online
Work With Appen From Home And Make Money Online | Source

A Web Search Evaluator Is Also Known As:

  • Search engine evaluator
  • Ads quality rater
  • Internet assessor
  • Search engine judges

Is Appen A Legit Company?

This is what their official website says:

Appen is an award-winning organization. Our people help leading technology companies expand into new global markets. With capability in over 140 languages, Appen’s global network of specialists and in-country virtual teams work together to ensure new products and technologies operate in all the languages our clients need.

Appen offers work from home opportunities for exciting, flexible, short-term projects as well as full-time corporate opportunities. We are proud to have been named in Forbes Magazine as one of the Top 100 Companies Offering Flexible Jobs in 2014.

Appen was founded by Julie Vonwiller, in 1996. In 2010, Appen merged with the Butler Hill Group. After the merger, Appen became Appen Butler Hill, and we expanded our business scope to include language resources, search, and text. Our client base has grown to include global technology leaders, including Microsoft, SAP, Raytheon and Oracle. Additionally, we work with leading government agencies in the United States and United Kingdom.

So yes, Appen is a legit, well-known and prestigious organization. Online research tells me that Appen has been providing opportunities for people interested to work from home and earn money. It's an ideal source of income for students, stay-at-home moms or retired professionals. Don't worry about payments, you'll be paid monthly without fail. Appen is a trusted name and they have employees all over the world working as Web Search Evaluators.

What Google Says About Search Evaluation?

  • Search evaluation is the process of measuring the quality of our search results and our users' experience with search.
  • We're serious about search evaluation because we are serious about giving you the highest quality search experience possible.

More on Search Engine Evaluation from Google

What Is A Web Search Evaluator?

Search engine evaluators give feedback to ensure that Internet search results are comprehensive, accurate and timely and are spam-free and relevant to the searcher's intent. In essence, they are the human check on the complicated algorithms that search engines run.

To do this, the search engine evaluator must be familiar with the language and the culture of the local search engine user. In India, if you want to work as a Web Search Evaluator, you must be fluent in English - read and write fluency.

This book introduces you to the core topics underlying modern search technologies, algorithms, data structures, indexing, retrieval, and evaluation

Oprah Winfrey of the famous talk show, "The Oprah Winfrey Show"
Oprah Winfrey of the famous talk show, "The Oprah Winfrey Show" | Source

Web Search Evaluation Made Easy

With the help of human search engine evaluators, search engines ensure that when you type search words into the search bar, you find what you are looking for. For example, if you were doing a search on “Oprah Winfrey,” her official website would show up either at the top or near the top of the results. That’s because that’s probably the most relevant result for your search on Oprah. Other sites, like her You Tube videos, Twitter account, or a Wikipedia link would also be relevant, but not as relevant as the official site. If you find search results on Elle De Generes,that would be irrelevant.


  • $4.50 per hour for Indians. This means you can expect to earn somewhere between 20,000 - 30,000 INR a month.
  • You will be hired as a contractor for Appen so you'll need to bear the tax responsibilities.
  • You'll be paid once a month via paper check or direct bank transfer.

Requirements To Become A Web Search Evaluator

  • Fluency in written and verbal English.
  • A passionate and avid interest in working with the Internet.
  • Experience with Web browsers in navigating a variety of content.
  • A broad interest and current knowledge of web-based culture, media, sports, news, and business.
  • The flexibility and patience to learn in an environment of changing standards and tasks.
  • The willingness to seek guidance and coaching when uncertain.
  • Ability to follow instructions without allowing personal experience or sentiment to cloud judgment.
  • Strong attention to detail and ability to focus and maintain accuracy in a time-sensitive environment.
  • The ability to work independently with effective time management skills.
  • Excellent research skills, critical thinking and decision making skills.
  • Excellent troubleshooting, communication and problem-solving skills.
  • Basic aptitude for solving technical/software issues independently.
  • Personal Windows Computer or laptop that runs Windows 7 or above.
  • Access to a reliable high-speed internet connection.
  • Basic aptitude for installing applications, and troubleshooting and addressing software issues with limited support.
  • Any anti-virus software installed on the PC or laptop.
  • Knowledgeable user of MS Office suite.
  • 9 years of residence in India.
  • Before you take up your first assignment with Appen, you'll need to pass their online test. More on that in the next section.

Apply on Appen's official site
Apply on Appen's official site | Source

Web Search Evaluators Schedule:

  • 4-5 hours a day Monday through Friday (with the flexibility to choose when you work each day)
  • 20-22 hours per week

Appen's Online Test

  • It's a 3 part test which aims to gauge your search/analytical skills, English proficiency and technical skills.
  • There's no time limit set to complete this one. You can finish it in your own time.
  • To qualify, make sure you read their instructions thoroughly, especially for the first section, which is about search analysis, before you attempt taking the test.
  • I suggest you keep in the instructions somewhere to refer back and forth. Because the questions in the first section will be based on the instructions.
  • The English and the technical sections are easy and should not take much of your time, if you have intermediate proficiency in speaking the language and if you know how to use a computer and the Microsoft suite.
  • For the technical section, you can also refer to the internet, if you don't know any answer.
  • Do not try to finish the test as early as possible. This will increase your chances of making an error. Remember, there's no timer ticking.
  • If you are not sure of any answer, you can go back and check or edit it before you press Submit.
  • Once you press submit, you'll not be allowed to make any edits.
  • If you qualify, you'll be mailed within 30 days.
  • If you don't hear from them, re-apply.

After You Pass The Online Test:

  • You'll be contacted via phone or Skype.
  • You will need to complete a qualification process of 5-30 hours over a 1-3 week period.
  • You''ll need to pass another round of test after your training.
  • And that's it!
  • You''ll start work with Appen as a contractor.

The Good, The Bad And The Ugly Of Life At Appen

The Good:

  • Home-based opportunity
  • Non-telephonic work
  • You can choose your work hours
  • Timely pay
  • Hourly pay as compared to daily pay
  • Fixed source of income
  • It helps you experience and learn search evaluation
  • Timely help from colleagues and mentors

The Bad and The Ugly:

  • Pay for Indian employees is less as compared to Appen employees in the U.S..Our American counterparts are paid $13-$15 per hour.
  • Pay is less compared to other companies like Lionbridge, where the hourly pay is $6.50
  • Stringent quality checks
  • You need to meet deadlines every day
  • Monotonous work
  • Stressful
  • Training period which is between 1-3 weeks may not be paid for Indian employees
  • No job security - they can let you go at any time, if they're not happy with your performance

Salary range of Appen employees in India
Salary range of Appen employees in India | Source

Similar Opportunities


This company takes Internet Assessors (another name for Web Search Evaluators) from time to time. Keep an eye on popular job sites in India, where they advertise for this role. You can also visit their official site to apply.

Forbes 2014 ranked Lionbridge as one of America's most trustworthy companies.

Apply to Lionbridge


  • Google doesn't recruit Ads Quality Raters from India. It's a U.S. based position.
  • Leapforce doesn't have home based opportunities for Indians in English or in any other Indian language.
  • ZeroChaos, Inc., formerly WorkforceLogic doesn't offer home based opportunities for Indians. You can apply if you're based in the U.S.

Appen Hiring 2000 People In The U.S. To Work From Home


Tell Me

How was your experience with Appen Butler Hill in India?

See results

© 2014 Chitrangada Mukherjee

Share Your Experience - Leave Your Comment

    0 of 8192 characters used
    Post Comment
    • Happymommy2520 profile image


      13 months ago from East Coast

      I took the test for Appen and didn't pay much attention to the first set of instructions. Not so sure on how I did! I think it's easier to get a part time job outside of the home, less stressful.


    This website uses cookies

    As a user in the EEA, your approval is needed on a few things. To provide a better website experience, uses cookies (and other similar technologies) and may collect, process, and share personal data. Please choose which areas of our service you consent to our doing so.

    For more information on managing or withdrawing consents and how we handle data, visit our Privacy Policy at:

    Show Details
    HubPages Device IDThis is used to identify particular browsers or devices when the access the service, and is used for security reasons.
    LoginThis is necessary to sign in to the HubPages Service.
    Google RecaptchaThis is used to prevent bots and spam. (Privacy Policy)
    AkismetThis is used to detect comment spam. (Privacy Policy)
    HubPages Google AnalyticsThis is used to provide data on traffic to our website, all personally identifyable data is anonymized. (Privacy Policy)
    HubPages Traffic PixelThis is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.
    Amazon Web ServicesThis is a cloud services platform that we used to host our service. (Privacy Policy)
    CloudflareThis is a cloud CDN service that we use to efficiently deliver files required for our service to operate such as javascript, cascading style sheets, images, and videos. (Privacy Policy)
    Google Hosted LibrariesJavascript software libraries such as jQuery are loaded at endpoints on the or domains, for performance and efficiency reasons. (Privacy Policy)
    Google Custom SearchThis is feature allows you to search the site. (Privacy Policy)
    Google MapsSome articles have Google Maps embedded in them. (Privacy Policy)
    Google ChartsThis is used to display charts and graphs on articles and the author center. (Privacy Policy)
    Google AdSense Host APIThis service allows you to sign up for or associate a Google AdSense account with HubPages, so that you can earn money from ads on your articles. No data is shared unless you engage with this feature. (Privacy Policy)
    Google YouTubeSome articles have YouTube videos embedded in them. (Privacy Policy)
    VimeoSome articles have Vimeo videos embedded in them. (Privacy Policy)
    PaypalThis is used for a registered author who enrolls in the HubPages Earnings program and requests to be paid via PayPal. No data is shared with Paypal unless you engage with this feature. (Privacy Policy)
    Facebook LoginYou can use this to streamline signing up for, or signing in to your Hubpages account. No data is shared with Facebook unless you engage with this feature. (Privacy Policy)
    MavenThis supports the Maven widget and search functionality. (Privacy Policy)
    Google AdSenseThis is an ad network. (Privacy Policy)
    Google DoubleClickGoogle provides ad serving technology and runs an ad network. (Privacy Policy)
    Index ExchangeThis is an ad network. (Privacy Policy)
    SovrnThis is an ad network. (Privacy Policy)
    Facebook AdsThis is an ad network. (Privacy Policy)
    Amazon Unified Ad MarketplaceThis is an ad network. (Privacy Policy)
    AppNexusThis is an ad network. (Privacy Policy)
    OpenxThis is an ad network. (Privacy Policy)
    Rubicon ProjectThis is an ad network. (Privacy Policy)
    TripleLiftThis is an ad network. (Privacy Policy)
    Say MediaWe partner with Say Media to deliver ad campaigns on our sites. (Privacy Policy)
    Remarketing PixelsWe may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.
    Conversion Tracking PixelsWe may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.
    Author Google AnalyticsThis is used to provide traffic data and reports to the authors of articles on the HubPages Service. (Privacy Policy)
    ComscoreComScore is a media measurement and analytics company providing marketing data and analytics to enterprises, media and advertising agencies, and publishers. Non-consent will result in ComScore only processing obfuscated personal data. (Privacy Policy)
    Amazon Tracking PixelSome articles display amazon products as part of the Amazon Affiliate program, this pixel provides traffic statistics for those products (Privacy Policy)