HOW TO PASS THE LEAPFORCE

(RATERLABS), APPEN (INCA) AND

LIONBRIDGE EXAMS? (EXAM
GUIDELINES 2019)
Posted on 29.12.2015 by Tim Allen
How to crack Leapforce exam? How to pass Yukon exam? How to pass
Lionbridge exam? How to pass Inca exam?

Before you can start working on various tasks, you must pass the qualification exam.
The qualification exam you will take covers two types of rating tasks which will make up
70% of all tasks in the project: Needs Met and Page Quality.

Once your candidature is approved for certification, you will get an exam email with
detailed instructions. Within seven days you have to study 160 pages of the General
Guideline which consists of rating rules and concepts which teaches you how to do
the rating of search results and assessment of quality of web pages. You should follow
these rules and not use your personal judgment. What they want is for you to represent
a typical user in your country. Before you proceed with the exam you need to study the
Guideline at least twice paying particular attention to practical task examples. Keep in
mind that it’s 160 pages long. As I always advise, don’t wait till the last minute.

Note: At the stage of examination, Lionbridge provides candidates with very good exam
preparation support. You will get access as an exam guest to the Lionbridge learning
portal where you can listen to webinars and even try to do a few practical tasks before
the exam!

Important update: Lionbridge is very selective in terms of recruiting new raters, up on

revising exam results they will check your activity on their exam preparation portal, with
this in mind, I strongly recommend you go through all the webinars and tasks simulation
on their exam preparation portal before proceeding with the exam itself. Make sure that
you get a pass for Needs Met simulation tasks. You may do them several times until
getting a pass.

There are three parts in the exam: you can proceed with the next part only if you pass
the previous one. Once you complete any part of exam, within 3-10 minutes you will
receive an email with information about results.
Google updates the way the exam is done from time to time. The main feature that has
been changed recently is that you must rate pages from your smartphone (Send to
Device tasks). If you do not have smartphone, they say you cannot apply for this job.
This is due to the fact that the number of mobile users is constantly growing and the
company wants to assess websites from the perspective of on-the-go mobile users.

Note:There is a recommended schedule that will give you plenty of time so that you’re
not rushing to complete the exam at the last minute:

 Day 1 – Study the Guidelines – Make sure to setup your smartphone so that you
are ready to take the final portion of the exam.
 Day 2 – Start the Theory part of the exam making sure you are taking time to
CAREFULLY read each question. Some of them can be tricky and that’s meant
to make sure you fully understand the concepts.
 Day 3 – Go back and study the guidelines once again starting with the Page
Quality section.
 Day 3/4 You can start the second part of the exam which is the Page Quality
section if you feel comfortable on day 3. You may want to study this entire day,
and you’ve got plenty of time if you decide this to take the exam on day 4.
 Day 5 – Read the Needs Met section of the guidelines again and make sure to
take your time. You’ve still got two more days to finish. And as it has been
mentioned before, have your guidelines open in case you need to refer back to
them.
 Days 5/6/7 – Get started on the last part of the exam ‘Needs Met Rating’

Part one Theory (Leapforce exam part one)

In this part of the exam you will be assessed on how well you understand the theoretical
part of rating concepts, as well as on your ability to interpret questions and search for
information in the General Guidelines. It is an open book exam, so you can use the
General Guidelines to find answers to the test questions. This part has 32 question
sections; each section has 4 parts, so in fact you have 132 true/false questions to
answer. Read questions carefully, some of questions can be tricky in terms of their
wording. You can consult with the guideline book while passing the exam and it’s
strongly recommended to use this opportunity.

Note: Do not leave incomplete tasks more than for 1 hour, otherwise they will expire
and you will fail the exam automatically. If you need to take a break,complete tasks and
press “Submit and Stop rating”.

In most cases an hour would be enough to complete the theoretical part of Leapforce
exam. The following message will be shown to you once you have submitted the last
page of questions:

No tasks are currently available. Please try again later.

Within 10 minutes a result notification will come to your gmail, and in the case you are
successful with part 1, the next part will be available in 10 minutes.

Part two Page Quality (Leapforce exam part two)

In this part of the exam you will be asked to assess 7 web pages for their quality. My
advice for this part is to check all quality aspects, and fill in the online form very carefully
so you can give a correct overall quality score (from lowest to highest) to a page. You
should expect 2-3 low quality web pages, 2 high quality web pages and 2-3 medium
quality web pages. Keep this in mind. In order to give correct ratings, examine web
pages for ETA (Expertise, Authority and Trustworthiness) criteria very carefully.

Also, keep in mind that in this part of exam you need to give a PQ rating mainly to a
web pageand not to a website, although some quality aspects of a website have to be
taken into consideration when assigning overall PQ rating, in particular in case of YMYL
(Your Money Or Your Life) content which Google takes very serious.

Do not forget to write useful comments where required, otherwise the system may show
an error.

You don’t need to finish this part at once. If you want, you can take a rest. The tasks are
still available when you sign in. Again, if you pass this part, the company will send you
an e-mail saying that you can proceed with part 3.

Note: The url/web page may not open on your PC, in this case do not mark these
as “Did Not Load”. During the exam you should not expect to give a website this flag. If
you do so, your answer will be incorrect. To solve this issue try to open link using
incognito mode on your browser or/and give rating using other sources of information
(website reputation, etc).
Page Quality Task
Part three Send to device (Leapforce exam part three)

This is probably the most difficult part of the exam, and many candidates fail the exam
at this stage. There are 7 tasks, and each task contains 8-12 result blocks. In each task
you will be given a certain query, and a list of search results blocks with links where you
have to give a usefulness rating to search results using a scale from “Fails to Meet” to
“Fully Meets”. Lionbridge and Leapforce exam passing score: in order to pass this part
you have to get an overall score of at least 80%.

Note: while doing Leapforce and Lionbridge exam part 3, keep in mind that all links
have to be opened on your phone because Google analyses web pages from the point
of view of mobile users. If you do not have a smartphone, you may use any android
emulator for this purpose, in some cases it is even more convenient than using
a smartphone for opening links.In order to open the link on your mobile phone, click
the link on the result block on your desktop and then go to www.raterhub.com/url on
your mobile browser (Google Chrome) to visit the link. You must be logged in your
gmail account in order to have access to raterhub platform on your phone. The same
rule works if you use android emulator.

Note: Some candidates when accessing the link (www.raterhub.com/url ), got informed
that Gmail account was unauthorized to visit the link. Most likely reason for this error is
the fact of being logged on multiple Gmail accounts on a device. The solution for this
problem is to go to Android setting -> Users & accounts -> add project associated Gmail
account, then restart your device. This setting should fix the issue.

When you are evaluating landing pages in the exam, don’t place too much importance
on the Page Quality slider. The focus needs to be on Needs Met Ratings. Do not worry
about using flags in the exam such as the ‘Hard to Use’ flags.

One of the most important things is to absolutely know when to use Fully Meets. Fully
Meets ratings are very rare compared to Highly Meets ratings. Avoid being too
generous on landing pages. If you have any doubts at all, you should not be rating a
page ‘Fully Meets’.

Additionally I would like to give general tips on how to proceed with Leapforce
(Lionbridge) exam part 3:

1. Make sure that you fully understand the query and user intent. If you do not fully
understand user intent, make additional research on the Internet.

2. Determine what type of query (user intent) is:

o Single entity (business) query with local or non local or both intent/to visit in
person/navigate to a website

o Business chain query or query which is looking for business within one category (e.g.
car repair service near me)
o Simple know query (where the user requests a specific piece of information, do not
assign the Fully Meets rating to any particular result, the correct answer must be
present in an SCRB).Examples of simple know queries:paris weather, delta airlines
customer service number, current time in Amsterdam)

o Information query seeking a long answer/piece of information (what cases stress)

Types of SCRBs (Special Content Result Blocks): ny weather (simple know query), how
old is universe (simple know query), does god exist (long answer seeking), berlin airport
(single entity), burger king amsterdam (chain), coffee shops amsterdam (categorical).
o URL/website query

3. Consider the following aspects while giving ratings to result blocks: user location, for
local intent queries far away results are useless or slightly relevant. This aspect is very
important for the following types of queries: tire shops near me, where to eat near me,
Walmart near me, etc. When you get a task with this type of query do use in built map
for researching user location/view port and results.

4. Make sure you give correct ratings to special content result blocks for single entity
and business category queries. In case of business chain/category query, the result
block with a list of businesses is always better than just result for a single business
within one category.
5. Consider expertise and trustworthiness of search results for financial, legal, and
health related queries; low expertise and trustworthiness automatically reduce needs
met rating of the results.

6. Think of dominant, possible common, and minor interpretations for the query and
take this aspect into account while giving ratings to a result block. Minor interpretation
results should get a low usefulness (Needs Met) rating.

7. Take into account how well the web page/website is optimized for mobile users.

8. Once you have analyzed and considered all listed above aspects, you should give a
rating to result blocks one by one.

Note: In some cases there might be some results (links) which are not accessible from
outside U.S. (usually websites of well known retailers such as Target, Walmart, etc.
They ban access from foreign IPs to prevent hacker attacks). Raterlabs or Lionbridge
do not take into account this factor and therefore rating such results as fails to met may
lead to overall fail.

To make sure you do not miss anything before proceeding with part 3, follow pre-exam
instructions to pass this part. There will be a link to a video. Watch it and follow the
instructions.
Examination Need Met Task
Note: In part 3 of the exam (Needs Met), most of results blocks have Needs Met and E-
A-T (previously PQ) sliders. Main focus should be on providing correct Needs Met
rating, which in some cases might be affected by E-T-A (PQ) rating when it comes to
YMYL queries and results. Leapforce/Google re-named PQ to E-T-A in part 3 to make it
clear that the most important aspects in PQ are expertise, trustworthiness and authority.
In general it is similar to PQ concept. While giving E-T-A rating you should evaluate MC
under these 3 criteria. In most cases you may do it fast at a first glance approach, but
be sure to provide good evaluation for E-T-A when you have YMYL query.

Note: If the user location map does not show user location correctly, and you have a
blank page, hit the black arrow button. The task will be closed, but you will
see “Incomplete tasks” on the evaluation platform. Click continue and come back to
your task with the updated user location field. Remember that it is very important to take
into account the user location while giving ratings to block results. Also keep in mind
that there is no need to finish the task in one sitting. You can take a break if you need
to.

Once you complete 7 tasks you will get this message:

No tasks are currently available. Please try again later.

NEW!!! Welcome to Search Engine Evaluation Exam Simulation Tool!

What is exam simulation tool?

I have created a special tool that will help anyone who is getting ready or considering
taking the exam. This tool was designed to assist candidates with exam preparation
with the main focus on practical rating tasks that include Page Quality, and Search
Results Satisfaction ratings. The tool has 5 Page Quality tasks, and 5 Search Results
Satisfaction (Needs Met) tasks of all the major query types. (If you’re not sure what a
query type is, that is the keyword that a user searches Google for). These include;
simple-know, local search, information search, website/navigation, visit-in-
person/business which cover basically all rating concepts/tasks types and skills which
will be tested during a real exam.

How using this tool can help you pass the exam?

You might be wondering how using this tool can help you pass the exam. The way that
it is designed will show you exactly your problem area that you need to focus on. It
helps you identify your level of understanding of the rating concepts, and your ability to
apply them by practicing first, and then identifying your weak points. You will receive
your overall score (pass or fail), detailed feedback on your mistakes and know exactly
what you need to go back and study in the guide. Of course we need to disclaim that
there are no real actual exam tasks because that isn’t going to help you understand
anyway. Each one of these is hand designed from most typical exam tasks, and is
designed to be the best simulation possible. If you pass this, you will be ready to pass
the actual exam!

Explore the tool here: examsimulation.passleapforceexam.com

Leapforce exam results and Lionbridge exam results

You will get overall exam results on the exam due date from Leapforce and exam due
date plus one day if your vendor is Lionbridge. At Leapforce you will be asked to sign a
few electronic forms and in 2-4 days you will be given access to live tasks. At Lionbridge
you will have to complete educational course with no pass/no fail quiz before you are
granted full access to the tasks.

US Raterlabs and Lionbridge raters

Once you pass the exam you will then go through the employment process which might
take up to 3 weeks. You will be asked to complete an online version of the IRS Form
8850 (Pre-Screening Notice and Certification Request for the Work Opportunity Credit),
and a tax credit questionnaire from a vendor payroll provider. After you have completed
these two forms, you will be presented with a formal employment offer letter. After
acknowledging your offer, you will still need to complete the required activities in a
timely manner. Try not to postpone the completion of these important steps: Providing
bank details for ACH payments on Paycom website. Providing your I9 Employee
Section 1 and I9 Employment Eligibility Documents (section 2) must be completed by
specified deadline. It is very important that candidates complete all required steps as
soon as possible to avoid termination of your employment.

Leapforce/Appen/Raterlabs candidate? If you get a job at one of

these places, you’re going to need Payoneer account because that is the only payment
option available for these companies. Simply sign up for Payoneer under my referral
link and you’ll get the simulation tool subscription fee back as Payoneer subscription
25$ bonus once your account is loaded with 1000$! Normally it takes 1-2 months to
make 1000$ for EU/USA/Canada raters and 3-4 months for raters from another
countries.

The following posts are recommended for reading:

Payoneer As a Payment Method for Appen, Raterlabs, Leapforce, Lionbridge and Utest

You Failed the Leapforce (Raterlabs) or Lionbridge Exam – Now What?

Common issues of new raters (Yukon Raterlabs/Leapforce and Lionbridge Google

Rating Projects)

What Should You Do If You Fail Leapforce or Lionbridge Exam Twice and How to Re-
Apply?

How many attempts did you take to pass Leapforce Yukon/Lionbridge exam?
I passed exam at the first attempt I passed exam at the second attempt I was given a third chance and

passed it! I failed exam two or more times

VoteView ResultsPolldaddy.com

COMMON ISSUES OF NEW RATERS

(YUKON RATERLABS/LEAPFORCE
AND LIONBRIDGE GOOGLE RATING
PROJECTS)
Posted on 10.01.2016 by Tim Allen
In this post I will discuss some common issues that new raters face. If you have
other issues, feel free to share by leaving a comment below.

What kind of tasks to expect while providing search engine evaluation service for
Leapforce/Lionbridge? Rater Tasks Review

If you get a position as a Search Engine Rater with Leapforce or lionbridge (Internet
Assessor), you may encounter many different tasks. Some of these tasks are your
normal rating tasks, and some are side by side, and you may even run into
experimental tasks. This article was written to explain the different tasks that you’ll face
as a rater. Before I go on, I should note that not all these tasks will be available at one
time. All tasks are given out and are on a first-come first-served basis.

Some of the tasks are easier than others, like experimental tasks. Each task has a
different set of instructions, so it’s best to make sure you know exactly what you are
doing, and read very carefully each of the task instructions.

Side By Side

Side by Side rating tasks are very interesting and have everything to do with Google
algorithm changes. The human role or ‘rating’ in Side By Side tasks is to determine
which side, left or right, is better than the other. In this task you are shown blocks on the
left and right side. Each block has a slider from Fails to Meet to Fully Meets, and you
should choose which one is best for each block depending on the user intent and query.
The same guidelines apply for the blocks as they would for a page rating. Meaning that
if block meets user intent, it should get the appropriate rating. Once you have chosen
the ratings for each block, you will then be asked to choose on a scale which side is
better than the other. A comment may be required to give your own opinion on why
you’ve chosen which side, and why it is the best over the other side. It’s very important
that you base all your ratings on user intent and taking their location in mind. You will
also have a quality review on Side by Side tasks almost each month.

Page Quality

This is the main rating task that a rater is hired to rate. You will be given a website URL
along with the first 5 questions which check things like Foreign Language, which if
you’re doing English/USA ratings, would need to be in English to be understood from
your location. Pages that don’t load need to be checked, as well as flagging for porn.
The second question is asking you to describe the purpose of the page. The purpose of
the page and the user intent are entirely different aspects. Make sure you’re checking
the website out to see if it matches user intent, and by looking at the website, you
should be able to understand what its main purpose is. If the page is malicious, harmful,
or just lacks its purpose for what it is searched for, then you should mark that here.
Pages that are simply existing to show ads, without any help to the user, should be
flagged. And lastly, it is important to make sure that you understand if the page is a
YMYL (Your money or your life) webpage. Understanding this is important because it
will change the overall rating of the website.

Once you have completed this, you will then rate the different aspects of the page
including its Main Content Quality, and the amount of content. Expertise, Authority, and
Trustworthiness, who is responsible for the website, the supplementary content, page
design, layout, and website care and maintenance are all graded on a scale from lowest
to highest. The last thing to do is to give the website its overall rating. Usually these
types of tasks are allowed 9 minutes to complete. A quality review is done each month
to see how you rate. So it’s important to make sure that you are taking the time to
evaluate each website properly.

Needs Met

This type of tasks you have already saw while doing part 3 of the qualification exam.
Each task contains 8-12 result blocks. In each task you will be given a certain query,
and a list of search results blocks with links where you have to give a usefulness rating
to search results using a scale from “Fails to Meet” to “Fully Meets”

Experimental

Sometimes during rating of Side by Side, you will see Experimental tasks pop up. In
most cases Experemental tasks are standard Page quality or Need Met tasks, but
sometimes you will get new types of tasks. Experimental tasks have a wide range of
instructions. It’s important to read the instructions for each task as they will be different
each time. Experimental tasks can be very simple, or take a few minutes to complete.
They are not always available, and each task can be completely different than the other.

Quality of your service

New raters do live tasks immediately after getting access to the task portal. It is highly
advised that you hold off on these if you do not want to be restricted for quality in the
next month. Typically tasks which are available for new raters are quality tasks on
which raters are accessed for their quality. Instead, new agents should focus on doing
simulation tasks and self-education. Time spent doing this will really pay off, and you
wont be restricted for quality in the future. Also, by doing a certain number of simulation
tasks correctly you will upgrade your status in the system, and will be allowed to work
more hours.

During your participation in the project your service will be evaluated for its quality by
means of quality review tasks. In the beginning of every month, a certain number of
tasks are uploaded into the system. Normally there are 10-12 tasks of Needs Met or
Side by Side, and once in 3 months PQ tasks to be released as quality review tasks.
These tasks are quality review tasks up on which your quality is measured every month,
in the end of the month you will get your quality score feedback.

If your ratings often stand out of general range of ratings provided by other raters in the
project, most likely your account will be flagged by the system automatically and your
work will be checked manuallyfor quality .

Read more about this topic here:

Time Management and the Leapforce Extension

Time management of the work you complete can become a problem if you aren’t
managing how much time you are spending on tasks. You should not sacrifice quality
for time. In the beginning you may spend more time than the average estimated time
that Leapforce allocates to the task, but make sure that in the invoice you put average
estimated time that they give you. If you spend less time than average estimated time
per task or set of tasks, be informed that your invoice will be returned for correction,
Leapforce will ask you to put actual time spent, that is why there is no sense to
complete tasks faster than average estimated time. Take your time, do everything
correctly and watch your time.

Do not forget to log on to the Leapforce extension each time you work in the system.

According to the Leapforce policy: any time spent logging on/off, reading, studying, and
break times are not billable. Any tasks that are not submitted or are released are also
not billable. Please make sure you are not including any of this time on your invoice.

Also please keep in mind that consecutive invoices submitted with productivity below
100% may result in removal from the project or you may lose your contract with
Leapforce.

Invoice Returned for Missing or Incorrect Data

Your invoice has been rejected for missing or incorrect data. Please make the
necessary corrections or provide specific details on the reason for each discrepancy.
Time Discrepancy: For the following line item(s) there is a discrepancy between the
hours you have submitted and the activity and work recorded on our servers.

Reported: x hours, xx mins

Unaccounted Variance: -xx mins

What raters should do in this situation?

Raters have to deduct xx nnaccounted varianceminutes from the invoice, in the future
make sure only AET is entered into invoice and the Leapforce exstension has to be
always to be on while active rating.

Working some tasks much faster than the AET followed by holding on to a task
for much longer than the AET and billing for the full amount on your invoice

This email is a reminder that raters are allowed to bill for the AET of a task OR the
actual time spent working, whichever is LESS of the two amounts. It has been
discovered that you are working some tasks much faster than the AET followed by
holding on to a task for much longer than the AET and billing for the full amount on your
invoice, which is a violation of official policy and will not be tolerated.

For example: You work 5 tasks, each with an AET of 5 minutes. The first 4 tasks you
complete in 1 minute each, and the 5th task you hold on to for 30 minutes.

This is an official warning. If this pattern continues, your invoice will be rejected and you
will be removed from the rating program. Be sure that all future invoices are in
compliance with policy.

Multi-accounts

Be informed that it is prohibited to have multiple accounts, without special arrangement.

Leapforce and Lionbridge can find duplicate accounts very fast, and as a result, you will
lose both accounts.

Leapforce IP change/Network sharing

In some cases people may share their Internet network, while working as search engine
evaluator make sure that you have your personal unique IP address and no one uses
the same IP to go online for rating project.Once you are in the Project, you may change
your IP address many times, it will not affect your project status. Make sure that you do
your project tasks in a private place as it stated in the contract.

Non-completion of a minimum required number of tasks

This issue is very common among new Leapforce agents and may lead to termination of
your contract, and happens when new agents show no activity in the first month of their
service. In particular this can happen if new agents enter the project in the second half
of month, and for whatever reasons, they did not complete a minimum required number
of tasks. In order to avoid this issue, make sure to show the minimum required activity in
the system as per your contract.

Tasks availability and time restriction

In general Leapforce and Lionbridge guarantee at least 2 hours of work per day but task
availability may depend on your country. There might be some days when tasks are
available for more than 4 hours.

You should understand that the system of task distribution is based on a “first come first
served” basis and you need to be ready to catch your portion of tasks when they are
uploaded into the system. To identify time slots when task availability is the highest
please look at task completion graph, usually tasks are uploaded every day into the
system at the same time slots.

Lionbridge does not provide raters with a task availability instrument, so raters have to
identify time slots when tasks are uploaded into the system by themselves.

Leapforce also has a system that restricts access to tasks for new raters, and those
who are undergoing their quality review. To lift this restriction, you have to complete a
certain number of simulation tasks or wait till the next quality review, if your quality score
is good, the restriction will be lifted automatically.

Locked for quality audit or restricted for quality?

If you receive an email notifying you that your account has been placed under quality
review,this is a good time to identify your weak points and improve your rating skills.
Below you will find some tips on how to deal with a “Locked for quality audit” situation.

1. To speed up the process and to get feedback on your mistakes as quickly as

possible, I recommend writing to LP/LB and ask why exactly your account has
been placed under review.Sometimesthe automatic system locks raters accounts
without specific reasons. Usually such cases are being resolved within 1-2 days.

2. While waiting for detailed feedback for LP team, start doing simulation tasks in
order to improve your rating skills. In most cases the issue is related to Side by
Side tasks. Make sure that you understand how to deal with this type of task and
that you provide well written comments where required. In many cases, raters
are placed under quality review due to poorly written comments.
 3. Once you receive the feedback email with your mistakes/quality issues, read it
carefully and reply back with an explanation on how you will improve your weak
points.

4. Once your status is moved to “Restricted for quality”, keep in mind that your
service is under inspection, thus making sure that you do your best to provide the
best possible service.

Why is my Leapforce status restricted with a meets expectations rating?

Sometimes some raters do not get their restricted status changed to unrestricted with
getting a meets expectations or above quality score. This happens because they were
restricted for Side by Side or PQ tasks quality issues and feedback was released for
needs met tasks. In order to lift up all restrictions a rater will have to wait for the next
quality review cycle for type of tasks a rater was initially restricted for.

And finally, at the end of month, if you get meets expectations or an above quality score
your account will be unrestricted again.

Here are two videos and link to the article which will help you to understand how you will
contribute to improving Google search engine.

Leapforce US raters will become part-time employees: no more full-time work

In April, US raters received an e-mail from Leapforce, which states the following
“Effective June 1, 2017, [Raters in the US] can work up to 26 hours in a calendar week
(Sunday to Saturday).” All raters will be moved to a new platform called raterlab and will
not be able to work on another projects at Leapforce. Read more about this change
here:

https://arstechnica.com/features/2017/04/the-secret-lives-of-google-raters/

How Does Google Search Work?

Survey:Leapforce/Lionbridge working hours spent per month

Have you ever wondered what hours raters work ?

Knowing these statistics can be useful for raters in terms of estimating possible
productivity .

The survey is completely anonymous and once completed will show the overall
statistics.
Thanks for participating!

How many hours do you work in Google rating project in a month on average?
less than 20 hours from 20 to 40 hours from 40 to 60 hours from 60 to 100 hours more than
100 hours
VoteView ResultsPolldaddy.com
https://passleapforceexam.com/2018/12/19/search-engine-evaluation-exam-simulation-exam-
preparation-tool/

EXAM PREPARATION TOOL TO HELP

CANDIDATES TO CRACK THE EXAM
Posted on 19.12.2018 by Tim Allen
Why candidates fail the exam?

When you apply for search engine evaluator jobs from Leapforce/Raterlabs, Lionbridge,
and Appen, you have to pass qualification exam that is quite difficult. Each company
has a name for their search engine project. Leapforce/Raterlabs is called Yukon, if you
work for Lionbridge you work on the Internet Assessor, and Appen’s search engine
project is named Inca.

Despite all the fancy names, the exam is the same for these companies. The biggest
problem with this exam is that it is very hard. In fact, even Lionbridge Appen Leapforce
explains in a welcome mail that there is high chance of failing it. With that said, you’re
going to need all the help you can get.

Studying the guidelines and doing the exam simulation practice are essential in
success in passing the real exam

If you think this is an exaggeration, then just search for comments on passing the exam
simulation and see what you will find. You’ll find in a lot of cases people who claim that
they studied for several days before the exam began. With that said, it’s just not
possible to demonstrate the knowledge of these guidelines without investing a
significant amount of effort in the one-week time frame they give you to study the
guide. The guide itself is designed in a way that assesses your ability to understand and
apply rating concepts and the rules based on the hefty guide. There is a lot of material
to go over, and it can be a bit confusing. But once again, you’re not going to get
anywhere near passing if you don’t start going through the guide.

What is exam simulation tool?

I have created a special tool that will help anyone who is getting ready or considering
taking the exam. This tool was designed to assist candidates with exam preparation
with the main focus on practical rating tasks that include Page Quality, and Search
Results Satisfaction ratings. The tool has 5 Page Content Quality tasks, and 5 Search
Results Satisfaction tasks of all the major query types. (If you’re not sure what a query
type is, that is the keyword that a user searches Google for). These include; simple-
know, local search, information search, website/navigation, visit-in-person/business
which cover basically all rating concepts/tasks types and skills which will be tested
during a real exam.

How using this tool can help you pass the exam?

You might be wondering how using this tool can help you pass the exam. The way that
it is designed will show you exactly your problem area that you need to focus on. It
helps you identify your level of understanding of the rating concepts, and your ability to
apply them by practicing first, and then identifying your weak points. You will receive
your overall score (pass or fail), detailed feedback on your mistakes and know exactly
what you need to go back and study in the guide. Of course we need to disclaim that
there are no real actual exam tasks because that isn’t going to help you understand
anyway. Each one of these is hand designed from most typical exam tasks, and is
designed to be the best simulation possible. If you pass this, you will be ready to pass
the actual exam!

Welcome to Search Engine Evaluation Exam Simulation Tool!

Explore the tool here: examsimulation.passleapforceexam.com

The full list can be found here.

Rank Company Name

1 Appen

2 Lionbridge

3 VIPKID

4 Liveops

5 Working Solutions

6 Amazon
7 TTEC

8 Kelly Services

9 Concentrix

10 UnitedHealth Group

11 Williams-Sonoma

12 LanguageLine Solutions

13 Intuit

14 TranscribeMe

15 SYKES

16 Transcom

17 Dell

18 BroadPath Healthcare Solutions

19 Cactus Communications

20 Aetna

21 Robert Half International

22 Appirio, A Wipro Company

23 BCD Travel

24 Hilton

25 AFIRM

26 Magellan Health

27 Commonwealth of Virginia

28 EF - Education First

29 Anthem, Inc.
30 Kaplan

31 SAP

32 Enterprise Holdings

33 K12

34 Syneos Health

35 Leidos

36 Thermo Fisher Scientific

37 Sutherland

38 Amgen

39 Stryker

40 ADP

41 PRA Health Sciences

42 Humana

43 Red Hat

44 Pearson

45 Alight Solutions

46 Wells Fargo

47 VMware

48 Motion Recruitment Partners

49 Gartner

50 U.S. Department of Commerce

51 Fiserv

52 EXL
53 Abbott

54 VocoVision

55 Cisco

56 Philips

57 Salesforce

58 Carlson Wagonlit Travel

59 Direct Interactions

60 JPMorgan Chase

61 PAREXEL

62 Houghton Mifflin Harcourt - HMH

63 Grand Canyon University - GCU

64 Covance

65 CLASS100

66 A Place for Mom

67 Sodexo

68 CyraCom

69 CVS Health

70 BELAY

71 Worldwide101

72 Xerox

73 InVision

74 Change Healthcare

75 Sanofi
76 State of Washington

77 DataStax

78 The Hartford

79 Western Governors University - WGU

80 Shire

81 Cozymeal

82 First Data

83 ServiceNow

84 Haynes & Company

85 JLL - Jones Lang LaSalle

86 ConsenSys

87 American Express

88 GitHub

89 Lenovo

90 Aquent

91 Apex Systems

92 HD Supply

93 General Dynamics

94 Auth0

95 NTT Group

96 Toptal

97 Hibu

98 Ultimate Software
99 Johnson & Johnson

100 Rackspace

The full list can be found here.

Rank Company Name

1 Appen

2 Lionbridge

3 VIPKID

4 Liveops

5 Working Solutions

6 Amazon

7 TTEC

8 Kelly Services

9 Concentrix

10 UnitedHealth Group

11 Williams-Sonoma

12 LanguageLine Solutions

13 Intuit

14 TranscribeMe

15 SYKES

16 Transcom

17 Dell

18 BroadPath Healthcare Solutions

19 Cactus Communications

20 Aetna
21 Robert Half International

22 Appirio, A Wipro Company

23 BCD Travel

24 Hilton

25 AFIRM

26 Magellan Health

27 Commonwealth of Virginia

28 EF - Education First

29 Anthem, Inc.

30 Kaplan

31 SAP

32 Enterprise Holdings

33 K12

34 Syneos Health

35 Leidos

36 Thermo Fisher Scientific

37 Sutherland

38 Amgen

39 Stryker

40 ADP

41 PRA Health Sciences

42 Humana

43 Red Hat

44 Pearson

45 Alight Solutions
46 Wells Fargo

47 VMware

48 Motion Recruitment Partners

49 Gartner

50 U.S. Department of Commerce

51 Fiserv

52 EXL

53 Abbott

54 VocoVision

55 Cisco

56 Philips

57 Salesforce

58 Carlson Wagonlit Travel

59 Direct Interactions

60 JPMorgan Chase

61 PAREXEL

62 Houghton Mifflin Harcourt - HMH

63 Grand Canyon University - GCU

64 Covance

65 CLASS100

66 A Place for Mom

67 Sodexo

68 CyraCom

69 CVS Health

70 BELAY
71 Worldwide101

72 Xerox

73 InVision

74 Change Healthcare

75 Sanofi

76 State of Washington

77 DataStax

78 The Hartford

79 Western Governors University - WGU

80 Shire

81 Cozymeal

82 First Data

83 ServiceNow

84 Haynes & Company

85 JLL - Jones Lang LaSalle

86 ConsenSys

87 American Express

88 GitHub

89 Lenovo

90 Aquent

91 Apex Systems

92 HD Supply

93 General Dynamics

94 Auth0

95 NTT Group
96 Toptal

97 Hibu

98 Ultimate Software

99 Johnson & Johnson

100 Rackspace