critical thinking for appraisal

Critical Thinking: 40 Useful Performance Feedback Phrases

Critical Thinking: Use these sample phrases to craft meaningful performance evaluations, drive change and motivate your workforce.

Critical Thinking is the ability to think clearly and rationally while understanding the logical connection between ideas in a reflective and independent thinking.

Critical Thinking: Exceeds Expectations Phrases

Highly demonstrates assertive and decisive ability when finding solutions for problems.
Knows how to communicate ideas and issues easily in a very clear and concise manner.
Able to piece together elements and come up with proper deductions on issues.
Knows how to clarify problems and solutions easily so that other people can understand.
Evaluates ideas and opinions in an unbiased manner without favoritism.
Thinks through issues in a very logical manner that results in finding the best solution to a problem.
Demonstrates excellent problem-solving skills by accessing a problem and devising the best possible solution for it.
Takes in into consideration different and varied perspectives when solving problems.
Examines the implications and possible consequences to any particular action carefully.
Solves problems one by one so as not to mix up issues and ideas.

Critical Thinking: Meets Expectations Phrases

Uses strategic approachability and skill when it comes to solving issues.
Demonstrates well assertive and decisive ability when it comes to handling problems.
Tries to always consider all factors at play before deciding on a particular methods or way.
Gathers all the required facts and figures before starting to solve a particular problem.
Always seeks to ask questions as a form of finding a sound basis to solving a problem.
Not afraid to make mistakes and tries to find creative ways to handle any issue.
Looks at issues in different angles and not in a one-sided way.
Shows great flexibility when it comes to changing strategies and tact while dealing with different problems.
Questions regularly to find out if the decision taken will achieve the desired effect.
Always feels comfortable and confident when seeking help or advice whenever stuck on solving any issue.

Critical Thinking: Needs Improvement Phrases

Does not take the time to consider all factors available before making a decision carefully.
Looks at issues in a one-sided manner instead of having different varied ways of looking at it.
Finds it challenging to arrive at a concrete conclusion after undertaking any evaluation.
Not willing to do proper research and relies on outdated data and information.
Does not demonstrate a curious type of attitude to try to find out a little bit more on issues.
Not willing to accept corrections and take calculated risks when necessary.
Does not show enough willingness to try to improve the critical thinking skills.
Does not present ideas and points in a logical order or outline.
Looks at issues in a biased and unfair way by not evaluating all factors.
Not willing and inflexible to change tact or strategy when the initial plan fails to achieve the desired effect

Critical Thinking: Self Evaluation Questions

How well do you research and gather facts and information before solving an issue?
Give an instance you hurriedly made a decision without thinking it through and what was the result?
Elaborate on a given occasion that you made the best decision. How did you feel about it?
How well do you consider all the factors available before making your decision?
Do you get to appreciate and learn from your mistakes and how do you deal with making wrong decisions?
Do you always try to inquire further, what could be the missing elements that could achieve a positive outcome?
How well do you consider having a concrete conclusion when presenting your ideas?
When expressing your ideas do you deliver them in a logical manner?
Do you usually look at issues in a one-sided manner or at different angles?
How flexible are you when it comes to trying different ways of solving problems other than the intended way.

These articles may interest you

Watson Glaser Critical Thinking Tests

Complex and challenging critical thinking tests, including the Watson-Glaser, are used mostly by law firms.

Page contents:

About critical thinking tests and how they work, free practice critical thinking tests, the watson glaser critical thinking appraisal, what is measured by a watson glaser critical thinking test, what should i know before taking a watson glaser critical thinking test, major publishers' critical thinking tests, advice for all critical thinking tests, assessmentday's practice tests can help you to prepare for a critical thinking test, one final point, other test publishers.

Updated: 08 September 2022

Critical thinking tests, or critical reasoning tests, are psychometric tests used in recruitment at all levels, graduate, professional and managerial, but predominantly in the legal sector. However, it is not uncommon to find companies in other sectors using critical thinking tests as part of their selection process. This is an intense test, focusing primarily on your analytical, or critical thinking, skills. Some tests are still conducted by paper and pen, but, just like other psychometric tests, critical thinking tests are mostly administered online at home or on a computer at a testing center.

The questions are multiple choice, and these choices and the style of questions are explained in more detail further down the page. The tests will often follow these two common timings:

30 questions with a 40 minute time limit
80 questions with a 60 minute time limit

Critical Thinking can be defined in many ways and an exact description is disputed, however, most agree on a broad definition of critical thinking, that 'critical thinking involves rational, purposeful, and goal-directed thinking...by using certain cognitive skills and strategies.' An absence or lack of critical thinking skills at times may lead us to believe things which aren't true, because we haven't sufficiently analysed and criticized the information we've received or used this to formulate and independently test our own theories, arguments and ideas. These are all examples of critical thinking skills put into practice. Glaser (An Experiment in the Development of Critical Thinking, 1941) stated that to think critically involved three key parts:

An attitude of being disposed to consider in a thoughtful way the problems and subjects that come within the range of one's experiences
Knowledge of the methods of logical inquiry and reasoning
Some skill in applying those methods

Note: AssessmentDay and its products are not affiliated with Pearson or TalentLens. Our practice tests are for candidates to prepare for the Watson Glaser Critical Thinking Appraisal; we do not sell tests for employers to select candidates.

Free Critical Thinking Test

Here, we have a full critical thinking test for you to practice for free. You can dive straight in and practice the full test (in blue at the bottom), or tackle each individual section one at a time.

All answers and explanations are included at the end of the test, or alternatively you can download the Solutions PDF. Each test has been given a generous time limit.

Critical Thinking Test 1

40 questions

Critical Thinking Test 2

Critical thinking test 3, critical thinking test 4.

TalentLens' Watson Glaser Critical Thinking Appraisal (WGCTA) is the most common critical thinking test. You can visit their official site here: Watson Glaser . Most other critical thinking tests are based on the Watson Glaser format. More than 90 years' of experience have led to many modifications and improvements in the test.

The Watson Glaser Critical Thinking Appraisal is widely regarded as a good predictor of work productivity and at identifying candidates with a good potential to become managers and occupy other positions as a senior member of staff. The latest edition of the Watson Glaser Critical Thinking Test has improved its validity, appealed more to businesses by focusing on business-relevant topics, switched to the Item Response Theory (IRT) for its scoring, updated norm groups, and integrated anti-cheat measures by having an online retest, which can be used to validate results.

Developed by Goodwin Watson and Edward Glaser, the Watson Glaser test is favored by law firms , keen to measure people's abilities to reason, reach conclusions and know when leaps in logic have been made. Skills which are required in the legal sector. The questions in each of the 5 sections aims to evaluate the candidate's ability to:

1. Arrive at correct inferences
2. Identify when an assumption has been made
3. Use deductive reasoning
4. Reach logical conclusions
5. Evaluate the effectiveness of arguments

Did You Know

The most recent revision of the W-GCTA was published in 2011 with notable improvements being better face validity and business-relevant items, scoring based on Item Response Theory (IRT), updated norm groups, and an online retest which can be used to validate a paper and pencil test result.

A Critical thinking tests assesses your ability in 5 key areas mentioned above; assumptions, arguments, deductions, inferences and interpreting information. Often in this order. A short paragraph of text a few sentences long or a single sentence is used as a starting point. This passage will contain information which you will base your answer to the question on. Another sentence is then presented to you and you will be asked to judge something about this sentence based on the information in the short paragraph. The five sections are explained in more detail here:

Assumptions - You are being asked to state whether the information in the second set of text you are presented is an assumption made in the first paragraph. Quite a tricky concept to get your head around at first. In a nutshell, when people speak or make arguments, there are underlying assumptions in those arguments. Here you are presented with some assumptions and are asked to judge if that is being made in the original statement. For example in the statement "only people earning a high salary can afford a fast car," what's being assumed is that fast cars are expensive because only people who are earning a lot of money can buy one, however, what's not being assumed is that people without high salaries aren't legally allowed to buy a fast car. You are asked to choose whether an assumption has been made or has not been made.
Arguments - You are presented with an argument, such as "Should college fees be abolished?" Regardless of your own opinions and thoughts on the argument, you are then presented with statements related to this original argument. You are asked to say whether the responses to the original argument of "Should college fees be abolished?" make for strong or weak arguments. Arguments are considered strong if they are related to the topic such as, "Yes, many people who would benefit from a college education do not because they cannot afford it. This hurts the country's economic growth." The argument presented is sound, related to the original question. Compare this with a weak argument, "No, I do not trust people who read a lot of books." It is clear that the second argument bears very little relation to the subject of the abolition of college tuition fees. This is not to say that an argument against the original argument will always be a weak one, or that an argument in favor will always be a strong one. For example, "Yes, I like people that read books," is in favor of the abolition as indicated by "yes," but that person's like or dislike of others that read books isn't related, or hasn't been explained how it's related to removing the fees. Carefully considering what is being said, remove it from your own personal opinions and political views to objectively analyse what someone else has put forward.
Deductions - A few sentences of information are presented to you. Another separate short statement will also be shown to you, which is supposed to represent a conclusion that someone has reached. You will have to determine whether this conclusion logically follows from the information given to you. Can the statement be deduced from the information available>? If so, and without a doubt, then the conclusion follows, if not, then the conclusion does not follow. Your decision must be based on the information given and not from your own knowledge.
Inferences - A short scenario is described to you, followed by possible inferences. The inferences are short statements. Imagine that these are what people have said is inferred from the scenario. Use your judgement and the short scenario to assess whether what's being said has actually been inferred from the passage and the likelihood of this inference. You are asked to rank each inference as either 'true,' 'false,' 'possibly true,' 'possibly false.' For some proposed inferences there isn't enough information to say either 'true' or 'false' so a fifth option is included; 'more information required.' You can only select one option from the five.
Interpreting Information - Following a similar format to the previous four sections, a short passage of information and then a series of statements are shown to you. You are asked to judge whether the information in the passage can be interpreted as the statements suggest. The answer options are straightforward here; you either select 'conclusion follows,' or 'conclusion does not follow,' depending on whether or not you believe that the statement can be logically reached from the information given. Again, for this section and all others, you are to base your choice of answer on what you're given, not on any specialized knowledge you might have.

If a watson glaser critical thinking test is used in the early stages of the application process it's likely to be used as a screening tool. This puts some pressure on candidates to meet a minimum pass mark, which will allow them to be selected to go on to the next stage of the selection process. If it's used at a later stage in the process, the results from this will be combined with performance in other assessments, tests, exercises and interviews. All the information you need to answer the questions will be in the test. Below the details of a few companies' critical thinking tests are pointed out.

Here is a list of critical reasoning tests on the market at present, which candidates may be likely to encounter for recruitment, selection or development.

W-GCTA - The Watson Glaser Critical Thinking Appraisal as it is formally called is the most ubiquitous critical thinking test out there. This is the one that you are most likely to encounter.
GMAT - The general management aptitude test, used by business schools and colleges test students' critical thinking ability. The critical thinking questions are written in a business or finance context.
SHL - SHL have produced the Critical Reasoning Test Battery composed of 60 critical reasoning questions with a strict time limit of 30 minutes.
Cornell - Cornell have developed a critical thinking test to be used in educational environments. The two levels, X and Z, are aimed at children and adults, respectively.
Area-specific - There are tests which focus on either numerical critical reasoning skills and verbal critical reasoning skills. These tests will ask only numerical or only verbal questions to assess your skills in a specific area.

Here is some general advice to help you perform to the best of your ability for your critical reasoning test.

No prior knowledge - The key point here is that critical reasoning tests are measuring your ability to think, or the method that you use to reach a conclusion. You should therefore not rely on prior knowledge to answer the question. Questions will be written so that you do not need to know any specialist knowledge to answer the question. For example, you will not be expected to know mathematical formulas or laws of nature and to answer questions with that information. If you are given the formula and its description in the questions, you are expected to use that information to reach the answer.
Carefully read the instructions - There are 5 sections to most critical thinking tests and each will assess a slightly different skill. Make sure you have read the instructions and understand what it is you are expected to do to answer the questions for this section. There is quite a difference between the Assumptions section and the Deductions section for example. Applying the rules of one to the other would lead to just guessing the answers and making many mistakes.
Keep your eye on the timer - These tests are complex. You might find yourself fixated on answering one question and taking up a lot of the time you are allowed. Checking how much time you have every so often can help you to more evenly distribute your time between the questions. This is done to avoid spending too much time on one question when that time would be better spent answering more or checking your answers. This time management applies to all tests, but is particularly important with Critical Thinking tests, as many people believe they have such a large amount of time, but underestimate the number of questions they have to answer.
Logical fallacies - Identifying logical fallacies is key to many parts of this test, and researching the difference between sound and fallacious logic will prove helpful in a critical reasoning test. A fallacy is an error in reasoning due to a misconception or a presumption, and an argument which employs a formal fallacy, logical fallacy or a deductive fallacy in its reasoning becomes an invalid argument. Researching the different types of fallacy (i.e. red herring argument, straw man argument, confusing correlation and causation etc.) can help you spot these in the test and correctly answer the question.

The practice tests that we have cover all of the sections of the Watson Glaser Critical Thinking test and these overlap with many of the variations in Critical Thinking tests produced by major publishers. practice helps to increase your confidence, gives you a chance to learn from your mistakes in a risk-free environment, and can reduce stress before an exam.

The best place to get advice on taking a critical thinking tests is the test publisher's website, for example this one for the Watson Glaser .

If you have already successfully passed a few initial stages of the application process, it's unlikely that companies will focus solely on your results in the Watson Glaser Critical Thinking test when deciding whether or not to hire you. This type of selection by results on one test is more likely if it is part of the early stages of the process. However, towards the later stages the company will look at your results across interviews, group exercises, other aptitude tests and your résumé and will collate all of this information before reaching a decision. If you have been invited to undertake a critical reasoning test then the organisation clearly has an interest in hiring you, let that fact inspire confidence and perform to the best of your ability on your test, good luck!

You may also be interested in these popular tests sections.

Critical Thinking: Performance Review Examples (Rating 1 – 5)

By Status.net Editorial Team on July 15, 2023 — 8 minutes to read

Critical thinking skills are an essential aspect of an employee’s evaluation: the ability to solve problems, analyze situations, and make informed decisions is crucial for the success of any organization.

Questions that can help you determine an employee’s rating for critical thinking:

Does the employee consistently analyze data and information to identify patterns and trends?
Does the employee proactively identify potential problems and develop solutions to mitigate them?
Has the employee demonstrated the ability to think creatively and come up with innovative ideas or approaches?
Does the employee actively seek out feedback and input from others to inform their decision-making process?
Has the employee demonstrated the ability to make sound decisions based on available information and data?

Performance Review Phrases and Paragraphs Examples For Critical Thinking

5 – outstanding.

Employees with outstanding critical thinking skills are exceptional at identifying patterns, making connections, and using past experiences to inform their decisions.

Phrases Examples

Consistently demonstrates exceptional critical thinking abilities
Always finds creative and innovative solutions to complex problems
Skilfully analyzes information and data to make well-informed decisions
Frequently provides valuable insights and perspectives that benefit the team
Continuously seeks out new learning opportunities to sharpen their critical thinking skills
Demonstrates exceptional ability to identify and analyze complex issues
Consistently develops innovative solutions to problems
Skillfully connects disparate ideas to create coherent arguments
Effectively communicates well-reasoned conclusions
Exceptional ability to recognize trends in data
Expertly applies existing knowledge to new situations
Consistently anticipates potential challenges and develops solution

Paragraph Example 1

“Jane consistently demonstrates outstanding critical thinking skills in her role. She not only engages in deep analysis of complex information, but she also presents unique solutions to problems that have a significant positive impact on the team’s performance. Her ability to make well-informed decisions and offer valuable insights has led to numerous successes for the organization. Moreover, Jane’s dedication to improvement and learning demonstrates her commitment to personal and professional growth in the area of critical thinking.”

Paragraph Example 2

“Jessica consistently displays outstanding critical thinking skills. She is able to identify and analyze complex issues with ease and has demonstrated her ability to develop innovative solutions. Her skill in connecting disparate ideas to create coherent arguments is impressive, and she excels at communicating her well-reasoned conclusions to the team.”

Paragraph Example 3

“Melanie consistently demonstrates an exceptional ability to recognize patterns and trends in data, which has significantly contributed to the success of our projects. Her critical thinking skills allow her to apply her extensive knowledge and experience in creative and innovative ways, proactively addressing potential challenges and developing effective solutions.”

4 – Exceeds Expectations

Employees exceeding expectations in critical thinking skills are adept at analyzing information, making sound decisions, and providing thoughtful recommendations. They are also effective at adapting their knowledge to novel situations and displaying confidence in their abilities.

Excellent analytical capabilities
Provides well-reasoned recommendations
Demonstrates a solid understanding of complex concepts
Regularly demonstrates the ability to think analytically and critically
Effectively identifies and addresses complex problems with well-thought-out solutions
Shows exceptional skill in generating innovative ideas and solutions
Exhibits a consistently high level of decision-making based on sound reasoning
Proactively seeks out new information to improve critical thinking skills
Routinely identifies potential challenges and provides solutions
Typically recognizes and prioritizes the most relevant information
Logical thinking is evident in daily decision-making
Often weighs the pros and cons of multiple options before selecting a course of action

“Eric’s critical thinking skills have consistently exceeded expectations throughout his tenure at the company. He is skilled at reviewing and analyzing complex information, leading him to provide well-reasoned recommendations and insights. Eric regularly demonstrates a deep understanding of complicated concepts, which allows him to excel in his role.”

“In this evaluation period, Jane has consistently demonstrated an exceptional ability to think critically and analytically. She has repeatedly shown skill in identifying complex issues while working on projects and has provided well-thought-out and effective solutions. Her innovative ideas have contributed significantly to the success of several key initiatives. Moreover, Jane’s decision-making skills are built on sound reasoning, which has led to positive outcomes for the team and organization. Additionally, she actively seeks opportunities to acquire new information and apply it to her work, further strengthening her critical thinking capabilities.”

“John consistently exceeds expectations in his critical thinking abilities. He routinely identifies potential challenges and provides thoughtful solutions. He is skilled at recognizing and prioritizing the most relevant information to make well-informed decisions. John regularly weighs the pros and cons of various options and selects the best course of action based on logic.”

3 – Meets Expectations

Employees meeting expectations in critical thinking skills demonstrate an ability to analyze information and draw logical conclusions. They are effective at problem-solving and can make informed decisions with minimal supervision.

Capable of processing information and making informed decisions
Displays problem-solving skills
Demonstrates logical thinking and reasoning
Consistently demonstrates the ability to analyze problems and find possible solutions.
Actively engages in group discussions and contributes valuable ideas.
Demonstrates the ability to draw conclusions based on logical analysis of information.
Shows willingness to consider alternative perspectives when making decisions.
Weighs the pros and cons of a situation before reaching a decision.
Usually identifies relevant factors when faced with complex situations
Demonstrates an understanding of cause and effect relationships
Generally uses sound reasoning to make decisions
Listens to and considers different perspectives

“Sarah consistently meets expectations in her critical thinking skills, successfully processing information and making informed decisions. She has shown her ability to solve problems effectively and displays logical reasoning when approaching new challenges. Sarah continues to be a valuable team member thanks to these critical thinking skills.”

“Jane is a team member who consistently meets expectations in regards to her critical thinking skills. She demonstrates an aptitude for analyzing problems within the workplace and actively seeks out potential solutions by collaborating with her colleagues. Jane is open-minded and makes an effort to consider alternative perspectives during decision-making processes. She carefully weighs the pros and cons of the situations she encounters, which helps her make informed choices that align with the company’s objectives.”

“David meets expectations in his critical thinking skills. He can usually identify the relevant factors when dealing with complex situations and demonstrates an understanding of cause and effect relationships. David’s decision-making is generally based on sound reasoning, and he listens to and considers different perspectives before reaching a conclusion.”

2 – Needs Improvement

Employees in need of improvement in critical thinking skills may struggle with processing information and making logical conclusions. They may require additional guidance when making decisions or solving problems.

Struggles with analyzing complex information
Requires guidance when working through challenges
Difficulty applying past experiences to new situations
With some guidance, Jane is able to think critically, but she struggles to do so independently.
John tends to jump to conclusions without analyzing a situation fully.
Sarah’s problem-solving skills need improvement, as she often overlooks important information when making decisions.
David’s critical thinking skills are limited and need further development to enhance his overall work performance.
Occasionally struggles to identify and analyze problems effectively
Inconsistently uses logic to make decisions
Often overlooks important information or perspectives
Requires guidance in weighing options and making judgments

“Bob’s critical thinking skills could benefit from further development and improvement. He often struggles when analyzing complex information and tends to need additional guidance when working through challenges. Enhancing Bob’s ability to apply his past experiences to new situations would lead to a notable improvement in his overall performance.”

“Jenny is a valuable team member, but her critical thinking skills need improvement before she will be able to reach her full potential. In many instances, Jenny makes decisions based on her first impressions without questioning the validity of her assumptions or considering alternative perspectives. Her tendency to overlook key details has led to several instances in which her solutions are ineffective or only partly beneficial. With focused guidance and support, Jenny has the potential to develop her critical thinking skills and make more informed decisions in the future.”

“Tom’s critical thinking skills require improvement. He occasionally struggles to identify and analyze problems effectively, and his decision-making is inconsistent in its use of logic. Tom often overlooks important information or perspectives and may require guidance in weighing options and making judgments.”

1 – Unacceptable

Employees with unacceptable critical thinking skills lack the ability to analyze information effectively, struggle with decision-making, and fail to solve problems without extensive support from others.

Fails to draw logical conclusions from information
Incapable of making informed decisions
Unable to solve problems without extensive assistance
Fails to analyze potential problems before making decisions
Struggles to think critically and ask relevant questions
Cannot effectively identify alternative solutions
Lacks the ability to apply logic and reason in problem-solving situations
Does not consistently seek input from others or gather information before making a decision
Regularly fails to recognize or address important issues
Makes hasty decisions without considering potential consequences
Lacks objectivity and often relies on personal biases
Resistant to alternative viewpoints and constructive feedback

“Unfortunately, Sue’s critical thinking skills have been consistently unacceptable. She fails to draw logical conclusions from available information and is incapable of making informed decisions. Sue has also shown that she is unable to solve problems without extensive assistance from others, which significantly impacts her performance and the team’s productivity.”

“Jane’s performance in critical thinking has been unacceptable. She often fails to analyze potential problems before making decisions and struggles to think critically and ask relevant questions. Jane’s inability to effectively identify alternative solutions and apply logic and reason in problem-solving situations has negatively impacted her work. Furthermore, she does not consistently seek input from others or gather information before making a decision. It is crucial for Jane to improve her critical thinking skills to become a more effective and valuable team member.”

“Susan’s critical thinking skills are unacceptable. She regularly fails to recognize and address important issues, and her decision-making is often hasty and without considering potential consequences. Susan frequently lacks objectivity and tends to rely on personal biases. She is resistant to alternative viewpoints and constructive feedback, which negatively affects her work performance.”

Job Knowledge Performance Review Phrases (Examples)
100 Performance Review Phrases for Job Knowledge, Judgment, Listening Skills
100+ Performance Evaluation Comments for Attitude, Training Ability, Critical Thinking
How to Write an Effective Performance Review (Essential Steps)
How To Write a Manager Performance Review? (with Examples)
60 Self-Performance Review Goals Examples

The Watson Glaser Critical Thinking Appraisal

What Is the Watson Glaser Test?

Who uses the watson glaser test and why, why is it so important to be a critical thinker, what is the watson glaser red model, how to pass a watson glaser test in 2024, how to prepare for a watson glaser critical appraisal in 2024, frequently asked questions, the watson glaser critical thinking appraisal.

Updated May 10, 2024

Modern employers have changed the way that they recruit new candidates. They are no longer looking for people who have the technical skills on paper that match the job description.

Instead, they are looking for candidates who can demonstrably prove that they have a wider range of transferrable skills.

One of those key skills is the ability to think critically .

Firms (particularly those in sectors such as law, finance, HR and marketing ) need to know that their employees can look beyond the surface of the information presented to them.

They want confidence that their staff members can understand, analyze and evaluate situations or work-related tasks. There is more on the importance of critical thinking later in this article.

This is where the Watson Glaser Critical Thinking test comes into play.

The Watson Glaser critical thinking test is a unique assessment that provides a detailed analysis of a participant’s ability to think critically.

The test lasts 30 minutes and applicants can expect to be tested on around 40 questions in five distinct areas :

Assumptions

Interpretation.

The questions are multiple-choice and may be phrased as true/false statements in a bid to see how well the participant has understood and interpreted the information provided.

Employers around the world use it during recruitment campaigns to help hiring managers effectively filter their prospective candidates .

The Watson Glaser test has been used for more than 85 years; employers trust the insights that the test can provide.

In today’s competitive jobs market where every candidate has brought the best of themselves, it can be increasingly difficult for employers to decide between applicants.

On paper, two candidates may appear identical, with a similar level of education, work experience, and even interests and skills.

But that does not necessarily mean both or either of them is right for the job.

There is much information available on creating an effective cover letter and resume, not to mention advice on making a good impression during an interview.

As a result, employers are increasingly turning to psychometric testing to look beyond the information that they have.

They want to find the right fit: someone who has the skills that they need now and in the future. And with recruitment costs rising each year, making the wrong hiring decision can be catastrophic.

This is where the Watson Glaser test can help.

It can provide hiring managers with the additional support and guidance they need to help them make an informed decision.

The Watson Glaser test is popular among firms working in professional services (such as law, banking and insurance) . It is used for recruitment for junior and senior positions and some of the world’s most recognized establishments are known for their use of the test.

The Bank of England, Deloitte, Hiscox, Linklaters and Hogan Lovells are just a few employers who enhance their recruitment processes through Watson Glaser testing.

Critical thinking is all about logic and rational thought. Finding out someone’s critical thinking skill level is about knowing whether they can assess whether they are being told the truth and how they can use inferences and assumptions to aid their decision-making.

If you are working in a high-pressure environment, having an instinctive ability to look beyond the information provided to the underlying patterns of cause-and-effect can be crucial to do your job well.

Although it is often thought of concerning law firms and finance teams, it is easy to see how critical thinking skills could be applied to a wide range of professions.

For example, HR professionals dealing with internal disputes may need to think critically. Or social workers and other health professionals may need to use critical thinking to assess whether someone is vulnerable and in need of help and support when that person does not or cannot say openly.

Practice Watson Glaser Test with TestHQ

Critical thinking is about questioning what you already know . It is about understanding how to find the facts and the truth about a situation or argument without being influenced by other people’s opinions .

It is also about looking at the bigger picture and seeing how decisions made now may have short-term benefits but long-term consequences.

For those working in senior managerial roles, this ability to think objectively can make a big difference to business success.

As part of the critical thinking assessment, the Watson Glaser Test focuses on the acronym, 'RED':

R ecognize assumptions
E valuate arguments
D raw conclusions

Put simply, the RED model ensures you can understand how to move beyond subconscious bias in your thinking. It ensures that you can identify the truth and understand the differences between fact and opinion.

To recognize assumptions , you must understand yourself and others: what your thought patterns and past experiences have led you to conclude about the world.

Evaluating arguments requires you to genuinely consider the merits of all options in a situation, and not just choose the one you feel that you ‘ought’ to.

Finally, to draw an accurate and beneficial conclusion you must trust your decision-making and understanding of the situation.

Watson Glaser Practice Test Questions & Answers

As mentioned earlier, the Watson Glaser Test assesses five core elements. Here, they will be examined in more depth:

This part of the test is about your ability to draw conclusions based on facts . These facts may be directly provided or may be assumptions that you have previously made.

Within the assessment, you can expect to be provided with a selection of text. Along with the text will be a statement.

You may need to decide whether that statement is true, probably true, insufficient data (neither true nor false), probably false or false.

The test looks to see if your answer was based on a conclusion that could be inferred from the text provided or if it is based on an assumption you previously made.

Take a Watson Glaser Practice Test

Example Statement:

500 students recently attended a voluntary conference in New York. During the conference, two of the main topics discussed were issues relating to diversity and climate change. This is because these are the two issues that the students selected that are important to them.

Many people make decisions based on assumptions. But you need to be able to identify when assumptions are being made.

Within the Watson Glaser test , you will be provided with a written statement as well as an assumption.

You will be asked to declare whether that assumption was made in the text provided or not .

This is an important part of the test; it allows employers to understand if you have any expectations about whether things are true or not . For roles in law or finance, this is a vital skill.

We need to save money, so we’ll visit the local shops in the nearest town rather than the local supermarket

As a core part of critical thinking, 'deduction' is the ability to use logic and reasoning to come to an informed decision .

You will be presented with several facts, along with a variety of conclusions. You will be tasked with confirming whether those conclusions can be made from the information provided in that statement.

The answers are commonly in a ‘Yes, it follows/No, it does not follow’ form.

It is sometimes sunny on Wednesdays. All sunny days are fun. Therefore…

If you need to prepare for a number of different employment tests and want to outsmart the competition, choose a Premium Membership from TestHQ . You will get access to three PrepPacks of your choice, from a database that covers all the major test providers and employers and tailored profession packs.

Get a Premium Package Now

Critical thinking is also about interpreting the information correctly. It is about using the information provided to come to a valuable, informed decision .

Like the deduction questions, you will be provided with a written statement, which you must assume to be true.

You will also be provided with a suggested interpretation of that written statement. You must decide if that interpretation is correct based on the information provided, using a yes/no format.

A study of toddlers shows that their speech can change significantly between the ages of 10 months and three years old. At 1 year old, a child may learn their first word whereas at three years old they may know 200 words

Evaluation of Arguments

This final part requires you to identify whether an argument is strong or weak . You will be presented with a written statement and several arguments that can be used for or against it. You need to identify which is the strongest argument and which is the weakest based on the information provided.

Should all 18-year-olds go to college to study for a degree after they have graduated from high school?

There are no confirmed pass/fail scores for Watson Glaser tests; different sectors have different interpretations of what is a good score .

Law firms, for example, will require a pass mark of at least 75–80% because the ability to think critically is an essential aspect of working as a lawyer.

As a comparative test, you need to consider what the comparative ‘norm’ is for your chosen profession. Your score will be compared to other candidates taking the test and you need to score better than them.

It is important to try and score as highly as you possibly can. Your Watson Glaser test score can set you apart from other candidates; you need to impress the recruiters as much as possible.

Your best chance of achieving a high score is to practice as much as possible in advance.

Everyone will have their own preferred study methods, and what works for one person may not necessarily work for another.

However, there are some basic techniques everyone can use, which will enhance your study preparation ahead of the test:

Step 1 . Pay Attention to Online Practice Tests

There are numerous free online training aids available; these can be beneficial as a starting point to your preparation.

However, it should be noted that they are often not as detailed as the actual exam questions.

When researching for online test questions, make sure that any questions are specific to the Watson Glaser Test , not just critical thinking.

General critical thinking questions can help you improve your skills but will not familiarize you with this test. Therefore, make sure you practice any questions which follow the ‘rules’ and structure of a Watson Glaser Test .

Step 2 . Paid-for Preparation Packs Can Be Effective

If you are looking for something that mimics the complexity of a Watson Glaser test , you may wish to look at investing in a preparation pack.

There are plenty of options available from sites such as TestHQ . These are often far more comprehensive than free practice tests.

They may also include specific drills (which take you through each of the five stages of the test) as well as study guides, practice tests and suggestions of how to improve your score.

Psychologically, if you have purchased a preparation pack, you may be more inclined to increase your pre-test practice/study when compared to using free tools, due to having invested money.

Step 3 . Apply Critical Thinking to All Aspects of Your Daily Routine

The best way to improve your critical thinking score is to practice it every day.

It is not just about using your skills to pass an exam question; it is about being able to think critically in everyday scenarios.

Therefore, when you are reading the news or online articles, try to think whether you are being given facts or you are making deductions and assumptions from the information provided.

The more you practice your critical thinking in these scenarios, the more it will become second nature to you.

You could revert to the RED model: recognize the assumptions being made, by you and the author; evaluate the arguments and decide which, if any, are strong; and draw conclusions from the information provided and perhaps see if they differ from conclusions drawn using your external knowledge.

Prepare for Watson Glaser Test with TestHQ

Nine Top Tips for Ensuring Success in Your Watson Glaser Test

If you are getting ready to participate in a Watson Glaser test, you must be clear about what you are being asked to do.

Here are a few tips that can help you to improve your Watson Glaser test score.

1. Practice, Practice, Practice

Critical thinking is a skill that should become second nature to you. You should practice as much as possible, not just so that you can pass the test, but also to feel confident in using your skills in reality.

2. The Best Success Is Based on the Long-Term Study

To succeed in your Watson Glaser test , you need to spend time preparing.

Those who begin studying in the weeks and months beforehand will be far more successful than those who leave their study to the last minute.

3. Acquaint Yourself With the Test Format

The Watson Glaser test has a different type of question to other critical thinking tests.

Make sure that you are aware of what to expect from the test questions. The last thing you want is to be surprised on test day.

4. Read the Instructions Carefully

This is one of the simplest but most effective tips. Your critical thinking skills start with understanding what you are being asked to do. Take your time over the question.

Although you may only have 30 minutes to complete the test, it is still important that you do not rush through and submit the wrong answers. You do not get a higher score if you finish early, so use your time wisely.

5. Only Use the Information Provided in the Question

Remember, the purpose of the test is to see if you can come to a decision based on the provided written statement.

This means that you must ignore anything that you think you already know and focus only on the information given in the question.

6. Widen Your Non-Fictional Reading

Reading a variety of journals, newspapers and reports, and watching examples of debates and arguments will help you to improve your skills.

You will start to understand how the same basic facts can be presented in different ways and cause people to draw different conclusions.

From there, you can start to enhance your critical thinking skills to go beyond the perspective provided in any given situation.

7. Be Self-Aware

We all have our own biases and prejudices whether we know them or not. It is important to think about how your own opinions and life experiences may impact how you perceive and understand situations.

For example, someone who has grown up with a lot of money may have a different interpretation of what it is like to go without, compared to someone who has grown up in extreme poverty.

It is important to have this self-awareness as it is important for understanding other people; this is useful if you are working in sectors such as law.

8. Read the Explanations During Your Preparation

To make the most of practice tests, make sure you read the analysis explaining the answers, regardless of if you got the question right or wrong.

This is the crux of your study; it will explain the reasoning why a certain answer is correct, and this will help you understand how to choose the correct answers.

9. Practice Your Timings

You know that you will have five sections to complete in the test. You also know that you have 30 minutes to complete the test.

Therefore, make sure that your timings are in sync within your practice, so you can work your way through the test in its entirety.

Time yourself on how long each section takes you and put in extra work on your slowest.

What score do you need to pass the Watson Glaser test?

There is no standard benchmark score to pass the Watson Glaser test . Each business sector has its own perception of what constitutes a good score and every employer will set its own requirements.

It is wise to aim for a Watson Glaser test score of at least 75%. To score 75% or higher, you will need to correctly answer at least 30 of the 40 questions.

The employing organization will use your test results to compare your performance with other candidates within the selection pool. The higher you score in the Watson Glaser test , the better your chances of being hired.

Can you fail a Watson Glaser test?

It is not possible to fail a Watson Glaser test . However, your score may not be high enough to meet the benchmark set by the employing organization.

By aiming for a score of at least 75%, you stand a good chance of progressing to the next stage of the recruitment process.

Are Watson Glaser tests hard?

Many candidates find the Watson Glaser test hard. The test is designed to assess five different aspects of logical reasoning skills. Candidates must work under pressure, which adds another dimension of difficulty.

By practicing your critical thinking skills, you can improve your chances of achieving a high score on the Watson Glaser test .

How do I prepare for Watson Glaser?

To prepare for Watson Glaser , you will need to practice your critical thinking abilities. This can be achieved through a range of activities; for example, reading a variety of newspapers, journals and other literature.

Try applying the RED model to your reading – recognize the assumptions being made (both by you and the writer), evaluate the arguments and decide which of these (if any) are strong.

You should also practice drawing conclusions from the information available to you.

Online Watson Glaser practice assessments are a useful way to prepare for Watson Glaser. These practice tests will give you an idea of what to expect on the day, although the questions are not usually as detailed as those in the actual test.

You might also consider using a paid-for Watson Glaser preparation pack, such as the one available from TestHQ . Preparation packs provide a comprehensive test guide, including practice tests and recommendations on how to improve your test score.

How long does the Watson Glaser test take?

Candidates are allowed 30 minutes to complete the Watson Glaser test . The multiple-choice test questions are grouped into five distinct areas – assumptions, deduction, evaluation, inference and interpretation.

Which firms use the Watson Glaser test?

Companies all over the world use the Watson Glaser test as part of their recruitment campaigns.

It is a popular choice for professional service firms, including banking, law, and insurance. Firms using the Watson Glaser test include the Bank of England, Hiscox, Deloitte and Clifford Chance.

How many times can you take the Watson Glaser test?

Most employers will only allow you to take the Watson Glaser test once per application. However, you may take the Watson Glaser test more than once throughout your career.

What is the next step after passing the Watson Glaser test?

The next step after passing the Watson Glaser test will vary between employers. Some firms will ask you to attend a face-to-face interview after passing the Watson Glaser test, others will ask you to attend an assessment center. Speak to the hiring manager to find out the process for the firm you are applying for.

Start preparing in advance for the Watson Glaser test

The Watson Glaser test differs from other critical thinking tests. It has its own rules and formations, and the exam is incredibly competitive. If you are asked to participate in a Watson Glaser test it is because your prospective employer is looking for the ‘best of the best’. Your aim is not to simply pass the test; it is to achieve a higher score than anyone else taking that test .

Therefore, taking the time to prepare for the Watson Glaser test is vital for your chances of success. You need to be confident that you know what you are being asked to do, and that you can use your critical thinking skills to make informed decisions.

Your study is about more than helping you to pass a test; it is about providing you with the skills and capability to think critically about information in the ‘real world’ .

You might also be interested in these other Psychometric Success articles:

Or explore the Aptitude Tests / Test Types sections.

Watson-Glaser Assessments: Guidelines & Practice Examples

Originally designed by Goodwin Watson and Edward Glaser, The Watson-Glaser Critical Thinking Appraisal (Form AM) was a measurement of “how well you are able to reason analytically and logically.” After their extensive use during World War One, experts increasingly used the tests as a tool to rank and filter individuals in contexts including (but not limited to) education and employment. In this article, we’ll be providing you with an overview of The Watson-Glaser Critical Thinking Appraisal, its test format, and question examples for your practice.

Table of Contents

What is a Watson Glaser test?

The Watson Glaser Assessment (Watson Glaser Critical Thinking Appraisal) is designed by Pearson Talentlens – a part of the famous Pearson education publishing house. The assessment is a quick, consistent, and accurate measurement of the test-takers ability to analyze, reason, interpret and draw logical conclusions from written information .

This critical thinking test has five scales which are the elementary units of critical thinking and reasoning . These five units serve as parameters to measure all areas of critical thinking ability.

The test is administered to appraising adults (16 years and above) with questions of varying difficulty and format.

Watson Glaser Test format

The Watson Glaser Critical Thinking Appraisal is a timed test. It can be administered both online and offline, depending on the company you are applying to.

For the online version (W-G III), the test is suitable for the unproctored screening of job applicants . Questions are selected randomly from a larger pool of questions called “item bank”. This helps minimize the possibility of cheating due to the fact that there are no applicants having the same set of questions.
For the offline version (W-G II Forms D and E), applicants have to take the test under supervised conditions .

Upon finishing, applicants receive a percentile score with norm groups either provided by Pearson Talentlens or designed by the company.

Popular test formats are as follows:

40 questions – 30 minutes
80 questions – 60 minutes

The question distribution in a 40-question Watson Glaser test includes the following:

Inference – 5 questions
Recognition of assumptions – 12 questions
Deduction – 5 questions
Interpretation – 6 questions
Evaluation – 12 questions

Watson Glaser test: 5 question types & examples

Five types of questions appearing in the test are

Infer questions

Recognize Assumption questions

Deduce questions

Interpret questions.

Evaluate Argument questions

You will find five choices of answers for each inference in the question: True, Probably True, Insufficient Data, Probably False, and False. Your job is to determine which choice best fits the hypothesis.

True : If you think the inference is definitely TRUE; that it properly follows beyond a reasonable doubt from the statement of facts given.
Probably True : If, in the light of the facts given, you think the inference is Probably True; that it is more likely to be true than false.
Insufficient Data : If you decide that there are Insufficient Data; that you cannot tell from the facts given whether the inference is likely to be true or false; if the facts provide no basis for judging one way or another.
Probably False : If, in the light of the facts given, you think the inference is Probably False; that it is more likely to be true than false.
False : If you think the inference is definitely False; that it is wrong, either because it misinterprets the facts given, or because it contradicts the facts or necessary inferences from those facts.

Unlike popular aptitude tests where you use solely given information, this test allows the use of specific commonly accepted knowledge or information that practically every person has.

Source: Pearson Talentlens

During the past month, managers scheduled for international assignments voluntarily attended our company’s cross-cultural business training workshop. All of the managers reported that the quality of the training was high and focused on valuable work skills that could be immediately applied.

The majority of training was devoted to rules and regulations for doing business in this country.

A. True B. Probably True C. Insufficient Data D. Probably False E. False

Answer : Probably False

Explanation : Probably False because the training focused on cross-cultural business. It cannot be considered definitely false because the specific course content is not provided.

Practice Example:

Chamonix is one of the oldest ski resorts in France. Last year, the Chamonix-Mont-Blanc Valley authorities introduced a climate and energy action plan, the first in the French Alps. The plan commits to reducing greenhouse gas emissions in the area by 22 percent. Among the proposed measures is a ban on the most polluting lorries using the nearby Mont Blanc tunnel. Climate change will have a major impact on the valley’s main economic activities: less snow on low-altitude ski slopes and the risk of increased pressure on high-altitude ski slopes have been recorded in recent studies. Natural habitats, river patterns, forests, and agriculture might be radically transformed, increasing the likelihood of hazards such as avalanches, floods, and landslides.

Although air quality is a great concern for those living at the foot of Mont Blanc, noise pollution is arguably the most noticeable at a local level.

A. True B. ProbablyTrue C. Insufficient Data D. Probably False E. False

Answer : Insufficient Data

Explanation : The passage does not mention noise pollution, as well as its existence at local level.

Recognize assumption questions

In this question, you are presented with a statement and two choices “ Assumption made ” or “ Assumption not made “. Your job is to determine whether the statement is an assumption taken for granted (Assumption made) or an assumption not necessarily taken for granted (Assumption not made).

We need to save time in getting there so we’d better go by plane.

There is a plane service available to us for at least part of the distance to the destination.

A. Assumption made B. Assumption not made

Answer : Assumption made

Explanation :

This is assumed in the statement because, in order to save time by plane, it must be possible to go by plane.

While owning a pet can be expensive and is occasionally an inconvenience, it’s a good thing to do if you want to improve your chances of living a satisfying life.

Pet owners will always lead more satisfying lives than those who don’t own pets.

Answer : Assumption not made

From the given premises, we can only see that: if you want a satisfying life, it is a good thing to have a pet. However, having a pet does not definitely lead to a satisfying life. There is no indication to compare the satisfaction between having a pet or not having a pet as a way to live a satisfying life.

In this type of question, each item contains several statements (premises) followed by several suggested conclusions. For the purposes of the test, you must consider the given statements as true without exception. The question presents you with two options

Conclusion follows : If you think the conclusion necessarily follows from the statements given;
Conclusion does not follow : If you think it is not a necessary conclusion from the statements given.

Since the test requires you to regard given statements as completely true, you have to try not to let your common sense and existing knowledge interfere. You have to stick to only the given statements (premises) and make judgments as to whether it necessarily follows from the statement or not.

One thing to note is the use of the word “Some” in this type of question. It means an indefinite part or quantity of a class of things. It can be either a portion or perhaps all of the class.

Sample:

Some Sundays are rainy. All rainy days are boring. Therefore …

Some Sundays are boring.

A. Conclusion follows B. Conclusion does not follow

Answer : Conclusion follows

The conclusion necessarily follows from the statements because, according to them, rainy Sundays must be boring.

Damage to roads in the area has made them unsuitable for loads over one ton. These loads are being transported to the capital by air, but as air resources are limited they are restricted to carrying food and medical supplies. Roads cannot be repaired until medical emergencies are dealt with. Therefore, …

Food can be taken to the capital by road.

Answer : Conclusion does not follow

Roads can not be used to transport food in loads over one ton. Food loads over one ton are being transported by air. We are not sure whether food in loads under one ton are delivered by road or anything else.

An interpret question provides you with a short paragraph followed by several suggested conclusions. You must assume that everything in the short paragraph is true, for the purpose of the test. To answer the question, you have to judge whether or not each of the suggested conclusions logically follows beyond a reasonable doubt from the information presented in the paragraph.

You have two answer choices:

Conclusion follows : If you think the conclusions follow beyond a reasonable doubt (although they may not follow absolutely and necessarily);
Conclusion does not follow : If you think the conclusions doesn’t follow beyond a reasonable doubt from the facts given in the short paragraph.

As a rule of thumb, you should judge each conclusion independently from your common sense or outside knowledge.

Source: Watson Glaser

A study of vocabulary growth in children from ages eight months to six years old shows that the size of spoken vocabulary increases from zero words at age eight months to 2562 words at age six years.

Vocabulary is slowest during the period when children are learning to walk.

Answer : Conclusion does not follow.

The conclusion does not follow because there is no information given that relates the growth of vocabulary to walking.

An accounting computer program, MagicNumber, is Wisdom Software’s biggest-selling product, with its development involving 20% of programmers and 30% of marketing staff. DesignAid, a graphic design program, is the latest offering from the company. It is definitely expected to sell more copies than MagicNumber and will have fewer programmers working on its design, but more marketing staff.

DesignAid will bring in greater profits for the company than MagicNumber.

The paragraph only mentioned that DesignAid is expected to sell more than MagicNumber. This does not necessarily mean that DesignAid uiwll bring greater profit than MagicNumber.

Evaluate argument questions

The question involves distinguishing between strong and weak arguments, as far as the question at issue is concerned. In each question, there is a series of arguments that you must regard as true. Your job is to determine whether or not each of these arguments is a strong or a weak one.

Argument strong : If you think the argument is strong;
Argument weak: If you think the argument is weak.

For an objective evaluation of the argument, you must judge each argument independently on its own merit, without the influence of your personal perception.

One thing to note is the use of the word Should. By using Should at the beginning of each question, it means “Would the proposed action promote the general welfare of the people in your country?”

Should young adults in this country go to university?

No; a large percentage of young adults do not have enough ability or interest to derive any benefit from university training.

A. Argument strong B. Argument weak

Answer : Argument strong.

If this is true, as the directions require us to assume, it is a weighty argument against all young adults going to university.

Practice Example 5:

Is it worthwhile for a business to invest in training employees?

Yes, research shows the amount of money spent on training is positively related to profitability.

A. Argument Strong B. Argument Weak

Answer : Argument Strong

The explanation show that business can increase their profit by invest more money on training. This is a direct back up evidence for the claim.

Which companies use Watson Glaser tests?

Watson Glaser Tests are popular in the pre-employment process across sectors such as medical, marketing, education, legal, and professional services. The test can be used for different job levels like Graduates, Execs and Managerial, Supervisors, and Professionals., depending on the company hiring request.

There are a great number of UK companies using it for their pre-employment screening process. The names include the following

Simmons & Simmons
Hill Dickinson
Bank of England
Burges Salmon
Ince & Co
Government Legal Service
Irwin Mitchell
Clifford Chance
Hogan Lovells

Prepare for aptitude tests with MConsultingPrep

Explore MConsultingPrep’s Aptitude Test – a strategic & comprehensive practicing platform with

A question bank of +1000 aptitude questions (Numerical, Verbal & Logical)
A comprehensive explanation of every question
Evaluation and recording tools for performance reviews

You’ll be practicing more strategically with our test packages, to gain more confidence for every test question you might experience in your future aptitude tests.

Our massive question bank consists of a significant number of question variations from many test publishers and companies, across different companies & businesses.

With questions organized by type, you can leverage your preparation by

Focusing on practicing questions in specific types
Improving your performance in questions that you struggle with

With evaluation tools coming in handy, you have better insights into your overall performance, what you excel at, and what you need improvements on.

Scoring in the McKinsey PSG/Digital Assessment

The scoring mechanism in the McKinsey Digital Assessment

Aptitude Test Package

Simulating most common test publishers, this package provides you with 1400+ numerical, verbal and logical reasoning questions. Ace the aptitude test with our practical study guides tailored to each question type.

Let’s dive deep into aptitude tests: definition, different types, and free practice materials for this world-famous assessment tool!

Aptitude tests are usually compulsory in the application process. So how much time should you spend on learning to get a high score?

While the majority of aptitude tests contain multiple-choice questions, some test providers provide gamified assessments. Dive in the details now!

How to Prepare and Pass the Watson-Glaser Test

In the following article, we will explore one of the most challenging pre-employment tests in the UK and worldwide – the Watson Glaser test – which is most commonly used for recruitment in the legal sector.

Included are an overview of the test, its main challenges, and how to overcome them with effective practice methods. The article also features two brief introductory videos:

Video #1 – Structure, content, and practice tips

Video #2 – Step-by-step solutions to five Watson Glaser sample questions, to exemplify the rules and requirements of the test.

What Is the Watson Glaser Test?

The Watson Glaser Critical Thinking Appraisal (WGCTA) is a pre-employment test used primarily in the law industry. Some of the major employers using the test are Linklaters, Clifford Chance, Hogan Lovells, and the Government Legal Service. The test assesses your critical thinking – namely, your ability to analyse and interpret verbal information, draw conclusions, evaluate arguments, etc.

The test contains 40 questions divided into 5 sections, each one assessing a different aspect of critical thinking:

Recognition of Assumptions
Interpretation
Evaluation of Arguments

Visit the Complete Watson Glaser Test Guide for a full overview of the test sections and content, including sample questions and a free sample test.

The Watson Glaser Test Guide

Check out the following 3.5-minutes video for a complete overview of the Watson Glaser test:

What Are the Main Challenges of the Watson Glaser Test and How to Overcome Them?

The Watson Glaser test is indeed considered a difficult test, designed with very specific rules, and often requiring counterintuitive solving methods. And yet, with a good understanding of the three main challenges of the test and the ways to overcome them, you CAN improve your score and get the offers you want. Let’s see how:

Challenge #1 – A Single Trait Measured

The Watson Glaser test is aimed at assessing one thing only – your critical thinking. It does so in five different ways and being successful on all of them is the best guarantee to passing the test.

Overcoming Challenge #1 – Prepare for Test Sections as They Are

You have a test, so prepare for the test.

Learn how the Watson Glaser test questions look like, and practise that.

Once you have a grasp of the test, you can certainly construct your own practice plan using open sources. However, structured preparation plans such as JobTestPrep’s Watson Glaser Preparation Pack make it much easier, with practice material replicating the actual test’s rules and formatting.

Challenge #2 – A Unique Set of Rules

The Watson Glaser has its own set of rules, unparalleled by any other critical thinking test. For example:

Generalisation equals existence
“Probably True” and “Probably False” answer choices.

This makes the Watson Glaser test a unique, tailored testing experience, which requires a tailored preparation plan.

Overcoming Challenge #2 – Learn to Let Go

A major part of your preparation will be to uproot all your misconceptions about how to solve critical thinking questions and to learn how to ignore any irrelevant information. This may be the hardest part of you preparation. You will learn to go against what you believe to be true, just to get the question right. To beat your competitors, you must think like the test does and not like you do.

Want to see the test rules in action? Watch the following video , where we explain the logic behind five sample Watson Glaser questions, one of each category.

Challenge #3 – Intuition and Knowledge Will Fail You

The Watson Glaser test uses a collection of tactics to constantly elude, distract, and mislead you with near-correct answers. To avoid these pitfalls, you must understand the exact rules of the test and disregard anything else.

Up for the challenge? Try a 7-minutes free Watson Glaser sample test

Overcoming Challenge #3 – Develop Thinking Algorithms

One of the best ways to make sure you set your own beliefs and opinions aside is developing thinking algorithms – a methodical series of simple Q&As that lead you to the correct answer. For instance:

Evaluation of Arguments– ITDN table
Recognition of Assumptions – The Negative Test
Inference – Common Inference vs. Common Knowledge

With some focused practice, thinking algorithms will replace your intuition and personal knowledge as your main critical thinking tool.

This article was written by Shlomik Silbiger, JobTestPrep’s expert on the Watson Glaser test. If you have any questions, contact [email protected]

Free access to JobTestPrep for Oxford University students

As an Oxford University student, you can get free access to JobTestPrep via the Careers Service to practise for a wide variety of online recruitment tests, including Watson Glaser CTA, e-tray exercises and assessment centres as well as numerical-, verbal- and spatial-reasoning tests. Find out how you can gain access >>

Numerical Reasoning
Verbal Reasoning
Inductive Reasoning
Logical Reasoning
Situational Judgement
Mechanical Reasoning
Watson Glaser Critical thinking
Deductive reasoning
Abstract reasoning
Spatial reasoning
Error checking
Verbal comprehension
Reading comprehension
Diagrammatic Reasoning
Psychometric tests
Personality test
In-Tray exercise
E-Tray exercise
Competency based assessment
Game based assessments
Analysis exercise
Group exercise
Presentation exercise
Video interview
Strengths based assessment
Strengths based interviews
Saville Assessment
Talent Q / Korn Ferry
Watson Glaser
Criterion Partnership
Test Partnership
Cut-e / Aon
Team Focus PFS
Sova Assessment

Watson Glaser Critical Thinking Practice Tests and Advice

Critical thinking tests are high-level aptitude tests, with the Watson-Glaser being the most common.

Buy critical tests
Start for free

Page contents:

What is a critical thinking test, critical thinking test format.

Watson Glaser critical thinking explained

Critical thinking arguments tutorial

Free watson glaser practice tests, critical thinking assumptions tutorial.

What does a critical test measure?

Critical thinking deductions tutorial

Most popular critical thinking tests

Critical thinking inferences tutorial

How to pass Watson Glaser test

Watson Glaser FAQs

Updated: 24 August 2023

A critical thinking test is used to assess your ability to logically analyse assumptions, arguments, deductions, inferences and interpreting information. Critical thinking can be defined as ‘the ability to consider a range of information derived from many different sources, to process this information in a creative and logical manner, challenging it, analysing it and arriving at considered conclusions which can be defended and justified’ (Moon, 2008).

Critical reasoning tests, also known as critical thinking tests, are psychometric tests commonly used in graduate, professional and managerial recruitment. These high-level analytical test are most commonly encountered in the legal sector, but other organisations such as the Bank of England also use them as part of their selection process.

If we lack critical thinking skills, it is possible to be misguided into believing that an argument is strong, when in actual fact there is little evidence to support it. Critical thinking skills therefore include the ability to structure a sound, solid argument, to analyse and synthesise available information, and to make assumptions and inferences. Critical thinking skills are also about being able to evaluate the information and draw conclusions that can be supported.

Your critical thinking test may be pencil and paper or, more likely, it may be administered online. Which one you take will often depend on the format and the structure of the recruitment process. The questions will be multiple choice format and will usually be administered under time constraints.

Common test formats are as follows:

40 questions - 30 minutes
80 question - 60 minutes

Once you understand the format of your test, you are much more likely to perform better. Practice is the best way to maximise your chances of test success.

Watson Glaser critical thinking appraisal explained

By far the most common type of critical thinking test is the Watson-Glaser Critical Thinking Appraisal (W-GCTA) which is published by TalentLens. You can visit their official site here: Watson Glaser . With over 85 years' worth of development, the Watson-Glaser Critical Thinking Appraisal is the most popular measure of critical thinking ability. The test is most commonly used by law firms, which is understandable as the abilities measured by the W-GCTA are good predictors of future success in roles which require clarity of understanding from multiple perspectives and the ability to reason with fact versus assumption.

The Watson-Glaser Thinking Appraisal (W-GCTA) is one of the main evaluating tools for cognitive abilities in professionals, since it measures critical thinking. It is seen as a successful tool to predict job success, as well as being used to select good managers and finding possible future leaders. It is also used in order to select the right person for a specific job role, especially for careers in the law.

Did You Know

The W-GCTA was originally developed by Goodwin Watson and Edward Glaser. The W-GCTA measures the critical skills that are necessary for presenting in a clear, structured, well-reasoned way, a certain point of view and convincing others of your argument. The test questions are looking at the individual’s ability to:

Make correct inferences
To recognise assumptions
To make deductions
To come to conclusions
To interpret and evaluate arguments

The following video features Ben explain how to answer an arguments-style question from a critical thinking test:

Free Critical Thinking Test

We have broken down a critical thinking test into the different sections. You can try each section or take the full test (86 questions, 60 minutes).

Critical Thinking Test 1

40 questions

Critical Thinking Test 2

Critical thinking test 3, critical thinking test 4.

The following video features Ben explain how to answer an assumptions-style question from a critical thinking test:

Master aptitude tests and become the #1 candidate

Get a completely free starter account

Over 20 tests
Track your progress

woman sitting next to illustrations of assessmentday platform

What does a critical thinking test measure?

Critical thinking tests assess your ability to logically analyse assumptions, arguments, deductions, inferences and interpreting information. You will be given a passage of information which may contain a mixture of verbal and numerical data, and will be provided with a statement which requires the candidate’s critical assessment of how true that statement is based on the above passage.

The Watson and Glaser Critical Thinking Appraisal contains five sections which are specially designed in order to find out how good an individual is at reasoning analytically and logically. There are five sections:

Assumptions: In these questions a statement will be presented and the candidate will have to decide if an assumption has been made in making the statement. For example in the statement “only people earning a high salary can afford a fast car” it is assumed that fast cars cost more than not fast cars (this is just one of many assumptions implicit in the statement). An assumption is something someone effectively takes for granted. Statements are given for the individual to read and they are then followed by several proposed assumptions. The candidate has to select whether an assumption has or has not been made.
Analysing arguments: Candidates will be provided with a given scenario i.e. “Should the government pay student’s tuition fees?” They are subsequently provided with a list of arguments for or against the scenario presented. The candidate will need to assess if each argument is strong or weak, based on how relevant it is and how well it addresses the question. The argument is considered to be strong if it directly relates to the question or statement, and weak if it is not directly related to the question or statement.
Deductions: Candidates will be provided with a passage of information and candidates will need to evaluate a list of deductions made based on that passage. If one cannot deduce a particular statement from the passage, then that deduction does not follow, and the candidate must select which deductions follow and which do not follow. The answer must be entirely based on the statements made and not on conclusions made from one’s own knowledge.
Inferences: In this section candidates will be provided with a passage of information on a scenario. A subsequent list of possible inferences will follow, and candidates will be asked to rate if they are true, false, possibly true, possibly false or whether it is not possible to say based on the information in the passage.
Interpreting Information: A paragraph of information will be provided to the candidate, with a list of possible conclusions. Candidates will need to interpret the information in the paragraph and decide if each conclusion follows based on the presented information. Once again the decisions must solely be based on the information given.

With so many sections, each having their own instructions and guidelines, it can be tough to become confident on all areas.

Survey results

We asked critical thinking test takers what they found was the most difficult section of a critical thinking test. 35% of them believed 'assumptions' to be the most difficult. You can see the full results below:

The following video features Ben explain how to answer a deductions-style question from a critical thinking test:

Most popular critical thinking test publishers

There may be variations in your test depending on the test publisher you have for your critical thinking test.

Throughout 2020, we analysed a sample of critical thinking tests to discover the most popular test publishers. It was found that 77% of critical thinking tests were published by Watson Glaser.

Here is a list of critical reasoning tests on the market at present, which candidates may be likely to encounter for recruitment, selection or development:

Watson Glaser Critical Thinking Appraisal: The W-GCTA is the most widely-used critical reasoning test on the market, and the one candidates are most likely to encounter.
SHL Critical Reasoning Test Battery: The SHL Critical Reasoning Test Battery is a collection of 60 critical reasoning questions with varying difficulty depending of the level of candidate. This test has a time limit of 30 minutes.
Cornell Critical Thinking Assessment: The Cornell Critical Thinking Assessment is a test primarily used in educational settings. There are two versions of this test, one for children and one for adults. This test may be used for entry onto particular degree courses or for recruitment/development purposes.
Cappfinity Critical Reasoning Test: This assesses your problem solving and decision making skills. Its topics have similarities with the Watson Glaser.
Test Partnership Concepts Critical Thinking Test: This also shares some similarities with the Watson Glaser. Test Partnership assesses the classic aspects of critical thinking with a modern candidate experience.

The following video features Ben explain how to answer an inference-style question from a critical thinking test:

How to pass Watson Glaser test - critical thinking tips

Here is some general advice to help you learn how to improve your Watson Glaser score:

Only use the information contained in the test: When reading the passages of information within the test, your first instinct may be to use general knowledge or your own personal experience. Critical reasoning tests are not tests of what you think; they are tests of how you think. You will not be required to utilise any prior knowledge when answering a question, and at times the correct answer will completely contradict what you know to be true based on your own knowledge, but is true in the context of the passage.
Read the instructions thoroughly: Critical reasoning tests will require numerous separate types of logical reasoning, and reading the instructions will inform you of how to answer questions correctly. For example if a question requires you to evaluate the strength of an argument, the instruction page will inform you what constitutes a strong or weak argument. Take ample time to ensure you know how to answer questions regardless of any time limits.
Pay attention to time limits: Due to the complex nature of critical reasoning tests, there will often be no time limits or there will be generous time limits. Candidates are advised to use this to their advantage and take plenty of time when reading, evaluating and answering. An easy mistake to make is treating this type of test like a verbal or numerical reasoning test and answering questions as quickly as possible. Rushing through a critical thinking test may lead to candidates missing key points, and answering incorrectly as a result.
Understand logical fallacies: Understanding logical fallacies is an important part of the test, and researching the difference between sound and fallacious logic can help maximise performance on a critical reasoning test. A fallacy is an error in reasoning due to a misconception or a presumption, and an argument which employs a formal fallacy, logical fallacy or a deductive fallacy in its reasoning becomes an invalid argument. Researching the different types of fallacy (i.e. red herring argument, straw man argument, confusing correlation and causation etc.) can help you identify them in the test and therefore answer the question correctly.

You will not be hired solely on your Watson Glaser score, but a score of 75% is a good score that will give you a good chance of progressing through selection rounds. When taking practice Watson Glaser tests try to achieve +75% in your raw score, this should be enough.

The Watson Glaser test has a time limit of 30 minutes. There is a total of 40 questions to complete within this time limit.

Yes, the Watson Glaser test is multiple-choice format and is split into the five section: assumptions, analysing arguments, deductions, inferences, interpreting information.

Most law firms will use a Watson Glaser test to assess the candidate's critical thinking ability. Some well known law firms include: Hogan Lovells, Clifford Chance, DLA Piper, Linklaters, Freshfields BD and others.

Critical thinking

Analysis and Evaluation

What is critical appraisal?

What can i critically appraise about the research, critical appraisal tools.

Creativity & Innovation
Reflective Practice
Training & events

Critical appraisal is a specific aspect of critical analysis where you examine and assess research in order to judge its:

Trustworthiness

You are evaluating the quality of the research and how it has been carried out, as well as the findings.

What you can choose to appraise will differ depending on the research methodology of the article and your field, so the suggestions below are general guidelines. Further down the page is a list of critical appraisal tools which are organised by and tailored to different types of research methodology.

Introduction - are there clear aims and objectives? Is the research question clear and focused?
Study design/choice of methodology - are they appropriate for what is being measured? Could the hypotheses/aim have been investigated using a different method?
Methodology - are there methodological protocols to limit bias? Have participants been appropriately selected? Is the sample size appropriate? Have they followed any protocols for data collection and performing the study?
Results and Statistical analysis - is raw data included? Have the findings been analysed accurately? Is there any potential measurement error? Has the reliability been considered? Is statistical significance considered?
Discussion/interpretation of results - are these linked back to the study aims? Have null findings been interpreted? Have limitations of the study been considered? Are conclusions/arguments justified by the results data?
External validity - can the results be generalised? Are the findings transferable to other settings or limited to the one where they were obtained?
Bias - design, sampling, data collection, measurement, reporting, analysis, publication, ethical issues. Has potential bias been addressed? Are conflicts of interest addressed?

Below is a suggested list of critical appraisal tools, which are checklists organised primarily by type of study, to help you identify what to critically appraise when reading a research article.These are primarily tailored to healthcare research but the principals can be adapted to other fields.

CASP (Critical Appraisal Skills Programme)

SIGN (Scottish Intercollegiate Guidelines Network)

Joanna Briggs Institute

Specialist Unit for Review Evidence (Cardiff University)

Centre for Evidence-Based Medicine (University of Oxford)

<< Previous: Analysis and Evaluation
Next: Creativity & Innovation >>
Last Updated: Jan 30, 2024 3:18 PM
URL: https://libguides.napier.ac.uk/criticalthinking

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Publications
Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

Advanced Search
Journal List
J Clin Diagn Res
v.11(5); 2017 May

Critical Appraisal of Clinical Research

Azzam al-jundi.

1 Professor, Department of Orthodontics, King Saud bin Abdul Aziz University for Health Sciences-College of Dentistry, Riyadh, Kingdom of Saudi Arabia.

Salah Sakka

2 Associate Professor, Department of Oral and Maxillofacial Surgery, Al Farabi Dental College, Riyadh, KSA.

Evidence-based practice is the integration of individual clinical expertise with the best available external clinical evidence from systematic research and patient’s values and expectations into the decision making process for patient care. It is a fundamental skill to be able to identify and appraise the best available evidence in order to integrate it with your own clinical experience and patients values. The aim of this article is to provide a robust and simple process for assessing the credibility of articles and their value to your clinical practice.

Introduction

Decisions related to patient value and care is carefully made following an essential process of integration of the best existing evidence, clinical experience and patient preference. Critical appraisal is the course of action for watchfully and systematically examining research to assess its reliability, value and relevance in order to direct professionals in their vital clinical decision making [ 1 ].

Critical appraisal is essential to:

Combat information overload;
Identify papers that are clinically relevant;
Continuing Professional Development (CPD).

Carrying out Critical Appraisal:

Assessing the research methods used in the study is a prime step in its critical appraisal. This is done using checklists which are specific to the study design.

Standard Common Questions:

What is the research question?
What is the study type (design)?
Selection issues.
What are the outcome factors and how are they measured?
What are the study factors and how are they measured?
What important potential confounders are considered?
What is the statistical method used in the study?
Statistical results.
What conclusions did the authors reach about the research question?
Are ethical issues considered?

The Critical Appraisal starts by double checking the following main sections:

I. Overview of the paper:

The publishing journal and the year
The article title: Does it state key trial objectives?
The author (s) and their institution (s)

The presence of a peer review process in journal acceptance protocols also adds robustness to the assessment criteria for research papers and hence would indicate a reduced likelihood of publication of poor quality research. Other areas to consider may include authors’ declarations of interest and potential market bias. Attention should be paid to any declared funding or the issue of a research grant, in order to check for a conflict of interest [ 2 ].

II. ABSTRACT: Reading the abstract is a quick way of getting to know the article and its purpose, major procedures and methods, main findings, and conclusions.

Aim of the study: It should be well and clearly written.
Materials and Methods: The study design and type of groups, type of randomization process, sample size, gender, age, and procedure rendered to each group and measuring tool(s) should be evidently mentioned.
Results: The measured variables with their statistical analysis and significance.
Conclusion: It must clearly answer the question of interest.

III. Introduction/Background section:

An excellent introduction will thoroughly include references to earlier work related to the area under discussion and express the importance and limitations of what is previously acknowledged [ 2 ].

-Why this study is considered necessary? What is the purpose of this study? Was the purpose identified before the study or a chance result revealed as part of ‘data searching?’

-What has been already achieved and how does this study be at variance?

-Does the scientific approach outline the advantages along with possible drawbacks associated with the intervention or observations?

IV. Methods and Materials section : Full details on how the study was actually carried out should be mentioned. Precise information is given on the study design, the population, the sample size and the interventions presented. All measurements approaches should be clearly stated [ 3 ].

V. Results section : This section should clearly reveal what actually occur to the subjects. The results might contain raw data and explain the statistical analysis. These can be shown in related tables, diagrams and graphs.

VI. Discussion section : This section should include an absolute comparison of what is already identified in the topic of interest and the clinical relevance of what has been newly established. A discussion on a possible related limitations and necessitation for further studies should also be indicated.

Does it summarize the main findings of the study and relate them to any deficiencies in the study design or problems in the conduct of the study? (This is called intention to treat analysis).

Does it address any source of potential bias?
Are interpretations consistent with the results?
How are null findings interpreted?
Does it mention how do the findings of this study relate to previous work in the area?
Can they be generalized (external validity)?
Does it mention their clinical implications/applicability?
What are the results/outcomes/findings applicable to and will they affect a clinical practice?
Does the conclusion answer the study question?
-Is the conclusion convincing?
-Does the paper indicate ethics approval?
-Can you identify potential ethical issues?
-Do the results apply to the population in which you are interested?
-Will you use the results of the study?

Once you have answered the preliminary and key questions and identified the research method used, you can incorporate specific questions related to each method into your appraisal process or checklist.

1-What is the research question?

For a study to gain value, it should address a significant problem within the healthcare and provide new or meaningful results. Useful structure for assessing the problem addressed in the article is the Problem Intervention Comparison Outcome (PICO) method [ 3 ].

P = Patient or problem: Patient/Problem/Population:

It involves identifying if the research has a focused question. What is the chief complaint?

E.g.,: Disease status, previous ailments, current medications etc.,

I = Intervention: Appropriately and clearly stated management strategy e.g.,: new diagnostic test, treatment, adjunctive therapy etc.,

C= Comparison: A suitable control or alternative

E.g.,: specific and limited to one alternative choice.

O= Outcomes: The desired results or patient related consequences have to be identified. e.g.,: eliminating symptoms, improving function, esthetics etc.,

The clinical question determines which study designs are appropriate. There are five broad categories of clinical questions, as shown in [ Table/Fig-1 ].

[Table/Fig-1]:

Categories of clinical questions and the related study designs.

2- What is the study type (design)?

The study design of the research is fundamental to the usefulness of the study.

In a clinical paper the methodology employed to generate the results is fully explained. In general, all questions about the related clinical query, the study design, the subjects and the correlated measures to reduce bias and confounding should be adequately and thoroughly explored and answered.

Participants/Sample Population:

Researchers identify the target population they are interested in. A sample population is therefore taken and results from this sample are then generalized to the target population.

The sample should be representative of the target population from which it came. Knowing the baseline characteristics of the sample population is important because this allows researchers to see how closely the subjects match their own patients [ 4 ].

Sample size calculation (Power calculation): A trial should be large enough to have a high chance of detecting a worthwhile effect if it exists. Statisticians can work out before the trial begins how large the sample size should be in order to have a good chance of detecting a true difference between the intervention and control groups [ 5 ].

Is the sample defined? Human, Animals (type); what population does it represent?
Does it mention eligibility criteria with reasons?
Does it mention where and how the sample were recruited, selected and assessed?
Does it mention where was the study carried out?
Is the sample size justified? Rightly calculated? Is it adequate to detect statistical and clinical significant results?
Does it mention a suitable study design/type?
Is the study type appropriate to the research question?
Is the study adequately controlled? Does it mention type of randomization process? Does it mention the presence of control group or explain lack of it?
Are the samples similar at baseline? Is sample attrition mentioned?
All studies report the number of participants/specimens at the start of a study, together with details of how many of them completed the study and reasons for incomplete follow up if there is any.
Does it mention who was blinded? Are the assessors and participants blind to the interventions received?
Is it mentioned how was the data analysed?
Are any measurements taken likely to be valid?

Researchers use measuring techniques and instruments that have been shown to be valid and reliable.

Validity refers to the extent to which a test measures what it is supposed to measure.

(the extent to which the value obtained represents the object of interest.)

-Soundness, effectiveness of the measuring instrument;
-What does the test measure?
-Does it measure, what it is supposed to be measured?
-How well, how accurately does it measure?

Reliability: In research, the term reliability means “repeatability” or “consistency”

Reliability refers to how consistent a test is on repeated measurements. It is important especially if assessments are made on different occasions and or by different examiners. Studies should state the method for assessing the reliability of any measurements taken and what the intra –examiner reliability was [ 6 ].

3-Selection issues:

The following questions should be raised:

- How were subjects chosen or recruited? If not random, are they representative of the population?
- Types of Blinding (Masking) Single, Double, Triple?
- Is there a control group? How was it chosen?
- How are patients followed up? Who are the dropouts? Why and how many are there?
- Are the independent (predictor) and dependent (outcome) variables in the study clearly identified, defined, and measured?
- Is there a statement about sample size issues or statistical power (especially important in negative studies)?
- If a multicenter study, what quality assurance measures were employed to obtain consistency across sites?
- Are there selection biases?
• In a case-control study, if exercise habits to be compared:
- Are the controls appropriate?
- Were records of cases and controls reviewed blindly?
- How were possible selection biases controlled (Prevalence bias, Admission Rate bias, Volunteer bias, Recall bias, Lead Time bias, Detection bias, etc.,)?
• Cross Sectional Studies:
- Was the sample selected in an appropriate manner (random, convenience, etc.,)?
- Were efforts made to ensure a good response rate or to minimize the occurrence of missing data?
- Were reliability (reproducibility) and validity reported?
• In an intervention study, how were subjects recruited and assigned to groups?
• In a cohort study, how many reached final follow-up?
- Are the subject’s representatives of the population to which the findings are applied?
- Is there evidence of volunteer bias? Was there adequate follow-up time?
- What was the drop-out rate?
- Any shortcoming in the methodology can lead to results that do not reflect the truth. If clinical practice is changed on the basis of these results, patients could be harmed.

Researchers employ a variety of techniques to make the methodology more robust, such as matching, restriction, randomization, and blinding [ 7 ].

Bias is the term used to describe an error at any stage of the study that was not due to chance. Bias leads to results in which there are a systematic deviation from the truth. As bias cannot be measured, researchers need to rely on good research design to minimize bias [ 8 ]. To minimize any bias within a study the sample population should be representative of the population. It is also imperative to consider the sample size in the study and identify if the study is adequately powered to produce statistically significant results, i.e., p-values quoted are <0.05 [ 9 ].

4-What are the outcome factors and how are they measured?

-Are all relevant outcomes assessed?
-Is measurement error an important source of bias?

5-What are the study factors and how are they measured?

-Are all the relevant study factors included in the study?
-Have the factors been measured using appropriate tools?

Data Analysis and Results:

- Were the tests appropriate for the data?

- Are confidence intervals or p-values given?

How strong is the association between intervention and outcome?
How precise is the estimate of the risk?
Does it clearly mention the main finding(s) and does the data support them?
Does it mention the clinical significance of the result?
Is adverse event or lack of it mentioned?
Are all relevant outcomes assessed?
Was the sample size adequate to detect a clinically/socially significant result?
Are the results presented in a way to help in health policy decisions?
Is there measurement error?
Is measurement error an important source of bias?

Confounding Factors:

A confounder has a triangular relationship with both the exposure and the outcome. However, it is not on the causal pathway. It makes it appear as if there is a direct relationship between the exposure and the outcome or it might even mask an association that would otherwise have been present [ 9 ].

6- What important potential confounders are considered?

-Are potential confounders examined and controlled for?
-Is confounding an important source of bias?

7- What is the statistical method in the study?

-Are the statistical methods described appropriate to compare participants for primary and secondary outcomes?
-Are statistical methods specified insufficient detail (If I had access to the raw data, could I reproduce the analysis)?
-Were the tests appropriate for the data?
-Are confidence intervals or p-values given?
-Are results presented as absolute risk reduction as well as relative risk reduction?

Interpretation of p-value:

The p-value refers to the probability that any particular outcome would have arisen by chance. A p-value of less than 1 in 20 (p<0.05) is statistically significant.

When p-value is less than significance level, which is usually 0.05, we often reject the null hypothesis and the result is considered to be statistically significant. Conversely, when p-value is greater than 0.05, we conclude that the result is not statistically significant and the null hypothesis is accepted.

Confidence interval:

Multiple repetition of the same trial would not yield the exact same results every time. However, on average the results would be within a certain range. A 95% confidence interval means that there is a 95% chance that the true size of effect will lie within this range.

8- Statistical results:

-Do statistical tests answer the research question?

Are statistical tests performed and comparisons made (data searching)?

Correct statistical analysis of results is crucial to the reliability of the conclusions drawn from the research paper. Depending on the study design and sample selection method employed, observational or inferential statistical analysis may be carried out on the results of the study.

It is important to identify if this is appropriate for the study [ 9 ].

-Was the sample size adequate to detect a clinically/socially significant result?
-Are the results presented in a way to help in health policy decisions?

Clinical significance:

Statistical significance as shown by p-value is not the same as clinical significance. Statistical significance judges whether treatment effects are explicable as chance findings, whereas clinical significance assesses whether treatment effects are worthwhile in real life. Small improvements that are statistically significant might not result in any meaningful improvement clinically. The following questions should always be on mind:

-If the results are statistically significant, do they also have clinical significance?
-If the results are not statistically significant, was the sample size sufficiently large to detect a meaningful difference or effect?

9- What conclusions did the authors reach about the study question?

Conclusions should ensure that recommendations stated are suitable for the results attained within the capacity of the study. The authors should also concentrate on the limitations in the study and their effects on the outcomes and the proposed suggestions for future studies [ 10 ].

-Are the questions posed in the study adequately addressed?
-Are the conclusions justified by the data?
-Do the authors extrapolate beyond the data?
-Are shortcomings of the study addressed and constructive suggestions given for future research?
-Bibliography/References:

Do the citations follow one of the Council of Biological Editors’ (CBE) standard formats?

10- Are ethical issues considered?

If a study involves human subjects, human tissues, or animals, was approval from appropriate institutional or governmental entities obtained? [ 10 , 11 ].

Critical appraisal of RCTs: Factors to look for:

Allocation (randomization, stratification, confounders).
Follow up of participants (intention to treat).
Data collection (bias).
Sample size (power calculation).
Presentation of results (clear, precise).
Applicability to local population.

[ Table/Fig-2 ] summarizes the guidelines for Consolidated Standards of Reporting Trials CONSORT [ 12 ].

[Table/Fig-2]:

Summary of the CONSORT guidelines.

Critical appraisal of systematic reviews: provide an overview of all primary studies on a topic and try to obtain an overall picture of the results.

In a systematic review, all the primary studies identified are critically appraised and only the best ones are selected. A meta-analysis (i.e., a statistical analysis) of the results from selected studies may be included. Factors to look for:

Literature search (did it include published and unpublished materials as well as non-English language studies? Was personal contact with experts sought?).
Quality-control of studies included (type of study; scoring system used to rate studies; analysis performed by at least two experts).
Homogeneity of studies.

[ Table/Fig-3 ] summarizes the guidelines for Preferred Reporting Items for Systematic reviews and Meta-Analyses PRISMA [ 13 ].

[Table/Fig-3]:

Summary of PRISMA guidelines.

Critical appraisal is a fundamental skill in modern practice for assessing the value of clinical researches and providing an indication of their relevance to the profession. It is a skills-set developed throughout a professional career that facilitates this and, through integration with clinical experience and patient preference, permits the practice of evidence based medicine and dentistry. By following a systematic approach, such evidence can be considered and applied to clinical practice.

Financial or other Competing Interests

1 Introduction to Critical Thinking

I. what is c ritical t hinking [1].

Critical thinking is the ability to think clearly and rationally about what to do or what to believe. It includes the ability to engage in reflective and independent thinking. Someone with critical thinking skills is able to do the following:

Understand the logical connections between ideas.
Identify, construct, and evaluate arguments.
Detect inconsistencies and common mistakes in reasoning.
Solve problems systematically.
Identify the relevance and importance of ideas.
Reflect on the justification of one’s own beliefs and values.

Critical thinking is not simply a matter of accumulating information. A person with a good memory and who knows a lot of facts is not necessarily good at critical thinking. Critical thinkers are able to deduce consequences from what they know, make use of information to solve problems, and to seek relevant sources of information to inform themselves.

Critical thinking should not be confused with being argumentative or being critical of other people. Although critical thinking skills can be used in exposing fallacies and bad reasoning, critical thinking can also play an important role in cooperative reasoning and constructive tasks. Critical thinking can help us acquire knowledge, improve our theories, and strengthen arguments. We can also use critical thinking to enhance work processes and improve social institutions.

Some people believe that critical thinking hinders creativity because critical thinking requires following the rules of logic and rationality, whereas creativity might require breaking those rules. This is a misconception. Critical thinking is quite compatible with thinking “out-of-the-box,” challenging consensus views, and pursuing less popular approaches. If anything, critical thinking is an essential part of creativity because we need critical thinking to evaluate and improve our creative ideas.

II. The I mportance of C ritical T hinking

Critical thinking is a domain-general thinking skill. The ability to think clearly and rationally is important whatever we choose to do. If you work in education, research, finance, management or the legal profession, then critical thinking is obviously important. But critical thinking skills are not restricted to a particular subject area. Being able to think well and solve problems systematically is an asset for any career.

Critical thinking is very important in the new knowledge economy. The global knowledge economy is driven by information and technology. One has to be able to deal with changes quickly and effectively. The new economy places increasing demands on flexible intellectual skills, and the ability to analyze information and integrate diverse sources of knowledge in solving problems. Good critical thinking promotes such thinking skills, and is very important in the fast-changing workplace.

Critical thinking enhances language and presentation skills. Thinking clearly and systematically can improve the way we express our ideas. In learning how to analyze the logical structure of texts, critical thinking also improves comprehension abilities.

Critical thinking promotes creativity. To come up with a creative solution to a problem involves not just having new ideas. It must also be the case that the new ideas being generated are useful and relevant to the task at hand. Critical thinking plays a crucial role in evaluating new ideas, selecting the best ones and modifying them if necessary.

Critical thinking is crucial for self-reflection. In order to live a meaningful life and to structure our lives accordingly, we need to justify and reflect on our values and decisions. Critical thinking provides the tools for this process of self-evaluation.

Good critical thinking is the foundation of science and democracy. Science requires the critical use of reason in experimentation and theory confirmation. The proper functioning of a liberal democracy requires citizens who can think critically about social issues to inform their judgments about proper governance and to overcome biases and prejudice.

Critical thinking is a metacognitive skill . What this means is that it is a higher-level cognitive skill that involves thinking about thinking. We have to be aware of the good principles of reasoning, and be reflective about our own reasoning. In addition, we often need to make a conscious effort to improve ourselves, avoid biases, and maintain objectivity. This is notoriously hard to do. We are all able to think but to think well often requires a long period of training. The mastery of critical thinking is similar to the mastery of many other skills. There are three important components: theory, practice, and attitude.

III. Improv ing O ur T hinking S kills

If we want to think correctly, we need to follow the correct rules of reasoning. Knowledge of theory includes knowledge of these rules. These are the basic principles of critical thinking, such as the laws of logic, and the methods of scientific reasoning, etc.

Also, it would be useful to know something about what not to do if we want to reason correctly. This means we should have some basic knowledge of the mistakes that people make. First, this requires some knowledge of typical fallacies. Second, psychologists have discovered persistent biases and limitations in human reasoning. An awareness of these empirical findings will alert us to potential problems.

However, merely knowing the principles that distinguish good and bad reasoning is not enough. We might study in the classroom about how to swim, and learn about the basic theory, such as the fact that one should not breathe underwater. But unless we can apply such theoretical knowledge through constant practice, we might not actually be able to swim.

Similarly, to be good at critical thinking skills it is necessary to internalize the theoretical principles so that we can actually apply them in daily life. There are at least two ways to do this. One is to perform lots of quality exercises. These exercises don’t just include practicing in the classroom or receiving tutorials; they also include engaging in discussions and debates with other people in our daily lives, where the principles of critical thinking can be applied. The second method is to think more deeply about the principles that we have acquired. In the human mind, memory and understanding are acquired through making connections between ideas.

Good critical thinking skills require more than just knowledge and practice. Persistent practice can bring about improvements only if one has the right kind of motivation and attitude. The following attitudes are not uncommon, but they are obstacles to critical thinking:

I prefer being given the correct answers rather than figuring them out myself.
I don’t like to think a lot about my decisions as I rely only on gut feelings.
I don’t usually review the mistakes I have made.
I don’t like to be criticized.

To improve our thinking we have to recognize the importance of reflecting on the reasons for belief and action. We should also be willing to engage in debate, break old habits, and deal with linguistic complexities and abstract concepts.

The California Critical Thinking Disposition Inventory is a psychological test that is used to measure whether people are disposed to think critically. It measures the seven different thinking habits listed below, and it is useful to ask ourselves to what extent they describe the way we think:

Truth-Seeking—Do you try to understand how things really are? Are you interested in finding out the truth?
Open-Mindedness—How receptive are you to new ideas, even when you do not intuitively agree with them? Do you give new concepts a fair hearing?
Analyticity—Do you try to understand the reasons behind things? Do you act impulsively or do you evaluate the pros and cons of your decisions?
Systematicity—Are you systematic in your thinking? Do you break down a complex problem into parts?
Confidence in Reasoning—Do you always defer to other people? How confident are you in your own judgment? Do you have reasons for your confidence? Do you have a way to evaluate your own thinking?
Inquisitiveness—Are you curious about unfamiliar topics and resolving complicated problems? Will you chase down an answer until you find it?
Maturity of Judgment—Do you jump to conclusions? Do you try to see things from different perspectives? Do you take other people’s experiences into account?

Finally, as mentioned earlier, psychologists have discovered over the years that human reasoning can be easily affected by a variety of cognitive biases. For example, people tend to be over-confident of their abilities and focus too much on evidence that supports their pre-existing opinions. We should be alert to these biases in our attitudes towards our own thinking.

IV. Defining Critical Thinking

There are many different definitions of critical thinking. Here we list some of the well-known ones. You might notice that they all emphasize the importance of clarity and rationality. Here we will look at some well-known definitions in chronological order.

1) Many people trace the importance of critical thinking in education to the early twentieth-century American philosopher John Dewey. But Dewey did not make very extensive use of the term “critical thinking.” Instead, in his book How We Think (1910), he argued for the importance of what he called “reflective thinking”:

…[when] the ground or basis for a belief is deliberately sought and its adequacy to support the belief examined. This process is called reflective thought; it alone is truly educative in value…

Active, persistent and careful consideration of any belief or supposed form of knowledge in light of the grounds that support it, and the further conclusions to which it tends, constitutes reflective thought.

There is however one passage from How We Think where Dewey explicitly uses the term “critical thinking”:

The essence of critical thinking is suspended judgment; and the essence of this suspense is inquiry to determine the nature of the problem before proceeding to attempts at its solution. This, more than any other thing, transforms mere inference into tested inference, suggested conclusions into proof.

2) The Watson-Glaser Critical Thinking Appraisal (1980) is a well-known psychological test of critical thinking ability. The authors of this test define critical thinking as:

…a composite of attitudes, knowledge and skills. This composite includes: (1) attitudes of inquiry that involve an ability to recognize the existence of problems and an acceptance of the general need for evidence in support of what is asserted to be true; (2) knowledge of the nature of valid inferences, abstractions, and generalizations in which the weight or accuracy of different kinds of evidence are logically determined; and (3) skills in employing and applying the above attitudes and knowledge.

3) A very well-known and influential definition of critical thinking comes from philosopher and professor Robert Ennis in his work “A Taxonomy of Critical Thinking Dispositions and Abilities” (1987):

Critical thinking is reasonable reflective thinking that is focused on deciding what to believe or do.

4) The following definition comes from a statement written in 1987 by the philosophers Michael Scriven and Richard Paul for the National Council for Excellence in Critical Thinking (link), an organization promoting critical thinking in the US:

Critical thinking is the intellectually disciplined process of actively and skillfully conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication, as a guide to belief and action. In its exemplary form, it is based on universal intellectual values that transcend subject matter divisions: clarity, accuracy, precision, consistency, relevance, sound evidence, good reasons, depth, breadth, and fairness. It entails the examination of those structures or elements of thought implicit in all reasoning: purpose, problem, or question-at-issue, assumptions, concepts, empirical grounding; reasoning leading to conclusions, implications and consequences, objections from alternative viewpoints, and frame of reference.

The following excerpt from Peter A. Facione’s “Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction” (1990) is quoted from a report written for the American Philosophical Association:

We understand critical thinking to be purposeful, self-regulatory judgment which results in interpretation, analysis, evaluation, and inference, as well as explanation of the evidential, conceptual, methodological, criteriological, or contextual considerations upon which that judgment is based. CT is essential as a tool of inquiry. As such, CT is a liberating force in education and a powerful resource in one’s personal and civic life. While not synonymous with good thinking, CT is a pervasive and self-rectifying human phenomenon. The ideal critical thinker is habitually inquisitive, well-informed, trustful of reason, open-minded, flexible, fairminded in evaluation, honest in facing personal biases, prudent in making judgments, willing to reconsider, clear about issues, orderly in complex matters, diligent in seeking relevant information, reasonable in the selection of criteria, focused in inquiry, and persistent in seeking results which are as precise as the subject and the circumstances of inquiry permit. Thus, educating good critical thinkers means working toward this ideal. It combines developing CT skills with nurturing those dispositions which consistently yield useful insights and which are the basis of a rational and democratic society.

V. Two F eatures of C ritical T hinking

A. how not what .

Critical thinking is concerned not with what you believe, but rather how or why you believe it. Most classes, such as those on biology or chemistry, teach you what to believe about a subject matter. In contrast, critical thinking is not particularly interested in what the world is, in fact, like. Rather, critical thinking will teach you how to form beliefs and how to think. It is interested in the type of reasoning you use when you form your beliefs, and concerns itself with whether you have good reasons to believe what you believe. Therefore, this class isn’t a class on the psychology of reasoning, which brings us to the second important feature of critical thinking.

B. Ought N ot Is ( or Normative N ot Descriptive )

There is a difference between normative and descriptive theories. Descriptive theories, such as those provided by physics, provide a picture of how the world factually behaves and operates. In contrast, normative theories, such as those provided by ethics or political philosophy, provide a picture of how the world should be. Rather than ask question such as why something is the way it is, normative theories ask how something should be. In this course, we will be interested in normative theories that govern our thinking and reasoning. Therefore, we will not be interested in how we actually reason, but rather focus on how we ought to reason.

In the introduction to this course we considered a selection task with cards that must be flipped in order to check the validity of a rule. We noted that many people fail to identify all the cards required to check the rule. This is how people do in fact reason (descriptive). We then noted that you must flip over two cards. This is how people ought to reason (normative).

Section I-IV are taken from http://philosophy.hku.hk/think/ and are in use under the creative commons license. Some modifications have been made to the original content. ↵

IMAGES

6 Ways to Improve Critical Thinking at Work
Critical Thinking Definition, Skills, and Examples
5+ Critical Thinking Strategies for your Essay (2023)
Watson Glaser Critical Thinking Appraisal
Tools Of Critical Thinking
How to be a critical thinker

VIDEO

How to develop Critical Thinking And Analytical Skills
Watson Glaser Free Practice Question 2
Watson Glaser Overview Sample Question 3
Watson Glaser Overview Sample Question 5
Watson Glaser Free Practice Question 4
Watson Glaser Overview Sample Question 4

COMMENTS

Critical Thinking: 40 Useful Performance Feedback Phrases
Critical Thinking: Meets Expectations Phrases. Uses strategic approachability and skill when it comes to solving issues. Demonstrates well assertive and decisive ability when it comes to handling problems. Tries to always consider all factors at play before deciding on a particular methods or way.
Watson Glaser Critical Thinking Appraisal Free Practice Tests
The Watson Glaser Critical Thinking Appraisal is widely regarded as a good predictor of work productivity and at identifying candidates with a good potential to become managers and occupy other positions as a senior member of staff. The latest edition of the Watson Glaser Critical Thinking Test has improved its validity, appealed more to ...
Critical Thinking: Performance Review Examples (Rating 1
Critical Thinking: Performance Review Examples (Rating 1 - 5) Critical thinking skills are an essential aspect of an employee's evaluation: the ability to solve problems, analyze situations, and make informed decisions is crucial for the success of any organization. Questions that can help you determine an employee's rating for critical ...
The Watson Glaser Critical Thinking Test: 2024 Guide
The Watson Glaser critical thinking test is a unique assessment that provides a detailed analysis of a participant's ability to think critically. The test lasts 30 minutes and applicants can expect to be tested on around 40 questions in five distinct areas: Inference. Assumptions. Deduction.
Watson-Glaser Assessments: Guidelines & Practice Examples
The Watson Glaser Critical Thinking Appraisal is a timed test. It can be administered both online and offline, depending on the company you are applying to. For the online version (W-G III), the test is suitable for the unproctored screening of job applicants. Questions are selected randomly from a larger pool of questions called "item bank".
How to Prepare and Pass the Watson-Glaser Test
The Watson Glaser Critical Thinking Appraisal (WGCTA) is a pre-employment test used primarily in the law industry. Some of the major employers using the test are Linklaters, Clifford Chance, Hogan Lovells, and the Government Legal Service. The test assesses your critical thinking - namely, your ability to analyse and interpret verbal ...
Watson-Glaser Critical Thinking Appraisal (WGCTA)
The Watson-Glaser Critical Thinking Appraisal (WGCTA) contains 80 reading passages presenting problems, statements, arguments, and interpretations, each requiring the application of analytic reasoning skills. Its five exercises cover Drawing Inferences, Recognizing Assumptions, Argument Evaluation, Deductive Reasoning, and Logical Interpretation.
Watson-Glaser Critical Thinking Appraisal III
For nearly a century, the Watson-Glaser™ Critical Thinking Appraisal has been helping companies make data-driven decisions on staffing and development, and is now the leading critical thinking test available. Can your employees, managers and future leaders examine a situation and clearly understand it from multiple perspectives, while ...
PDF Watson-Glaser Critical Thinking Appraisal
Watson-Glaser Critical Thinking Appraisal — Efficacy Report Summary Critical thinking is essential for success in education and the workplace. Mentions of critical thinking as a requirement in job postings in the United States more than doubled between 2009 and 2014. For many, the purpose of earning a post-secondary degree is
Exploring the structure of the Watson-Glaser Critical Thinking
The Watson-Glaser Critical Thinking Appraisal (WGCTA) is the oldest and among the most widely used and studied CT measure. It was constructed around five subscales (or CT skills): inference, recognition of assumptions, deduction, interpretation, and evaluation of arguments. This paper describes a two part analysis of the psychometric ...
PDF Watson
In this test, each exercise begins with a statement of facts that you are to regard as true. After each statement of facts you will find several possible inferences i.e., conclusions that some persons might draw from the stated facts. Examine each inference separately, and make a decision as to its degree of truth or falsity.
Watson Glaser Critical Thinking Appraisal
Watson Glaser Critical Thinking Appraisal: The W-GCTA is the most widely-used critical reasoning test on the market, and the one candidates are most likely to encounter. SHL Critical Reasoning Test Battery: The SHL Critical Reasoning Test Battery is a collection of 60 critical reasoning questions with varying difficulty depending of the level of candidate.
PDF Watson-Glaser Critical Thinking Appraisal III (WG-III)
The Watson-Glaser Critical Thinking Appraisal is a verbal ability test measuring critical thinking ability. It assesses an individual's ability to analyze, interpret, and draw logical conclusions from written information — critical thinking skills. It addresses the challenges of higher education professionals, HR professionals and employers
Exploring the structure of the Watson-Glaser Critical Thinking
The Watson-Glaser Critical Thinking Appraisal (WGCTA) is the oldest and among the most widely used and studied CT measure. It was constructed around five subscales (or CT skills): inference ...
Critical Appraisal
Critical appraisal is a specific aspect of critical analysis where you examine and assess research in order to judge its: Trustworthiness. Value. Relevance. You are evaluating the quality of the research and how it has been carried out, as well as the findings.
Critical Appraisal of Clinical Research
Critical appraisal is the course of action for watchfully and systematically examining research to assess its reliability, value and relevance in order to direct professionals in their vital clinical decision making [ 1 ]. Critical appraisal is essential to: Continuing Professional Development (CPD).
Introduction to Critical Thinking
Critical thinking enhances language and presentation skills. Thinking clearly and systematically can improve the way we express our ideas. In learning how to analyze the logical structure of texts, critical thinking also improves comprehension abilities. ... The Watson-Glaser Critical Thinking Appraisal (1980) is a well-known psychological test ...
Watson-Glaser Critical Thinking Appraisal ®
A Psychometric Investigation of Scores on the Watson-Glaser Critical Thinking Appraisal New Form S. R. Loo K. Thorpe. Psychology. 1999. The Watson-Glaser Critical Thinking Appraisal (WGCTA) is a long-established and widely used measure. Recently, Watson and Glaser developed a short version, Form S, as a quickly administered measure….
Watson-Glaser Critical Thinking Appraisal
Researching Watson-Glaser. We assembled evidence from a range of sources to support the validity, reliability, and fairness of the Watson-Glaser Critical Thinking Appraisal in assessing critical thinking ability. The above finding about the test's ability to predict likely course success is based on one study with a group of business school ...
Watson-Glaser Critical Thinking Appraisal : Manual
Watson-Glaser Critical Thinking Appraisal: Manual Psychological Corporation , Goodwin Watson , Edward Maynard Glaser Psychological Corporation , 1980 - Critical thinking - 14 pages
PDF Watson-Glaser™ III
Critical thinking is an organized and disciplined way of thinking. It is logical and approaches ideas with clarity and precision. It entails questioning assumptions, making evaluations that are fair and accurate and requires the ability to identify and focus on relevant information when reaching conclusions. The Watson-Glaser is a multi-faceted ...
PDF Critical Thinking
Glaser defined critical thinking as: (1) an attitude of being disposed to consider in a thoughtful way the problems and subjects that come within the range of one's experience; (2) knowledge of the methods of logical enquiry and reasoning; and (3) some skill in applying those methods. Critical thinking calls for a persistent effort to examine ...
Validating the Watson Glaser Critical Thinking Appraisal
One of the most widely employed tools to measure CT skills is the Watson-Glaser Critical Thinking Appraisal (WGCTA) (Bernard et al, 2008). Although the WGCTA has generally shown to be reliable ...
A 10-Step Process to Align Problem-Based Learning With Accreditation
The appraisal of the references/resources should include, but not be limited to, why they selected them, how they performed their search, how they determined their credibility, potential limitations of the information they used, and challenges they faced. ... critical thinking, and problem-solving they developed in upcoming clerkships and ...