problem solving creativity communication

How it works

For Business

Join Mind Tools

Article • 10 min read

Creative Problem Solving

Finding innovative solutions to challenges.

By the Mind Tools Content Team

Imagine that you're vacuuming your house in a hurry because you've got friends coming over. Frustratingly, you're working hard but you're not getting very far. You kneel down, open up the vacuum cleaner, and pull out the bag. In a cloud of dust, you realize that it's full... again. Coughing, you empty it and wonder why vacuum cleaners with bags still exist!

James Dyson, inventor and founder of Dyson® vacuum cleaners, had exactly the same problem, and he used creative problem solving to find the answer. While many companies focused on developing a better vacuum cleaner filter, he realized that he had to think differently and find a more creative solution. So, he devised a revolutionary way to separate the dirt from the air, and invented the world's first bagless vacuum cleaner. [1]

Creative problem solving (CPS) is a way of solving problems or identifying opportunities when conventional thinking has failed. It encourages you to find fresh perspectives and come up with innovative solutions, so that you can formulate a plan to overcome obstacles and reach your goals.

In this article, we'll explore what CPS is, and we'll look at its key principles. We'll also provide a model that you can use to generate creative solutions.

About Creative Problem Solving

Alex Osborn, founder of the Creative Education Foundation, first developed creative problem solving in the 1940s, along with the term "brainstorming." And, together with Sid Parnes, he developed the Osborn-Parnes Creative Problem Solving Process. Despite its age, this model remains a valuable approach to problem solving. [2]

The early Osborn-Parnes model inspired a number of other tools. One of these is the 2011 CPS Learner's Model, also from the Creative Education Foundation, developed by Dr Gerard J. Puccio, Marie Mance, and co-workers. In this article, we'll use this modern four-step model to explore how you can use CPS to generate innovative, effective solutions.

Why Use Creative Problem Solving?

Dealing with obstacles and challenges is a regular part of working life, and overcoming them isn't always easy. To improve your products, services, communications, and interpersonal skills, and for you and your organization to excel, you need to encourage creative thinking and find innovative solutions that work.

CPS asks you to separate your "divergent" and "convergent" thinking as a way to do this. Divergent thinking is the process of generating lots of potential solutions and possibilities, otherwise known as brainstorming. And convergent thinking involves evaluating those options and choosing the most promising one. Often, we use a combination of the two to develop new ideas or solutions. However, using them simultaneously can result in unbalanced or biased decisions, and can stifle idea generation.

For more on divergent and convergent thinking, and for a useful diagram, see the book "Facilitator's Guide to Participatory Decision-Making." [3]

Core Principles of Creative Problem Solving

CPS has four core principles. Let's explore each one in more detail:

• Divergent and convergent thinking must be balanced. The key to creativity is learning how to identify and balance divergent and convergent thinking (done separately), and knowing when to practice each one.
• Ask problems as questions. When you rephrase problems and challenges as open-ended questions with multiple possibilities, it's easier to come up with solutions. Asking these types of questions generates lots of rich information, while asking closed questions tends to elicit short answers, such as confirmations or disagreements. Problem statements tend to generate limited responses, or none at all.
• Defer or suspend judgment. As Alex Osborn learned from his work on brainstorming, judging solutions early on tends to shut down idea generation. Instead, there's an appropriate and necessary time to judge ideas during the convergence stage.
• Focus on "Yes, and," rather than "No, but." Language matters when you're generating information and ideas. "Yes, and" encourages people to expand their thoughts, which is necessary during certain stages of CPS. Using the word "but" – preceded by "yes" or "no" – ends conversation, and often negates what's come before it.

How to Use the Tool

Let's explore how you can use each of the four steps of the CPS Learner's Model (shown in figure 1, below) to generate innovative ideas and solutions.

Figure 1 – CPS Learner's Model

Explore the Vision

Identify your goal, desire or challenge. This is a crucial first step because it's easy to assume, incorrectly, that you know what the problem is. However, you may have missed something or have failed to understand the issue fully, and defining your objective can provide clarity. Read our article, 5 Whys , for more on getting to the root of a problem quickly.

Gather Data

Once you've identified and understood the problem, you can collect information about it and develop a clear understanding of it. Make a note of details such as who and what is involved, all the relevant facts, and everyone's feelings and opinions.

Formulate Questions

When you've increased your awareness of the challenge or problem you've identified, ask questions that will generate solutions. Think about the obstacles you might face and the opportunities they could present.

Explore Ideas

Generate ideas that answer the challenge questions you identified in step 1. It can be tempting to consider solutions that you've tried before, as our minds tend to return to habitual thinking patterns that stop us from producing new ideas. However, this is a chance to use your creativity .

Brainstorming and Mind Maps are great ways to explore ideas during this divergent stage of CPS. And our articles, Encouraging Team Creativity , Problem Solving , Rolestorming , Hurson's Productive Thinking Model , and The Four-Step Innovation Process , can also help boost your creativity.

See our Brainstorming resources within our Creativity section for more on this.

Formulate Solutions

This is the convergent stage of CPS, where you begin to focus on evaluating all of your possible options and come up with solutions. Analyze whether potential solutions meet your needs and criteria, and decide whether you can implement them successfully. Next, consider how you can strengthen them and determine which ones are the best "fit." Our articles, Critical Thinking and ORAPAPA , are useful here.

4. Implement

Formulate a plan.

Once you've chosen the best solution, it's time to develop a plan of action. Start by identifying resources and actions that will allow you to implement your chosen solution. Next, communicate your plan and make sure that everyone involved understands and accepts it.

There have been many adaptations of CPS since its inception, because nobody owns the idea.

For example, Scott Isaksen and Donald Treffinger formed The Creative Problem Solving Group Inc . and the Center for Creative Learning , and their model has evolved over many versions. Blair Miller, Jonathan Vehar and Roger L. Firestien also created their own version, and Dr Gerard J. Puccio, Mary C. Murdock, and Marie Mance developed CPS: The Thinking Skills Model. [4] Tim Hurson created The Productive Thinking Model , and Paul Reali developed CPS: Competencies Model. [5]

Sid Parnes continued to adapt the CPS model by adding concepts such as imagery and visualization , and he founded the Creative Studies Project to teach CPS. For more information on the evolution and development of the CPS process, see Creative Problem Solving Version 6.1 by Donald J. Treffinger, Scott G. Isaksen, and K. Brian Dorval. [6]

Creative Problem Solving (CPS) Infographic

See our infographic on Creative Problem Solving .

Creative problem solving (CPS) is a way of using your creativity to develop new ideas and solutions to problems. The process is based on separating divergent and convergent thinking styles, so that you can focus your mind on creating at the first stage, and then evaluating at the second stage.

There have been many adaptations of the original Osborn-Parnes model, but they all involve a clear structure of identifying the problem, generating new ideas, evaluating the options, and then formulating a plan for successful implementation.

[1] Entrepreneur (2012). James Dyson on Using Failure to Drive Success [online]. Available here . [Accessed May 27, 2022.]

[2] Creative Education Foundation (2015). The CPS Process [online]. Available here . [Accessed May 26, 2022.]

[3] Kaner, S. et al. (2014). 'Facilitator′s Guide to Participatory Decision–Making,' San Francisco: Jossey-Bass.

[4] Puccio, G., Mance, M., and Murdock, M. (2011). 'Creative Leadership: Skils That Drive Change' (2nd Ed.), Thousand Oaks, CA: Sage.

[5] OmniSkills (2013). Creative Problem Solving [online]. Available here . [Accessed May 26, 2022].

[6] Treffinger, G., Isaksen, S., and Dorval, B. (2010). Creative Problem Solving (CPS Version 6.1). Center for Creative Learning, Inc. & Creative Problem Solving Group, Inc. Available here .

You've accessed 1 of your 2 free resources.

Get unlimited access

Discover more content

4 logical fallacies.

Avoid Common Types of Faulty Reasoning

Everyday Cybersecurity

Keep Your Data Safe

Add comment

Comments (0)

Be the first to comment!

Sign-up to our newsletter

Subscribing to the Mind Tools newsletter will keep you up-to-date with our latest updates and newest resources.

Subscribe now

Business Skills

Personal Development

Leadership and Management

Member Extras

Most Popular

Latest Updates

Pain Points Podcast - Presentations Pt 2

NEW! Pain Points - How Do I Decide?

Mind Tools Store

About Mind Tools Content

Discover something new today

Finding the Best Mix in Training Methods

Using Mediation To Resolve Conflict

Resolving conflicts peacefully with mediation

How Emotionally Intelligent Are You?

Boosting Your People Skills

Self-Assessment

What's Your Leadership Style?

Learn About the Strengths and Weaknesses of the Way You Like to Lead

Recommended for you

What are the halt risk states.

Understanding the Risks of Working on Empty

Business Operations and Process Management

Strategy Tools

Customer Service

Business Ethics and Values

Handling Information and Data

Project Management

Knowledge Management

Self-Development and Goal Setting

Time Management

Presentation Skills

Learning Skills

Career Skills

Communication Skills

Negotiation, Persuasion and Influence

Working With Others

Difficult Conversations

Creativity Tools

Self-Management

Work-Life Balance

Stress Management and Wellbeing

Coaching and Mentoring

Change Management

Team Management

Managing Conflict

Delegation and Empowerment

Performance Management

Leadership Skills

Developing Your Team

Talent Management

Problem Solving

Decision Making

Member Podcast

How to master communication in problem solving

May 11, 2023 The path from problem to solution is not linear. In fast-moving, complex times, decision-makers can’t effectively act alone when it comes to solving complicated workplace problems; diverse perspectives and rigorous debate are crucial to determining the best steps to take. What’s missing in many companies is the use of “contributory dissent,” or the capabilities required to engage in healthy if divergent discussions about critical business problems, write Ben Fletcher , Chris Hartley , Rupert Hoskin , and Dana Maor  in a recent article . Contributory dissent allows individuals and groups to air their differences in a way that moves the discussion toward a positive outcome and doesn’t undermine leadership or group cohesion. Check out these insights to learn how to establish cultures and structures where individuals and teams feel free to bring innovative—and often better—alternative solutions to the table, and dive into the best ways to master communication in problem solving.

Into all problem-solving, a little dissent must fall

Capturing the value of ‘one firm’

Bias Busters: A better way to brainstorm

Psychological safety and the critical role of leadership development

The next competitive advantage in talent: Continuous employee listening

Author Talks: Fred Dust on making conversations count

What is an effective meeting?

Bias Busters: Getting both sides of the story

Fear factor: Overcoming human barriers to innovation

Listen with your head and heart: How Mars anchors on principles and people

• Business Essentials
• Leadership & Management
• Credential of Leadership, Impact, and Management in Business (CLIMB)
• Entrepreneurship & Innovation
• Digital Transformation
• Finance & Accounting
• Business in Society
• For Organizations
• Support Portal
• Media Coverage
• Founding Donors
• Leadership Team

• Harvard Business School →
• HBS Online →
• Business Insights →

Business Insights

Harvard Business School Online's Business Insights Blog provides the career insights you need to achieve your goals and gain confidence in your business skills.

• Career Development
• Communication
• Decision-Making
• Earning Your MBA
• Negotiation
• News & Events
• Productivity
• Staff Spotlight
• Student Profiles
• Work-Life Balance
• AI Essentials for Business
• Alternative Investments
• Business Analytics
• Business Strategy
• Business and Climate Change
• Design Thinking and Innovation
• Digital Marketing Strategy
• Disruptive Strategy
• Economics for Managers
• Entrepreneurship Essentials
• Financial Accounting
• Global Business
• Launching Tech Ventures
• Leadership Principles
• Leadership, Ethics, and Corporate Accountability
• Leading Change and Organizational Renewal
• Leading with Finance
• Management Essentials
• Negotiation Mastery
• Organizational Leadership
• Power and Influence for Positive Impact
• Strategy Execution
• Sustainable Business Strategy
• Sustainable Investing
• Winning with Digital Platforms

How to Be a More Creative Problem-Solver at Work: 8 Tips

• 01 Mar 2022

The importance of creativity in the workplace—particularly when problem-solving—is undeniable. Business leaders can’t approach new problems with old solutions and expect the same result.

This is where innovation-based processes need to guide problem-solving. Here’s an overview of what creative problem-solving is, along with tips on how to use it in conjunction with design thinking.

Access your free e-book today.

What Is Creative Problem-Solving?

Encountering problems with no clear cause can be frustrating. This occurs when there’s disagreement around a defined problem or research yields unclear results. In such situations, creative problem-solving helps develop solutions, despite a lack of clarity.

While creative problem-solving is less structured than other forms of innovation, it encourages exploring open-ended ideas and shifting perspectives—thereby fostering innovation and easier adaptation in the workplace. It also works best when paired with other innovation-based processes, such as design thinking .

Creative Problem-Solving and Design Thinking

Design thinking is a solutions-based mentality that encourages innovation and problem-solving. It’s guided by an iterative process that Harvard Business School Dean Srikant Datar outlines in four stages in the online course Design Thinking and Innovation :

• Clarify: This stage involves researching a problem through empathic observation and insights.
• Ideate: This stage focuses on generating ideas and asking open-ended questions based on observations made during the clarification stage.
• Develop: The development stage involves exploring possible solutions based on the ideas you generate. Experimentation and prototyping are both encouraged.
• Implement: The final stage is a culmination of the previous three. It involves finalizing a solution’s development and communicating its value to stakeholders.

Although user research is an essential first step in the design thinking process, there are times when it can’t identify a problem’s root cause. Creative problem-solving addresses this challenge by promoting the development of new perspectives.

Leveraging tools like design thinking and creativity at work can further your problem-solving abilities. Here are eight tips for doing so.

8 Creative Problem-Solving Tips

1. empathize with your audience.

A fundamental practice of design thinking’s clarify stage is empathy. Understanding your target audience can help you find creative and relevant solutions for their pain points through observing them and asking questions.

Practice empathy by paying attention to others’ needs and avoiding personal comparisons. The more you understand your audience, the more effective your solutions will be.

2. Reframe Problems as Questions

If a problem is difficult to define, reframe it as a question rather than a statement. For example, instead of saying, "The problem is," try framing around a question like, "How might we?" Think creatively by shifting your focus from the problem to potential solutions.

Consider this hypothetical case study: You’re the owner of a local coffee shop trying to fill your tip jar. Approaching the situation with a problem-focused mindset frames this as: "We need to find a way to get customers to tip more." If you reframe this as a question, however, you can explore: "How might we make it easier for customers to tip?" When you shift your focus from the shop to the customer, you empathize with your audience. You can take this train of thought one step further and consider questions such as: "How might we provide a tipping method for customers who don't carry cash?"

Whether you work at a coffee shop, a startup, or a Fortune 500 company, reframing can help surface creative solutions to problems that are difficult to define.

3. Defer Judgment of Ideas

If you encounter an idea that seems outlandish or unreasonable, a natural response would be to reject it. This instant judgment impedes creativity. Even if ideas seem implausible, they can play a huge part in ideation. It's important to permit the exploration of original ideas.

While judgment can be perceived as negative, it’s crucial to avoid accepting ideas too quickly. If you love an idea, don’t immediately pursue it. Give equal consideration to each proposal and build on different concepts instead of acting on them immediately.

4. Overcome Cognitive Fixedness

Cognitive fixedness is a state of mind that prevents you from recognizing a situation’s alternative solutions or interpretations instead of considering every situation through the lens of past experiences.

Although it's efficient in the short-term, cognitive fixedness interferes with creative thinking because it prevents you from approaching situations unbiased. It's important to be aware of this tendency so you can avoid it.

5. Balance Divergent and Convergent Thinking

One of the key principles of creative problem-solving is the balance of divergent and convergent thinking. Divergent thinking is the process of brainstorming multiple ideas without limitation; open-ended creativity is encouraged. It’s an effective tool for generating ideas, but not every idea can be explored. Divergent thinking eventually needs to be grounded in reality.

Convergent thinking, on the other hand, is the process of narrowing ideas down into a few options. While converging ideas too quickly stifles creativity, it’s an important step that bridges the gap between ideation and development. It's important to strike a healthy balance between both to allow for the ideation and exploration of creative ideas.

6. Use Creative Tools

Using creative tools is another way to foster innovation. Without a clear cause for a problem, such tools can help you avoid cognitive fixedness and abrupt decision-making. Here are several examples:

Problem Stories

Creating a problem story requires identifying undesired phenomena (UDP) and taking note of events that precede and result from them. The goal is to reframe the situations to visualize their cause and effect.

To start, identify a UDP. Then, discover what events led to it. Observe and ask questions of your consumer base to determine the UDP’s cause.

Next, identify why the UDP is a problem. What effect does the UDP have that necessitates changing the status quo? It's helpful to visualize each event in boxes adjacent to one another when answering such questions.

The problem story can be extended in either direction, as long as there are additional cause-and-effect relationships. Once complete, focus on breaking the chains connecting two subsequent events by disrupting the cause-and-effect relationship between them.

Alternate Worlds

The alternate worlds tool encourages you to consider how people from different backgrounds would approach similar situations. For instance, how would someone in hospitality versus manufacturing approach the same problem? This tool isn't intended to instantly solve problems but, rather, to encourage idea generation and creativity.

7. Use Positive Language

It's vital to maintain a positive mindset when problem-solving and avoid negative words that interfere with creativity. Positive language prevents quick judgments and overcomes cognitive fixedness. Instead of "no, but," use words like "yes, and."

Positive language makes others feel heard and valued rather than shut down. This practice doesn’t necessitate agreeing with every idea but instead approaching each from a positive perspective.

Using “yes, and” as a tool for further idea exploration is also effective. If someone presents an idea, build upon it using “yes, and.” What additional features could improve it? How could it benefit consumers beyond its intended purpose?

While it may not seem essential, this small adjustment can make a big difference in encouraging creativity.

8. Practice Design Thinking

Practicing design thinking can make you a more creative problem-solver. While commonly associated with the workplace, adopting a design thinking mentality can also improve your everyday life. Here are several ways you can practice design thinking:

• Learn from others: There are many examples of design thinking in business . Review case studies to learn from others’ successes, research problems companies haven't addressed, and consider alternative solutions using the design thinking process.
• Approach everyday problems with a design thinking mentality: One of the best ways to practice design thinking is to apply it to your daily life. Approach everyday problems using design thinking’s four-stage framework to uncover what solutions it yields.
• Study design thinking: While learning design thinking independently is a great place to start, taking an online course can offer more insight and practical experience. The right course can teach you important skills , increase your marketability, and provide valuable networking opportunities.

Ready to Become a Creative Problem-Solver?

Though creativity comes naturally to some, it's an acquired skill for many. Regardless of which category you're in, improving your ability to innovate is a valuable endeavor. Whether you want to bolster your creativity or expand your professional skill set, taking an innovation-based course can enhance your problem-solving.

If you're ready to become a more creative problem-solver, explore Design Thinking and Innovation , one of our online entrepreneurship and innovation courses . If you aren't sure which course is the right fit, download our free course flowchart to determine which best aligns with your goals.

About the Author

How it works

Transform your enterprise with the scalable mindsets, skills, & behavior change that drive performance.

Explore how BetterUp connects to your core business systems.

We pair AI with the latest in human-centered coaching to drive powerful, lasting learning and behavior change.

Build leaders that accelerate team performance and engagement.

Unlock performance potential at scale with AI-powered curated growth journeys.

Build resilience, well-being and agility to drive performance across your entire enterprise.

Transform your business, starting with your sales leaders.

Unlock business impact from the top with executive coaching.

Foster a culture of inclusion and belonging.

Accelerate the performance and potential of your agencies and employees.

See how innovative organizations use BetterUp to build a thriving workforce.

Discover how BetterUp measurably impacts key business outcomes for organizations like yours.

A demo is the first step to transforming your business. Meet with us to develop a plan for attaining your goals.

• What is coaching?

Learn how 1:1 coaching works, who its for, and if it's right for you.

Accelerate your personal and professional growth with the expert guidance of a BetterUp Coach.

Types of Coaching

Navigate career transitions, accelerate your professional growth, and achieve your career goals with expert coaching.

Enhance your communication skills for better personal and professional relationships, with tailored coaching that focuses on your needs.

Find balance, resilience, and well-being in all areas of your life with holistic coaching designed to empower you.

Discover your perfect match : Take our 5-minute assessment and let us pair you with one of our top Coaches tailored just for you.

Research, expert insights, and resources to develop courageous leaders within your organization.

Best practices, research, and tools to fuel individual and business growth.

View on-demand BetterUp events and learn about upcoming live discussions.

The latest insights and ideas for building a high-performing workplace.

• BetterUp Briefing

The online magazine that helps you understand tomorrow's workforce trends, today.

Innovative research featured in peer-reviewed journals, press, and more.

Founded in 2022 to deepen the understanding of the intersection of well-being, purpose, and performance

We're on a mission to help everyone live with clarity, purpose, and passion.

Join us and create impactful change.

Read the buzz about BetterUp.

Meet the leadership that's passionate about empowering your workforce.

For Business

For Individuals

How to improve your creative skills for effective problem-solving

Jump to section

What’s creative thinking?

Creative thinking versus critical thinking

Creative thinking skills

How to develop creative thinking skills

4 creative thinking examples to include on your resume

Sharpen your creativity

Creative thinking is the key to unlocking innovation and problem-solving excellence. 

In the whirlwind of everyday professional challenges, we’ve all encountered moments when fresh ideas feel elusive. If you’ve found yourself struggling to inspire your team or spinning out during a brainstorming session , it may be a sign you need to develop your creative skills. Plus, creative problem solving looks excellent on a resume .

As a leader or team member, your ability to think outside the box can ignite a spark of ingenuity that propels your team to new heights. Fan the flames of growth and learn how to improve your creative thinking (and highlight your new skills in your next job application).

What’s creative thinking? 

Creative thinking is the dynamic process of transforming your ideas into actions. The skillset equips you to think differently and approach challenges from innovative angles.

At its core, creative thinking empowers you to break free from the constraints of the status quo and dream up fresh, original ideas. It breathes life into your decisions, encouraging you to embrace your imaginative instincts. 

By daring to challenge traditional approaches, your creativity opens doors to uncharted innovations and groundbreaking solutions.

Creative thinking versus critical thinking 

Although creative and critical thinking are both used in problem-solving , the two skills are marked by key differences. 

Creative thinking is the catalyst for generating innovative ideas and crafting novel approaches to the challenges around them. With an open mind and a wild imagination, creative thinkers produce and explore unconventional solutions to the problems that stand in their way.

Critical thinking analyzes available information with an unbiased and rational approach. It involves questioning perceptions, ensuring that decisions are devoid of bias and reasoning remains grounded in sound judgment. 

Creative thinking skills 

When you look at creative thinking as a set of particular abilities, it becomes easier to develop and perfect. These creative skill examples can help you thrive inside and outside of the workplace:

1. Open-mindedness

When you’re open-minded, you can readily adapt to new information and look for fresh problem-solving approaches. You’re receptive to the opinions and ideas of others because you view them as constructive rather than criticizing . This openness also encourages you to freely share your creative ideas without fearing judgement.

2. Curiosity

You might find that you tap into creative potential the most when you’re challenging convention and posing new ways of thinking. Analyzing processes and asking yourself how you can improve them is an exciting way to make more efficient systems.

Whether you’re new to a job or have worked at the company for years, you may wonder why procedures are what they are — lean into this curiosity to develop new and better ways to work. 

3. Ability to brainstorm

There are numerous ways to solve a problem, and brainstorming helps to get them onto paper so you can weigh their pros and cons. This way of lateral thinking encourages you to view solutions as multifaceted rather than a single, straightforward answer.

4. Experimentation

Creative people experiment with various ways of solving a problem before deciding on the best way to take action. Emulate this mindset in your projects and tasks. For instance, if you work in web design, you might try several page layouts before deciding on a final visual identity for your client.

5. Networking

Speaking with people from different professional backgrounds is an excellent way to stimulate creative thinking and develop new perspectives. When you network with professionals with diverse skill sets and experiences, they might influence you to look at the world differently or suggest an innovative way to tackle a problem.

6. Observation

It’s important to know when to take the backseat and listen in. Observing how others tackle complex issues might inspire you to make changes within your team. Always keep an eye out for opportunities to learn from more experienced peers and innovative colleagues.

7. Organization

Although some individuals claim to thrive in clutter, keeping your work organized creates an environment where you can work freely without distraction. This involves keeping your workspace tidy, creating clear to-do lists, and using visual maps to express your plans and processes.

8. Communication

Proper communication empowers you to share valuable insight and ideas with your teammates. You need strong verbal and written skills to pitch and describe your thoughts and actively listen to others’ feedback and advice.

9. Analysis

Before you can dream up a creative approach to an obstacle, you must fully understand the problem at hand. Without proper analysis, your solution may contain flaws, or you could miss important details of your problem. Practice sifting through every detail of the issue and pinpointing the causes. 

10. Problem-solving

No matter your industry, problem-solving is always a valuable skill. Consider how to tackle a problem without asking the advice of others to see what creative solutions arise. This way, you can see what inventive ideas you can come up with before external opinions influence you.

Although some of your coworkers may seem to have a natural talent for creativity and creative thinking, it’s a skill anyone can develop and improve. Here are seven ways to advance your innovative problem-solving:

Reading is an effective way to exercise your mind, increase your vocabulary, and expose yourself to new ways of thinking. Whether your book is on a problem you’re facing at work or a new and exciting subject, reading is an excellent opportunity to learn. That’s right: simply cracking open a book can help you grow . 

Keep a notepad nearby and write down thoughts and ideas as they arise. Writing helps you to process information, and you can revisit your musing whenever you need to get your creative juices flowing. If you’ve never tried journaling before, it’s an excellent way to process your thoughts and feelings in a safe and private space. 

3. Exercise

Exercising improves your sleep and ability to cope with stress, making it easier to stay alert and contribute fresh ideas at work. 

4. Listen to music

Music can affect your mood and place you in the mindset to solve problems. If you’re struggling with creative writing or creating a visual piece of work, listening to music could push you toward expressing yourself more meaningfully. 

5. Ask for feedback

Collaboration and teamwork are key when developing creative solutions in the workplace. You can ask teammates or superiors for feedback on your ideas to gain insight into potential flaws in your reasoning and streamline your solutions.

6. Find a mentor or coach

Having an experienced person to bounce ideas off is a catalyst for creativity. A mentor or coach who’s dealt with similar obstacles can provide insight into what worked and what didn’t, saving you valuable brainstorming time. 

7. Change your approach

If you’ve been approaching your tasks the same way, adjusting your processes may bring a fresh perspective and stimulate change. Ask yourself why you tackle work from a similar angle each time and consider more creative ways to conduct your day-to-day operations.

4 creative thinking examples to include on your resume 

Employers want to add creative people to their teams because solving problems takes a lot of ingenuity. Use these four examples and bullet points for inspiration when listing creative thinking skills on your resume.

On a graphic designer’s resume:

• Collaborated on rebranding [company’s] visual identity and social media content strategy
• Developed unique and innovative branding material for [company A] , [company B] , and [company C]

On a copywriter’s resume:

• Revised [company’s] website and blog content to be more engaging, exciting, and SEO-focused
• Contributed original and innovative articles on [topic] to [publication A] and [publication B]

On a public relations specialist’s resume:

• Increased [company’s] brand awareness by planning [event] to launch [product]
• Collaborated with [brand] on [product’s] creative marketing strategy to reach a wider audience

On a teacher’s resume:

• Developed a novel approach to teaching [subject or class] to students with various learning styles and needs
• Introduced [extracurricular] , the first of its kind in [the school board] , to engage students in [activity]

Sharpen your creativity 

Critical and creative thinking broaden your perspective and allow you to devise unique solutions to everyday problems. You can develop your creative skills by changing your environment, learning from others, and adjusting your approach to work. 

Regardless of how you choose to spark creativity at work, don’t be afraid to step outside your comfort zone and confidently contribute your ideas. You never know — you might just come up with the next big company innovation.

Cultivate your creativity

Foster creativity and continuous learning with guidance from our certified Coaches.

Elizabeth Perry, ACC

Elizabeth Perry is a Coach Community Manager at BetterUp. She uses strategic engagement strategies to cultivate a learning community across a global network of Coaches through in-person and virtual experiences, technology-enabled platforms, and strategic coaching industry partnerships. With over 3 years of coaching experience and a certification in transformative leadership and life coaching from Sofia University, Elizabeth leverages transpersonal psychology expertise to help coaches and clients gain awareness of their behavioral and thought patterns, discover their purpose and passions, and elevate their potential. She is a lifelong student of psychology, personal growth, and human potential as well as an ICF-certified ACC transpersonal life and leadership Coach.

How to develop critical thinking skills

6 ways to leverage ai for hyper-personalized corporate learning, self directed learning is the key to new skills and knowledge, why asynchronous learning is the key to successful upskilling, the power of professional learning communities, can dreams help you solve problems 6 ways to try, experimentation brings innovation: create an experimental workplace, 8 creative solutions to your most challenging problems, why creativity isn't just for creatives and how to find it anywhere, similar articles, 10 problem-solving strategies to turn challenges on their head, thinking outside the box: 8 ways to become a creative problem solver, what is creative thinking and why does it matter, essential decision-making skills to guide your tough choices, what are professional skills, and which should you add to your resume, professional leadership skills to incorporate on your resume, stay connected with betterup, get our newsletter, event invites, plus product insights and research..

3100 E 5th Street, Suite 350 Austin, TX 78702

• Platform Overview
• Integrations
• Powered by AI
• BetterUp Lead™
• BetterUp Manage™
• BetterUp Care®
• Sales Performance
• Diversity & Inclusion
• Case Studies
• Why BetterUp?
• About Coaching
• Find your Coach
• Career Coaching
• Communication Coaching
• Life Coaching
• News and Press
• Leadership Team
• Become a BetterUp Coach
• BetterUp Labs
• Center for Purpose & Performance
• Leadership Training
• Business Coaching
• Contact Support
• Contact Sales
• Privacy Policy
• Acceptable Use Policy
• Trust & Security
• Cookie Preferences

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• PMC10054602

Creativity, Critical Thinking, Communication, and Collaboration: Assessment, Certification, and Promotion of 21st Century Skills for the Future of Work and Education

Branden thornhill-miller.

1 Faculty of Philosophy, University of Oxford, Oxford OX2 6GG, UK

2 International Institute for Competency Development, 75001 Paris, France

Anaëlle Camarda

3 LaPEA, Université Paris Cité and Univ Gustave Eiffel, 92100 Boulogne-Billancourt, France

4 Institut Supérieur Maria Montessori, 94130 Nogent-Sur-Marne, France

Maxence Mercier

Jean-marie burkhardt.

5 LaPEA, Univ Gustave Eiffel and Université Paris Cité, CEDEX, 78008 Versailles, France

Tiffany Morisseau

6 Strane Innovation, 91190 Gif-sur-Yvette, France

Samira Bourgeois-Bougrine

Florent vinchon, stephanie el hayek.

7 AFNOR International, 93210 Saint-Denis, France

Myriam Augereau-Landais

Florence mourey, cyrille feybesse.

8 Centre Hospitalier Guillaume Regnier, Université de Rennes 1, 35200 Rennes, France

Daniel Sundquist

Todd lubart, associated data.

Not Applicable.

This article addresses educational challenges posed by the future of work, examining “21st century skills”, their conception, assessment, and valorization. It focuses in particular on key soft skill competencies known as the “4Cs”: creativity, critical thinking, collaboration, and communication. In a section on each C, we provide an overview of assessment at the level of individual performance, before focusing on the less common assessment of systemic support for the development of the 4Cs that can be measured at the institutional level (i.e., in schools, universities, professional training programs, etc.). We then present the process of official assessment and certification known as “labelization”, suggesting it as a solution both for establishing a publicly trusted assessment of the 4Cs and for promoting their cultural valorization. Next, two variations of the “International Institute for Competency Development’s 21st Century Skills Framework” are presented. The first of these comprehensive systems allows for the assessment and labelization of the extent to which development of the 4Cs is supported by a formal educational program or institution. The second assesses informal educational or training experiences, such as playing a game. We discuss the overlap between the 4Cs and the challenges of teaching and institutionalizing them, both of which may be assisted by adopting a dynamic interactionist model of the 4Cs—playfully entitled “Crea-Critical-Collab-ication”—for pedagogical and policy-promotion purposes. We conclude by briefly discussing opportunities presented by future research and new technologies such as artificial intelligence and virtual reality.

1. Introduction

There are many ways of describing the massive educational challenges faced in the 21st century. With the appearance of computers and digital technologies, new means of interacting between people, and a growing competitiveness on the international level, organizations are now requiring new skills from their employees, leaving educational systems struggling to provide appropriate ongoing training. Indeed, according to the World Economic Forum’s 2020 “Future of Jobs Report”, studying 15 industries in 26 advanced and emerging countries, up to 50% of employees will need some degree of “reskilling” by 2025 ( World Economic Forum 2020 ). Although many national and international educational efforts and institutions now explicitly put the cultivation of new kinds of skills on their educational agendas, practical means of assessing such skills remains underdeveloped, thus hampering the valorization of these skills and the development of guidance for relevant pedagogy ( Care et al. 2018 ; Vincent-Lancrin et al. 2019 ; for overviews and discussion of higher education in global developmental context, see Blessinger and Anchan 2015 ; Salmi 2017 ).

This article addresses some of these challenges and related issues for the future of education and work, by focusing on so-called “21st Century Skills” and key “soft skills” known as the “4Cs” (creativity, critical thinking, communication, and collaboration), more particularly. It begins with a brief discussion of these skills, outlining their conceptual locations and potential roles in the modern educational context. A section on each “C” then follows, defining the C, summarizing research and methods for its scientific assessment at the individual level, and then outlining some means and avenues at the systemic level for fostering its development (e.g., important aspects of curriculum, institutional structure, or of the general environment, as well as pedagogical methods) that might be leveraged by an institution or program in order to promote the development of that C among its students/trainees. In the next section, the certification-like process of “labelization” is outlined and proposed as one of the best available solutions both for valorizing the 4Cs and moving them towards the center of the modern educational enterprise, as well as for benchmarking and monitoring institutions’ progress in fostering their development. The International Institute for Competency Development’s 4Cs Framework is then outlined as an example of such a comprehensive system for assessing and labelizing the extent to which educational institutions and programs support the development of the 4Cs. We further demonstrate the possibility of labelizing and promoting support for the development of the 4Cs by activities or within less formal educational settings, presenting a second framework for assessment of the 4Cs in games and similar training activities. Our discussion section begins with the challenges to implementing educational change in the direction of 21st century skills, focusing on the complex and overlapping nature of the 4Cs. Here, we propose that promoting a “Dynamic Interactionist Model of the 4Cs” not only justifies grouping them together, but it might also assist more directly with some of the challenges of pedagogy, assessment, policy promotion, and ultimately, institutionalization, faced by the 4Cs and related efforts to modernize education. We conclude by suggesting some important future work for the 4Cs individually and also as an interrelated collective of vital skills for the future of education and work.

“21st Century Skills”, “Soft Skills”, and the “4Cs”

For 40 years, so-called “21st century skills” have been promoted as those necessary for success in a modern work environment that the US Army War College ( Barber 1992 ) has accurately described as increasingly “VUCA”—“volatile, uncertain, complex and ambiguous”. Various lists of skills and competencies have been formulated on their own or as part of comprehensive overarching educational frameworks. Although a detailed overview of this background material is outside the scope of this article (see Lamri et al. 2022 ; Lucas 2022 for summaries), one of the first prominent examples of this trend was the Partnership for 21st Century Skills (P21), whose comprehensive “Framework for 21st Century Learning” is presented in Figure 1 ( Battelle for Kids 2022 ). This framework for future-oriented education originated the idea of the “4Cs”, placing them at its center and apex as “Learning and Innovation Skills” that are in need of much broader institutional support at the foundational level in the form of new standards and assessments, curriculum and instructional development, ongoing professional development, and appropriately improved learning environments ( Partnership for 21st Century Skills 2008 ). These points are also consistent with the approach and assessment frameworks presented later in this article.

The P21 Framework for 21st Century Learning. (© 2019, Battelle for Kids. All Rights Reserved. https://www.battelleforkids.org/ ; accessed on 17 January 2023).

Other important organizations such as the World Economic Forum ( 2015 ) have produced similar overarching models of “21st century skills’’ with the 4Cs at their center, but the term “21st century skills’’ has been rightly criticized for a several reasons: the skills referred to are not actually all unique to, or uniquely important to, the 21st century, and it is a term that is often used more as an advertising or promotional label for systems that sometimes conflate and confuse different kinds of skills with other concepts that users lump together ( Lucas 2019 ). Indeed, though there is no absolute consensus on the definition of a “skill”, they are often described as being multidimensional and involve the ability to solve problems in context and to perform tasks using appropriate resources at the right time and in the right combination ( Lamri and Lubart 2021 ). At its simplest, a skill is a “learned capacity to do something useful” ( Lucas and Claxton 2009 ), or an ability to perform a given task at a specified performance level, which develops through practice, experience. and training ( Lamri et al. 2022 ).

The idea of what skills “are’’, however, has also evolved to some extent over time in parallel to the nature of the abilities required to make valued contributions to society. The digital and information age, in particular, has seen the replacement by machines of much traditional work sometimes referred to as “hard skills’’—skills such as numerical calculation or driving, budget-formulating, or copyediting abilities, which entail mastery of fixed sets of knowledge and know-how of standard procedures, and which are often learned on the job. Such skills are more routine, machine-related, or technically oriented and not as likely to be centered on human interaction. In contrast, the work that has been increasingly valued in the 21st century involves the more complex, human interactive, and/or non-routine skills that Whitmore ( 1972 ) first referred to as “soft skills”.

Unfortunately, researchers, educators, and consultants have defined, redefined, regrouped, and expanded soft skills—sometimes labeling them “transversal competencies”, “generic competencies”, or even “life skills” in addition to “21st century skills”—in so many different ways within and across different domains of research and education (as well as languages and national educational systems) that much progress towards these goals has literally been “lost in translation” ( Cinque 2016 ).

Indeed, there is also a long-standing ambiguity and confusion between the terms “competency” (also competence) and “skill” due to their use across different domains (e.g., learning research, education, vocational training, personnel selection) as well as different epistemological backgrounds and cultural specificities ( Drisko 2014 ; Winterton et al. 2006 ; van Klink and Boon 2003 ). The term “competency” is, however, often used as a broader concept that encompasses skills, abilities, and attitudes, whereas, in a narrower sense, the term “skill” has been defined as “goal-directed, well-organized behavior that is acquired through practice and performed with economy of effort” ( Proctor and Dutta 1995, p. 18 ). For example, whereas the command of a spoken language or the ability to write are skills (hard skills, to be precise), the ability to communicate effectively is a competence that may draw on an individual’s knowledge of language, writing skills, practical IT skills, and emotional intelligence, as well as attitudes towards those with whom one is communicating ( Rychen and Hersch 2003 ). Providing high-quality customer service is a competency that relies on listening skills, social perception skills, and contextual knowledge of products. Beyond these potential distinctions, the term “competency” is predominant in Europe, whereas “skill” is more commonly used in the US. Yet it also frequently occurs that both are used as rough synonyms. For example, Voogt and Roblin ( 2012, p. 299 ) examine the “21st century competences and the recommended strategies for the implementation of these skills”, and Graesser et al. ( 2022, p. 568 ) state that twenty-first-century skills “include self-regulated learning, collaborative problem solving, communication (…) and other competencies”. In conclusion, the term “competencies” is often used interchangeably with “skills” (and can have a particularly large overlap with “soft skills”), but it is also often considered in a broader sense as a set of skills, knowledge, and attitudes that, together, meet a complex demand ( Ananiadoui and Claro 2009 ). From this perspective, one could argue that the 4Cs, as complex, “higher-order” soft skills, might best be labeled competencies. For ease and convenience, however, in this text, we consider the two terms interchangeable but favor the term “skills”, only using “competency” in some instances to avoid cumbersome repetition.

Even having defined soft skills as a potentially more narrow and manageable focus, we are still aware of no large-scale study that has employed a comprehensive enough range of actual psychometric measures of soft skills in a manner that might help produce a definitive empirical taxonomy. Some more recent taxonomic efforts have, however, attempted to provide additional empirical grounding for the accurate identification of key soft skills (see e.g., Joie-La Marle et al. 2022 ). Further, recent research by JobTeaser (see Lamri et al. 2022 ) surveying a large, diverse sample of young workers about a comprehensive, systematic list of soft skills as actually used in their professional roles represents a good step towards some clarification and mapping of this domain on an empirical basis. Despite the fact that both these studies necessarily involved assumptions and interpretive grouping of variables, the presence and importance of the 4Cs as higher-order skills is evident in both sets of empirical results.

Various comprehensive “21st century skills” systems proposed in the past without much empirical verification also seem to have been found too complex and cumbersome for implementation. The 4Cs, on the other hand, seem to provide a relatively simple, persuasive, targetable core that has been found to constitute a pedagogically and policy-friendly model by major organizations, and that also now seems to be gaining some additional empirical validity. Gathering support from researchers and industry alike, we suggest that the 4Cs can be seen as highest-level transversal skills—or “meta-competencies”—that allow individuals to remain competent and to develop their potential in a rapidly changing professional world. Thus, in the end, they may also be one of the most useful ways of summarizing and addressing the critical challenges faced by the future of work and education ( National Education Association 2011 ).

Taking them as our focus, we note, however, that the teaching and development of the 4Cs will require a complex intervention and mobilization of educational and socio-economic resources—both a major shift in pedagogical techniques and even more fundamental changes in institutional structures ( Ananiadoui and Claro 2009 ). One very important issue for understanding the 4Cs and their educational implementation related to this, which can simultaneously facilitate their teaching but be a challenge for their assessment, is the multidimensionality, interrelatedness, and transdisciplinary relevance of the 4Cs. Thus, we address the relationships between the Cs in the different C sections and later in our Discussion, we present a “Dynamic Interactionist Model of the 4Cs’’ that we hope will assist in their understanding, in the further development of pedagogical processes related to them, and in their public promotion and related policy. Ultimately, it is partly due to their complexity and interrelationships, we argue, that it is important and expedient that the 4Cs are taught, assessed, and promoted together.

2. The 4Cs, Assessment, and Support for Development

2.1. creativity.

In psychology, creativity is usually defined as the capacity to produce novel, original work that fits with task constraints and has value in its context (for a recent overview, see Lubart and Thornhill-Miller 2019 ). This basic definition, though useful for testing and measurement, is largely incomplete, as it does not contain any information about the individual or groups doing the creating or the nature of physical and social contexts ( Glăveanu 2014 ). Moreover, Corazza ( 2016 ) challenged this standard definition of creativity, arguing that as it focuses solely on the existence of an original and effective outcome, it misses the dynamics of the creative process, which is frequently associated with periods of creative inconclusiveness and limited occasions of creative achievements. To move away from the limitations of the standard definition of creativity, we can consider Bruner’s description of creativity as “figuring out how to use what you already know in order to go beyond what you currently think” (p. 183 in Weick 1993 ). This description echoes the notion of potential, which refers to a latent state that may be put to use if a person has the opportunity.

Creativity is a multifaceted phenomenon that can be approached from many different angles. There are three main frameworks for creativity studies: the 4Ps ( Rhodes 1961 ), the 5As ( Glăveanu 2013 ), and the 7Cs model ( Lubart 2017 ). These frameworks share at least four fundamental and measurable dimensions: the act of creating (process), the outcome of the creative process (product), the characteristics of creative actor(s) enacting the process (person), and the social and physical environment that enable or hinder the creative process (press). Contrary to many traditional beliefs, however, creativity can be trained and taught in a variety of different ways, both through direct, active teaching of creativity concepts and techniques and through more passive and indirect means such as the development of creativity-supporting contexts ( Chiu 2015 ; Thornhill-Miller and Dupont 2016 ). Alongside intelligence, with which it shares some common mechanisms, creativity is now recognized as an indispensable element for the flexibility and adaptation of individuals in challenging situations ( Sternberg 1986 ).

2.1.1. Individual Assessment of Creativity

Drawing upon previous efforts to structure creativity research, Batey ( 2012 ) proposed a taxonomic framework for creativity measurement that takes the form of a three-dimensional matrix: (a) the level at which creativity may be measured (the individual, the team, the organization, and the culture), (b) the facets of creativity that may be assessed (person/trait, process, press, and product), and (c) the measurement approach (objective, self-rating, other ratings). It is beyond the scope of this article to offer a literature review of all these dimensions, but for the purposes of this paper, we address some important aspects of individual-level and institutional-level assessment here.

Assessing creativity at an individual level encompasses two major approaches: (1) creative accomplishment based on production and (2) creative potential. Regarding the first approach focusing on creative accomplishment , there are at least four main assessment techniques (or tools representing variations of assessment techniques): (a) the historiometric approach, which applies quantitative analysis to historically available data (such as the number of prizes won or times cited) in an effort to understand eminent, field-changing creativity ( Simonton 1999 ); (b) the Consensual Assessment Technique (CAT) ( Amabile 1982 ), which offers a method for combining and validating judges’ subjective evaluations of a set of (potentially) creative productions or ideas; (c) the Creative Achievement Questionnaire ( Carson et al. 2005 ), which asks individuals to supply a self-reported assessment of their publicly recognizable achievement in ten different creative domains; and (d) the Inventory of Creative Activities and Achievements (ICAA) ( Jauk et al. 2014 ; Diedrich et al. 2018 ), which includes self-report scales assessing the frequency of engagement in creative activity and also levels of achievement in eight different domains.

The second major approach to individual assessment is based on creative potential, which measures the cognitive abilities and/or personality traits that are important for creative work. The two most popular assessments of creative potential are the Remote Associations Test (RAT) and the Alternative Uses Task (AUT). The RAT, which involves identifying the fourth word that is somehow associated with each of three given words, underscores the role that the ability to convergently associate disparate ideas plays as a key capacity for creativity. In contrast, the AUT, which requires individuals to generate a maximum number of ideas based on a prompt (e.g., different uses for a paperclip), is used to assess divergent thinking capacity. According to multivariate models of creative potential ( Lubart et al. 2013 ), there are cognitive factors (e.g., divergent thinking, mental flexibility, convergent thinking, associative thinking, selective combination), conative factors (openness, tolerance of ambiguity, intuitive thinking, risk taking, motivation to create), and environmental factors that all support creativity. Higher creative potential is predicted by having more of the ingredients for creativity. However, multiple different profiles among a similar set of these important ingredients exist, and their weighting for optimal creative potential varies according to the profession, the domain, and the task under consideration. For example, Lubart and Thornhill-Miller ( 2021 ) and Lubin et al. ( forthcoming ) have taken this creativity profiling approach, exploring the identification and training of the components of creative potential among lawyers and clinical psychologists, respectively. For a current example of this sort of comprehensive, differentiated measurement of creative potential in adults in different domains and professions, see CreativityProfiling.org. For a recent battery of tests that are relevant for children, including domain-relevant divergent-exploratory and convergent-integrative tasks, see Lubart et al. ( 2019 ). Underscoring the growing recognition of the importance of creativity assessment, measures of creative potential for students were introduced internationally for the first time in the PISA 2022 assessment ( OECD 2019a ).

2.1.2. Institutional and Environmental Support for Development of Creativity

The structural support that institutions and programs can provide to promote the development of creativity can be described as coming through three main paths: (1) through design of the physical environment in a manner that supports creativity, (2) through teaching about creativity, the creative process, and creativity techniques, and (3) through training opportunities to help students/employees develop personal habits, characteristics, and other ingredients associated with creative achievement and potential.

Given the multi-dimensionality of the notion of creativity, the environment can positively influence and help develop creative capacities. Studies have shown that the physical environment in which individuals work can enhance their positive emotions and mood and thus their creativity. For example, stimulating working environments might have unusual furniture and spaces that have natural light, windows open to nature, plants and flowers, a relaxing atmosphere and colors in the room (e.g., green and blue), or positive sounds (e.g., calm music or silence), as well as inspiring and energizing colors (e.g., yellow, pink, orange). Furthermore, the arrangement of physical space to promote interpersonal exchange rather than isolation, as well as the presence of tools, such as whiteboards, that support and show the value of exchange, are also important (for reviews, see Dul and Ceylan 2011 ; Samani et al. 2014 ).

Although it has been claimed that “creativity is intelligence having fun” ( Scialabba 1984 ; Reiman 1992 ), for most people, opportunities for fun and creativity, especially in their work environment, appear rather limited. In fact, the social and physical environment often hinders creativity. Corazza et al. ( 2021 )’s theoretical framework concerning the “Space-Time Continuum”, related to support for creativity, suggests that traditional education systems are an example of an environment that is “tight” both in the conceptual “space” it affords for creativity and in the available time allowed for creativity to happen—essentially leaving little room for original ideas to emerge. Indeed, though world-wide data suggest that neither money nor mere time spent in class correlate well with educational outcomes, both policies and pedagogy that direct the ways in which time is spent make a significant difference ( Schleicher 2022 ). Research and common sense suggest that teachers, students, and employees need more space and time to invest energy in the creative process and the development of creative potential.

Underscoring the importance of teaching the creative process and creativity techniques is the demonstration, in a number of contexts, that groups of individuals who generate ideas without a specific method are often negatively influenced by their social environment. For example, unless guarded against, the presence of others tends to reduce the number of ideas generated and to induce a fixation on a limited number of ideas conforming to those produced by others ( Camarda et al. 2021 ; Goldenberg and Wiley 2011 ; Kohn and Smith 2011 ; Paulus and Dzindolet 1993 ; Putman and Paulus 2009 ; Rietzschel et al. 2006 ). To overcome these cognitive and social biases, different variants of brainstorming techniques have shown positive effects (for reviews of methods, see Al-Samarraie and Hurmuzan 2018 ; Paulus and Brown 2007 ). These include: using ( Osborn 1953 ) initial brainstorming rules (which aim to reduce spontaneous self-judgment of ideas and fear of this judgment by others); drawing attention to ideas generated by others by writing them down independently (e.g., the technique known as “brainwriting”); and requiring incubation periods between work sessions by forcing members of a problem-solving group to take breaks ( Paulus and Yang 2000 ; Paulus and Kenworthy 2019 ).

It is also possible to use design methods that are structured to guide the creative process and the exploration of ideas, as well as to avoid settling on uncreative solution paths ( Chulvi et al. 2012 ; Edelman et al. 2022 ; Kowaltowski et al. 2010 ; see Cotter et al. 2022 for a valuable survey of best practices for avoiding the suppression of creativity and fostering creative interaction and metacognition in the classroom). Indeed, many helpful design thinking-related programs now exist around the world and have been shown to have a substantial impact on creative outcomes ( Bourgeois-Bougrine 2022 ).

Research and experts suggest the utility of many additional creativity enhancement techniques (see, e.g., Thornhill-Miller and Dupont 2016 ), and the largest and most rapid effects are often attributed to these more method- or technique-oriented approaches ( Scott et al. 2004 ). More long-term institutional and environmental support for the development of creativity, however, should also include targeted training and understanding of personality and emotional traits associated with the “creative person” (e.g., empathy and exploratory habits that can expand knowledge, as well as increase tolerance of ambiguity, openness, and mental flexibility; see Lubart and Thornhill-Miller 2021 ). Complementing these approaches and focusing on a more systemic level, recent work conducted by the OECD exemplifies efforts aimed to foster creativity (and critical thinking) by focusing simultaneously on curriculum, educational activities, and teacher support and development at the primary, secondary, and higher education levels (see Vincent-Lancrin et al. 2019 ; Saroyan 2022 ).

2.2. Critical Thinking

Researchers, teachers, employers, and public policymakers around the world have long ranked the development of critical thinking (CT) abilities as one of the highest educational priorities and public needs in modern democratic societies ( Ahern et al. 2019 ; Dumitru et al. 2018 ; Pasquinelli et al. 2021 ). CT is central to better outcomes in daily life and general problem solving ( Hitchcock 2020 ), to intelligence and adaptability ( Halpern and Dunn 2021 ), and to academic achievement ( Ren et al. 2020 ). One needs to be aware of distorted or erroneous information in the media, of the difference between personal opinions and proven facts, and how to handle increasingly large bodies of information required to understand and evaluate information in the modern age.

Although much research has addressed both potentially related constructs, such as intelligence and wisdom, and lists of potential component aspects of human thought, such as inductive or deductive reasoning (for reviews of all of these, see Sternberg and Funke 2019 ), reaching a consensus on a definition has been difficult, because CT relies on the coordination of many different skills ( Bellaera et al. 2021 ; Dumitru et al. 2018 ) and is involved in, and sometimes described from the perspective of, many different domains ( Lewis and Smith 1993 ). Furthermore, as a transversal competency, having the skills to perform aspects of critical thinking in a given domain does not necessarily entail also having the metacognitive ability to know when to engage in which of its aspects, or having the disposition, attitude, or “mindset” that motivates one to actually engage in them—all of which are actually required to be a good critical thinker ( Facione 2011 ).

As pointed out by the American Philosophical Association’s consensus definition, the ideal “critical thinker” is someone who is inquisitive, open-minded, flexible, fair-minded, and keeps well-informed, thus understanding different points of view and perspectives ( Facione 1990b ). These characteristics, one might note, are also characteristic of the “creative individual” ( Facione 1990b ; Lai 2011 ), as is the ability to imagine alternatives, which is often cited as a component of critical thinking ability ( Facione 1990b ; Halpern 1998 ). Conversely, creative production in any domain needs to be balanced by critical appraisal and thought at each step of the creative process ( Bailin 1988 ). Indeed, it can be argued that creativity and critical thinking are inextricably linked and are often two sides of the same coin. Representing different aspects of “good thought” that are linked and develop in parallel, it seems reasonable that they should, in practice, be taught and considered together in teaching and learning ( Paul and Elder 2006 ).

Given its complexity, many definitions of critical thinking have been offered. However, some more recent work has helpfully defined critical thinking as “the capacity of assessing the epistemic quality of available information and—as a consequence of this assessment—of calibrating one’s confidence in order to act upon such information” ( Pasquinelli et al. 2021 ). This definition, unlike others proposed in the field (for a review, see: Bellaera et al. 2021 ; Liu et al. 2014 ), is specific (i.e., it limits the use of poorly defined concepts), as well as consensual and operational (i.e., it has clear and direct implications for the education and assessment of critical thinking skills; Pasquinelli et al. 2021 ; Pasquinelli and Bronner 2021 ). Thus, this approach assumes that individuals possess better or worse cognitive processes and strategies that make it possible to judge the reliability of the information received, by determining, for example, what the arguments provided actually are. Are the arguments convincing? Is the source of information identifiable and reliable? Does the information conflict with other information held by the individual?

It should also be noted that being able to apply critical thinking is necessary to detect and overcome the cognitive biases that can constrain one’s reasoning. Indeed, when solving a problem, it is widely recognized that people tend to automate the application of strategies that are usually relevant in similar and analogous situations that have already been encountered. However, these heuristics (i.e., automatisms) can be a source of errors, in particular, in tricky reasoning situations, as demonstrated in the field of reasoning, arithmetic problems ( Kahneman 2003 ) or even divergent thinking tasks ( Cassotti et al. 2016 ; for a review of biases, see Friedman 2017 ). Though some cognitive biases can even be seen as normal ways of thinking and feeling, sometimes shaping human beliefs and ideologies in ways that make it completely normal—and even definitely human— not to be objective (see Thornhill-Miller and Millican 2015 ), the mobilization of cognitive resources such as those involved in critical reasoning on logical bases usually makes it possible to overcome cognitive biases and adjust one’s reasoning ( West et al. 2008 ).

According to Pasquinelli et al. ( 2021 ), young children already possess cognitive functions underlying critical thinking, such as the ability to determine that information is false. However, until late adolescence, studies have demonstrated an underdevelopment of executive functions involved in resistance to biased reasoning ( Casey et al. 2008 ) as well as some other higher-order skills that underlie the overall critical thinking process ( Bloom 1956 ). According to Facione and the landmark American Philosophical Association’s task force on critical thinking ( Facione 1990b ; Facione 2011 ), these components of critical thinking can be organized into six measurable skills: the ability to (1) interpret information (i.e., meaning and context); (2) analyze information (i.e., make sense of why this information has been provided, identify pro and con arguments, and decide whether we can accept the conclusion of the information); (3) make inferences (i.e., determine the implications of the evidence, its reliability, the undesirable consequences); (4) evaluate the strength of the information (i.e., its credibility, determine the trust in the person who provides it); (5) provide explanations (i.e., summarize the findings, determine how the information can be interpreted, and offer verification of the reasoning); (6) self-regulate (i.e., evaluate the strength of the methods applied, determine the conflict between different conclusions, clarify the conclusions, and verify missing elements).

2.2.1. Individual Assessment of Critical Thinking

The individual assessment of critical thinking skills presents a number of challenges, because it is a multi-task ability and involves specific knowledge in the different areas in which it is applied ( Liu et al. 2014 ; Willingham 2008 ). However, the literature provides several tools with which to measure different facets of cognitive functions and skills involved in the overarching critical thinking process ( Lai 2011 ; Liu et al. 2014 ). Most assessments involve multiple-choice questions requiring reasoning within a particular situation based upon a constrained set of information provided. For example, in one of the most widely used tests, the California Critical Thinking Skills Test ( Facione 1990a ), participants are provided with everyday scenarios and have to answer multiple questions targeting the six higher-order skills described previously. Similarly, the Watson–Glaser Critical Thinking Appraisal ( Watson 1980 ; Watson and Glaser 2010 ) presents test takers with passages and scenarios measuring their competencies at recognizing assumptions, evaluating arguments, and drawing conclusions. Although the Watson–Glaser is one of the oldest and most frequently used assessments internationally for hiring and promotion in professional contexts, its construct validity, like many other measures of this challenging topic, has some limitations ( Possin 2014 ).

Less frequently, case study or experiential methods of assessment are also used. This approach may involve asking participants to reflect on past experiences, analyze the situations they faced and the way they behaved or made judgments and decisions and then took action ( Bandyopadhyay and Szostek 2019 ; Brookfield 1997 ). These methods, often employed by teachers or employers on students and employees, usually involve the analysis of qualitative data that can cast doubt on the reliability of the results. Consequently, various researchers have suggested ways to improve analytic methods, and they emphasize the need to create more advanced evaluation methods ( Brookfield 1997 ; Liu et al. 2014 ).

For example, Liu et al. ( 2014 ) reviewed current assessment methods and suggest that future work improves the operational definition of critical thinking, aiming to assess it both in different specific contexts and in different formats. Specifically, assessments could be contextualized within the major areas addressed by education programs (e.g., social sciences, humanities, and/or natural sciences), and the tasks themselves should be as practically connected to the “real world” as possible (e.g., categorizing a set of features, opinions, or facts based on whether or not they support an initial statement). Moreover, as Brookfield ( 1997 ) argues, because critical thinking is a social process that takes place in specific contexts of knowledge and culture, it should be assessed as a social process, therefore, involving a multiplicity of experiences, perceptions, and contributions. Thus, Brookfield makes three recommendations for improving the assessment of critical thinking that are still relevant today: (1) to assess critical thinking in specific situations, so one can study the process and the discourse related to it; (2) to involve students/peers in the evaluation of critical thinking abilities, so that the evaluation is not provided only by the instructor; and (3) to allow learners or participants in an experiment to document, demonstrate, and justify their engagement in critical thinking, because this learning perspective can provide insight into basic dimensions of the critical thinking process.

Finally, another more recent and less widely used form of assessment targets the specific executive functions that underlie logical reasoning and resistance to cognitive biases, as well as the ability of individuals to resist these biases. This form of assessment is usually done through specific experimental laboratory tasks that vary depending on the particular executive function and according to the domain of interest ( Houdé and Borst 2014 ; Kahneman 2011 ; West et al. 2008 ).

2.2.2. Institutional and Environmental Support for Development of Critical Thinking Skills

The executive functions underlying general critical thinking, the ability to overcome bias ( Houdé 2000 ; Houdé and Borst 2014 ), and meta-cognitive processes (i.e., meta information about our cognitive strategies) can all be trained and enhanced by educational programs ( Abrami et al. 2015 ; Ahern et al. 2019 ; Alsaleh 2020 ; Bellaera et al. 2021 ; Uribe-Enciso et al. 2017 ; Popil 2011 ; Pasquinelli and Bronner 2021 ; Yue et al. 2017 ).

Educational programs and institutions can support the development of critical thinking in several different ways. The process of developing critical thinking focuses on the interaction between personal dispositions (attitudes and habits), skills (evaluation, reasoning, self-regulation), and finally, knowledge (general and specific knowledge, as well as experience) ( Thomas and Lok 2015 ). It is specifically in regard to skills and knowledge that institutions are well suited to develop critical thinking through pedagogical elements such as rhetoric training, relevance of information evaluation (e.g., media literacy, where and how to check information on the internet, dealing with “fake news”, etc.), deductive thinking skills, and inductive reasoning ( Moore and Parker 2016 ). A few tools, such as case studies or concept mapping, can also be used in conjunction with a problem-based learning method, both in individual and team contexts and in person or online ( Abrami et al. 2015 ; Carmichael and Farrell 2012 ; Popil 2011 ; Thorndahl and Stentoft 2020 ). According to Marin and Halpern ( 2011 ), training critical thinking should include explicit instruction involving at least the four following components and objectives: (1) working on attitudes and encouraging individuals to think; (2) teaching and practicing critical thinking skills; (3) training for transfer between contexts, identifying concrete situations in which to adopt the strategies learned; and (4) suggesting metacognition through reflection on one’s thought processes. Supporting these propositions, Pasquinelli and Bronner ( 2021 ), in a French national educational report, proposed practical advice for creating workshops to stimulate critical thinking in school classrooms, which appear relevant even in non-school intervention situations. For example, the authors suggest combining concrete examples and exercises with general and abstract explanations, rules and strategies, which can be transferred to other areas beyond the one studied. They also suggest inviting learners to create examples of situations (e.g., case studies) in order to increase the opportunities to practice and for the learner to actively participate. Finally, they suggest making the process of reflection explicit by asking the learner to pay attention to the strategies adopted by others in order to stimulate the development of metacognition.

2.3. Communication

In its most basic definition, communication consists of exchanging information to change the epistemic context of others. In cooperative contexts, it aims at the smooth and efficient exchange of information contributing to the achievement of a desired outcome or goal ( Schultz 2010 ). But human communication involves multiple dimensions. Both verbal and non-verbal communication can involve large quantities of information that have to be both formulated and deciphered with a range of purposes and intentions in mind ( Jones and LeBaron 2002 ). These dimensions of communication have as much to do with the ability to express oneself, both orally and in writing and the mastering of a language (linguistic competences), as with the ability to use this communication system appropriately (pragmatic skills; see Grassmann 2014 ; Matthews 2014 ), and with social skills, based on the knowledge of how to behave in society and on the ability to connect with others, to understand the intentions and perspectives of others ( Tomasello 2005 ).

Like the other 4Cs, according to most authorities, communication skills are ranked by both students and teachers as skills of the highest priority for acquisition in order to be ready for the workforce in 2030 ( OECD 2019b ; Hanover Research 2012 ). Teaching students how to communicate efficiently and effectively in all the new modalities of information exchange is an important challenge faced by all pedagogical organizations today ( Morreale et al. 2017 ). All dimensions of communication (linguistic, pragmatic, and social) are part of what is taught in school curricula at different levels. But pragmatic and social competencies are rarely explicitly taught as such. Work on social/emotional intelligence (and on its role in students’ personal and professional success) shows that these skills are both disparate and difficult to assess ( Humphrey et al. 2007 ). Research on this issue is, however, becoming increasingly rigorous, with the potential to provide usable data for the development of science-based practice ( Keefer et al. 2018 ). Teachers and pedagogical teams also have an important, changing role to play: they also need to master new information and communication technologies and the transmission of information through them ( Zlatić et al. 2014 ).

Communication has an obvious link with the three other Cs. Starting with critical thinking, sound communication implies fostering the conditions for a communicative exchange directed towards a common goal, which is, at least in educational and professional contexts, based on a fair evaluation of reality ( Pornpitakpan 2004 ). Collaboration too has a strong link with communication, because successful collaboration is highly dependent on the quality of knowledge sharing and trust that emerges between group members. Finally, creativity involves the communication of an idea to an audience and can involve high-quality communication when creative work occurs in a team context.

2.3.1. Individual Assessment of Communication

Given the vast field of communication, an exhaustive list of its evaluation methods is difficult to establish. A number of methods have been reported in the literature to assess an individual’s ability to communicate non-verbally and verbally. But although these two aspects are intrinsically linked, they are rarely measured together with a single tool. Moreover, as Spitzberg ( 2003 ) pointed out, communication skills are supported by different abilities, classically conceptualized as motivational functions (e.g., confidence and goal-orientation), knowledge (e.g., content and procedural knowledge), or cognitive and socio-cognitive functions (e.g., theory of mind, verbal cognition, emotional intelligence, and empathy; McDonald et al. 2014 ; Rothermich 2020 ), implying different specific types of evaluations. Finally, producing vs. receiving communication involve different skills and abilities, which can also vary according to the context ( Landa 2005 ).

To overcome these challenges, Spitzberg ( 2003 ) recommends the use of different assessment criteria. These criteria include the clarity of interaction, the understanding of what was involved in the interaction, the satisfaction of having interacted (expected to be higher when communication is effective), the efficiency of the interaction (the more competent someone is, the less effort, complexity, and resources will be needed to achieve their goal), its effectiveness or appropriateness (i.e., its relevance according to the context), as well as criteria relative to the quality of the dialogue (which involves coordination, cooperation, coherence, reciprocity, and mutuality in the exchange with others). Different forms of evaluation are also called for, such as self-reported questionnaires, hetero-reported questionnaires filled out by parents, teachers, or other observers, and tasks involving exposure to role-playing games, scenarios or videos (for a review of these assessment tools, see Cömert et al. 2016 ; Landa 2005 ; Sigafoos et al. 2008 ; Spitzberg 2003 ; van der Vleuten et al. 2019 ). Results from these tools must then be associated with others assessing underlying abilities, such as theory of mind and metacognition.

2.3.2. Institutional and Environmental Support for Development of Communication Skills

Although communication appears to be a key employability skill, the proficiency acquired during studies rarely meets the expectations of employers ( Jackson 2014 ). Communication must therefore become a priority in the training of students, beyond the sectors in which it is already known as essential (e.g., in medicine, nursing, engineering, etc.; Bourke et al. 2021 ; D’Alimonte et al. 2019 ; Peddle et al. 2018 ; Riemer 2007 ), and also through professional development ( Jackson 2014 ). Training programs involving, for example, communication theory classes ( Kruijver et al. 2000 ) and self-assessment tools that can be used in specific situations ( Curtis et al. 2013 ; Rider and Keefer 2006 ) have had convincingly positive results. The literature suggests that interactive approaches in small groups, in which competencies are practiced explicitly in an open and feedback-safe environment, are more effective ( Bourke et al. 2021 ; D’Alimonte et al. 2019 ; AbuSeileek 2012 ; Fryer-Edwards et al. 2006 ). These can take different forms: project-based work, video reviews, simulation or role-play games (see Hathaway et al. 2022 for a review; Schlegel et al. 2012 ). Finally, computer-assisted learning methods can be relevant for establishing a secure framework (especially, for example, when learning another language): anonymity indeed helps to overcome anxiety or social blockages linked to fear of public speaking or showing one’s difficulties ( AbuSeileek 2012 ). Each of these methods tackles one or more dimensions of communication that must then be assessed as such, by means of tools specifically developed and adapted to the contexts in which these skills are expressed (e.g., see the two 4Cs evaluation grids for institutions and for games outlined in Section 4 and Section 5 , below).

2.4. Collaboration

Collaborative problem solving—and more generally, collaboration—has gained increasing attention in national and international assessments (e.g., PISA) as an educational priority encompassing social, emotional, and cognitive skills critical to efficiency, effectiveness, and innovation in the modern global economy ( Graesser et al. 2018 ; OECD 2017 ). Understanding what makes effective collaboration is of crucial importance for professional practice and training ( Détienne et al. 2012 ; Graesser et al. 2018 ), as evidenced by the long line of research on group or team collaboration over the past 40 years (for a review, see e.g., Salas et al. 2004 ; Mathieu et al. 2017 ). Although there is no consensus on a definition of collaboration, scholars often see it as mutual engagement in a coordinated effort to achieve a common goal that involves the sharing of goals, resources, and representations relating to the joint activity of participants; and other important aspects relate to mutual respect, trust, responsibilities, and accountability within situational rules and norms ( Détienne et al. 2012 ).

In the teamwork research literature, skills are commonly described across three classes most often labeled Knowledge, Behavior, and Attitudes (e.g., Cannon-Bowers et al. 1995 ). Knowledge competencies refer to the skills related to elaborating the knowledge content required for the group to process and successfully achieve the task/goal to which they are assigned. Behavior includes skills related to the actualization of actions, coordination, communication, and interactions within the group as well as with any other relevant interlocutors for the task at hand. Note here that effective collaboration involves skills that have also been identified elsewhere as essential competencies, including communication, creativity, and critical thinking. Finally, several attitudes have been evidenced or hypothesized as desirable competencies in the team context, for example, attitude towards teamwork, collective orientation, cohesion/team morale, etc. Another common distinction lies between teamwork and taskwork. Teamwork refers to the collaborative, communicative, or social skills required to coordinate the work within the participants in order to achieve the task, whereas taskwork refers to specific aspects related to solving the task such as using the tools and knowing the procedure, policies, and any other task-related activities ( Salas et al. 2015 ; Graesser et al. 2018 ). Furthermore, collaborative competences can have specific (to a group of people or to a task) and general dimensions (i.e., easily transferable to any group or team situation and to other tasks). For example, skills related to communication, information exchange, conflict management, maintaining attention and motivation, leadership, etc. are present and transferable to a large number of group work situations and tasks (team-generic and task-contingent skills). Other skills can, on the other hand, be more specific to a team or group, such as internal organization, motivation, knowledge of the skills distributed in the team, etc.

2.4.1. Individual Assessment of Collaboration

Assessing collaboration requires capturing the dynamic and multi-level nature of the collaboration process, which is not as easily quantifiable as group/team inputs and outputs (task performance, satisfaction, and changes at group/team and individual level). There are indeed multiple interactions between the context, the collaboration processes, the task processes, and their (various) outcomes ( Détienne et al. 2012 ). The integrative concept of “quality of collaboration” ( Burkhardt et al. 2009 ) encapsulates much of what is currently known about collaborative processes and what constitutes effective collaboration. According to this approach, collaborative processes can be grouped along several dimensions concerning communication processes such as grounding, task-related processes (e.g., exchanges of knowledge relevant for the task at hand), and organization/coordination processes ( Burkhardt et al. 2009 ). Communication processes are most important for ensuring the construction of a common referential within a group of collaborators. Task-related processes relate to how the group resolves the task at hand by sharing and co-elaborating knowledge, by confronting their various perspectives, and by converging toward negotiated solutions. Collaboration also involves group management activities such as: (a) common goal management and coordination activities, e.g., allocation and planning of tasks; (b) meeting/interaction management activities, e.g., ordering and postponing of topics in the meeting. Finally, the ability to pursue reflexive activity, in the sense of reflecting not only on the content of a problem or solution but on one’s collaboration and problem-solving strategies, is critical for the development of the team and supports them in changing and improving their practices. Graesser et al. ( 2018 ) identify collaborative skills based on the combination of these dimensions with a step in the problem-solving process.

A large body of methodology developed to assess collaboration processes and collaborative tools has been focused on quantifying a restricted subset of fine-grained interactions (e.g., number of speakers’ turns; number of words spoken; number of interruptions; amount of grounding questions). This approach has at least two limitations. First, because these categories of analysis are often ad hoc with respect to the considered situation, they are difficult to apply in all situations and make it difficult to compare between studies. Second, quantitative variations of most of these indicators are non-univocal: any increase or decrease of them could signify either an interactive–intensive collaboration or else evidence of major difficulties in establishing and/or maintaining the collaboration ( Détienne et al. 2012 ). Alternatively, qualitative approaches based on multidimensional views of collaboration provide a more elaborated or nuanced view of collaboration and are useful for identifying potential relationships between distinctive dimensions of collaboration and aspects of team performance, in order to identify processes that could be improved. Based on the method of Spada et al. ( 2005 ) in Computer-Supported Collaborative Learning (CSCL) research, Burkhardt et al. ( 2009 ) have proposed a multi-dimensional rating scheme for evaluating the quality of collaboration (QC) in technology-mediated design. QC distinguishes seven dimensions, grouped along five aspects, identified as central for collaboration in a problem-solving task such as design: communication (1, 2), task-oriented processes (3, 4), group-oriented processes (5), symmetry in interaction—an orthogonal dimension—(6), and individual task orientation (7). This method has recently been adapted for use in the context of assessing games as a support to collaborative skills learning.

2.4.2. Institutional and Environmental Support for Development of Collaboration and Collaborative Skills

Support for individuals’ development of collaborative skills provided by institutions and programs can take a variety of forms: (a) through the social impact of the physical structure of the organization, (b) the nature of the work required within the curriculum, (c) content within the curriculum focusing on collaboration and collaborative skills, and (d) the existence and promotion of extracurricular and inter-institutional opportunities for collaboration.

For instance, institutional support for collaboration has taken a variety of forms in various fields such as healthcare, engineering, public participation, and education. Training and education programs such as Interprofessional Education or Team Sciences in the health domain ( World Health Organization 2010 ; Hager et al. 2016 ; O’Carroll et al. 2021 ), Peer-Led Team Learning in chemistry and engineering domains ( Wilson and Varma-Nelson 2016 ), or Collaborative Problem Solving in education ( Peña-López 2017 ; Taddei 2009 ) are notable examples.

Contextual support recently arose from the deployment of online digital media and new mixed realities in the workplace, in the learning environments and in society at large—obviously stimulated and accentuated with the COVID-19 pandemic. This has led many organizations to invest in proposing support for synchronous and asynchronous collaboration (notably remote, between employees, between students and educators or within group members, etc.) in various ways, including the provision of communication hardware and software, computer-supported cooperative work and computer-supported collaborative learning platforms, training and practical guides, etc. Users can collaborate through heterogeneous hybrid collaborative interaction spaces that can be accessed through virtual or augmented reality, but also simple video conferencing or even a voice-only or text-only interface. These new spaces for collaboration are, however, often difficult to use and less satisfactory than face-to-face interactions, suggesting the need for more research on collaborative activities and on how to support them ( Faidley 2018 ; Karl et al. 2022 ; Kemp and Grieve 2014 ; Singh et al. 2022 ; Waizenegger et al. 2020 ).

A substantive body of literature on teams, collaborative learning, and computer-supported technologies provides evidence related to individual, contextual, and technological factors impacting the collaboration quality and efficiency. For example, teacher-based skills that are critical for enhancing collaboration are, among others, the abilities to plan, monitor, support, consolidate, and reflect upon student interaction in group work ( Kaendler et al. 2016 ). Research focuses also on investigating the most relevant tasks and evaluating the possibilities offered by technology to support, to assess (e.g., Nouri et al. 2017 ; Graesser et al. 2018 ), and/or to learn the skills involved in pursuing effective and satisfying collaboration (see e.g., Schneider et al. 2018 ; Doyle 2021 ; Ainsworth and Chounta 2021 ).

3. Labelization: Valorization of the 4Cs and Assessing Support for Their Development

Moving from the nature of the 4Cs and their individual assessment and towards the ways in which institutions can support their development in individuals, we can now address the fundamentally important question of how best to support and promote this 21st century educational mission within and among institutions themselves. This also raises the question of the systemic recognition of educational settings that are conducive to the development of the 4Cs. In response to these questions, the nature and value of labelization is now presented.

A label is “a special mark created by a trusted third party and displayed on a product intended for sale, to certify its origin, to guarantee its quality and to ensure its conformity with the standards of practices in force” ( Renard 2005 ). A label is therefore a way of informing the public about the objective properties and qualities of a product, service, or system. The label is usually easily identifiable and can be seen as a proof that a product or service, a company, or an organization complies with defined criteria. Its effectiveness is therefore closely linked to the choice of requirements set out in its specifications, as well as to the independence and rigor of the body that verifies compliance with the criteria.

3.1. Labeling as a Means of Trust and Differentiation

As a sign of recognition established by a third party, the label or certification can constitute a proof of trust aiming to reassure the final consumer. According to Sutter ( 2005 ), there are different means of signaling trust. First, the brand name of a product or service and its reputation can, in itself, constitute a label when this brand name is recognized on the market. Second, various forms of self-declaration, such as internal company charters, though not statements assessed by a third party, show an internal commitment that can provide reassurance. Finally, there is certification or labeling, which is awarded by an external body and requires a third-party assessment by a qualified expert, according to criteria set out in a specific reference framework. It is this external body, a trusted third party, which guarantees the reliability of the label and constitutes a guarantee of credibility. Its objectivity and impartiality are meant to guarantee that the company, organization, product, or service meets defined quality or reliability criteria ( Jahn et al. 2005 ).

Research on populations around the world (e.g., Amron 2018 ; Sasmita and Suki 2015 ) show that the buying decisions of consumers are heavily influenced by the trust they have in a brand. More specifically, third-party assurances and labelization have been shown to strongly influence customer buying intentions and purchasing behavior (e.g., Kimery and McCord 2002 ; Lee et al. 2004 ). Taking France as an example, research shows that quality certification is seen as “important” or “significant” by 76% of companies ( Chameroy and Veran 2014 ), and decision makers feel more confident and are more willing to invest with the support of third-party approval than if their decision is merely based on the brand’s reputation or its demonstrated level of social responsibility ( Etilé and Teyssier 2016 ). Indeed, French companies with corporate social responsibility labels have been shown to have higher than average growth rates, and the adoption of quality standards is linked with a 7% increase in the share of export turnover ( Restout 2020 ).

3.2. Influence on Choice and Adoption of Goods and Services

Studies diverge in this area, but based on the seminal work of Parkinson ( 1975 ); Chameroy and Veran ( 2014 ), in their research on the effect of labels on willingness to pay, found that in 75% of cases, products with labels are chosen and preferred to those without labels, demonstrating the impact of the label on customer confidence—provided that it is issued by a recognized third party. Thus, brands that have good reputations tend to be preferred over cheaper new brands, because they are more accepted and valued by the individual social network ( Zielke and Dobbelstein 2007 ).

3.3. Process of Labelizing Products and Services

The creation of a label may be the result of a customer or market need, a request from a private sector of activity or from the government. Creating a label involves setting up a working group including stakeholders who are experts in the field, product managers, and a certification body in order to elaborate a reference framework. This is then reviewed by a specialized committee and validated by the stakeholders. The standard includes evaluation criteria that must be clearly defined ( Mourad 2017 ). An audit system is set up by a trusted third party. It must include the drafting of an audit report, a system for making decisions on labeling, and a system for identifying qualified assessors. The validity of the assessment process is reinforced by this double evaluation: a first level of audit carried out by a team of experts according to a clearly defined set of criteria and a second level of decision making assuring that the methodology and the result of the audit are in conformity with the defined reference framework.

3.4. Labelization of 21st Century Skills

The world of education is particularly concerned by the need to develop and assess 21st century skills, because it represents the first link in the chain of skills acquisition, preparing the human resources of tomorrow. One important means of simultaneously offering a reliable, independent assessment of 21st century skills and valorizing them by making them a core target within an educational system (schools, universities, and teaching and training programs of all kinds) is labelization. Two examples of labelization processes related to 21st century skills were recently developed by the International Institute for Competency Development ( 2021 ; see iicd.net; accessed on 20 November 2022) working with international experts, teachers, and researchers from the University of Paris Cité (formerly Université Sorbonne Paris Cité), Oxford University, and AFNOR UK (an accredited certification body and part of AFNOR International, a subsidiary of the AFNOR group, the only standards body in France).

The last two or three decades has seen the simultaneous rise of international ranking systems and an interest in quality assurance and assessment in an increasingly competitive educational market ( Sursock 2021 ). The aim of these labelization frameworks is to assist in the development of “quality culture” in education by offering individual programs, institutions, and systems additional independent, reliable means of benchmarking, charting progress, and distinguishing themselves based on their capacity to support and promote the development of crucial skills. Importantly, the external perspectives provided by such assessment system should be capable of being individually adapted and applied in a manner that can resist becoming rigidly imposed external standards ( Sursock and Vettori 2017 ). Similarly, as we have seen in the literature review, the best approach to understanding and assessing a particular C is from a combination of different levels and perspectives in context. For example, important approaches to critical thinking have been made from educationally, philosophically, and psychologically focused vantage points ( Lai 2011 ). We can also argue that understandings of creativity are also results of different approaches: the major models in the literature (e.g., the “4Ps” and “7Cs” models; see Lubart and Thornhill-Miller 2019 ) explicitly result from and include the objectives of different education-focused, process-focused, and “ingredient” or component-focused approaches.

The two assessment frameworks outlined in the sections that follow were formulated with these different perspectives and objective needs in mind. Given the complexity and very different natures of their respective targets (i.e., one assessing entire formal educational contexts such as institutions or programs, whereas the other targets the less multi-dimensional, informal educational activities represented by games), the assessment of the individual Cs also represents what experts consider a target-appropriate balance of education- and curriculum-focused, process-focused, and component-focused criteria for assessing each different C.

4. The International Institute for Competency Development’s 21st Century Competencies 4Cs Assessment Framework for Institutions and Programs

One comprehensive attempt to operationalize programmatic-level and institutional-level support for the development of the 4Cs is the International Institute for Competency Development’s 4Cs Assessment Framework ( International Institute for Competency Development 2021 ). Based upon expert opinion and a review of the available literature, this evaluation grid is a practical tool that divides each of the 4Cs into three “user-friendly” but topic-covering components (see Table 1 and definitions and further discussion in the sections that follow). Each of these components is then assessed across seven dimensions (see Table 2 , below), designed to cover concisely the pedagogical process and the educational context. Examples for each point level are provided within the evaluation grid in order to offer additional clarity for educational stakeholders and expert assessors.

Three different components of each C in IICD’s 21st Century Skills 4Cs Assessment Framework.

Seven dimensions evaluated for the 3 different components of each C.

* Educational-level dependent and potentially less available for younger students or in some contexts.

The grid itself can be used in several important and different ways by different educational stakeholders: (1) by the institution itself in its self-evaluation and possible preparation for a certification or labelization process, (2) as an explicit list of criteria for external evaluation of the institution and its 4Cs-related programs, and (3) as a potential long-term development targeting tool for the institution or the institution in dialogue with the labelization process.

4.1. Evaluation Grid for Creativity

Dropping the component of “creative person” that is not relevant at the institutional level, this evaluation grid is based on Rhodes’ ( 1961 ) classic “4P” model of creativity, which remains the most concise model today ( Lubart and Thornhill-Miller 2019 ). The three “P” components retained are: creative process , creative environment , and creative product . Creative process refers to the acquisition of a set of tools and techniques that students can use to enhance the creativity of their thinking and work. Creative environment (also called “Press” in earlier literature) is about how the physical and social surroundings of students can help them be more creative. Finally, creative product refers to the evaluation of actual “productions” (e.g., a piece of art, text, speech, etc.) generated through the creative process.

4.2. Evaluation Grid for Critical Thinking

Our evaluation grid divides critical thinking into three main components: critical thinking about the world , critical thinking about oneself (self-reflection), as well as critical action and decision making . The first component refers to having an evidence-based view of the exterior world, notably by identifying and evaluating sources of information and using them to question current understandings and solve problems. Self-reflection refers to thinking critically about one’s own life situation, values, and actions; it presupposes the autonomy of thought and a certain distance as well as the most objective observation possible with regard to one’s own knowledge (“meta-cognition”). The third and final component, critical action and decision making, is about using critical thinking skills more practically in order to make appropriate life decisions as well as to be open to different points of view. This component also addresses soft skills and attitudes such as trusting information.

Our evaluation framework for critical thinking was in part inspired by Barnett’s “curriculum for critical being” (2015), whose model distinguishes two axes: one defined by the qualitative differences in the level of criticality attained and the second comprised of three different domains of application: formal knowledge, the self, and the world. The first two components of our framework (and the seven dimensions on which they are rated) reflect and encompass these three domains. Similar to Barrett’s proposal, our third rubric moves beyond the “skills-plus-dispositions” model of competency implicit in much theorizing about critical thinking and adds the importance of “action”—not just the ability to think critically and the disposition to do so, but the central importance of training and practicing “critical doing” ( Barnett 2015 ). Critical thinking should also be exercised collectively by involving students in collective thinking, facilitating the exchange of ideas and civic engagement ( Huber and Kuncel 2016 ).

4.3. Evaluation Grid for Collaboration

The first component of collaboration skills in the IICD grid is engagement and participation , referring to the active engagement in group work. Perspective taking and openness concerns the flexibility to work with and accommodate other group members and their points of view. The final dimension— social regulation —is about being able to reach for a common goal, notably through compromise and negotiation, as well as being aware of the different types of roles that group members can hold ( Hesse et al. 2015 ; Rusdin and Ali 2019 ; Care et al. 2016 ). (These last two components include elements of leadership, character, and emotional intelligence as sometimes described in other soft-skill and competency-related systems.) Participation, social regulation, and perspective taking have been identified as central social skills in collaborative problem solving ( Hesse et al. 2015 ). Regarding social regulation in this context, recognizing and profiting from group diversity is key ( Graesser et al. 2018 ). When describing an assessment in an educational setting of collaborative problem solving (with a task in which two or more students have to collaborate in order to solve it, each using a different set of resources), two main underpinning skills were described for the assessment: the social skill of audience awareness (“how to adapt one’s own behavior to suit the needs of the task and the partner’s requirements”, Care et al. 2016, p. 258 ) and the cognitive skill of planning and executing (developing a plan to reach for a goal) ( Care et al. 2016 ). The former is included in the perspective taking and openness rubric and the latter in the social regulation component in the IICD grid. Evans ( 2020 ) identified four main collaboration skills consistently mentioned in the scientific literature that are assessed in the IICD grid: the ability to plan and make group decisions (example item from the IICD grid: teachers provide assistance to students to overcome differences and reach a common goal during group work); the ability to communicate about thinking with the group (assessed notably in the meta-reflection strand of the IICD grid); the ability to contribute resources, ideas, and efforts and support group members (included notably in the engagement and participation as well as the social regulation components); and finally, the ability to monitor, reflect, and adapt individual and group processes to benefit the group (example item from the IICD grid: students use perspective-taking tools and techniques in group activities).

4.4. Evaluation Grid for Communication

The evaluation grid for communication is also composed of three dimensions: message formulation, message delivery, and message and communication feedback . Message formulation refers to the ability to design and structure a message to be sent, such as outlining the content of an argument. Message delivery is about effectively transmitting verbal and non-verbal aspects of a message. Finally, message and communication feedback refers to the ability of students and teachers to understand their audience, analyze their social surroundings, and interpret information in context. Other components of communication skills such as theory of mind, empathy, or emotional intelligence are also relevant and included in the process of applying the grid. Thompson ( 2020 ) proposes a four-component operationalized definition of communication for its assessment in students. First, they describe a comprehension strand covering the understanding and selection of adequate information from a range of sources. Message formulation in the IICD grid captures this dimension through its focus on content analysis and generation. Second, the presentation of information and ideas is mentioned in several different modes, adjusted to the intended audience, verbally as well as non-verbally. The message delivery component of the IICD grid focuses on these points. Third, the authors note the importance of communication technology and its advanced use. The IICD grid also covers the importance of technology use in its tools and techniques category, with, for example, an item that reads: students learn to effectively use a variety of formats of communication (social media, make a video, e-mail, letter writing, creating a document). Finally, Thompson ( 2020 ) describes the recognition of cultural and other differences as an important aspect of communication. The IICD grid aims at incorporating these aspects, notably in the meta-reflection category under each of the three dimensions.

5. Assessing the 4Cs in Informal Educational Contexts: The Example of Games

5.1. the 4cs in informal educational contexts.

So far, the focus has been on rather formal ways of nurturing the 4Cs. Although institutions and training programs are perhaps the most significant and necessary avenues of education, they are not the sole context in which 4Cs’ learning and improvement can manifest. One other important potential learning context is game play. Games are activities that are present and participated in throughout human society—by those of all ages, genders, and socio-economic statuses ( Bateson and Martin 2013 ; Huizinga 1949 ; Malaby 2007 ). This informal setting can also provide favorable conditions to help improve the 4Cs ( van Rosmalen et al. 2014 ) and should not be under-appreciated. Games provide a unique environment for learning, as they can foster a space to freely explore possibilities and one’s own potential ( de Freitas 2006 ). We argue that games are a significant potential pathway for the improvement of the 4Cs, and as such, they merit the same attention as more formal ways of learning and developing competencies.

5.2. 4Cs Evaluation Framework for Games

Compared to schools and educational institutions, the focus of IICD’s evaluation framework for games (see International Institute for Competency Development 2021 ) is more narrow. Thus, it is fundamentally different from the institutional grid: games, complex and deep as they can sometimes be, cannot directly be compared to the complexity of a school curriculum and all the programs it contains. The evaluation of a game’s effectiveness for training/improving a given C rests on the following principle: if a game presents affordances conducive to exercising a given skill, engaged playing of that game should help improve that skill.

The game’s evaluation grid is scored based on two criteria. For example, as a part of a game’s rating as a tool for the development of creativity, we determine the game must first meet two conditions. First, whether or not the game allows the opportunity for creativity to manifest itself: if creativity cannot occur in the game, it is obviously not eligible to receive ratings for that C. Second, whether or not creativity is needed in order to perform well in the game: if the players can win or achieve success in the game without needing creativity, this also means it cannot receive a rating for that C. If both conditions are met, however, the game will be considered potentially effective to improve creativity through the practice of certain components of creative behavior. This basic principle applies for all four of the Cs.

As outlined in Table 3 , below, the evaluation grid for each of the four Cs is composed of five components relevant to games that are different for each of the Cs. The grid works as follows: for each of the five components of each C, we evaluate the game on a list of sub-components using two yes/no scales: one for whether it is “possible” for that subcomponent to manifest and one for whether that sub-component is “required for success” in the game. This evaluation is done for all sub-components. After this, each general component is rated on the same two indicators. If 60% (i.e., three out of five) or more sub-components are positively rated as required, the general component is considered required. Then, the game is evaluated on its effectiveness for training and improving each of the 4Cs. If 60% or more components are positively rated as required, the game will be labelized as having the potential to be effective for training and improving the corresponding C.

Five different components evaluated for each C by the 4Cs assessment framework for games.

The evaluation grid for creativity is based on the multivariate model of creative potential (see Section 2.1.1 and Lubart et al. 2013 for more information) and is composed of four cognitive factors and one conative factor: originality , divergent thinking , convergent thinking , mental flexibility , and creative dispositions . Originality refers to the generation of ideas that are novel or unexpected, depending on the context. Divergent thinking corresponds to the generation of multiple ideas or solutions. Convergent thinking refers to the combination of multiple ideas and the selection of the most creative idea. Mental flexibility entails changing perspectives on a given problem and breaking away from initial ideas. Finally, creative dispositions concerns multiple personality-related factors conducive to creativity, such as openness to experience or risk taking.

The evaluation grid for critical thinking echoes Halpern’s ( 1998 ) as well as Marin and Halpern’s ( 2011 ) considerations for teaching this skill, that is, taking into consideration thinking skills, metacognition, and dispositions. The five components of the critical thinking grid are: goal-adequate discernment, objective thinking, metacognition, elaborate reasoning, and uncertainty management. Goal-adequate discernment entails the formulation of inferences and the discernment of contradictions when faced with a problem. Objective thinking corresponds to the suspension of one’s own judgment and the analysis of affirmations and sources in the most objective manner possible. Metacognition, here, is about questioning and reassessing information, as well as the awareness of one’s own cognitive biases. Elaborate reasoning entails reasoning in a way that is cautious, thorough, and serious. Finally, uncertainty management refers to the dispositional propensity to tolerate ambiguity and accept doubt.

The evaluation grid for collaboration is based on the quality of collaboration (QC) method ( Burkhardt et al. 2009 ; see Section 2.4.2 for more details) and is composed of the following five components: collaboration fluidity, well-argued deliberation and consensus-based decision, balance of contribution, organization and coordination, and cognitive syncing, input, and support. Collaboration fluidity entails the absence of speech overlap and the presence of a good flow in terms of turns to speak. Well-argued deliberation and consensus-based decision is about contributing to the discussion and task at hand, as well as participating in discussions and arguments, in order to obtain a consensus. Balance of contribution refers to having equal or equivalent contributions to organization, coordination, and decision making. Organization and coordination refers to effective management of roles, time, and “deadlines”, as well as the attribution of roles depending on participants’ skills. Finally, cognitive syncing, input, and support is about bringing ideas and resources to the group, as well as supporting and reinforcing other members of the group.

The five components used to evaluate communication in games include both linguistic, pragmatic, and social aspects. Linguistic skills per se are captured by the mastery of written and spoken language component. This component assesses language comprehension and the appropriate use of vocabulary. Pragmatic skills are captured by the verbal and non-verbal communication components and refer to the efficient use of verbal and body signals in the context of the game to achieve one’s communicative goals ( Grassmann 2014 ; Matthews 2014 ). Finally, the grid also evaluates social skills with its two last components, social interactions and social cognition, which, respectively, refer to the ability to interact with others appropriately—including by complying with the rules of the game—and to the understanding of other people’ mental states ( Tomasello 2005 ).

6. Discussion and Conclusions

Each of the 4Cs is a broad, multi-faceted concept that is the subject of a tremendous amount of research and discussion by a wide range of stakeholders in different disciplines, professions, and parts of the educational establishment. The development of evaluation frameworks to allow support for the 4Cs to be assessed and publicly recognized, using a label, is an important step for promoting and fostering these skills in educational contexts. As illustrated by IICD’s 4Cs Framework for educational institutions and programs, as well as its games/activities evaluation grid, the specific criteria to detect support for each C can vary depending upon the educational context (e.g., formal and institutional level or informal and at the activity level). Yet considering the 4Cs together highlights some additional observations, current challenges, and opportunities for the future that are worthy of discussion.

6.1. Interrelationships between the 4Cs and a New Model for Use in Pedagogy and Policy Promotion

One very important issue for understanding the 4Cs and their educational implementation that can be simultaneously a help and a hindrance for teaching them—and also a challenge when assessing them—is their multidimensionality and interrelatedness. In other words, the 4Cs are not entirely separate entities but instead, as Figure 2 shows, should be seen as four interlinked basic “elements” for future-oriented education that can help individuals in their learning process and, together, synergistically “bootstrap” the development of their cognitive potentials. Lamri and Lubart ( 2021 ), for example, found a certain base level of creativity was a necessary but not sufficient condition for success in managerial tasks, but that high-level performance required a combination of all four Cs. Some thinkers have argued that one cannot be creative without critical thinking, which also requires creativity, for example, to come up with alternative arguments (see Paul and Elder 2006 ). Similarly, among many other interrelationships, there is no collaboration without communication—and even ostensibly individual creativity is a “collaboration” of sorts with the general culture and precursors in a given field. As a result, it ranges from impossible to suboptimal to teach (or teach towards) one of the 4Cs without involving one or more of the others, and this commingling also underscores the genuine need and appropriateness of assessing them together.

“‘Crea-Critical-Collab-ication’: a Dynamic Interactionist Model of the 4Cs”. (Illustration of the interplay and interpenetration of creativity, critical thinking, collaboration, and communication shown in dimensional space according to their differing cognitive/individual vs. social/interpersonal emphases; (© 2023, Branden Thornhill-Miller. All Rights Reserved. thornhill-miller.com; accessed on 20 January 2023)).

From this perspective, Thornhill-Miller ( 2021 ) proposed a “dynamic interactionist model of the 4Cs” and their interrelated contributions to the future of education and work. Presented in Figure 2 , this model is meant to serve as a visual and conceptual aid for understanding the 4Cs and their interrelationships, thereby also promoting better use and understanding of them in pedagogical and policy settings. In addition to suggesting the portmanteau of “crea-critical thinking” as a new term to describe the overlap of much of the creative and critical thinking processes, the title of this model, “Crea-Critical-Collab-ication”, is a verbal representation of the fluid four-way interrelationship between the 4Cs visually represented in Figure 2 (a title meant to playfully repackage the 4Cs for important pedagogical and policy uses). This model goes further to suggest some dimensional differences in emphases that, roughly speaking, also often exist among the 4Cs: that is to say, the frequently greater emphasis on cognitive or individual elements at play in creativity and critical thinking in comparison to the social and interpersonal aspects more central to communication and collaboration ( Thornhill-Miller 2021 ).

Similarly focused on the need to promote a phase change towards future-oriented education, Lucas ( 2019 ) and colleagues have suggested conflating creative thinking and critical thinking in order to propose “3Cs” (creative thinking, communication, and collaboration) as new “foundational literacies” to symmetrically add to the 3Rs (Reading, wRiting, and aRithmetic) of previous educational eras. Although we applaud these efforts, from our applied research perspective, we believe that the individual importance of, and distinct differences between, creative thinking and critical thinking support preserving them both as separate constructs in order to encourage the greatest development of each of them. Moreover, if only three categories were somehow required or preferable, one could argue that uniting communication and collaboration (as “collab-ication” suggests) might be preferable—particularly also given the fact that substantial aspects of communication are already covered within the 3Rs. In any case, we look forward to more such innovations and collaborations in this vibrant and important area of work at the crossroads between research, pedagogy, and policy development.

6.2. Limitations and Future Work

The rich literature in each of the 4Cs domains shows the positive effects of integrating these dimensions into educational and professional curricula. At the same time, the complexity of their definitions makes them difficult to assess, both in terms of reliability (assessment must not vary from one measurement to another) and of validity (tests must measure that which they are intended to measure). However, applied research in this area is becoming increasingly rigorous, with a growing capacity to provide the necessary tools for evidence-based practice. The development of these practices should involve interdisciplinary teams of teachers and other educational practitioners who are equipped and trained accordingly. Similarly, on the research side, further exploration and clarification of subcomponents of the 4Cs and other related skills will be important. Recent efforts to clarify the conceptual overlap and hierarchical relations of soft skills for the future of education and work, for example, have been helpful and promising (e.g., Joie-La Marle et al. 2022 ; Lamri et al. 2022 ). But the most definitive sort of taxonomy and measurement model that we are currently lacking might only be established based on the large-scale administration of a comprehensive battery of skill-measuring psychometric tests on appropriate cross sections of society.

The rapid development and integration of new technologies will also aid and change the contexts, resources, and implementation of the 4Cs. For example, the recent developments make it clear that the 4Cs will be enhanced and changed by interaction with artificially intelligence, even as 4Cs-related skills will probably, for the same reason, increasingly constitute the core of available human work in the future (see, e.g., Ross 2018 ). Similarly, research on virtual reality and creativity suggest that VR environments assist and expand individual and collaborative creativity ( Bourgeois-Bougrine et al. 2022 ). Because VR technologies offer the possibility of enhanced and materially enriched communication, collaboration, and information availability, they not only allow for the enhancement of creativity techniques but also for similar expansions and improvements on almost all forms of human activity (see Thornhill-Miller and Dupont 2016 )—including the other three Cs.

6.3. Conclusion: Labelization of the 4Cs and the Future of Education and Work

Traditional educational approaches cannot meet the educational needs of our emergent societies if they do not teach, promote, and assess in line with the new learner characteristics and contexts of the 21st century ( Sahin 2009 ). The sort of future-oriented change and development required by this shift in institutional practices, programming, and structure will likely meet with significant resistance from comfortably entrenched (and often outdated) segments of traditional educational and training establishments. Additional external evaluation and monitoring is rarely welcome by workers in any context. We believe, however, that top-down processes from the innovative and competition-conscious administrative levels will be met by bottom-up demands from students and education consumers to support these institutional changes. And we contend that efforts such as labelizing 4C processes will serve to push educators and institutions towards more relevant offerings, oriented towards the future of work and helping build a more successful future for all.

In the end, the 4Cs framework seems to be a manageable, focused model for modernizing education, and one worthy of its growing prevalence in the educational and research marketplace for a number of reasons. These reasons include the complexity and cumbersome nature of larger alternative systems and the 4Cs’ persuasive presence at the core of a number of early and industry-driven frameworks. In addition, the 4Cs have benefitted from their subsequent promotion by organizations such as the OECD and the World Economic Forum, as well as some more direct support from recent empirical research. The promotion, teaching, and assessment of the 4Cs will require a complex social intervention and mobilization of educational resources—a major shift in pedagogy and institutional structures. Yet the same evolving digital technologies that have largely caused the need for these massive, rapid changes can also assist in the implementation of solutions ( van Laar et al. 2017 ). To the extent that future research also converges on such a model (that has already been found pedagogically useful and policy-friendly by so many individuals and organizations), the 4Cs framework has the potential to become a manageable core for 21st century skills and the future of education and work—one that stakeholders with various agendas can already begin building on for a better educational and economic future together.

Funding Statement

This research received no external funding.

Author Contributions

Conceptualization, B.T.-M. and T.L.; writing—original draft preparation, B.T.-M., A.C., M.M., J.-M.B., T.M., S.B.-B., S.E.H., F.V., M.A.-L., C.F., D.S., F.M.; writing—review and editing, B.T.-M., A.C., T.L., J.-M.B., C.F.; visualization, B.T.-M.; supervision, B.T.-M., T.L.; project administration, B.T.-M., T.L. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Data availability statement, conflicts of interest.

B.T.-M. and T.L. are unpaid academic co-founder and project collaborator for the International Institute for Competency Development, whose labelization frameworks (developed in cooperation with Afnor International and the LaPEA lab of Université Paris Cité and Université Gustave Eiffel) are used as examples in this review. S.E.H. and M.A.-L. are employees of AFNOR International. No funding was received to support this research or article, which reflects the views of the scientists and researchers and not their organizations or companies.

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

• Abrami Philip C., Bernard Robert M., Borokhovski Eugene, Waddington David I., Wade C. Anne, Persson Tonje. Strategies for Teaching Students to Think Critically: A Meta-Analysis. Review of Educational Research. 2015; 85 :275–314. doi: 10.3102/0034654314551063. [ CrossRef ] [ Google Scholar ]
• AbuSeileek Ali Farhan. The Effect of Computer-Assisted Cooperative Learning Methods and Group Size on the EFL Learners’ Achievement in Communication Skills. Computers & Education. 2012; 58 :231–39. doi: 10.1016/j.compedu.2011.07.011. [ CrossRef ] [ Google Scholar ]
• Ahern Aoife, Dominguez Caroline, McNally Ciaran, O’Sullivan John J., Pedrosa Daniela. A Literature Review of Critical Thinking in Engineering Education. Studies in Higher Education. 2019; 44 :816–28. doi: 10.1080/03075079.2019.1586325. [ CrossRef ] [ Google Scholar ]
• Ainsworth Shaaron E., Chounta Irene-Angelica. The roles of representation in computer-supported collaborative learning. In: Cress Ulrike, Rosé Carolyn, Wise Alyssa Friend, Oshima Jun., editors. International Handbook of Computer-Supported Collaborative Learning. Springer; Cham: 2021. pp. 353–69. [ CrossRef ] [ Google Scholar ]
• Alsaleh Nada J. Teaching Critical Thinking Skills: Literature Review. [(accessed on 1 November 2022)]; The Turkish Online Journal of Educational Technology. 2020 19 :21–39. Available online: http://files.eric.ed.gov/fulltext/EJ1239945.pdf [ Google Scholar ]
• Al-Samarraie Hosam, Hurmuzan Shuhaila. A Review of Brainstorming Techniques in Higher Education. Thinking Skills and Creativity. 2018; 27 :78–91. doi: 10.1016/j.tsc.2017.12.002. [ CrossRef ] [ Google Scholar ]
• Amabile Teresa M. Social Psychology of Creativity: A Consensual Assessment Technique. Journal of Personality and Social Psychology. 1982; 43 :997–1013. doi: 10.1037/0022-3514.43.5.997. [ CrossRef ] [ Google Scholar ]
• Amron Manajemen Pemasaran. The influence of brand image, brand trust, product quality, and price on the consumer’s buying decision of MPV cars. European Scientific Journal. 2018; 14 :228–39. doi: 10.19044/esj.2018.v14n13p228. [ CrossRef ] [ Google Scholar ]
• Ananiadoui Katerina, Claro Magdalean. 21st Century Skills and Competences for New Millennium Learners in OECD Countries. OECD Publishing; Paris: 2009. OECD Education Working Papers, No. 41. [ CrossRef ] [ Google Scholar ]
• Bailin Sharon. Achieving Extraordinary Ends: An Essay on Creativity. Springer; Dordrecht: 1988. [ CrossRef ] [ Google Scholar ]
• Bandyopadhyay Subir, Szostek Jana. Thinking Critically about Critical Thinking: Assessing Critical Thinking of Business Students Using Multiple Measures. Journal of Education for Business. 2019; 94 :259–70. doi: 10.1080/08832323.2018.1524355. [ CrossRef ] [ Google Scholar ]
• Barber Herbert F. Developing Strategic Leadership: The US Army War College Experience. Journal of Management Development. 1992; 11 :4–12. doi: 10.1108/02621719210018208. [ CrossRef ] [ Google Scholar ]
• Barnett Ronald. The Palgrave Handbook of Critical Thinking in Higher Education. Palgrave Macmillan US; New York: 2015. A Curriculum for Critical Being; pp. 63–76. [ CrossRef ] [ Google Scholar ]
• Bateson Patrick, Martin Paul. Play, Playfulness, Creativity and Innovation. Cambridge University Press; Cambridge: 2013. [ CrossRef ] [ Google Scholar ]
• Batey Mark. The Measurement of Creativity: From Definitional Consensus to the Introduction of a New Heuristic Framework. Creativity Research Journal. 2012; 24 :55–65. doi: 10.1080/10400419.2012.649181. [ CrossRef ] [ Google Scholar ]
• Battelle for Kids Framework for 21st Century Learning Definitions. 2022. [(accessed on 1 November 2022)]. Available online: http://static.battelleforkids.org/documents/p21/P21_Framework_DefinitionsBFK.pdf
• Bellaera Lauren, Weinstein-Jones Yana, Ilie Sonia, Baker Sara T. Critical Thinking in Practice: The Priorities and Practices of Instructors Teaching in Higher Education. Thinking Skills and Creativity. 2021; 41 :100856. doi: 10.1016/j.tsc.2021.100856. [ CrossRef ] [ Google Scholar ]
• Blessinger Patrick, Anchan John P. In: Democratizing Higher Education: International Comparative Perspectives. 1st ed. Blessinger Patrick, Anchan John P., editors. Routledge; London: 2015. [(accessed on 1 November 2022)]. Available online: https://www.routledge.com/Democratizing-Higher-Education-International-Comparative-Perspectives/Blessinger-Anchan/p/book/9781138020955 [ Google Scholar ]
• Bloom Benjamin Samuel., editor. Taxonomy of Educational Objectives: The Classification of Educational Goals: Handbook I, Cognitive Domain. Longmans; New York: 1956. [ Google Scholar ]
• Bourgeois-Bougrine Samira. The Palgrave Encyclopedia of the Possible. Springer International Publishing; Cham: 2022. Design Thinking. [ CrossRef ] [ Google Scholar ]
• Bourgeois-Bougrine Samira, Bonnardel Nathalie, Burkhardt Jean-Marie, Thornhill-Miller Branden, Pahlavan Farzaneh, Buisine Stéphanie, Guegan Jérôme, Pichot Nicolas, Lubart Todd. Immersive Virtual Environments’ Impact on Individual and Collective Creativity: A Review of Recent Research. European Psychologist. 2022; 27 :237–53. doi: 10.1027/1016-9040/a000481. [ CrossRef ] [ Google Scholar ]
• Bourke Sharon L., Cooper Simon, Lam Louisa, McKenna Lisa. Undergraduate Health Professional Students’ Team Communication in Simulated Emergency Settings: A Scoping Review. Clinical Simulation in Nursing. 2021; 60 :42–63. doi: 10.1016/j.ecns.2021.07.004. [ CrossRef ] [ Google Scholar ]
• Brookfield Stephen D. Assessing Critical Thinking. New Directions for Adult and Continuing Education. 1997; 75 :17–29. doi: 10.1002/ace.7502. [ CrossRef ] [ Google Scholar ]
• Burkhardt Jean-Marie, Détienne Françoise, Hébert Anne-Marie, Perron Laurence. Human-Computer Interaction—INTERACT 2009. Springer; Berlin/Heidelberg: 2009. Assessing the ‘Quality of Collaboration’ in Technology-Mediated Design Situations with Several Dimensions; pp. 157–60. [ CrossRef ] [ Google Scholar ]
• Camarda Anaëlle, Bouhours Lison, Osmont Anaïs, Masson Pascal Le, Weil Benoît, Borst Grégoire, Cassotti Mathieu. Opposite Effect of Social Evaluation on Creative Idea Generation in Early and Middle Adolescents. Creativity Research Journal. 2021; 33 :399–410. doi: 10.1080/10400419.2021.1902174. [ CrossRef ] [ Google Scholar ]
• Cannon-Bowers Janis, Tannenbaum Scott I., Salas Eduardo, Volpe Catherine E. Defining team competencies and establishing team training requirements. In: Guzzo Richard A., Salas Eduardo., editors. Team Effectiveness and Decision Making in Organizations. Jossey-Bass; San Francisco: 1995. pp. 333–80. [ Google Scholar ]
• Care Esther, Scoular Claire, Griffin Patrick. Assessment of Collaborative Problem Solving in Education Environments. Applied Measurement in Education. 2016; 29 :250–64. doi: 10.1080/08957347.2016.1209204. [ CrossRef ] [ Google Scholar ]
• Care Esther, Kim Helyn, Vista Alvin, Anderson Kate. Education System Alignment for 21st Century Skills: Focus on Assessment. Brookings Institution; Washington, DC: 2018. [ Google Scholar ]
• Carmichael Erst, Farrell Helen. Evaluation of the Effectiveness of Online Resources in Developing Student Critical Thinking: Review of Literature and Case Study of a Critical Thinking Online Site. Journal of University Teaching and Learning Practice. 2012; 9 :38–55. doi: 10.53761/1.9.1.4. [ CrossRef ] [ Google Scholar ]
• Carson Shelley H., Peterson Jordan B., Higgins Daniel M. Reliability, Validity, and Factor Structure of the Creative Achievement Questionnaire. Creativity Research Journal. 2005; 17 :37–50. doi: 10.1207/s15326934crj1701_4. [ CrossRef ] [ Google Scholar ]
• Casey Betty J., Getz Sarah, Galvan Adriana. The Adolescent Brain. Developmental Review: DR. 2008; 28 :62–77. doi: 10.1016/j.dr.2007.08.003. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Cassotti Mathieu, Camarda Anaëlle, Poirel Nicolas, Houdé Olivier, Agogué Marine. Fixation Effect in Creative Ideas Generation: Opposite Impacts of Example in Children and Adults. Thinking Skills and Creativity. 2016; 19 :146–52. doi: 10.1016/j.tsc.2015.10.008. [ CrossRef ] [ Google Scholar ]
• Chameroy Fabienne, Veran Lucien. Immatérialité de La Qualité et Effet Des Labels Sur Le Consentement à Payer. Management International. 2014; 18 :32–44. doi: 10.7202/1025088ar. [ CrossRef ] [ Google Scholar ]
• Chiu Fa-Chung. Improving Your Creative Potential without Awareness: Overinclusive Thinking Training. Thinking Skills and Creativity. 2015; 15 :1–12. doi: 10.1016/j.tsc.2014.11.001. [ CrossRef ] [ Google Scholar ]
• Chulvi Vicente, Mulet Elena, Chakrabarti Amaresh, López-Mesa Belinda, González-Cruz Carmen. Comparison of the Degree of Creativity in the Design Outcomes Using Different Design Methods. Journal of Engineering Design. 2012; 23 :241–69. doi: 10.1080/09544828.2011.624501. [ CrossRef ] [ Google Scholar ]
• Cinque Maria. ‘Lost in Translation’. Soft Skills Development in European Countries. Tuning Journal for Higher Education. 2016; 3 :389–427. doi: 10.18543/tjhe-3(2)-2016pp389-427. [ CrossRef ] [ Google Scholar ]
• Cömert Musa, Zill Jördis Maria, Christalle Eva, Dirmaier Jörg, Härter Martin, Scholl Isabelle. Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales. PLoS ONE. 2016; 11 :e0152717. doi: 10.1371/journal.pone.0152717. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Corazza Giovanni Emanuele. Potential Originality and Effectiveness: The Dynamic Definition of Creativity. Creativity Research Journal. 2016; 28 :258–67. doi: 10.1080/10400419.2016.1195627. [ CrossRef ] [ Google Scholar ]
• Corazza Giovanni Emanuele, Darbellay Frédéric, Lubart Todd, Panciroli Chiara. Developing Intelligence and Creativity in Education: Insights from the Space–Time Continuum. In: Lemmetty Soila, Collin Kaija, Glăveanu Vlad, Forsman Panu., editors. Creativity and Learning. Springer International Publishing; Cham: 2021. pp. 69–87. [ CrossRef ] [ Google Scholar ]
• Cotter Katherine N., Beghetto Ronald A., Kaufman James C. Creativity in the Classroom: Advice for Best Practices. In: Lubart Todd, Botella Marion, Bourgeois-Bougrine Samira, Caroff Xavier, Guégan Jérôme, Mouchiroud Christohe, Nelson Julien, Zenasni Franck., editors. Homo Creativus. Springer International Publishing; Cham: 2022. pp. 249–64. [ CrossRef ] [ Google Scholar ]
• Curtis J. Randall, Back Anthony L., Ford Dee W., Downey Lois, Shannon Sarah E., Doorenbos Ardith Z., Kross Erin K., Reinke Lynn F., Feemster Laura C., Edlund Barbara, et al. Effect of Communication Skills Training for Residents and Nurse Practitioners on Quality of Communication with Patients with Serious Illness: A Randomized Trial. JAMA: The Journal of the American Medical Association. 2013; 310 :2271. doi: 10.1001/jama.2013.282081. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• D’Alimonte Laura, McLaney Elizabeth, Prospero Lisa Di. Best Practices on Team Communication: Interprofessional Practice in Oncology. Current Opinion in Supportive and Palliative Care. 2019; 13 :69–74. doi: 10.1097/SPC.0000000000000412. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• de Freitas Sara. Learning in Immersive Worlds: A Review of Game-Based Learning. JISC; Bristol: 2006. [(accessed on 1 November 2022)]. Available online: http://www.jisc.ac.uk/media/documents/programmes/elearninginnovation/gamingreport_v3.pdf [ Google Scholar ]
• Détienne Françoise, Baker Michael, Burkhardt Jean-Marie. Perspectives on Quality of Collaboration in Design. CoDesign. 2012; 8 :197–99. doi: 10.1080/15710882.2012.742350. [ CrossRef ] [ Google Scholar ]
• Diedrich Jennifer, Jauk Emanuel, Silvia Paul J., Gredlein Jeffrey M., Neubauer Aljoscha C., Benedek Mathias. Assessment of Real-Life Creativity: The Inventory of Creative Activities and Achievements (ICAA) Psychology of Aesthetics, Creativity, and the Arts. 2018; 12 :304–16. doi: 10.1037/aca0000137. [ CrossRef ] [ Google Scholar ]
• Doyle Denise. Creativity in the Twenty First Century. Edited by Anna Hui and Christian Wagner. Springer International Publishing; Cham: 2021. Creative and Collaborative Practices in Virtual Immersive Environments; pp. 3–19. [ CrossRef ] [ Google Scholar ]
• Drisko James W. Competencies and Their Assessment. Journal of Social Work Education. 2014; 50 :414–26. doi: 10.1080/10437797.2014.917927. [ CrossRef ] [ Google Scholar ]
• Dul Jan, Ceylan Canan. Work Environments for Employee Creativity. Ergonomics. 2011; 54 :12–20. doi: 10.1080/00140139.2010.542833. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Dumitru Daniela, Bigu Dragos, Elen Jan, Ahern Aoife, McNally Ciaran, O’Sullivan John. A European Review on Critical Thinking Educational Practices in Higher Education Institutions. UTAD; Vila Real: 2018. [(accessed on 2 November 2022)]. Available online: http://repositorio.utad.pt/handle/10348/8320 [ Google Scholar ]
• Edelman Jonathan, Owoyele Babajide, Santuber Joaquin. Design Thinking in Education. Springer International Publishing; Cham: 2022. Beyond Brainstorming: Introducing Medgi, an Effective, Research-Based Method for Structured Concept Development; pp. 209–32. [ CrossRef ] [ Google Scholar ]
• Etilé Fabrice, Teyssier Sabrina. Signaling Corporate Social Responsibility: Third-Party Certification versus Brands: Signaling CSR: Third-Party Certification versus Brands. The Scandinavian Journal of Economics. 2016; 118 :397–432. doi: 10.1111/sjoe.12150. [ CrossRef ] [ Google Scholar ]
• Evans Carla. Measuring Student Success Skills: A Review of the Literature on Collaboration. National Center for the Improvement of Educational Assessment; Dover: 2020. [ Google Scholar ]
• Facione Peter Arthur. The California Critical Thinking Skills Test–College Level. Technical Report# 1. Experimental Validation and Content Validity. [(accessed on 2 November 2022)]; 1990a Available online: https://files.eric.ed.gov/fulltext/ED327549.pdf
• Facione Peter Arthur. Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction. Research Findings and Recommendations. ERIC, Institute of Education Sciences; Washington, DC: 1990b. [(accessed on 2 November 2022)]. pp. 1–112. Available online: https://eric.ed.gov/?id=ED315423 [ Google Scholar ]
• Facione Peter Arthur. Critical thinking: What it is and why it counts. Insight Assessment. 2011; 2007 :1–23. [ Google Scholar ]
• Faidley Joel. Ph.D. dissertation. East Tennessee State University; Johnson City, TN, USA: 2018. Comparison of Learning Outcomes from Online and Face-to-Face Accounting Courses. [ Google Scholar ]
• Friedman Hershey H. Cognitive Biases That Interfere with Critical Thinking and Scientific Reasoning: A Course Module. SSRN Electronic Journal. 2017:1–60. doi: 10.2139/ssrn.2958800. [ CrossRef ] [ Google Scholar ]
• Fryer-Edwards Kelly, Arnold Robert M., Baile Walter, Tulsky James A., Petracca Frances, Back Anthony. Reflective Teaching Practices: An Approach to Teaching Communication Skills in a Small-Group Setting. Academic Medicine: Journal of the Association of American Medical Colleges. 2006; 81 :638–44. doi: 10.1097/01.ACM.0000232414.43142.45. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Glăveanu Vlad Petre. Rewriting the Language of Creativity: The Five A’s Framework. Review of General Psychology: Journal of Division 1, of the American Psychological Association. 2013; 17 :69–81. doi: 10.1037/a0029528. [ CrossRef ] [ Google Scholar ]
• Glăveanu Vlad Petre. The Psychology of Creativity: A Critical Reading. Creativity Theories Research Applications. 2014; 1 :10–32. doi: 10.15290/ctra.2014.01.01.02. [ CrossRef ] [ Google Scholar ]
• Goldenberg Olga, Wiley Jennifer. Quality, Conformity, and Conflict: Questioning the Assumptions of Osborn’s Brainstorming Technique. The Journal of Problem Solving. 2011; 3 :96–118. doi: 10.7771/1932-6246.1093. [ CrossRef ] [ Google Scholar ]
• Graesser Arthur C., Sabatini John P., Li Haiying. Educational Psychology Is Evolving to Accommodate Technology, Multiple Disciplines, and Twenty-First-Century Skills. Annual Review of Psychology. 2022; 73 :547–74. doi: 10.1146/annurev-psych-020821-113042. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Graesser Arthur C., Fiore Stephen M., Greiff Samuel, Andrews-Todd Jessica, Foltz Peter W., Hesse Friedrich W. Advancing the Science of Collaborative Problem Solving. Psychological Science in the Public Interest. 2018; 19 :59–92. doi: 10.1177/1529100618808244. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Grassmann Susanne. The pragmatics of word learning. In: Matthews Danielle., editor. Pragmatic Development in First Language Acquisition. John Benjamins Publishing Company; Amsterdam: 2014. pp. 139–60. [ CrossRef ] [ Google Scholar ]
• Hager Keri, St Hill Catherine, Prunuske Jacob, Swanoski Michael, Anderson Grant, Lutfiyya May Nawal. Development of an Interprofessional and Interdisciplinary Collaborative Research Practice for Clinical Faculty. Journal of Interprofessional Care. 2016; 30 :265–67. doi: 10.3109/13561820.2015.1092951. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Halpern Diane F. Teaching Critical Thinking for Transfer across Domains: Disposition, Skills, Structure Training, and Metacognitive Monitoring. The American Psychologist. 1998; 53 :449–55. doi: 10.1037/0003-066X.53.4.449. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Halpern Diane F., Dunn Dana S. Critical Thinking: A Model of Intelligence for Solving Real-World Problems. Journal of Intelligence. 2021; 9 :22. doi: 10.3390/jintelligence9020022. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Hanover Research A Crosswalk of 21st Century Skills. 2012. [(accessed on 15 August 2022)]. Available online: http://www.hanoverresearch.com/wp-content/uploads/2011/12/A-Crosswalk-of-21st-Century-Skills-Membership.pdf
• Hathaway Julia R., Tarini Beth A., Banerjee Sushmita, Smolkin Caroline O., Koos Jessica A., Pati Susmita. Healthcare Team Communication Training in the United States: A Scoping Review. Health Communication. 2022:1–26. doi: 10.1080/10410236.2022.2036439. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Hesse Friedrich, Care Esther, Buder Juergen, Sassenberg Kai, Griffin Patrick. A Framework for Teachable Collaborative Problem Solving Skills. In: Griffin Patrick, Care Esther., editors. Assessment and Teaching of 21st Century Skills. Springer Netherlands; Dordrecht: 2015. pp. 37–56. [ Google Scholar ]
• Hitchcock David. Critical Thinking. In: Edward Nouri Zalta., editor. The Stanford Encyclopedia of Philosophy (Fall 2020 Edition) Stanford University; Stanford: 2020. [ Google Scholar ]
• Houdé Olivier. Inhibition and cognitive development: Object, number, categorization, and reasoning. Cognitive Development. 2000; 15 :63–73. doi: 10.1016/S0885-2014(00)00015-0. [ CrossRef ] [ Google Scholar ]
• Houdé Olivier, Borst Grégoire. Measuring inhibitory control in children and adults: Brain imaging and mental chronometry. Frontiers in Psychology. 2014; 5 :616. doi: 10.3389/fpsyg.2014.00616. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Huber Christopher R., Kuncel Nathan R. Does College Teach Critical Thinking? A Meta-Analysis. Review of Educational Research. 2016; 86 :431–68. doi: 10.3102/0034654315605917. [ CrossRef ] [ Google Scholar ]
• Huizinga Johan. Homo Ludens: A Study of the Play-Elements in Culture. Routledge; London: 1949. [ Google Scholar ]
• Humphrey Neil, Curran Andrew, Morris Elisabeth, Farrell Peter, Woods Kevin. Emotional Intelligence and Education: A Critical Review. Educational Psychology. 2007; 27 :235–54. doi: 10.1080/01443410601066735. [ CrossRef ] [ Google Scholar ]
• International Institute for Competency Development 21st Century Skills 4Cs Labelization. 2021. [(accessed on 2 November 2022)]. Available online: https://icd-hr21.org/offers/21st-century-competencies/
• Jackson Denise. Business Graduate Performance in Oral Communication Skills and Strategies for Improvement. The International Journal of Management Education. 2014; 12 :22–34. doi: 10.1016/j.ijme.2013.08.001. [ CrossRef ] [ Google Scholar ]
• Jahn Gabriele, Schramm Matthias, Spiller Achim. The Reliability of Certification: Quality Labels as a Consumer Policy Tool. Journal of Consumer Policy. 2005; 28 :53–73. doi: 10.1007/s10603-004-7298-6. [ CrossRef ] [ Google Scholar ]
• Jauk Emanuel, Benedek Mathias, Neubauer Aljoscha C. The Road to Creative Achievement: A Latent Variable Model of Ability and Personality Predictors. European Journal of Personality. 2014; 28 :95–105. doi: 10.1002/per.1941. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Joie-La Marle Chantal, Parmentier François, Coltel Morgane, Lubart Todd, Borteyrou Xavier. A Systematic Review of Soft Skills Taxonomies: Descriptive and Conceptual Work. 2022. [(accessed on 2 November 2022)]. Available online: [ CrossRef ]
• Jones Stanley E., LeBaron Curtis D. Research on the Relationship between Verbal and Nonverbal Communication: Emerging Integrations. The Journal of Communication. 2002; 52 :499–521. doi: 10.1111/j.1460-2466.2002.tb02559.x. [ CrossRef ] [ Google Scholar ]
• Kaendler Celia, Wiedmann Michael, Leuders Timo, Rummel Nikol, Spada Hans. Monitoring Student Interaction during Collaborative Learning: Design and Evaluation of a Training Program for Pre-Service Teachers. Psychology Learning & Teaching. 2016; 15 :44–64. doi: 10.1177/1475725716638010. [ CrossRef ] [ Google Scholar ]
• Kahneman Daniel. A Perspective on Judgment and Choice: Mapping Bounded Rationality. The American Psychologist. 2003; 58 :697–720. doi: 10.1037/0003-066X.58.9.697. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Kahneman Daniel. Thinking, Fast and Slow. Macmillan; New York: 2011. [ Google Scholar ]
• Karl Katherine A., Peluchette Joy V., Aghakhani Navid. Virtual Work Meetings during the COVID-19 Pandemic: The Good, Bad, and Ugly. Small Group Research. 2022; 53 :343–65. doi: 10.1177/10464964211015286. [ CrossRef ] [ Google Scholar ]
• Keefer Kateryna V., Parker James D. A., Saklofske Donald H. The Springer Series on Human Exceptionality. Springer International Publishing; Cham: 2018. Three Decades of Emotional Intelligence Research: Perennial Issues, Emerging Trends, and Lessons Learned in Education: Introduction to Emotional Intelligence in Education; pp. 1–19. [ Google Scholar ]
• Kemp Nenagh, Grieve Rachel. Face-to-Face or Face-to-Screen? Undergraduates’ Opinions and Test Performance in Classroom vs. Online Learning. Frontiers in Psychology. 2014; 5 :1278. doi: 10.3389/fpsyg.2014.01278. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Kimery Kathryn, McCord Mary. Third-Party Assurances: Mapping the Road to Trust in E-retailing. The Journal of Information Technology Theory and Application. 2002; 4 :63–82. [ Google Scholar ]
• Kohn Nicholas W., Smith Steven M. Collaborative Fixation: Effects of Others’ Ideas on Brainstorming. Applied Cognitive Psychology. 2011; 25 :359–71. doi: 10.1002/acp.1699. [ CrossRef ] [ Google Scholar ]
• Kowaltowski Doris C. C. K., Bianchi Giovana, de Paiva Valéria Teixeira. Methods That May Stimulate Creativity and Their Use in Architectural Design Education. International Journal of Technology and Design Education. 2010; 20 :453–76. doi: 10.1007/s10798-009-9102-z. [ CrossRef ] [ Google Scholar ]
• Kruijver Irma P. M., Kerkstra Ada, Francke Anneke L., Bensing Jozien M., van de Wiel Harry B. M. Evaluation of Communication Training Programs in Nursing Care: A Review of the Literature. Patient Education and Counseling. 2000; 39 :129–45. doi: 10.1016/S0738-3991(99)00096-8. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Lai Emily R. Critical thinking: A literature review. Pearson’s Research Reports. 2011; 6 :40–41. doi: 10.25148/lawrev.11.2.3. [ CrossRef ] [ Google Scholar ]
• Lamri Jérémy, Lubart Todd. Creativity and Its’ Relationships with 21st Century Skills in Job Performance. Kindai Management Review. 2021; 9 :75–91. [ Google Scholar ]
• Lamri Jérémy, Barabel Michel, Meier Olivier, Lubart Todd. Le Défi Des Soft Skills: Comment les Développer au XXIe Siècle? Dunod; Paris: 2022. [ Google Scholar ]
• Landa Rebecca J. Assessment of Social Communication Skills in Preschoolers: Assessing Social Communication Skills in Children. Mental Retardation and Developmental Disabilities Research Reviews. 2005; 11 :247–52. doi: 10.1002/mrdd.20079. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Lee Sang M., Choi Jeongil, Lee Sang-Gun. The impact of a third-party assurance seal in customer purchasing intention. Journal of Internet Commerce. 2004; 3 :33–51. doi: 10.1300/J179v03n02_03. [ CrossRef ] [ Google Scholar ]
• Lewis Arthur, Smith David. Defining Higher Order Thinking. Theory into Practice. 1993; 32 :131–37. doi: 10.1080/00405849309543588. [ CrossRef ] [ Google Scholar ]
• Liu Ou Lydia, Frankel Lois, Roohr Katrina Crotts. Assessing Critical Thinking in Higher Education: Current State and Directions for next-Generation Assessment: Assessing Critical Thinking in Higher Education. ETS Research Report Series. 2014; 2014 :1–23. doi: 10.1002/ets2.12009. [ CrossRef ] [ Google Scholar ]
• Lubart Todd. The 7 C’s of Creativity. The Journal of Creative Behavior. 2017; 51 :293–96. doi: 10.1002/jocb.190. [ CrossRef ] [ Google Scholar ]
• Lubart Todd, Thornhill-Miller Branden. Creativity: An Overview of the 7C’s of Creative Thought. Heidelberg: Heidelberg University Publishing. 2019 doi: 10.17885/HEIUP.470.C6678. [ CrossRef ] [ Google Scholar ]
• Lubart Todd, Barbot Baptiste, Besançon Maud. Creative Potential: Assessment Issues and the EPoC Battery/Potencial Creativo: Temas de Evaluación y Batería EPoC. Estudios de Psicologia. 2019; 40 :540–62. doi: 10.1080/02109395.2019.1656462. [ CrossRef ] [ Google Scholar ]
• Lubart Todd, Zenasni Franck, Barbot Baptiste. Creative potential and its measurement. International Journal of Talent Development and Creativity. 2013; 1 :41–51. [ Google Scholar ]
• Lubart Tubart, Thornhill-Miller Branden. Creativity in Law: Legal Professions and the Creative Profiler Approach. In: Masson Antoine, Robinson Gavin., editors. Mapping Legal Innovation: Trends and Perspectives. Springer International Publishing; Cham: 2021. pp. 1–19. [ CrossRef ] [ Google Scholar ]
• Lubin Jeffrey, Hendrick Stephan, Thornhill-Miller Branden, Mercier Maxence, Lubart Todd. Creativity in Solution-Focused Brief Therapy Forthcoming.
• Lucas Bill. Why We Need to Stop Talking about Twenty-First Century Skills. Centre for Strategic Education; Melbourne: 2019. [ Google Scholar ]
• Lucas Bill. Creative Thinking in Schools across the World. The Global Institute of Creative Thinking; London: 2022. [ Google Scholar ]
• Lucas Bill, Claxton Guy. Wider Skills for Learning: What Are They, How Can They Be Cultivated, How Could They Be Measured and Why Are They Important for Innovation? NESTA; London: 2009. [ Google Scholar ]
• Malaby Thomas M. Beyond Play: A New Approach to Games. Games and Culture. 2007; 2 :95–113. doi: 10.1177/1555412007299434. [ CrossRef ] [ Google Scholar ]
• Marin Lisa M., Halpern Diane F. Pedagogy for developing critical thinking in adolescents: Explicit instruction produces greatest gains. Thinking Skills and Creativity. 2011; 6 :1–13. doi: 10.1016/j.tsc.2010.08.002. [ CrossRef ] [ Google Scholar ]
• Mathieu John E., Hollenbeck John R., van Knippenberg Daan, Ilgen Daniel R. A Century of Work Teams in the Journal of Applied Psychology. The Journal of Applied Psychology. 2017; 102 :452–67. doi: 10.1037/apl0000128. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Matthews Danielle. Pragmatic Development in First Language Acquisition. Amsterdam: John Benjamins Publishing Company. 2014 doi: 10.1075/tilar.10. [ CrossRef ] [ Google Scholar ]
• McDonald Skye, Gowland Alison, Randall Rebekah, Fisher Alana, Osborne-Crowley Katie, Honan Cynthia. Cognitive Factors Underpinning Poor Expressive Communication Skills after Traumatic Brain Injury: Theory of Mind or Executive Function? Neuropsychology. 2014; 28 :801–11. doi: 10.1037/neu0000089. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Moore Brooke Noel, Parker Richard. Critical Thinking. 20th ed. McGraw-Hill Education; New York: 2016. [ Google Scholar ]
• Morreale Sherwyn P., Valenzano Joseph M., Bauer Janessa A. Why Communication Education Is Important: A Third Study on the Centrality of the Discipline’s Content and Pedagogy. Communication Education. 2017; 66 :402–22. doi: 10.1080/03634523.2016.1265136. [ CrossRef ] [ Google Scholar ]
• Mourad Maha. Quality Assurance as a Driver of Information Management Strategy: Stakeholders’ Perspectives in Higher Education. Journal of Enterprise Information Management. 2017; 30 :779–94. doi: 10.1108/JEIM-06-2016-0104. [ CrossRef ] [ Google Scholar ]
• National Education Association . Preparing 21st Century Students for a Global Society: An Educator’s Guide to the “Four Cs”. National Education Association; Alexandria: 2011. [ Google Scholar ]
• Nouri Jalal, Åkerfeldt Anna, Fors Uno, Selander Staffan. Assessing Collaborative Problem Solving Skills in Technology-Enhanced Learning Environments—The PISA Framework and Modes of Communication. International Journal of Emerging Technologies in Learning (IJET) 2017; 12 :163. doi: 10.3991/ijet.v12i04.6737. [ CrossRef ] [ Google Scholar ]
• O’Carroll Veronica, Owens Melissa, Sy Michael, El-Awaisi Alla, Xyrichis Andreas, Leigh Jacqueline, Nagraj Shobhana, Huber Marion, Hutchings Maggie, McFadyen Angus. Top Tips for Interprofessional Education and Collaborative Practice Research: A Guide for Students and Early Career Researchers. Journal of Interprofessional Care. 2021; 35 :328–33. doi: 10.1080/13561820.2020.1777092. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• OECD . PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving. OECD Publishing; Paris: 2017. PISA 2015 collaborative problem-solving framework. [ CrossRef ] [ Google Scholar ]
• OECD . Framework for the Assessment of Creative Thinking in PISA 2021: Third Draft. OECD; Paris: 2019a. [(accessed on 2 November 2022)]. Available online: https://www.oecd.org/pisa/publications/PISA-2021-creative-thinking-framework.pdf [ Google Scholar ]
• OECD . Future of Education and Skills 2030: A Series of Concept Notes. OECD Learning Compass; Paris: 2019b. [(accessed on 2 November 2022)]. Available online: https://www.oecd.org/education/2030-project/teaching-and-learning/learning/learning-compass-2030/OECD_Learning_Compass_2030_Concept_Note_Series.pdf [ Google Scholar ]
• Osborn A. F. Applied Imagination. Charles Scribner’s Sons; New York: 1953. [ Google Scholar ]
• Parkinson Thomas L. The Role of Seals and Certifications of Approval in Consumer Decision-Making. The Journal of Consumer Affairs. 1975; 9 :1–14. doi: 10.1111/j.1745-6606.1975.tb00545.x. [ CrossRef ] [ Google Scholar ]
• Partnership for 21st Century Skills . 21st Century Skills Education and Competitiveness: A Resource and Policy Guide. Partnership for 21st Century Skills; Tuscon: 2008. [ Google Scholar ]
• Pasquinelli Elena, Bronner Gérald. Éduquer à l’esprit critique. Bases théoriques et indications pratiques pour l’enseignement et la formation. Ministère de l’Éducation Nationale, de la JEUNESSE et des Sports; Paris: 2021. Rapport du Conseil Scientifique de l’Éducation Nationale. [ Google Scholar ]
• Pasquinelli Elena, Farina Mathieu, Bedel Audrey, Casati Roberto. Naturalizing Critical Thinking: Consequences for Education, Blueprint for Future Research in Cognitive Science. Mind, Brain and Education: The Official Journal of the International Mind, Brain, and Education Society. 2021; 15 :168–76. doi: 10.1111/mbe.12286. [ CrossRef ] [ Google Scholar ]
• Paul Richard, Elder Linda. Critical thinking: The nature of critical and creative thought. Journal of Developmental Education. 2006; 30 :34–35. [ Google Scholar ]
• Paulus Paul B., Yang Huei-Chuan. Idea Generation in Groups: A Basis for Creativity in Organizations. Organizational Behavior and Human Decision Processes. 2000; 82 :76–87. doi: 10.1006/obhd.2000.2888. [ CrossRef ] [ Google Scholar ]
• Paulus Paul B., Kenworthy Jared B. Effective brainstorming. In: Paulus Paul B., Nijstad Bernard A., editors. The Oxford Handbook of Group Creativity and Innovation. Oxford University Press; New York: 2019. [ CrossRef ] [ Google Scholar ]
• Paulus Paul B., Dzindolet Mary T. Social Influence Processes in Group Brainstorming. Journal of Personality and Social Psychology. 1993; 64 :575–86. doi: 10.1037/0022-3514.64.4.575. [ CrossRef ] [ Google Scholar ]
• Paulus Paul B., Brown Vincent R. Toward More Creative and Innovative Group Idea Generation: A Cognitive-Social-Motivational Perspective of Brainstorming: Cognitive-Social-Motivational View of Brainstorming. Social and Personality Psychology Compass. 2007; 1 :248–65. doi: 10.1111/j.1751-9004.2007.00006.x. [ CrossRef ] [ Google Scholar ]
• Peddle Monica, Bearman Margaret, Radomski Natalie, Mckenna Lisa, Nestel Debra. What Non-Technical Skills Competencies Are Addressed by Australian Standards Documents for Health Professionals Who Work in Secondary and Tertiary Clinical Settings? A Qualitative Comparative Analysis. BMJ Open. 2018; 8 :e020799. doi: 10.1136/bmjopen-2017-020799. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Peña-López Ismaël. PISA 2015 Results (Volume V): Collaborative Problem Solving. PISA, OECD Publishing; Paris: 2017. [ Google Scholar ]
• Popil Inna. Promotion of Critical Thinking by Using Case Studies as Teaching Method. Nurse Education Today. 2011; 31 :204–7. doi: 10.1016/j.nedt.2010.06.002. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Pornpitakpan Chanthika. The Persuasiveness of Source Credibility: A Critical Review of Five Decades’ Evidence. Journal of Applied Social Psychology. 2004; 34 :243–81. doi: 10.1111/j.1559-1816.2004.tb02547.x. [ CrossRef ] [ Google Scholar ]
• Possin Kevin. Critique of the Watson-Glaser Critical Thinking Appraisal Test: The More You Know, the Lower Your Score. Informal Logic. 2014; 34 :393–416. doi: 10.22329/il.v34i4.4141. [ CrossRef ] [ Google Scholar ]
• Proctor Robert W., Dutta Addie. Skill Acquisition and Human Performance. Sage Publications, Inc.; Thousand Oaks: 1995. [ Google Scholar ]
• Putman Vicky L., Paulus Paul B. Brainstorming, Brainstorming Rules and Decision Making. The Journal of Creative Behavior. 2009; 43 :29–40. doi: 10.1002/j.2162-6057.2009.tb01304.x. [ CrossRef ] [ Google Scholar ]
• Reiman Joey. Success: The Original Handbook. Longstreet Press; Atlanta: 1992. [ Google Scholar ]
• Ren Xuezhu, Tong Yan, Peng Peng, Wang Tengfei. Critical Thinking Predicts Academic Performance beyond General Cognitive Ability: Evidence from Adults and Children. Intelligence. 2020; 82 :101487. doi: 10.1016/j.intell.2020.101487. [ CrossRef ] [ Google Scholar ]
• Renard Marie-Christine. Quality Certification, Regulation and Power in Fair Trade. Journal of Rural Studies. 2005; 21 :419–31. doi: 10.1016/j.jrurstud.2005.09.002. [ CrossRef ] [ Google Scholar ]
• Restout Emilie. Labels RSE: Un décryptage des entreprises labellisées en France. Goodwill Management. 2020. [(accessed on 2 November 2022)]. Available online: https://goodwill-management.com/labels-rse-decryptage-entreprises-labellisees/
• Rhodes Mel. An Analysis of Creativity. The Phi Delta Kappan. 1961; 42 :305–10. [ Google Scholar ]
• Rider Elizabeth A., Keefer Constance H. Communication Skills Competencies: Definitions and a Teaching Toolbox: Communication. Medical Education. 2006; 40 :624–29. doi: 10.1111/j.1365-2929.2006.02500.x. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Riemer Marc J. Communication Skills for the 21st Century Engineer. Global Journal of Engineering Education. 2007; 11 :89. [ Google Scholar ]
• Rietzschel Eric F., Nijstad Bernard A., Stroebe Wolfgang. Productivity Is Not Enough: A Comparison of Interactive and Nominal Brainstorming Groups on Idea Generation and Selection. Journal of Experimental Social Psychology. 2006; 42 :244–51. doi: 10.1016/j.jesp.2005.04.005. [ CrossRef ] [ Google Scholar ]
• Ross David. Why the Four Cs Will Become the Foundation of Human-AI Interface. 2018. [(accessed on 2 November 2022)]. Available online: https://www.gettingsmart.com/2018/03/04/why-the-4cs-will-become-the-foundation-of-human-ai-interface/
• Rothermich Kathrin. Social Communication Across the Lifespan: The Influence of Empathy [Preprint] SocArXiv. 2020 doi: 10.31235/osf.io/adgmy. [ CrossRef ] [ Google Scholar ]
• Rusdin Norazlin Mohd, Ali Siti Rahaimah. Practice of Fostering 4Cs Skills in Teaching and Learning. International Journal of Academic Research in Business and Social Sciences. 2019; 9 :1021–35. doi: 10.6007/IJARBSS/v9-i6/6063. [ CrossRef ] [ Google Scholar ]
• Rychen Dominique Simone, Hersch Salganik Laura., editors. Key Competencies for a Successful Life and a Well-Functioning Society. Hogrefe and Huber; Cambridge: 2003. [ Google Scholar ]
• Sahin Mehmet Can. Instructional Design Principles for 21st Century Learning Skills. Procedia, Social and Behavioral Sciences. 2009; 1 :1464–68. doi: 10.1016/j.sbspro.2009.01.258. [ CrossRef ] [ Google Scholar ]
• Salas Eduardo, Stagl Kevin C., Burke C. Shawn. International Review of Industrial and Organizational Psychology. John Wiley & Sons, Ltd.; Chichester: 2004. 25 Years of Team Effectiveness in Organizations: Research Themes and Emerging Needs; pp. 47–91. [ CrossRef ] [ Google Scholar ]
• Salas Eduardo, Shuffler Marissa L., Thayer Amanda L., Bedwell Wendy L., Lazzara Elizabeth H. Understanding and Improving Teamwork in Organizations: A Scientifically Based Practical Guide. Human Resource Management. 2015; 54 :599–622. doi: 10.1002/hrm.21628. [ CrossRef ] [ Google Scholar ]
• Salmi Jamil. The Tertiary Education Imperative: Knowledge, Skills and Values for Development. Springer; Cham: 2017. [ Google Scholar ]
• Samani Sanaz Ahmadpoor, Rasid Siti Zaleha Binti Abdul, bt Sofian Saudah. A Workplace to Support Creativity. Industrial Engineering & Management Systems. 2014; 13 :414–20. doi: 10.7232/iems.2014.13.4.414. [ CrossRef ] [ Google Scholar ]
• Saroyan Alenoush. Fostering Creativity and Critical Thinking in University Teaching and Learning: Considerations for Academics and Their Professional Learning. OECD; Paris: 2022. [ CrossRef ] [ Google Scholar ]
• Sasmita Jumiati, Suki Norazah Mohd. Young consumers’ insights on brand equity: Effects of brand association, brand loyalty, brand awareness, and brand image. International Journal of Retail & Distribution Management. 2015; 43 :276–92. doi: 10.1108/IJRDM-02-2014-0024. [ CrossRef ] [ Google Scholar ]
• Schlegel Claudia, Woermann Ulrich, Shaha Maya, Rethans Jan-Joost, van der Vleuten Cees. Effects of Communication Training on Real Practice Performance: A Role-Play Module versus a Standardized Patient Module. The Journal of Nursing Education. 2012; 51 :16–22. doi: 10.3928/01484834-20111116-02. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Schleicher Andreas. Why Creativity and Creative Teaching and Learning Matter Today and for Tomorrow’s World. GloCT in Collaboration with OECD CERI; Paris: 2022. Creativity in Education Summit 2022. [ Google Scholar ]
• Schneider Bertrand, Sharma Kshitij, Cuendet Sebastien, Zufferey Guillaume, Dillenbourg Pierre, Pea Roy. Leveraging Mobile Eye-Trackers to Capture Joint Visual Attention in Co-Located Collaborative Learning Groups. International Journal of Computer-Supported Collaborative Learning. 2018; 13 :241–61. doi: 10.1007/s11412-018-9281-2. [ CrossRef ] [ Google Scholar ]
• Schultz David M. Eloquent Science: A course to improve scientific and communication skills; Paper presented at the 19th Symposium on Education; Altanta, GA, USA. January 18–21; 2010. [ Google Scholar ]
• Scialabba George. Mindplay. Harvard Magazine. 1984; 16 :19. [ Google Scholar ]
• Scott Ginamarie, Leritz Lyle E., Mumford Michael D. The Effectiveness of Creativity Training: A Quantitative Review. Creativity Research Journal. 2004; 16 :361–88. doi: 10.1080/10400410409534549. [ CrossRef ] [ Google Scholar ]
• Sigafoos Jeff, Schlosser Ralf W., Green Vanessa A., O’Reilly Mark, Lancioni Giulio E. Communication and Social Skills Assessment. In: Matson Johnny L., editor. Clinical Assessment and Intervention for Autism Spectrum Disorders. Elsevier; Amsterdam: 2008. pp. 165–92. [ CrossRef ] [ Google Scholar ]
• Simonton Dean Keith. Creativity from a Historiometric Perspective. In: Sternberg Robert J., editor. Handbook of Creativity. Cambridge University Press; Cambridge: 1999. pp. 116–34. [ CrossRef ] [ Google Scholar ]
• Singh Pallavi, Bala Hillol, Dey Bidit Lal, Filieri Raffaele. Enforced Remote Working: The Impact of Digital Platform-Induced Stress and Remote Working Experience on Technology Exhaustion and Subjective Wellbeing. Journal of Business Research. 2022; 151 :269–86. doi: 10.1016/j.jbusres.2022.07.002. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Spada Hans, Meier Anne, Rummel Nikol, Hauser Sabine. Proceedings of the 2005 Conference on Computer Support for Collaborative Learning Learning 2005: The next 10 Years!—CSCL’05, Taipei, Taiwan, May 30–June 4. Association for Computational Linguistics; Morristown: 2005. A New Method to Assess the Quality of Collaborative Process in CSCL. [ Google Scholar ]
• Spitzberg Brian H. Methods of interpersonal skill assessment. In: Greene John O., Burleson Brant R., editors. The Handbook of Communication and Social Interaction Skills. Lawrence Erlbaum Associates; Mahwah: 2003. [ Google Scholar ]
• Sternberg Robert. Intelligence, Wisdom, and Creativity: Three Is Better than One. Educational Psychologist. 1986; 21 :175–90. doi: 10.1207/s15326985ep2103_2. [ CrossRef ] [ Google Scholar ]
• Sternberg Robert J., Funke Joachim. The Psychology of Human Thought: An Introduction. Heidelberg University Publishing (heiUP); Heidelberg: 2019. [ CrossRef ] [ Google Scholar ]
• Sursock Andrée. Quality assurance and rankings: Some European lessons. In: Hazelkorn Ellen, Mihut Georgiana., editors. Research Handbook on University Rankings. Edward Elgar Publishing; Cheltenham: 2021. pp. 185–96. [ CrossRef ] [ Google Scholar ]
• Sursock Andrée, Vettori Oliver. Qualitätskultur. Ein Blick in Die Gelebte Praxis der Hochschulen. Agency for Quality Assurance and Accreditation; Vienna: 2017. [(accessed on 2 November 2022)]. Quo vadis, quality culture? Theses from different perspectives; pp. 13–18. Available online: https://www.aq.ac.at/de/ueber-uns/publikationen/sonstige-publikationen.php [ Google Scholar ]
• Sutter Éric. Certification et Labellisation: Un Problème de Confiance. Bref Panorama de La Situation Actuelle. Documentaliste-Sciences de l Information. 2005; 42 :284–90. doi: 10.3917/docsi.424.0284. [ CrossRef ] [ Google Scholar ]
• Taddei François. Training Creative and Collaborative Knowledge-Builders: A Major Challenge for 21st Century Education. OCDE; Paris: 2009. [ Google Scholar ]
• Thomas Keith, Lok Beatrice. Teaching Critical Thinking: An Operational Framework. In: Davies Martin, Barnett Ronald., editors. The Palgrave Handbook of Critical Thinking in Higher Education. Palgrave Macmillan US; New York: 2015. pp. 93–105. [ CrossRef ] [ Google Scholar ]
• Thompson Jeri. Measuring Student Success Skills: A Review of the Literature on Complex Communication. National Center for the Improvement of Educational Assessment; Dover: 2020. [ Google Scholar ]
• Thorndahl Kathrine L., Stentoft Diana. Thinking Critically about Critical Thinking and Problem-Based Learning in Higher Education: A Scoping Review. Interdisciplinary Journal of Problem-Based Learning 14. 2020 doi: 10.14434/ijpbl.v14i1.28773. [ CrossRef ] [ Google Scholar ]
• Thornhill-Miller Branden. ‘Crea-Critical-Collab-ication’: A Dynamic Interactionist Model of the 4Cs (Creativity, Critical Thinking, Collaboration and Communication) 2021. [(accessed on 2 November 2022)]. Available online: http://thornhill-miller.com/newWordpress/index.php/current-research/
• Thornhill-Miller Branden, Dupont Jean-Marc. Virtual Reality and the Enhancement of Creativity and Innovation: Underrecognized Potential Among Converging Technologies? Journal for Cognitive Education and Psychology. 2016; 15 :102–21. doi: 10.1891/1945-8959.15.1.102. [ CrossRef ] [ Google Scholar ]
• Thornhill-Miller Branden, Millican Peter. The Common-Core/Diversity Dilemma: Revisions of Humean Thought, New Empirical Research, and the Limits of Rational Religious Belief. European Journal for Philosophy of Religion. 2015; 7 :1–49. doi: 10.24204/ejpr.v7i1.128. [ CrossRef ] [ Google Scholar ]
• Tomasello Michael. Constructing a Language: A Usage-Based Theory of Language Acquisition. Harvard University Press; Cambridge: 2005. [ CrossRef ] [ Google Scholar ]
• Uribe-Enciso Olga Lucía, Uribe-Enciso Diana Sofía, Vargas-Daza María Del Pilar. Pensamiento Crítico y Su Importancia En La Educación: Algunas Reflexiones. Rastros Rostros. 2017; 19 doi: 10.16925/ra.v19i34.2144. [ CrossRef ] [ Google Scholar ]
• van der Vleuten Cees, van den Eertwegh Valerie, Giroldi Esther. Assessment of Communication Skills. Patient Education and Counseling. 2019; 102 :2110–13. doi: 10.1016/j.pec.2019.07.007. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• van Klink Marcel R., Boon Jo. Competencies: The triumph of a fuzzy concept. International Journal of Human Resources Development and Management. 2003; 3 :125–37. doi: 10.1504/IJHRDM.2003.002415. [ CrossRef ] [ Google Scholar ]
• van Laar Ester, Van Deursen Alexander J. A. M., Van Dijk Jan A. G. M., de Haan Jos. The Relation between 21st-Century Skills and Digital Skills: A Systematic Literature Review. Computers in Human Behavior. 2017; 72 :577–88. doi: 10.1016/j.chb.2017.03.010. [ CrossRef ] [ Google Scholar ]
• van Rosmalen Peter, Boyle Elizabeth A., Nadolski Rob, van der Baaren John, Fernández-Manjón Baltasar, MacArthur Ewan, Pennanen Tiina, Manea Madalina, Star Kam. Lecture Notes in Computer Science. Springer International Publishing; Cham: 2014. Acquiring 21st Century Skills: Gaining Insight into the Design and Applicability of a Serious Game with 4C-ID; pp. 327–34. [ CrossRef ] [ Google Scholar ]
• Vincent-Lancrin Stéphan, González-Sancho Carlos, Bouckaert Mathias, de Luca Federico, Fernández-Barrerra Meritxell, Jacotin Gwénaël, Urgel Joaquin, Vidal Quentin. Fostering Students’ Creativity and Critical Thinking: What It Means in School. OECD Publishing; Paris: 2019. [ CrossRef ] [ Google Scholar ]
• Voogt Joke, Roblin Natalie Pareja. A Comparative Analysis of International Frameworks for 21st Century Competences: Implications for National Curriculum Policies. Journal of Curriculum Studies. 2012; 44 :299–321. doi: 10.1080/00220272.2012.668938. [ CrossRef ] [ Google Scholar ]
• Waizenegger Lena, McKenna Brad, Cai Wenjie, Bendz Taino. An Affordance Perspective of Team Collaboration and Enforced Working from Home during COVID-19. European Journal of Information Systems: An Official Journal of the Operational Research Society. 2020; 29 :429–42. doi: 10.1080/0960085X.2020.1800417. [ CrossRef ] [ Google Scholar ]
• Watson Goodwin. Watson-Glaser Critical Thinking Appraisal. Psychological Corporation; San Antonio: 1980. [ Google Scholar ]
• Watson Goodwin, Glaser Edwin M. Technical Manual and User’s Guide. Pearson; Kansas City: 2010. Watson-Glaser TM II critical thinking appraisal. [ Google Scholar ]
• Weick Karl E. The collapse of sensemaking in organizations: The Mann Gulch disaster. Administrative Science Quarterly. 1993; 38 :628–52. doi: 10.2307/2393339. [ CrossRef ] [ Google Scholar ]
• West Richard F., Toplak Maggie E., Stanovich Keith E. Heuristics and Biases as Measures of Critical Thinking: Associations with Cognitive Ability and Thinking Dispositions. Journal of Educational Psychology. 2008; 100 :930–41. doi: 10.1037/a0012842. [ CrossRef ] [ Google Scholar ]
• Whitmore Paul G. What are soft skills; Paper presented at the CONARC Soft Skills Conference; Fort Bliss, TX, USA. December 12–13; 1972. pp. 12–13. [ Google Scholar ]
• Willingham Daniel T. Critical Thinking: Why Is It so Hard to Teach? Arts Education Policy Review. 2008; 109 :21–32. doi: 10.3200/AEPR.109.4.21-32. [ CrossRef ] [ Google Scholar ]
• Wilson Sarah Beth, Varma-Nelson Pratibha. Small Groups, Significant Impact: A Review of Peer-Led Team Learning Research with Implications for STEM Education Researchers and Faculty. Journal of Chemical Education. 2016; 93 :1686–702. doi: 10.1021/acs.jchemed.5b00862. [ CrossRef ] [ Google Scholar ]
• Winterton Jonathan, Deist Françoise Delamare-Le, Stringfellow Emma. Typology of Knowledge, Skills and Competences: Clarification of the Concept and Prototype. Office for Official Publications of the European Communities; Luxembourg: 2006. [ Google Scholar ]
• World Economic Forum . New Vision for Education: Unlocking the Potential of Technology. World Economic Forum; Geneva: 2015. [ Google Scholar ]
• World Economic Forum The Future of Jobs Report 2020. 2020. [(accessed on 2 November 2022)]. Available online: https://www.weforum.org/reports/the-future-of-jobs-report-2020
• World Health Organization . Framework for Action on Interprofessional Education and Collaborative Practice. World Health Organization; Geneva: 2010. No. WHO/HRH/HPN/10.3. [ PubMed ] [ Google Scholar ]
• Yue Meng, Zhang Meng, Zhang Chunmei, Jin Changde. The Effectiveness of Concept Mapping on Development of Critical Thinking in Nursing Education: A Systematic Review and Meta-Analysis. Nurse Education Today. 2017; 52 :87–94. doi: 10.1016/j.nedt.2017.02.018. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Zielke Stephan, Dobbelstein Thomas. Customers’ Willingness to Purchase New Store Brands. Journal of Product & Brand Management. 2007; 16 :112–21. doi: 10.1108/10610420710739982. [ CrossRef ] [ Google Scholar ]
• Zlatić Lidija, Bjekić Dragana, Marinković Snežana, Bojović Milevica. Development of Teacher Communication Competence. Procedia, Social and Behavioral Sciences. 2014; 116 :606–10. doi: 10.1016/j.sbspro.2014.01.265. [ CrossRef ] [ Google Scholar ]

• school Campus Bookshelves
• menu_book Bookshelves
• perm_media Learning Objects
• login Login
• how_to_reg Request Instructor Account
• hub Instructor Commons

Margin Size

• Download Page (PDF)
• Download Full Book (PDF)
• Periodic Table
• Physics Constants
• Scientific Calculator
• Reference & Cite
• Tools expand_more
• Readability

selected template will load here

This action is not available.

11.3: Effective Strategies for Group Creativity

• Last updated
• Save as PDF
• Page ID 58762

\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)

\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)

( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)

\( \newcommand{\Span}{\mathrm{span}}\)

\( \newcommand{\id}{\mathrm{id}}\)

\( \newcommand{\kernel}{\mathrm{null}\,}\)

\( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\)

\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\)

\( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)

\( \newcommand{\vectorA}[1]{\vec{#1}}      % arrow\)

\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}}      % arrow\)

\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vectorC}[1]{\textbf{#1}} \)

\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)

\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)

\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)

Learning Objectives

• Define and explain “bisociation”
• Describe brainstorming and identify criteria for its effective use
• Differentiate between neophiles and neophobes
• Distinguish between the creative styles of “brooders” and “spawners”

Sisters, brothers, mothers, fathers, teachers—everybody starts to douse your imagination and creativity. At a young age it starts, and then all of a sudden you’re like a trunk going through an airport, covered in stickers. I think I have spent most of my life pulling off stickers.

Kim Basinger

Very few people do anything creative after the age of thirty-five. The reason is that very few people do anything creative before the age of thirty-five.

Joel Hildebrand

You can’t wait for inspiration. You have to go after it with a club.

Jack London

Human beings are naturally creative from an early age. Think of any four- or five-year-old child you’ve ever met, and you can verify this for yourself. Here are some examples from journals kept by one of the authors concerning his children’s development before age six:

I was reading Animal Farm the other day and mentioned that one of the “Seven Commandments” of the animals had to do with the beliefs that the beasts liked anything with four legs or wings. Amelia said, “Oh—then they like airplanes!”

Last night at dinner, Claire looked at the roll-top wooden bread storage compartment over the countertop in our kitchen and said, “That’s a garage door where food parks.”

When I was explaining that there are only four tastes which human tongues can detect—salty, sweet, sour, and bitter—Claire asked, “What about ‘yucky’?”

Last night on the way to folk-dancing, we started talking about vocabulary. For some reason, Amelia created a new word: “trampede.” According to her, a “trampede” is a centipede on a trampoline.

Solving problems and making decisions both work best if people in a group are creative; i.e., if they entertain new perspectives and generate new ideas. Can this be a simple matter of having the group’s leader tell people “Be creative,” though? Probably not. It’s like saying, “Don’t think of an elephant”: it’s apt to produce just the opposite effect of the command itself. Still, tools and techniques for encouraging creativity in a group do exist.

A Theory of Creativity

Arthur Koestler, a major intellectual and political force in Europe and the United States throughout most of the 20 th century, contended that all creativity comprises a process he called “bisociation.”Koestler, A. (1964). The act of creation. New York: Macmillan. Koestler’s seminal book on this topic, titled The Act of Creation , put forth a theory that he believed accounted for people’s “Aha” reaction of scientific discovery, their “Ha-ha” reaction to jokes, and their “Ah” reaction of mystical or religious insight.

Above all, creativity creates new things—things that weren’t there before the creative act took place. In every kind of creative situation, according to Koestler, the result is produced by a meeting of lines of thought that bring together hitherto unconnected ideas and fuse them into something new. If the lines of thought concern devotional matters, mystical insight emerges, and when they concern more mundane matters the result is apt to be a joke. If they are scientific, the result is a scientific discovery.

The expression “to think outside the box” is often used to refer to creativity. Koestler’s view seems to be that creativity consists, instead, of linking existing but separate “boxes” together. One implication of his theory is that, to be creative, a person not only needs to depart from the status quo but also needs to be familiar and comfortable with a range of alternatives from a wide variety of fields. Koestler’s perspective would seem to be consistent with the association we often make between creativity on the one hand and intelligence and breadth of knowledge on the other.

Overcoming Inertia

At every crossroads on the path that leads to the future, tradition has placed 10,000 men to guard the past.

Maurice Maeterlinck

When you cannot make up your mind which of two evenly balanced courses of action you should take, choose the bolder.

William Joseph Slim

Groups generally comprise a mixture of people when it comes to openness to change. A small fraction of the members may position themselves at one end of the openness continuum or the other. Some of these people, called neophiles, will eagerly embrace almost anything novel. Others, known as neophobes, will invariably shun what’s new and prefer the security of what they know and have done in the past. The majority of people, however, probably don’t fit neatly into either of these categories. Instead, they may prefer to produce or experiment with new things under certain circumstances and resist them under others.

It’s rarely possible to provoke creativity on the part of an entire group all at once. You needn’t agree with Thomas Fuller’s aphorism that “a conservative believes nothing should be done for the first time” to realize that some people in groups will hold onto what they’re familiar with all the more stubbornly as others begin to waver and experiment with something new.

Brainstorming

In regard to every problem that arises, there are counselors who say, “Do nothing” [and] other counselors who say, “Do everything”…I say to you: “Do something”; and when you have done something, if it works, do it some more; and if it does not work, then do something else.

Franklin Delano Roosevelt

One familiar technique that experts in the realm of creative thinking have long recommended is brainstorming. Alex Osborn, an advertising executive, began using the term in the mid-1950s and described the method in detail in his book Applied Imagination: Principles and Procedures of Creative Problem Solving . Osborn, A.F. (1963) Applied imagination: Principles and procedures of creative problem solving (3rd revised ed.). New York: Charles Scribner’s Sons.

One criterion of proper brainstorming is that it must begin with an unrestricted search for quantity and creativity rather than quality. It should actually solicit and reward craziness and zaniness, in other words.

A second criterion for good brainstorming is that it should encourage and praise “piggybacking” on ideas that have already emerged. A third is that brainstormers should avoid making any judgments until they’ve generated an extensive list of ideas.

Robert Sutton, a respected organizational consultant, published a book in 2002 called Weird Ideas That Work .Sutton, R. (2002). Weird ideas that work . New York: Free Press. Among other things, Sutton’s book paid tribute to brainstorming.

One of Sutton’s central contentions was that excellence arises from “a range of differences”—precisely what brainstorming aims to generate. To illustrate, Sutton declared that such prodigious geniuses as Shakespeare, Einstein, Mozart, Edison, and Picasso were first and foremost productive. In fact, he argued that these brilliant individuals didn’t succeed at a higher rate than anyone else; they just did more.

Mozart, for instance, started composing when he was seven years old and wrote at least 20 pieces of music per year from then until his death at the age of 35. Several of his compositions were routine or even dull, but many were sublime and some are unquestioned masterpieces.

Closer to home, Sutton noted that today’s toy business offers examples of the value of starting with lots of ideas and only then selecting quality ones. Skyline, an arm of California’s IDEO Corporation, employed just 10 staff members in 1998 but generated 4,000 ideas in that year for new toys.

According to Sutton, those 4,000 ideas boiled down to 230 possibilities worth examining through careful drawings or working prototypes. Of the 230 concepts, 12 were ultimately sold. In other words, the “yield” of saleable products came to only 3/10 of one percent of the original ideas. Sutton quoted Skyline’s founder, Brendan Boyle, as saying, “You can’t get any good new ideas without having a lot of dumb, lousy, and crazy ones.”

The Ostrich and the Sea Urchin

Now let’s take a look at what two animals have to do with ideas in general, and with varied ways of being creative about ideas in specific. The two animals are the ostrich and the sea urchin.

The ostrich’s reproductive processes lie at one end of a continuum, the sea urchin’s at the other. Like the 350-pound mother which lays it, an ostrich egg is large, imposing, and tough. For 42 days after it’s laid, it grows until it weighs more than three pounds. It will then reliably crack open and release a baby ostrich. Unless something highly unexpected happens, its mother will tend it well, and that single baby ostrich will in turn grow up and become a mature ostrich.

A sea urchin differs in almost every respect from an ostrich. The whole animal takes up less space and weighs less than an ostrich egg, for one thing. It has no eyes. It hardly moves all its life. To propagate, an urchin spews a cloud of more than a million miniscule eggs into the ocean. The eggs disperse immediately into the tide pools and reef inlets populated by their spiny parents.

Some of the sea urchin eggs meet sea urchin sperm and combine to form tiny, transparent, free-floating embryos. Eggs remain viable for only 6–8 hours, however, so lots of them die before this happens. Of a one-million-egg cloud, those which are to have a chance of becoming embryos must do so within 48 hours. The odds aren’t good.

Then things thin out even more. A Stanford University publication points out that “the young embryo is totally at the mercy of the sea. There are many organisms that will consume the young sea urchin embryo and later the young sea urchin.”Brooders vs spawners. www.stanford.edu/group/Urchin/bvss.htm In other words, the overwhelming majority of sea urchin eggs die of loneliness or get eaten.

Biologists call animals like ostriches “brooders” because they create only a few offspring but take care of each one faithfully. Creatures such as sea urchins, which produce vast numbers of candidates for fertilization but don’t take care of them and lose most of them to predators, are called “spawners.” Brainstorming is clearly a “spawning” process rather than a “brooding” one.

Threats to the Effectiveness of Brainstorming

Although it is meant to generate large quantities of ideas on which to base sound decision-making, brainstorming entails some same challenges. One group of researchers Stroebe, W., Diehl, M., & Abakoumkin, G. (1992). The illusion of group affectivity. Personality and Social Psychology Bulletin 18 (5): 643–650. identified three potential weakening factors inherent within brainstorming:

• Blocking. Since only one person at a time in a group can speak, other members may lose the desire to contribute their own ideas or even forget those ideas in the midst of a lively brainstorming session.
• Social matching.Brown, V., & Paulus, P. B. (1996). A simple dynamic model of social factors in group brainstorming. Small Group Research, 27 , 91–114. People in a group tend to calibrate their own degree of contribution to its activities on the basis of what the other members do. If someone has lots of ideas but sees that the rest of the group is less productive, that person is apt to reduce his or her own creative production.
• Illusion of group productivity. Group members are apt to rate the level of their output as being higher than it actually is. For one thing, members describe their group as being above average in productivity with respect to other groups. They also overrate their individual contributions; people in one study, for instance, said that they had contributed 36% of their group’s ideas when in fact they had offered only 25%. Paulus, P. B., Dzindolet, M. T., Poletes, G., & Camacho, L. M. (1993). Perception of performance in group brainstorming: The illusion of group productivity. Journal of Personality and Social Psychology, 64 (4), 575–586.

Key Takeaways

• Creativity, which can play a positive role in group decision-making, has been described as a process of combining two disparate elements. It can be stimulated through brainstorming.

Exercise \(\PageIndex{1}\)

• Do you agree with Arthur Koestler that all creativity involves bringing disparate trains of thought together? Provide 2–3 examples that support your answer.
• Do you consider yourself a “brooder” or a “spawner”? Explain your response to a fellow student, providing examples that support your answer.
• When was the last time you showed exceptional creativity? What factors in your environment or within you at the time contributed most to that creativity?
• Think of a neophile and a neophobe whom you’ve encountered in a group. Describe actions that each person took which illustrate his/her neophilia or neophobia.

Introducing Lenovo’s new content filtering and online safety solution, Lenovo NetFilter

•  United States
• Contact Sales: 833-247-2527

Education insights

Exploring the 4 C’s of 21st Century Learning

May 27, 2021

Learning and Innovation Skills, or the 4 C’s of 21 st Century Learning include Critical Thinking and Problem Solving, Creativity and Innovation, Communication, and Collaboration. If the 4 C’s sound familiar, it’s because they probably are. Most people learned many of these skills in school. So why are they called 21 st -Century Skills ? The answer is simple: they are the set of skills 21 st century employers consider the most important skills in prospective employees.

Economists, human resource directors, and business leaders have examined the 4 C’s for at least three decades. What skills, they ask, do major industries and professions need in an employee or professional? In other words, what skills can we teach students that are “future-proof” no matter how quickly the world changes?

Every five years, the World Economic Forum interviews human resource and business leaders to identify the most important skills needed in an employee. According to their 2020 Future of Jobs Report , the ten most vital core skills needed in the coming decade are:

• Cognitive flexibility
• Complex problem solving
• Critical thinking
• Judgment and decision making
• Negotiation
• People management
• Coordinating with others
• Service orientation
• Emotional intelligence.

While the list of vital skills will vary depending on who you talk to, there is a clear common thread across the board: any list of “future-proof” skills is always represented by the four categories of the 4 C’s. In the 20 th century, career-specific skills reigned supreme in schools, universities, and professions. Today, however, students must learn skills to meet the changes of the new century and be the workforce of the future. As a result, educators must shift teaching methodologies to teach these learning and innovation skills.

The framework for 21st Century Learning

For many, however, modern teaching methodologies like the 4 C’s, collaborative learning, or project-based learning can sound like neglect of traditional curriculum . The reality is that no subject in the traditional curriculum is being replaced.

In fact, the 4 C’s are part of a larger educational framework whose foundation is the traditional curriculum: math, reading, writing, language arts, science, civics, history, languages, geography, and the arts. The 4 C’s were originally part of the Framework for 21 st Century Learning from the Partnership for 21 st -Century Skills. In this framework, the traditional curriculum is still the focus, and Learning and Innovation Skills, or the 4 C’s, are intended to be used to support it.

What are the 4 C’s?

While the 4 C’s may sound a bit vague, they are actually composites of real skills that are definable, measurable, and teachable.

Creativity and innovation

Creativity is a set of skills that enables learners to discover alternatives, brainstorm ideas, generate solutions, rethink existing paradigms, and create new knowledge. However, creativity involves more than just “thinking outside the box.” In the 21 st century, creativity is overwhelmingly a group process that requires openness to new and divergent ideas, the ability to formulate useful feedback, the recognition of the limits of new ideas and the value of old ideas, and the capacity to use failure as an opportunity. Group creativity skills are just as important, if not more so, as thinking outside the box.

Critical thinking and problem solving

In the real world, problems do not have “right answers” conveniently printed at the back of the textbook. Critical Thinking and Problem Solving involves mastering skills that enable learners to define problems, pose questions, sort through information, evaluate evidence, weigh alternatives, consider different points of view, analyze arguments, understand complexity, and approach unfamiliar problems. Many of these skills have long been taught in the classroom in traditional courses like science, civics, history, and math, but the goal is to use them deliberately throughout the curriculum.

Communication

Communication is the set of skills that allows students to read, listen, interpret, speak, write, persuade, negotiate, argue, and master a large variety of media. Learning communication skills dates back centuries in subjects like reading, writing, oratory, and language arts. The difference, however, is that the 4 C’s put communication at the center of learning in all subjects, from language arts to algebra. A few ways to teach communication skills to students include encouraging activities that reinforce active listening, asking open-ended questions, fostering critical thinking and reflective learning opportunities, and modeling effective conversation skills when communicating with students.

Collaboration

In our complex and changing world, success requires that people work together . Most problems and projects in the 21 st century workplace are multifaceted and multidisciplinary, requiring a diverse set of skills, knowledge, and backgrounds to bring to completion. Collaboration is the set of skills that enable people to collectively set goals, allocate resources, fulfill group roles, plan, manage time, make group decisions, negotiate, resolve conflicts, and build teams. Unlike other aspects of the 4 C’s, collaboration is a relatively recent structural innovation in K-12 education. Widely adopted in the 1990’s, collaborative learning was originally intended to enhance learning outcomes in the traditional curriculum . The 4 C’s also focus on developing a defined set of interactional skills that not only increase learning, but are also necessary skills in today’s workplace. A few ways to encourage collaborative learning include incorporating games into lessons, creating a safe space for class discussion, encouraging storytelling and brainstorming, and amplifying all student voices.

The 4 C’s of 21st Century Learning are here to stay

For proof of concept of the crucial value of the 4 C’s, we need look no further than the last 12 months. As the COVID-19 pandemic raged across the country, teachers and learners worked to master distance learning in classrooms entirely managed through technology. When we reflect back, 2020 will likely be remembered as “the Year of Distance Learning.” Simply meeting the challenges posed by a year of remote and hybrid learning became a crash course in the 4 C’s for everyone, from students and teachers to administrators and IT personnel.

The 4 C’s are fundamental skills educators must teach as they transition from a “sage on the stage” to “guide on the side” style of teaching. They are the tools students use every day to meet the challenges of a changing classroom, even without the duress of a pandemic. They are an enduring skillset and are part of every student’s future.

Find out how LanSchool can help develop creativity, critical thinking, collaboration, and communication skills in your classroom.   

Even more from LanSchool

Join our mailing list and receive the latest edtech news and LanSchool updates delivered directly to your inbox.

3 ways to use the American Rescue Plan to purchase…

Features and updates

5 LanSchool features you can’t miss

How to write an effective digital lesson plan for k-12…, 8 key netiquette lessons to develop good digital citizens, get in touch.

Contact us today to learn more about LanSchool licenses, features, and benefits.

Try LanSchool for Free

Ready to see how LanSchool can transform your school or district?

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• My Account Login
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Review Article
• Open access
• Published: 11 January 2023

The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature

• Enwei Xu   ORCID: orcid.org/0000-0001-6424-8169 1 ,
• Wei Wang 1 &
• Qingxia Wang 1  

Humanities and Social Sciences Communications volume  10 , Article number:  16 ( 2023 ) Cite this article

16k Accesses

16 Citations

3 Altmetric

Metrics details

• Science, technology and society

Collaborative problem-solving has been widely embraced in the classroom instruction of critical thinking, which is regarded as the core of curriculum reform based on key competencies in the field of education as well as a key competence for learners in the 21st century. However, the effectiveness of collaborative problem-solving in promoting students’ critical thinking remains uncertain. This current research presents the major findings of a meta-analysis of 36 pieces of the literature revealed in worldwide educational periodicals during the 21st century to identify the effectiveness of collaborative problem-solving in promoting students’ critical thinking and to determine, based on evidence, whether and to what extent collaborative problem solving can result in a rise or decrease in critical thinking. The findings show that (1) collaborative problem solving is an effective teaching approach to foster students’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]); (2) in respect to the dimensions of critical thinking, collaborative problem solving can significantly and successfully enhance students’ attitudinal tendencies (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI[0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI[0.58, 0.82]); and (3) the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have an impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. On the basis of these results, recommendations are made for further study and instruction to better support students’ critical thinking in the context of collaborative problem-solving.

Similar content being viewed by others

Fostering twenty-first century skills among primary school students through math project-based learning

A meta-analysis to gauge the impact of pedagogies employed in mixed-ability high school biology classrooms

A guide to critical thinking: implications for dental education

Introduction.

Although critical thinking has a long history in research, the concept of critical thinking, which is regarded as an essential competence for learners in the 21st century, has recently attracted more attention from researchers and teaching practitioners (National Research Council, 2012 ). Critical thinking should be the core of curriculum reform based on key competencies in the field of education (Peng and Deng, 2017 ) because students with critical thinking can not only understand the meaning of knowledge but also effectively solve practical problems in real life even after knowledge is forgotten (Kek and Huijser, 2011 ). The definition of critical thinking is not universal (Ennis, 1989 ; Castle, 2009 ; Niu et al., 2013 ). In general, the definition of critical thinking is a self-aware and self-regulated thought process (Facione, 1990 ; Niu et al., 2013 ). It refers to the cognitive skills needed to interpret, analyze, synthesize, reason, and evaluate information as well as the attitudinal tendency to apply these abilities (Halpern, 2001 ). The view that critical thinking can be taught and learned through curriculum teaching has been widely supported by many researchers (e.g., Kuncel, 2011 ; Leng and Lu, 2020 ), leading to educators’ efforts to foster it among students. In the field of teaching practice, there are three types of courses for teaching critical thinking (Ennis, 1989 ). The first is an independent curriculum in which critical thinking is taught and cultivated without involving the knowledge of specific disciplines; the second is an integrated curriculum in which critical thinking is integrated into the teaching of other disciplines as a clear teaching goal; and the third is a mixed curriculum in which critical thinking is taught in parallel to the teaching of other disciplines for mixed teaching training. Furthermore, numerous measuring tools have been developed by researchers and educators to measure critical thinking in the context of teaching practice. These include standardized measurement tools, such as WGCTA, CCTST, CCTT, and CCTDI, which have been verified by repeated experiments and are considered effective and reliable by international scholars (Facione and Facione, 1992 ). In short, descriptions of critical thinking, including its two dimensions of attitudinal tendency and cognitive skills, different types of teaching courses, and standardized measurement tools provide a complex normative framework for understanding, teaching, and evaluating critical thinking.

Cultivating critical thinking in curriculum teaching can start with a problem, and one of the most popular critical thinking instructional approaches is problem-based learning (Liu et al., 2020 ). Duch et al. ( 2001 ) noted that problem-based learning in group collaboration is progressive active learning, which can improve students’ critical thinking and problem-solving skills. Collaborative problem-solving is the organic integration of collaborative learning and problem-based learning, which takes learners as the center of the learning process and uses problems with poor structure in real-world situations as the starting point for the learning process (Liang et al., 2017 ). Students learn the knowledge needed to solve problems in a collaborative group, reach a consensus on problems in the field, and form solutions through social cooperation methods, such as dialogue, interpretation, questioning, debate, negotiation, and reflection, thus promoting the development of learners’ domain knowledge and critical thinking (Cindy, 2004 ; Liang et al., 2017 ).

Collaborative problem-solving has been widely used in the teaching practice of critical thinking, and several studies have attempted to conduct a systematic review and meta-analysis of the empirical literature on critical thinking from various perspectives. However, little attention has been paid to the impact of collaborative problem-solving on critical thinking. Therefore, the best approach for developing and enhancing critical thinking throughout collaborative problem-solving is to examine how to implement critical thinking instruction; however, this issue is still unexplored, which means that many teachers are incapable of better instructing critical thinking (Leng and Lu, 2020 ; Niu et al., 2013 ). For example, Huber ( 2016 ) provided the meta-analysis findings of 71 publications on gaining critical thinking over various time frames in college with the aim of determining whether critical thinking was truly teachable. These authors found that learners significantly improve their critical thinking while in college and that critical thinking differs with factors such as teaching strategies, intervention duration, subject area, and teaching type. The usefulness of collaborative problem-solving in fostering students’ critical thinking, however, was not determined by this study, nor did it reveal whether there existed significant variations among the different elements. A meta-analysis of 31 pieces of educational literature was conducted by Liu et al. ( 2020 ) to assess the impact of problem-solving on college students’ critical thinking. These authors found that problem-solving could promote the development of critical thinking among college students and proposed establishing a reasonable group structure for problem-solving in a follow-up study to improve students’ critical thinking. Additionally, previous empirical studies have reached inconclusive and even contradictory conclusions about whether and to what extent collaborative problem-solving increases or decreases critical thinking levels. As an illustration, Yang et al. ( 2008 ) carried out an experiment on the integrated curriculum teaching of college students based on a web bulletin board with the goal of fostering participants’ critical thinking in the context of collaborative problem-solving. These authors’ research revealed that through sharing, debating, examining, and reflecting on various experiences and ideas, collaborative problem-solving can considerably enhance students’ critical thinking in real-life problem situations. In contrast, collaborative problem-solving had a positive impact on learners’ interaction and could improve learning interest and motivation but could not significantly improve students’ critical thinking when compared to traditional classroom teaching, according to research by Naber and Wyatt ( 2014 ) and Sendag and Odabasi ( 2009 ) on undergraduate and high school students, respectively.

The above studies show that there is inconsistency regarding the effectiveness of collaborative problem-solving in promoting students’ critical thinking. Therefore, it is essential to conduct a thorough and trustworthy review to detect and decide whether and to what degree collaborative problem-solving can result in a rise or decrease in critical thinking. Meta-analysis is a quantitative analysis approach that is utilized to examine quantitative data from various separate studies that are all focused on the same research topic. This approach characterizes the effectiveness of its impact by averaging the effect sizes of numerous qualitative studies in an effort to reduce the uncertainty brought on by independent research and produce more conclusive findings (Lipsey and Wilson, 2001 ).

This paper used a meta-analytic approach and carried out a meta-analysis to examine the effectiveness of collaborative problem-solving in promoting students’ critical thinking in order to make a contribution to both research and practice. The following research questions were addressed by this meta-analysis:

What is the overall effect size of collaborative problem-solving in promoting students’ critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills)?

How are the disparities between the study conclusions impacted by various moderating variables if the impacts of various experimental designs in the included studies are heterogeneous?

This research followed the strict procedures (e.g., database searching, identification, screening, eligibility, merging, duplicate removal, and analysis of included studies) of Cooper’s ( 2010 ) proposed meta-analysis approach for examining quantitative data from various separate studies that are all focused on the same research topic. The relevant empirical research that appeared in worldwide educational periodicals within the 21st century was subjected to this meta-analysis using Rev-Man 5.4. The consistency of the data extracted separately by two researchers was tested using Cohen’s kappa coefficient, and a publication bias test and a heterogeneity test were run on the sample data to ascertain the quality of this meta-analysis.

Data sources and search strategies

There were three stages to the data collection process for this meta-analysis, as shown in Fig. 1 , which shows the number of articles included and eliminated during the selection process based on the statement and study eligibility criteria.

This flowchart shows the number of records identified, included and excluded in the article.

First, the databases used to systematically search for relevant articles were the journal papers of the Web of Science Core Collection and the Chinese Core source journal, as well as the Chinese Social Science Citation Index (CSSCI) source journal papers included in CNKI. These databases were selected because they are credible platforms that are sources of scholarly and peer-reviewed information with advanced search tools and contain literature relevant to the subject of our topic from reliable researchers and experts. The search string with the Boolean operator used in the Web of Science was “TS = (((“critical thinking” or “ct” and “pretest” or “posttest”) or (“critical thinking” or “ct” and “control group” or “quasi experiment” or “experiment”)) and (“collaboration” or “collaborative learning” or “CSCL”) and (“problem solving” or “problem-based learning” or “PBL”))”. The research area was “Education Educational Research”, and the search period was “January 1, 2000, to December 30, 2021”. A total of 412 papers were obtained. The search string with the Boolean operator used in the CNKI was “SU = (‘critical thinking’*‘collaboration’ + ‘critical thinking’*‘collaborative learning’ + ‘critical thinking’*‘CSCL’ + ‘critical thinking’*‘problem solving’ + ‘critical thinking’*‘problem-based learning’ + ‘critical thinking’*‘PBL’ + ‘critical thinking’*‘problem oriented’) AND FT = (‘experiment’ + ‘quasi experiment’ + ‘pretest’ + ‘posttest’ + ‘empirical study’)” (translated into Chinese when searching). A total of 56 studies were found throughout the search period of “January 2000 to December 2021”. From the databases, all duplicates and retractions were eliminated before exporting the references into Endnote, a program for managing bibliographic references. In all, 466 studies were found.

Second, the studies that matched the inclusion and exclusion criteria for the meta-analysis were chosen by two researchers after they had reviewed the abstracts and titles of the gathered articles, yielding a total of 126 studies.

Third, two researchers thoroughly reviewed each included article’s whole text in accordance with the inclusion and exclusion criteria. Meanwhile, a snowball search was performed using the references and citations of the included articles to ensure complete coverage of the articles. Ultimately, 36 articles were kept.

Two researchers worked together to carry out this entire process, and a consensus rate of almost 94.7% was reached after discussion and negotiation to clarify any emerging differences.

Eligibility criteria

Since not all the retrieved studies matched the criteria for this meta-analysis, eligibility criteria for both inclusion and exclusion were developed as follows:

The publication language of the included studies was limited to English and Chinese, and the full text could be obtained. Articles that did not meet the publication language and articles not published between 2000 and 2021 were excluded.

The research design of the included studies must be empirical and quantitative studies that can assess the effect of collaborative problem-solving on the development of critical thinking. Articles that could not identify the causal mechanisms by which collaborative problem-solving affects critical thinking, such as review articles and theoretical articles, were excluded.

The research method of the included studies must feature a randomized control experiment or a quasi-experiment, or a natural experiment, which have a higher degree of internal validity with strong experimental designs and can all plausibly provide evidence that critical thinking and collaborative problem-solving are causally related. Articles with non-experimental research methods, such as purely correlational or observational studies, were excluded.

The participants of the included studies were only students in school, including K-12 students and college students. Articles in which the participants were non-school students, such as social workers or adult learners, were excluded.

The research results of the included studies must mention definite signs that may be utilized to gauge critical thinking’s impact (e.g., sample size, mean value, or standard deviation). Articles that lacked specific measurement indicators for critical thinking and could not calculate the effect size were excluded.

Data coding design

In order to perform a meta-analysis, it is necessary to collect the most important information from the articles, codify that information’s properties, and convert descriptive data into quantitative data. Therefore, this study designed a data coding template (see Table 1 ). Ultimately, 16 coding fields were retained.

The designed data-coding template consisted of three pieces of information. Basic information about the papers was included in the descriptive information: the publishing year, author, serial number, and title of the paper.

The variable information for the experimental design had three variables: the independent variable (instruction method), the dependent variable (critical thinking), and the moderating variable (learning stage, teaching type, intervention duration, learning scaffold, group size, measuring tool, and subject area). Depending on the topic of this study, the intervention strategy, as the independent variable, was coded into collaborative and non-collaborative problem-solving. The dependent variable, critical thinking, was coded as a cognitive skill and an attitudinal tendency. And seven moderating variables were created by grouping and combining the experimental design variables discovered within the 36 studies (see Table 1 ), where learning stages were encoded as higher education, high school, middle school, and primary school or lower; teaching types were encoded as mixed courses, integrated courses, and independent courses; intervention durations were encoded as 0–1 weeks, 1–4 weeks, 4–12 weeks, and more than 12 weeks; group sizes were encoded as 2–3 persons, 4–6 persons, 7–10 persons, and more than 10 persons; learning scaffolds were encoded as teacher-supported learning scaffold, technique-supported learning scaffold, and resource-supported learning scaffold; measuring tools were encoded as standardized measurement tools (e.g., WGCTA, CCTT, CCTST, and CCTDI) and self-adapting measurement tools (e.g., modified or made by researchers); and subject areas were encoded according to the specific subjects used in the 36 included studies.

The data information contained three metrics for measuring critical thinking: sample size, average value, and standard deviation. It is vital to remember that studies with various experimental designs frequently adopt various formulas to determine the effect size. And this paper used Morris’ proposed standardized mean difference (SMD) calculation formula ( 2008 , p. 369; see Supplementary Table S3 ).

Procedure for extracting and coding data

According to the data coding template (see Table 1 ), the 36 papers’ information was retrieved by two researchers, who then entered them into Excel (see Supplementary Table S1 ). The results of each study were extracted separately in the data extraction procedure if an article contained numerous studies on critical thinking, or if a study assessed different critical thinking dimensions. For instance, Tiwari et al. ( 2010 ) used four time points, which were viewed as numerous different studies, to examine the outcomes of critical thinking, and Chen ( 2013 ) included the two outcome variables of attitudinal tendency and cognitive skills, which were regarded as two studies. After discussion and negotiation during data extraction, the two researchers’ consistency test coefficients were roughly 93.27%. Supplementary Table S2 details the key characteristics of the 36 included articles with 79 effect quantities, including descriptive information (e.g., the publishing year, author, serial number, and title of the paper), variable information (e.g., independent variables, dependent variables, and moderating variables), and data information (e.g., mean values, standard deviations, and sample size). Following that, testing for publication bias and heterogeneity was done on the sample data using the Rev-Man 5.4 software, and then the test results were used to conduct a meta-analysis.

Publication bias test

When the sample of studies included in a meta-analysis does not accurately reflect the general status of research on the relevant subject, publication bias is said to be exhibited in this research. The reliability and accuracy of the meta-analysis may be impacted by publication bias. Due to this, the meta-analysis needs to check the sample data for publication bias (Stewart et al., 2006 ). A popular method to check for publication bias is the funnel plot; and it is unlikely that there will be publishing bias when the data are equally dispersed on either side of the average effect size and targeted within the higher region. The data are equally dispersed within the higher portion of the efficient zone, consistent with the funnel plot connected with this analysis (see Fig. 2 ), indicating that publication bias is unlikely in this situation.

This funnel plot shows the result of publication bias of 79 effect quantities across 36 studies.

Heterogeneity test

To select the appropriate effect models for the meta-analysis, one might use the results of a heterogeneity test on the data effect sizes. In a meta-analysis, it is common practice to gauge the degree of data heterogeneity using the I 2 value, and I 2  ≥ 50% is typically understood to denote medium-high heterogeneity, which calls for the adoption of a random effect model; if not, a fixed effect model ought to be applied (Lipsey and Wilson, 2001 ). The findings of the heterogeneity test in this paper (see Table 2 ) revealed that I 2 was 86% and displayed significant heterogeneity ( P  < 0.01). To ensure accuracy and reliability, the overall effect size ought to be calculated utilizing the random effect model.

The analysis of the overall effect size

This meta-analysis utilized a random effect model to examine 79 effect quantities from 36 studies after eliminating heterogeneity. In accordance with Cohen’s criterion (Cohen, 1992 ), it is abundantly clear from the analysis results, which are shown in the forest plot of the overall effect (see Fig. 3 ), that the cumulative impact size of cooperative problem-solving is 0.82, which is statistically significant ( z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]), and can encourage learners to practice critical thinking.

This forest plot shows the analysis result of the overall effect size across 36 studies.

In addition, this study examined two distinct dimensions of critical thinking to better understand the precise contributions that collaborative problem-solving makes to the growth of critical thinking. The findings (see Table 3 ) indicate that collaborative problem-solving improves cognitive skills (ES = 0.70) and attitudinal tendency (ES = 1.17), with significant intergroup differences (chi 2  = 7.95, P  < 0.01). Although collaborative problem-solving improves both dimensions of critical thinking, it is essential to point out that the improvements in students’ attitudinal tendency are much more pronounced and have a significant comprehensive effect (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]), whereas gains in learners’ cognitive skill are slightly improved and are just above average. (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

The analysis of moderator effect size

The whole forest plot’s 79 effect quantities underwent a two-tailed test, which revealed significant heterogeneity ( I 2  = 86%, z  = 12.78, P  < 0.01), indicating differences between various effect sizes that may have been influenced by moderating factors other than sampling error. Therefore, exploring possible moderating factors that might produce considerable heterogeneity was done using subgroup analysis, such as the learning stage, learning scaffold, teaching type, group size, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, in order to further explore the key factors that influence critical thinking. The findings (see Table 4 ) indicate that various moderating factors have advantageous effects on critical thinking. In this situation, the subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), learning scaffold (chi 2  = 9.03, P  < 0.01), and teaching type (chi 2  = 7.20, P  < 0.05) are all significant moderators that can be applied to support the cultivation of critical thinking. However, since the learning stage and the measuring tools did not significantly differ among intergroup (chi 2  = 3.15, P  = 0.21 > 0.05, and chi 2  = 0.08, P  = 0.78 > 0.05), we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving. These are the precise outcomes, as follows:

Various learning stages influenced critical thinking positively, without significant intergroup differences (chi 2  = 3.15, P  = 0.21 > 0.05). High school was first on the list of effect sizes (ES = 1.36, P  < 0.01), then higher education (ES = 0.78, P  < 0.01), and middle school (ES = 0.73, P  < 0.01). These results show that, despite the learning stage’s beneficial influence on cultivating learners’ critical thinking, we are unable to explain why it is essential for cultivating critical thinking in the context of collaborative problem-solving.

Different teaching types had varying degrees of positive impact on critical thinking, with significant intergroup differences (chi 2  = 7.20, P  < 0.05). The effect size was ranked as follows: mixed courses (ES = 1.34, P  < 0.01), integrated courses (ES = 0.81, P  < 0.01), and independent courses (ES = 0.27, P  < 0.01). These results indicate that the most effective approach to cultivate critical thinking utilizing collaborative problem solving is through the teaching type of mixed courses.

Various intervention durations significantly improved critical thinking, and there were significant intergroup differences (chi 2  = 12.18, P  < 0.01). The effect sizes related to this variable showed a tendency to increase with longer intervention durations. The improvement in critical thinking reached a significant level (ES = 0.85, P  < 0.01) after more than 12 weeks of training. These findings indicate that the intervention duration and critical thinking’s impact are positively correlated, with a longer intervention duration having a greater effect.

Different learning scaffolds influenced critical thinking positively, with significant intergroup differences (chi 2  = 9.03, P  < 0.01). The resource-supported learning scaffold (ES = 0.69, P  < 0.01) acquired a medium-to-higher level of impact, the technique-supported learning scaffold (ES = 0.63, P  < 0.01) also attained a medium-to-higher level of impact, and the teacher-supported learning scaffold (ES = 0.92, P  < 0.01) displayed a high level of significant impact. These results show that the learning scaffold with teacher support has the greatest impact on cultivating critical thinking.

Various group sizes influenced critical thinking positively, and the intergroup differences were statistically significant (chi 2  = 8.77, P  < 0.05). Critical thinking showed a general declining trend with increasing group size. The overall effect size of 2–3 people in this situation was the biggest (ES = 0.99, P  < 0.01), and when the group size was greater than 7 people, the improvement in critical thinking was at the lower-middle level (ES < 0.5, P  < 0.01). These results show that the impact on critical thinking is positively connected with group size, and as group size grows, so does the overall impact.

Various measuring tools influenced critical thinking positively, with significant intergroup differences (chi 2  = 0.08, P  = 0.78 > 0.05). In this situation, the self-adapting measurement tools obtained an upper-medium level of effect (ES = 0.78), whereas the complete effect size of the standardized measurement tools was the largest, achieving a significant level of effect (ES = 0.84, P  < 0.01). These results show that, despite the beneficial influence of the measuring tool on cultivating critical thinking, we are unable to explain why it is crucial in fostering the growth of critical thinking by utilizing the approach of collaborative problem-solving.

Different subject areas had a greater impact on critical thinking, and the intergroup differences were statistically significant (chi 2  = 13.36, P  < 0.05). Mathematics had the greatest overall impact, achieving a significant level of effect (ES = 1.68, P  < 0.01), followed by science (ES = 1.25, P  < 0.01) and medical science (ES = 0.87, P  < 0.01), both of which also achieved a significant level of effect. Programming technology was the least effective (ES = 0.39, P  < 0.01), only having a medium-low degree of effect compared to education (ES = 0.72, P  < 0.01) and other fields (such as language, art, and social sciences) (ES = 0.58, P  < 0.01). These results suggest that scientific fields (e.g., mathematics, science) may be the most effective subject areas for cultivating critical thinking utilizing the approach of collaborative problem-solving.

The effectiveness of collaborative problem solving with regard to teaching critical thinking

According to this meta-analysis, using collaborative problem-solving as an intervention strategy in critical thinking teaching has a considerable amount of impact on cultivating learners’ critical thinking as a whole and has a favorable promotional effect on the two dimensions of critical thinking. According to certain studies, collaborative problem solving, the most frequently used critical thinking teaching strategy in curriculum instruction can considerably enhance students’ critical thinking (e.g., Liang et al., 2017 ; Liu et al., 2020 ; Cindy, 2004 ). This meta-analysis provides convergent data support for the above research views. Thus, the findings of this meta-analysis not only effectively address the first research query regarding the overall effect of cultivating critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills) utilizing the approach of collaborative problem-solving, but also enhance our confidence in cultivating critical thinking by using collaborative problem-solving intervention approach in the context of classroom teaching.

Furthermore, the associated improvements in attitudinal tendency are much stronger, but the corresponding improvements in cognitive skill are only marginally better. According to certain studies, cognitive skill differs from the attitudinal tendency in classroom instruction; the cultivation and development of the former as a key ability is a process of gradual accumulation, while the latter as an attitude is affected by the context of the teaching situation (e.g., a novel and exciting teaching approach, challenging and rewarding tasks) (Halpern, 2001 ; Wei and Hong, 2022 ). Collaborative problem-solving as a teaching approach is exciting and interesting, as well as rewarding and challenging; because it takes the learners as the focus and examines problems with poor structure in real situations, and it can inspire students to fully realize their potential for problem-solving, which will significantly improve their attitudinal tendency toward solving problems (Liu et al., 2020 ). Similar to how collaborative problem-solving influences attitudinal tendency, attitudinal tendency impacts cognitive skill when attempting to solve a problem (Liu et al., 2020 ; Zhang et al., 2022 ), and stronger attitudinal tendencies are associated with improved learning achievement and cognitive ability in students (Sison, 2008 ; Zhang et al., 2022 ). It can be seen that the two specific dimensions of critical thinking as well as critical thinking as a whole are affected by collaborative problem-solving, and this study illuminates the nuanced links between cognitive skills and attitudinal tendencies with regard to these two dimensions of critical thinking. To fully develop students’ capacity for critical thinking, future empirical research should pay closer attention to cognitive skills.

The moderating effects of collaborative problem solving with regard to teaching critical thinking

In order to further explore the key factors that influence critical thinking, exploring possible moderating effects that might produce considerable heterogeneity was done using subgroup analysis. The findings show that the moderating factors, such as the teaching type, learning stage, group size, learning scaffold, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, could all support the cultivation of collaborative problem-solving in critical thinking. Among them, the effect size differences between the learning stage and measuring tool are not significant, which does not explain why these two factors are crucial in supporting the cultivation of critical thinking utilizing the approach of collaborative problem-solving.

In terms of the learning stage, various learning stages influenced critical thinking positively without significant intergroup differences, indicating that we are unable to explain why it is crucial in fostering the growth of critical thinking.

Although high education accounts for 70.89% of all empirical studies performed by researchers, high school may be the appropriate learning stage to foster students’ critical thinking by utilizing the approach of collaborative problem-solving since it has the largest overall effect size. This phenomenon may be related to student’s cognitive development, which needs to be further studied in follow-up research.

With regard to teaching type, mixed course teaching may be the best teaching method to cultivate students’ critical thinking. Relevant studies have shown that in the actual teaching process if students are trained in thinking methods alone, the methods they learn are isolated and divorced from subject knowledge, which is not conducive to their transfer of thinking methods; therefore, if students’ thinking is trained only in subject teaching without systematic method training, it is challenging to apply to real-world circumstances (Ruggiero, 2012 ; Hu and Liu, 2015 ). Teaching critical thinking as mixed course teaching in parallel to other subject teachings can achieve the best effect on learners’ critical thinking, and explicit critical thinking instruction is more effective than less explicit critical thinking instruction (Bensley and Spero, 2014 ).

In terms of the intervention duration, with longer intervention times, the overall effect size shows an upward tendency. Thus, the intervention duration and critical thinking’s impact are positively correlated. Critical thinking, as a key competency for students in the 21st century, is difficult to get a meaningful improvement in a brief intervention duration. Instead, it could be developed over a lengthy period of time through consistent teaching and the progressive accumulation of knowledge (Halpern, 2001 ; Hu and Liu, 2015 ). Therefore, future empirical studies ought to take these restrictions into account throughout a longer period of critical thinking instruction.

With regard to group size, a group size of 2–3 persons has the highest effect size, and the comprehensive effect size decreases with increasing group size in general. This outcome is in line with some research findings; as an example, a group composed of two to four members is most appropriate for collaborative learning (Schellens and Valcke, 2006 ). However, the meta-analysis results also indicate that once the group size exceeds 7 people, small groups cannot produce better interaction and performance than large groups. This may be because the learning scaffolds of technique support, resource support, and teacher support improve the frequency and effectiveness of interaction among group members, and a collaborative group with more members may increase the diversity of views, which is helpful to cultivate critical thinking utilizing the approach of collaborative problem-solving.

With regard to the learning scaffold, the three different kinds of learning scaffolds can all enhance critical thinking. Among them, the teacher-supported learning scaffold has the largest overall effect size, demonstrating the interdependence of effective learning scaffolds and collaborative problem-solving. This outcome is in line with some research findings; as an example, a successful strategy is to encourage learners to collaborate, come up with solutions, and develop critical thinking skills by using learning scaffolds (Reiser, 2004 ; Xu et al., 2022 ); learning scaffolds can lower task complexity and unpleasant feelings while also enticing students to engage in learning activities (Wood et al., 2006 ); learning scaffolds are designed to assist students in using learning approaches more successfully to adapt the collaborative problem-solving process, and the teacher-supported learning scaffolds have the greatest influence on critical thinking in this process because they are more targeted, informative, and timely (Xu et al., 2022 ).

With respect to the measuring tool, despite the fact that standardized measurement tools (such as the WGCTA, CCTT, and CCTST) have been acknowledged as trustworthy and effective by worldwide experts, only 54.43% of the research included in this meta-analysis adopted them for assessment, and the results indicated no intergroup differences. These results suggest that not all teaching circumstances are appropriate for measuring critical thinking using standardized measurement tools. “The measuring tools for measuring thinking ability have limits in assessing learners in educational situations and should be adapted appropriately to accurately assess the changes in learners’ critical thinking.”, according to Simpson and Courtney ( 2002 , p. 91). As a result, in order to more fully and precisely gauge how learners’ critical thinking has evolved, we must properly modify standardized measuring tools based on collaborative problem-solving learning contexts.

With regard to the subject area, the comprehensive effect size of science departments (e.g., mathematics, science, medical science) is larger than that of language arts and social sciences. Some recent international education reforms have noted that critical thinking is a basic part of scientific literacy. Students with scientific literacy can prove the rationality of their judgment according to accurate evidence and reasonable standards when they face challenges or poorly structured problems (Kyndt et al., 2013 ), which makes critical thinking crucial for developing scientific understanding and applying this understanding to practical problem solving for problems related to science, technology, and society (Yore et al., 2007 ).

Suggestions for critical thinking teaching

Other than those stated in the discussion above, the following suggestions are offered for critical thinking instruction utilizing the approach of collaborative problem-solving.

First, teachers should put a special emphasis on the two core elements, which are collaboration and problem-solving, to design real problems based on collaborative situations. This meta-analysis provides evidence to support the view that collaborative problem-solving has a strong synergistic effect on promoting students’ critical thinking. Asking questions about real situations and allowing learners to take part in critical discussions on real problems during class instruction are key ways to teach critical thinking rather than simply reading speculative articles without practice (Mulnix, 2012 ). Furthermore, the improvement of students’ critical thinking is realized through cognitive conflict with other learners in the problem situation (Yang et al., 2008 ). Consequently, it is essential for teachers to put a special emphasis on the two core elements, which are collaboration and problem-solving, and design real problems and encourage students to discuss, negotiate, and argue based on collaborative problem-solving situations.

Second, teachers should design and implement mixed courses to cultivate learners’ critical thinking, utilizing the approach of collaborative problem-solving. Critical thinking can be taught through curriculum instruction (Kuncel, 2011 ; Leng and Lu, 2020 ), with the goal of cultivating learners’ critical thinking for flexible transfer and application in real problem-solving situations. This meta-analysis shows that mixed course teaching has a highly substantial impact on the cultivation and promotion of learners’ critical thinking. Therefore, teachers should design and implement mixed course teaching with real collaborative problem-solving situations in combination with the knowledge content of specific disciplines in conventional teaching, teach methods and strategies of critical thinking based on poorly structured problems to help students master critical thinking, and provide practical activities in which students can interact with each other to develop knowledge construction and critical thinking utilizing the approach of collaborative problem-solving.

Third, teachers should be more trained in critical thinking, particularly preservice teachers, and they also should be conscious of the ways in which teachers’ support for learning scaffolds can promote critical thinking. The learning scaffold supported by teachers had the greatest impact on learners’ critical thinking, in addition to being more directive, targeted, and timely (Wood et al., 2006 ). Critical thinking can only be effectively taught when teachers recognize the significance of critical thinking for students’ growth and use the proper approaches while designing instructional activities (Forawi, 2016 ). Therefore, with the intention of enabling teachers to create learning scaffolds to cultivate learners’ critical thinking utilizing the approach of collaborative problem solving, it is essential to concentrate on the teacher-supported learning scaffolds and enhance the instruction for teaching critical thinking to teachers, especially preservice teachers.

Implications and limitations

There are certain limitations in this meta-analysis, but future research can correct them. First, the search languages were restricted to English and Chinese, so it is possible that pertinent studies that were written in other languages were overlooked, resulting in an inadequate number of articles for review. Second, these data provided by the included studies are partially missing, such as whether teachers were trained in the theory and practice of critical thinking, the average age and gender of learners, and the differences in critical thinking among learners of various ages and genders. Third, as is typical for review articles, more studies were released while this meta-analysis was being done; therefore, it had a time limit. With the development of relevant research, future studies focusing on these issues are highly relevant and needed.

Conclusions

The subject of the magnitude of collaborative problem-solving’s impact on fostering students’ critical thinking, which received scant attention from other studies, was successfully addressed by this study. The question of the effectiveness of collaborative problem-solving in promoting students’ critical thinking was addressed in this study, which addressed a topic that had gotten little attention in earlier research. The following conclusions can be made:

Regarding the results obtained, collaborative problem solving is an effective teaching approach to foster learners’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]). With respect to the dimensions of critical thinking, collaborative problem-solving can significantly and effectively improve students’ attitudinal tendency, and the comprehensive effect is significant (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

As demonstrated by both the results and the discussion, there are varying degrees of beneficial effects on students’ critical thinking from all seven moderating factors, which were found across 36 studies. In this context, the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have a positive impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. Since the learning stage (chi 2  = 3.15, P  = 0.21 > 0.05) and measuring tools (chi 2  = 0.08, P  = 0.78 > 0.05) did not demonstrate any significant intergroup differences, we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving.

Data availability

All data generated or analyzed during this study are included within the article and its supplementary information files, and the supplementary information files are available in the Dataverse repository: https://doi.org/10.7910/DVN/IPFJO6 .

Bensley DA, Spero RA (2014) Improving critical thinking skills and meta-cognitive monitoring through direct infusion. Think Skills Creat 12:55–68. https://doi.org/10.1016/j.tsc.2014.02.001

Article   Google Scholar  

Castle A (2009) Defining and assessing critical thinking skills for student radiographers. Radiography 15(1):70–76. https://doi.org/10.1016/j.radi.2007.10.007

Chen XD (2013) An empirical study on the influence of PBL teaching model on critical thinking ability of non-English majors. J PLA Foreign Lang College 36 (04):68–72

Google Scholar  

Cohen A (1992) Antecedents of organizational commitment across occupational groups: a meta-analysis. J Organ Behav. https://doi.org/10.1002/job.4030130602

Cooper H (2010) Research synthesis and meta-analysis: a step-by-step approach, 4th edn. Sage, London, England

Cindy HS (2004) Problem-based learning: what and how do students learn? Educ Psychol Rev 51(1):31–39

Duch BJ, Gron SD, Allen DE (2001) The power of problem-based learning: a practical “how to” for teaching undergraduate courses in any discipline. Stylus Educ Sci 2:190–198

Ennis RH (1989) Critical thinking and subject specificity: clarification and needed research. Educ Res 18(3):4–10. https://doi.org/10.3102/0013189x018003004

Facione PA (1990) Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. Research findings and recommendations. Eric document reproduction service. https://eric.ed.gov/?id=ed315423

Facione PA, Facione NC (1992) The California Critical Thinking Dispositions Inventory (CCTDI) and the CCTDI test manual. California Academic Press, Millbrae, CA

Forawi SA (2016) Standard-based science education and critical thinking. Think Skills Creat 20:52–62. https://doi.org/10.1016/j.tsc.2016.02.005

Halpern DF (2001) Assessing the effectiveness of critical thinking instruction. J Gen Educ 50(4):270–286. https://doi.org/10.2307/27797889

Hu WP, Liu J (2015) Cultivation of pupils’ thinking ability: a five-year follow-up study. Psychol Behav Res 13(05):648–654. https://doi.org/10.3969/j.issn.1672-0628.2015.05.010

Huber K (2016) Does college teach critical thinking? A meta-analysis. Rev Educ Res 86(2):431–468. https://doi.org/10.3102/0034654315605917

Kek MYCA, Huijser H (2011) The power of problem-based learning in developing critical thinking skills: preparing students for tomorrow’s digital futures in today’s classrooms. High Educ Res Dev 30(3):329–341. https://doi.org/10.1080/07294360.2010.501074

Kuncel NR (2011) Measurement and meaning of critical thinking (Research report for the NRC 21st Century Skills Workshop). National Research Council, Washington, DC

Kyndt E, Raes E, Lismont B, Timmers F, Cascallar E, Dochy F (2013) A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educ Res Rev 10(2):133–149. https://doi.org/10.1016/j.edurev.2013.02.002

Leng J, Lu XX (2020) Is critical thinking really teachable?—A meta-analysis based on 79 experimental or quasi experimental studies. Open Educ Res 26(06):110–118. https://doi.org/10.13966/j.cnki.kfjyyj.2020.06.011

Liang YZ, Zhu K, Zhao CL (2017) An empirical study on the depth of interaction promoted by collaborative problem solving learning activities. J E-educ Res 38(10):87–92. https://doi.org/10.13811/j.cnki.eer.2017.10.014

Lipsey M, Wilson D (2001) Practical meta-analysis. International Educational and Professional, London, pp. 92–160

Liu Z, Wu W, Jiang Q (2020) A study on the influence of problem based learning on college students’ critical thinking-based on a meta-analysis of 31 studies. Explor High Educ 03:43–49

Morris SB (2008) Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods 11(2):364–386. https://doi.org/10.1177/1094428106291059

Article   ADS   Google Scholar  

Mulnix JW (2012) Thinking critically about critical thinking. Educ Philos Theory 44(5):464–479. https://doi.org/10.1111/j.1469-5812.2010.00673.x

Naber J, Wyatt TH (2014) The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Educ Today 34(1):67–72. https://doi.org/10.1016/j.nedt.2013.04.002

National Research Council (2012) Education for life and work: developing transferable knowledge and skills in the 21st century. The National Academies Press, Washington, DC

Niu L, Behar HLS, Garvan CW (2013) Do instructional interventions influence college students’ critical thinking skills? A meta-analysis. Educ Res Rev 9(12):114–128. https://doi.org/10.1016/j.edurev.2012.12.002

Peng ZM, Deng L (2017) Towards the core of education reform: cultivating critical thinking skills as the core of skills in the 21st century. Res Educ Dev 24:57–63. https://doi.org/10.14121/j.cnki.1008-3855.2017.24.011

Reiser BJ (2004) Scaffolding complex learning: the mechanisms of structuring and problematizing student work. J Learn Sci 13(3):273–304. https://doi.org/10.1207/s15327809jls1303_2

Ruggiero VR (2012) The art of thinking: a guide to critical and creative thought, 4th edn. Harper Collins College Publishers, New York

Schellens T, Valcke M (2006) Fostering knowledge construction in university students through asynchronous discussion groups. Comput Educ 46(4):349–370. https://doi.org/10.1016/j.compedu.2004.07.010

Sendag S, Odabasi HF (2009) Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Comput Educ 53(1):132–141. https://doi.org/10.1016/j.compedu.2009.01.008

Sison R (2008) Investigating Pair Programming in a Software Engineering Course in an Asian Setting. 2008 15th Asia-Pacific Software Engineering Conference, pp. 325–331. https://doi.org/10.1109/APSEC.2008.61

Simpson E, Courtney M (2002) Critical thinking in nursing education: literature review. Mary Courtney 8(2):89–98

Stewart L, Tierney J, Burdett S (2006) Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? Publication bias in meta-analysis. John Wiley and Sons Inc, New York, pp. 261–286

Tiwari A, Lai P, So M, Yuen K (2010) A comparison of the effects of problem-based learning and lecturing on the development of students’ critical thinking. Med Educ 40(6):547–554. https://doi.org/10.1111/j.1365-2929.2006.02481.x

Wood D, Bruner JS, Ross G (2006) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

Wei T, Hong S (2022) The meaning and realization of teachable critical thinking. Educ Theory Practice 10:51–57

Xu EW, Wang W, Wang QX (2022) A meta-analysis of the effectiveness of programming teaching in promoting K-12 students’ computational thinking. Educ Inf Technol. https://doi.org/10.1007/s10639-022-11445-2

Yang YC, Newby T, Bill R (2008) Facilitating interactions through structured web-based bulletin boards: a quasi-experimental study on promoting learners’ critical thinking skills. Comput Educ 50(4):1572–1585. https://doi.org/10.1016/j.compedu.2007.04.006

Yore LD, Pimm D, Tuan HL (2007) The literacy component of mathematical and scientific literacy. Int J Sci Math Educ 5(4):559–589. https://doi.org/10.1007/s10763-007-9089-4

Zhang T, Zhang S, Gao QQ, Wang JH (2022) Research on the development of learners’ critical thinking in online peer review. Audio Visual Educ Res 6:53–60. https://doi.org/10.13811/j.cnki.eer.2022.06.08

Download references

Acknowledgements

This research was supported by the graduate scientific research and innovation project of Xinjiang Uygur Autonomous Region named “Research on in-depth learning of high school information technology courses for the cultivation of computing thinking” (No. XJ2022G190) and the independent innovation fund project for doctoral students of the College of Educational Science of Xinjiang Normal University named “Research on project-based teaching of high school information technology courses from the perspective of discipline core literacy” (No. XJNUJKYA2003).

Author information

Authors and affiliations.

College of Educational Science, Xinjiang Normal University, 830017, Urumqi, Xinjiang, China

Enwei Xu, Wei Wang & Qingxia Wang

You can also search for this author in PubMed   Google Scholar

Corresponding authors

Correspondence to Enwei Xu or Wei Wang .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Informed consent

Additional information.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary tables, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Xu, E., Wang, W. & Wang, Q. The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature. Humanit Soc Sci Commun 10 , 16 (2023). https://doi.org/10.1057/s41599-023-01508-1

Download citation

Received : 07 August 2022

Accepted : 04 January 2023

Published : 11 January 2023

DOI : https://doi.org/10.1057/s41599-023-01508-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Impacts of online collaborative learning on students’ intercultural communication apprehension and intercultural communicative competence.

• Hoa Thi Hoang Chau
• Hung Phu Bui
• Quynh Thi Huong Dinh

Education and Information Technologies (2024)

Exploring the effects of digital technology on deep learning: a meta-analysis

Sustainable electricity generation and farm-grid utilization from photovoltaic aquaculture: a bibliometric analysis.

• A. A. Amusa
• M. Alhassan

International Journal of Environmental Science and Technology (2024)

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Advertisement

Communication, Critical Thinking, Problem Solving: A Suggested Course for All High School Students in the 21st Century

• Published: 05 December 2013
• Volume 44 , pages 63–81, ( 2013 )

Cite this article

• Terresa Carlgren 1  

3901 Accesses

23 Citations

Explore all metrics

The skills of communication, critical thinking, and problem solving are essential to thriving as a citizen in the 21st century. These skills are required in order to contribute as a member of society, operate effectively in post-secondary institutions, and be competitive in the global market. Unfortunately they are not always intuitive or simple in nature. Instead these skills require both effort and time be devoted to identifying, learning, exploring, synthesizing, and applying them to different contexts and problems. This article argues that current high school students are hindered in their learning of communication, critical thinking, and problem solving by three factors: the structure of the current western education system, the complexity of the skills themselves, and the competence of the teachers to teach these skills in conjunction with their course material. The article will further advocate that all current high school students need the opportunity to develop these skills. Finally, it will posit that a course be offered to explicitly teach students these skills within a slightly modified western model of education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Speaking Truth to Power: Teaching Critical Thinking in the Critical Theory Tradition

Critical Thinking Across the Curriculum: A Vision

Critical pedagogy: critical thinking as a social practice.

A model of education as organized from western countries such as Canada, Great Britain, the United States, and some European nations by way of organizational structure (identified curricular outcomes, assessment strategies, hierarchical administrative levels).

Immersion in terms of critical thinking instruction refers to “deep, thoughtful, well understood subject-matter instruction in which the students are encouraged to think critically in the subject … but in which general critical thinking principles are not made explicit” (Ennis 1989 , p. 5).

Infusion as it refers to critical thinking involves the explicit instruction of critical thinking principles and strategies in conjunction with the subject material (Ennis 1989 , p. 5).

5 credit course as per government of Alberta standards (Alberta, Canada), http://education.alberta.ca/media/6719891/guidetoed2012.pdf , p. 42.

See basic structure of Alberta Education curriculum. Example from Science 10; http://education.alberta.ca/media/654833/science10.pdf .

Note: the curricular framework for this course is modelled after that of some curriculum in Alberta (Alberta Education 2005 ).

Alberta Education. (2005). Science 10 . Retrieved from http://education.alberta.ca/media/654833/science10.pdf .

Alberta Education. (2008). Mathematics grades 10–12 . Retrieved from http://education.alberta.ca/media/655889/math10to12.pdf .

Alberta Education. (2012). Guide to education: ECS to grade 12 . Retrieved from http://educaiton.alberta.ca/media/6719891/guidetoed2012.pdf .

Alliance for Excellent Education. (2011). A time for deeper learning: Preparing students for a changing world. Education Digest, 77 (4), 43–49. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=5&hid=12&sid=9695cbbb-ab96-496a-941e-35fa2bee2852%40sessionmgr4 .

Berger, E. B., & Starbird, M. (2012). The 5 elements of effective thinking . Princeton, NJ: Princeton University Press.

Google Scholar  

Brookfield, S. D. (1995). Becoming a critically reflective teacher . San Francisco: Jossey-Bass Inc.

Conley, D. T., & McGaughy, C. (2012). College and career readiness: Same or different? Educational Leadership, 69 (7), 28–34. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=4&hid=12&sid=9695cbbb-ab96-496a-941e-35fa2bee2852%40sessionmgr4 .

Covey, S. (2004). The 7 habits of highly effective people: Restoring the character ethic . New York: Simon & Schuster.

Crenshaw, P., Hale, E., & Harper, S. L. (2011). Producing intellectual labour in the classroom: The utilization of a critical thinking model to help students take command of their thinking. Journal of College Teaching & Learning, 8 (7), 13–26. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=3&sid=333f52c4-101e-4d9f-89e7-1088c51b14e7%40sessionmgr15&hid=19 .

Dobozy, E. (2012). Failed innovation implementation in teacher education: A case analysis. Problems of Education in the 21st Century, 40 , 35–44. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=4&sid=333f52c4-101e-4d9f-89e7-1088c51b14e7%40sessionmgr15&hid=19 .

Ennis, R. H. (1989). Critical thinking and subject specificity: Clarification and needed research. Educational Researcher, 18 (3), 4–10. Retrieved from http://www.jstor.org.ezproxy.lib.ucalgary.ca/stable/pdfplus/1174885.pdf?acceptTC=true .

Ennis, R. H., & Millman, J. (1985). Cornell critical thinking test level x . Pacific Grove, CA: Midwest Publications.

Greenstein, L. (2012). Assessing 21st century skills: A guide to evaluating mastery and authentic learning . Thousand Oaks, CA: Corwin.

Holloway-Libell, J., Amrein-Beardsley, A., & Collins, C. (2012). All hat & no cattle. Educational Leadership, 70 (3), 65–68. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?sid=ec665c98-aef1-44e8-8737-016b87157907%40sessionmgr13&vid=5&hid=1 .

Johanson, J. (2010). Cultivating critical thinking: An interview with Stephen Brookfield. Journal of Developmental Education, 33 (3), 26–30. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=14&sid=333f52c4-101e-4d9f-89e7-1088c51b14e7%40sessionmgr15&hid=19 .

Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments . New York: Routledge.

Jonassen, D. H. (2012). Designing for decision making. Educational Technology Research and Development, 60 (2), 341–359. doi: 10.1007/s11423-011-9230-5 .

Article   Google Scholar  

Kassim, H., & Fatimah, A. (2010). English communicative events and skills needed at the workplace: Feedback from the industry. English for Specific Purposes, 29 (3), 168–182. Retrieved from http://www.sciencedirect.com.ezproxy.lib.ucalgary.ca/science/article/pii/S0889490609000635 .

Kirikkaya, E. B., & Bozurt, E. (2011). The effects of using newspapers in science and technology course activities on students’ critical thinking skills. Eurasian Journal of Educational Research, 44 , 149–166. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=3&sid=2e1f2c2a-6199-4516-a3d0-5114f7c35314%40sessionmgr15&hid=19 .

Paige, M. (2012). Using VAM in high stakes employment decisions. Phi Delta Kappan, 94 (3), 29–32.

Passini, S. (2013). A binge-consuming culture: The effect of consumerism on social interaction in western societies. Culture & Psychology, 19 (3), 369–393. doi: 10.1177/1354067x13489317 .

Patterson, K., Grenny, J., & McMillan, R. (2011). Crucial conversations: Tools for talking when stakes are high (2nd ed.). New York: McGraw-Hill Companies, Inc.

Paul, R., & Elder, L. (2008). The miniature guide to critical thinking concepts and tools (5th ed.). Dillon Beach, CA: The Foundation for Critical Thinking.

Raybould, J., & Sheedy, V. (2005). Are graduates equipped with the right skills in the employability stakes? Industrial and Commercial Training, 37(4/5), 259–263. Retrieved from http://search.proquest.com.ezproxy.lib.ucalgary.ca/docview/214105484/fulltextPDF/13C3AF7848A26CBC442/26?accountid=9838 .

Richardson, J. (2011). Tune into what the new generation of teachers can do. Phi Delta Kappan, 92 (4), 14–19.

Robinson, K. (2011). Out of our minds . Chichester, West Sussex: Capstone Publishing Ltd.

Rosefsky, S., & Opfer, D. (2012). Learning 21st-century skills requires 21st-century teaching. Phi Delta Kappan, 94 (2), 8–13.

Sahlberg, P. (2006). Education reform for raising economic competitiveness. Journal of Educational Change, 7 , 259–287. doi: 10.1007/s10833-005-4884-6 .

Schleicher, A. (Ed.) (2012). Preparing teachers and developing school leaders for the 21st century: Lessons from around the world . Retrieved from http://site.ebrary.com.ezproxy.lib.ucalgary.ca/lib/ucalgary/docDetail.action?docID=10589565 .

Sherblom, P. (2010). Creating critically thinking educational leaders with courage, knowledge and skills to lead tomorrow’s schools today. Journal of Practical Leadership, 5 , 81–90. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=11&hid=12&sid=9695cbbb-ab96-496a-941e-35fa2bee2852%40sessionmgr4 .

Spencer, J. T. (2013). I’m a better teacher when students aren’t tested. Phi Delta Kappan, 94 (5), 72–73.

Tsang, K. L. (2012). Development of communication skills using an embedded approach for the evolving professional. The International Journal of Learning, 18 (3), 203–221. Retrieved from http://web.ebscohost.com.ezproxy.lib.ucalgary.ca/ehost/pdfviewer/pdfviewer?vid=3&sid=924c3e4d-4fa2-4f95-a769-cbd05ada6724%40sessionmgr4&hid=28 .

Williamson, P. K. (2011). The creative problem solving skills of arts and science students—The two cultures debate revisited. Thinking Skills and Creativity, 6 , 31–43. doi: 10.1016/j.tsc.2010.08.001 .

Download references

Author information

Authors and affiliations.

University of Calgary, Calgary, AB, Canada

Terresa Carlgren

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Terresa Carlgren .

Course Syllabus and Outline

Title: Communication, Critical Thinking, and Problem Solving (an introduction)

Course Components

No exclusionary, discriminatory, or derogatory material will be taught in this course, nor will the content in this course be deemed controversial in any way.

Philosophy and Rationale

Much of our thinking, left to itself, is biased, distorted, partial, uniformed or down-right prejudiced. Yet the quality of our life and that of what we produce, make, or build depends precisely on the quality of our thought. Shoddy thinking is costly, both in money and in quality of life. Excellence in thought, however, must be systematically cultivated (Paul and Elder 2008 , p. 2).

The skills required of today’s youth are more pronounced than that of the past. Students are required to have basic knowledge of content in areas of Science, Math, and English; as well as technological skills, problem solving skills, critical thinking skills, and the ability to communicate (Sahlberg 2006 ). However, with the time constraints placed on teachers, knowledge outcomes taking priority on learning due to the high stakes standardized achievement tests, and an understanding that the particular skills of communication, critical thinking, and problem solving require explicit instruction (Rosefsky and Opfer 2012 ); students are not mastering these skills to an acceptable standard.

In order for students to acquire and master the skills necessary to compete and be successful in the work force, post secondary education, and life; students must have the opportunity to engage by learning these skills through practice, application, and devoted explicit attention. Furthermore, students must explore these skills without fear of failure but rather with hope that they can improve and move forward from the learning experience. In this way, learning these skills as a secondary item within the context of another content based course will not do the students justice.

Historically, the skills of sewing, cooking, woodworking, and mechanics where offered in high school as application based courses that required hands on and explorative learning with teacher guidance. More recently computer courses, and digital citizenship are taking hold in schools to teach students these skills. There is no reason why the skills of communication, critical thinking, and problem solving should be treated any differently.

Without the structure and organization of education making drastic changes to mandate these skills be made more of a priority in the classroom, it is feared that the teaching and learning of these skills will remain an oversight. It is unfortunate that the students; citizens, economic and market contributors of our future, will be underserved. It is with these reasons that this course offering takes place; such that an opportunity within the current educational structure can provide students the opportunity to guard themselves with new foundational skills for the future.

General Learner Expectations

By the end of this course, it is expected learners will have developed and ascertained explicit knowledge of communication, critical thinking and problem solving. More importantly, students will have acquired the skills of communication, critical thinking, and problem solving through application, exploration, and trial and error, such that they can utilize these skills in different contexts of their lives in preparation for the work force or post-secondary education.

Specific Learner Expectations

The following is a list of specific learner expectations for the course. Please note that the units identified for this course are titled ‘Skill-sets’ for a reason as they are not discrete topics to be taught in isolation, but rather guides toward the encompassing theme of acquiring these skills. This course is in no way designed as a check the outcome box course, nor is it organized in order by skill or outcome number. Rather, the outcomes and skill-sets must be taught in conjunction with each other through the duration of the course with trust being given to the fact that through student exploration and leadership; along side teacher guidance and facilitation, students will improve on their existing skill-set for these skills.

Skill Set A: Critical Thinking Skills Footnote 6

Knowledge Outcomes: (Students will be able to)

A.K.1 Define the difference between fact and inference.

A.K.2 Derive criteria for which to judge a problem or predicament.

A.K.3 List the elements of thought associated with critical thinking as per one critical thinking model (Paul and Elder, Rusten and Schuman).

A.K.4 Identify inherent and hidden bias in an argument.

A.K.5 Identify faults in thinking due to oversimplifying or over generalizing issues or problems.

A.K.6 Identify and state the purpose of thinking.

Skill Outcomes: (Students will be able to)

A.S.1 Utilize background knowledge to solve a problem or predicament.

A.S.2 Apply evidence to solve a problem or predicament.

A.S.3 Express an argument that is logical, clear, and concise.

A.S.4 Derive and model a process by which to critically analyze, think, and solve a problem or predicament that involves a reasonable, logical, and relevant thinking strategy.

A.S.5 Explore alternative options and methods before drawing a conclusion.

A.S.6 Illustrate and explore the consequences and implications following the solution of a problem or issue.

A.S.7 Model, display, or perform the ability to think critically through verbal, written, and physical means.

Attitudes Outcomes: (Students will)

A.A.1 Believe that it is possible for themselves to solve problems with a reasonable level of confidence.

A.A.2 Have confidence that they are able to ascertain information needed to help themselves think critically about a problem or issue.

A.A.3 Respect the diverse nature of thinking and problem solving that allows for others’ opinions and arguments to be taken into account without discrimination.

Skill Set B: Problem Solving Skills

B.K.1 Define convergent and divergent thinking.

B.K.2 State that for any given problem there is more than one problem solving strategy.

B.K.3 List possible problem solving strategies that exist.

B.K.4 State that problem solving strategies are used in context and explore the types of contexts that might exist.

B.K.5 Identify that for any problem solving strategy there must be an evaluative component and an ability to modify the strategy to fit a new context or problem.

B.S.1 Derive and model, illustrate, or describe a problem solving strategy that is context specific.

B.S.2 Derive and model a personal problem solving strategy to solve a personal problem.

B.S.3 Solve problems using mathematical reasoning.

B.S.4 Solve problems using technological means or supports.

B.S.5 Solve problems by modeling existing economic structures.

B.S.6 Solve problems by modeling existing political structures.

B.A.1 Have improved self-confidence in attempting to solve problems in a number of different contexts.

B.A.2 Be proud of the problem solving ability they have acquired.

B.A.3 Feel empowered to attempt new problem solving methods that are logical and relevant without fear of failure.

Skill Set C: Decision Making Skills

C.K.1 Identify that decision making is a process toward problem solving.

C.K.2 Identify personal bias in an argument.

C.K.3 State the difference between dialectic and rhetorical arguments.

C.K.4 Illustrate the types of decisions expected in personal, professional, and civic lives.

C.K.5 Describe the difference between rational and emotional expressions.

C.K.6 State and explain the difference between normative and naturalistic decision making.

C.K.7 Define the term dilemma.

C.K.8 State that the primary purpose of decision making is to decide on the best option, or provide maximum utility.

C.K.9 State that decision making can be made based on what is most consistent with personal beliefs or past experiences.

C.K.10 Identify that there is uncertainty and risk associated with every decision.

C.S.1 Construct a decision making process that includes identification, evidence, evaluation and modification of a problem.

C.S.2 Construct and apply a method of decision making to solve personal problems.

C.S.3 Construct and apply a method of decision making to solve professional problems.

C.S.4 Construct and apply a method of decision making to solve civic problems.

C.S.5 Examine positive and negative methods of modifying and changing decisions after they have been made.

C.S.6 Examine circumstances by which to modify, change, or renegotiate a decision.

Attitude Outcomes: (Students will)

C.A.1 Acknowledge that a commitment needs to be made upon making a decision.

C.A.2 Take ownership of decisions made using the decision making skills.

C.A.3 Understand that decisions require a course of action that is intended to yield results that are satisfying for special individuals.

C.A.4 Reflect on decisions made in their life and decide if they were appropriate or not.

Skill Set D: Communication Skills

Knowledge outcomes: (students will be able to).

D.K.1 Identify factors affecting communication.

D.K.2 State that communication involves more than one person.

D.K.3 Identify and explore the roles of speaker and listener in any conversation.

D.K.4 List and explore different environments involving communication (i.e.; formal language vs. slang, workplace vs. home life).

D.K.5 Describe the difference between teamwork and collaboration.

D.K.6 Describe what effective and ineffective communication looks, sounds, and feels like.

D.K.7 Explain the role of respect, honesty, fairness, and reason in any communication interaction.

D.S.1 Model and illustrate different conflict resolution strategies.

D.S.2 Identify and illustrate factors affecting teamwork.

D.S.3 Communicate effectively with peers while working collaboratively as a team.

D.S.4 Communicate effectively with teachers and parents regarding conflicts and successes.

D.S.5 Communicate clearly, logically, and precisely in verbal and written modes.

D.S.6 Ask and accept help in communicating when needed.

D.A.1 Feel empowered to communicate with peers.

D.A.2 Have confidence in the skill of communicating to discuss difficult issues with parents, teachers, and employers.

D.A.3 Feel empowered to ask and accept help by communicating in an appropriate fashion without fear of rejection or judgment.

Course Assessment

The assessment for this course is by way of individual student improvement in conjunction with final skill aptitude of the above stated skill sets by course end. This improvement and aptitude can be measured through a number of different means and will depend on the structure of the course as arranged and organized by the teacher. Outlined below are some classroom activities and possible assessments that might be of benefit to teachers planning this course.

Activities:

A pre and post written statement of the intention for being in the course and the problems and skills a student would like to solve and understand.

Assessed formatively (both pre and post) for critical thinking skills such as clarity of work, logic, reasoning, and evidence provided.

Pre and post formative assessments then evaluated for level of improvement.

Debate as a form of argument, decision making, communication and problem solving.

Following and respecting debate rules and roles of speaker/listener.

Utilizing rubrics for argument, decision making, communication and problem solving.

Market modeling—modeling the course as a competitive market with students given roles based on an application from them on their expertise and motivation toward the given problem. The roles would dictate a level of income for the student as well as a level of responsibility and leadership for them.

Assessed by way of improvement and movement ‘up the market ladder’—i.e.—what by way of promotion, what conflict resolution strategies or problems needed to be overcome, how long did it take to resolve or solve the problem?

Take into account rationale for why students have chosen their particular role (provided this rationale is given in a clear, appropriate, relevant, and significant manner)—i.e. standard of living, other priorities at the time etc.

Socratic Seminar on issue at hand to interpret and illustrate improvement in speaking and communicating an argument.

Assessed by way of quality and strength of participation and argument.

Resume of students skills ascertained and improved on through the course.

Cross curricular problems and projects modeling real life i.e. effects of globalization, and marketization on students by multinational companies. Projects to be displayed and presented to the class.

Assessed by way of rubrics (teacher and peer).

Likert scale survey for teacher and student on level of improvement of outcomes throughout the course.

Utilization of pre-existing rubrics i.e. Decision Making (Jonassen 2012 ).

Cornell CT Test level X for critical thinking as a pre and post test? (a quantitative assessment ordered from http://www.criticalthinking.com/getProductDetails.do?code=c&id=05501 ) (Ennis and Millman 1985 ).

Assessment strategies as well as possible outcomes for skill-sets can be found in Greenstein’s ( 2012 ), Assessing 21st Century Skills: A guide to evaluating mastery and authentic learning .

It is expected that all students will learn skill-set outcomes through the duration of the course. The question is how much will be learned? The answer depends on the individual student as well as their incoming skill level in each given area. In this case equal does not mean equitable and the goal of assessment for this course is to ascertain what improvement as well as final level of understanding an individual student has.

It should be stated that the nature of the course is student-centered and driven by the student. The teacher, however, is responsible for setting up the course and providing students an opportunity to explore this learning. Therefore, the teacher must come up with valid, rich, open activities for students to work within while at the same time ideally allowing the students to come up with the problems, scenarios, and arguments with which to discuss and solve. Explicit instruction may be necessary but should be severely limited allowing students ample opportunity for application and practice.

It is highly recommended that students work the duration of this course in groups (and differing groups) as it is here that communication, collaboration, and teamwork skills will be developed. It is further recommended that students be a part of the assessment process in deciding on the nature of the assessments, the criteria for the assessment, and in self and peer assessment. Allowing students to direct and lead requires trust and openness on the part of the teacher but is in fact part of the learning process.

Learning Resources

Since the premise of this course is for the teacher to be a ‘guide on the side’ and not a ‘sage on the stage’, there are no required learning resources for this course. However, it is recommended that teachers undertake professional development in the skill-set areas to ensure they have developed the necessary skills to pass on. Books such as: Becoming a Critically Reflective Teacher by Brookfield, Learning to Solve Problems: A Handbook for Designing Problem - Solving Learning Environments by Jonassen, 7 Habits of Highly Effective People , Crucial Conversations, and The 5 Elements of Effective Thinking would be an introduction. Journal articles and professional publications regarding 21st century skills and the development of these would be helpful. Finally, professional development seminars or sessions by leading experts such as Richard Paul from The Foundation for Critical Thinking would be almost necessary.

From this learning, the teacher will need to develop a tool kit of resources at their disposal in which to best help their students. The nature of the course being student-centered will require a teacher to be flexible in the work that is undertaken. The teacher will also have to be reactive to issues, problems, and learning scenarios that take place in the classroom. However, as this is a course in allowing the students to ascertain skills in problem solving, critical thinking, and communication, it must be mentioned that it is the students who are doing the brunt of the work and actually doing the problem solving and critical thinking themselves. For instance, it would not be sufficient for a question to be: What book should we read to learn critical thinking? And have the answer to the problem be: go ask the teacher and he/she will tell us. Rather the answer should be: let us go to the library or use the internet and find out which book is the best book. What options are available? What type of critical thinking are we looking at? What is critical thinking? Who are the leading experts in the field? What bias do they have? Where can I actually find or order these books? What cost and what is my budget? In the end, a seemingly simple question—is wrought with learning experiences by the student provided the teacher take a backburner to the work and allow the student to take the reins.

Course Evaluation

The open nature of this course allows for a teacher at any time to make changes to the structure, organization, and assessment of the course due to evaluation and reflection. The evaluation and reflection of this course should therefore be ongoing by the student and teacher immersed in the learning environment. The teacher is responsible for periodically seeking feedback from students regarding the nature of the course, as well as professionally reflecting themselves on the presentation of the course to their students.

The teacher is also responsible for keeping records of the course, as well as feedback collected that identifies the (a) strengths and weaknesses of the course as it is being facilitated, (b) activities and assessments being implemented in the course, and (c) improvements to the course for a later date. The teacher should ideally create a long range plan (or running calendar) that becomes more descriptive as the course proceeds, about the level of difficulty, quality of problems, activities, resources, feedback, and assessments being utilized in the course to reference at a later date. Finally, the teacher should be able to provide evidence to the local school authority at any time in order for the authority to monitor, evaluate, and report progress should it be required.

Rights and permissions

Reprints and permissions

About this article

Carlgren, T. Communication, Critical Thinking, Problem Solving: A Suggested Course for All High School Students in the 21st Century. Interchange 44 , 63–81 (2013). https://doi.org/10.1007/s10780-013-9197-8

Download citation

Received : 19 April 2013

Accepted : 21 November 2013

Published : 05 December 2013

Issue Date : December 2013

DOI : https://doi.org/10.1007/s10780-013-9197-8

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Communication
• Critical thinking
• Global market
• High school course
• Problem solving
• Western model of education
• 21st Century
• Find a journal
• Publish with us
• Track your research

Online Students

For All Online Programs

International Students

On Campus, need or have Visa

Campus Students

For All Campus Programs

Communication in IT: Why Soft Skills Matter

If you’re working toward a job writing code or managing cybersecurity for an organization, you’ve likely explored the technical skills you’ll need to succeed. But while tech skills are essential, there’s also a growing focus on the value of soft skills, such as communication, to break into the tech field .

“Not only are soft skills important , I think they’re more important than technical skills,” said Laurel Schneider , an adjunct information technology (IT) instructor at Southern New Hampshire University (SNHU). “I’ve hired and managed hundreds of people over my career. The technical skills may get you the interview, but it is the soft skills that get you the job.”

Schneider is not alone. Employers across many industries named soft skills such as dependability, collaboration, flexibility and problem-solving as the top skills they want in employees, according to a report from Monster .

These skills have become increasingly necessary in the field of IT, which has become a more integral part of strategic business planning and operations in recent years.

Are you considering a career in IT ? Explore some of the top soft skills IT professionals need to succeed in the workforce as well as discover what soft skills really are.

What Are Soft Skills in the IT World?

Soft skills are the non-technical human skills needed in every job across every industry. Communication, problem-solving, critical thinking, analysis, perseverance and creativity are all considered soft skills.

Technical skills like coding and programming  are critical to success in IT roles. But without strong soft skills, even highly skilled workers can struggle in today’s workforce, said Schneider.

“You can be the best coder in the world, but if you can’t get on (a) call or be in a meeting with a customer and work through an issue and not lose your temper or sound condescending, then you’re not going to do well on a team,” she said.

What is the Role of Communication in IT?

While entry-level jobs may focus more on administrative tasks like managing passwords, supporting technological infrastructure or fixing computers, IT employees play a strategic role in business everywhere.

IT positions can be viewed as vital business partners and have been in higher organizational conversations. In order for IT roles to have those conversations, they need to have the soft skills to explain how technological solutions bring value to an organization.

Soft skills are critical to pursuing leadership roles in an IT department or company, said Daniel Hawkins , an adjunct IT instructor at SNHU. IT leaders often spend a lot more time collaborating with multiple departments and with other business leaders than sitting behind a computer.

“Moving away from the keyboard means that the IT professional starts having people work for them,” said Hawkins. “It also means working in teams, which is very collaborative. As the IT professional grows, that team collaboration evolves into leadership roles, which guides the teams to where they need to be.”

Learn how to become an IT manager .

What Soft Skills Are Needed in IT?

So, what soft skills do you need to work in today’s evolving IT environment? While communication in IT is one of the most commonly sought-after, the list of must-have soft skills is long.

Here are eight of the soft skills you'll use in an IT career.

1. Communication

When you work in IT, it’s not enough to simply understand and use your technical skills to solve problems or create opportunities for your company. You also need to be able to communicate those efforts to key stakeholders.

Depending on the project you’re working on or the role you play in the business, those stakeholders could be anyone from an end-user to a company leader.

You'll need to adapt your communication for a variety of different audiences. You can be an extremely skilled IT professional who does great work, but if you aren't able to communicate your ideas effectively to others, then your ideas may have diminished value.

2. Collaboration

When you work in IT, you may find yourself working in a team of other technology professionals. You might also have consistent contact with customers, other departments or even top executives.

Being able to work well with a variety of people from different professional experiences is key to success in this environment, said Schneider.

“It doesn’t matter where you work or if your job is customer-facing,” she said. “If you work in IT, you interface with everybody.”

3. Organization

IT professionals can end up managing many projects, tasks and problems all at once. Because of all of this multitasking, good organizational skills are valuable soft skills for IT workers.

Being organized can make you more efficient and productive at work and help you prioritize your daily tasks better, according to global tech association CompTIA .

4. Problem-solving

So much of the work done by IT departments is problem-solving. Whether you're integrating new code to fix a bug in software, creating a new cybersecurity program or responding to a hack, you'll have to utilize problem-solving skills to find innovative salutations to your issue.

These problem-solving skills are valuable and can tie in with other soft skills such as collaboration and communication, as you may have to work with others to receive their input, brainstorm and problem-solve together.

5. Analytical Thinking

Before you can successfully solve a problem, you need to analyze it from all angles and diagnose any technology issues. IT professionals with strong analytical skills can do this work more easily, even spotting potential problems before they arise.

"Being analytical gives you a major edge in IT, where you're expected to find logical solutions to problems frequently," according to CompTIA.

6. Creativity

IT may not be commonly considered an art, but solving IT problems often requires a lot of creativity, said Schneider. With a job in IT, you'll be challenged to come up with creative solutions, workarounds and fixes to keep business moving forward in the face of technical challenges.

“I can’t think of another field that uses creativity more,” Schneider said. “Without creativity, there is no innovation. And what is IT? It’s innovation.”

7. Perseverance

Just like creativity is required to solve IT problems, perseverance is another soft skill you’ll need to leverage often to be successful in this field. When you’re troubleshooting an IT issue, it’s not uncommon to have to rule out many potential causes before fixing a problem.

“The answer is almost never the first thing you tried,” said Schneider. “You have no choice but to persevere until you do have the answer.”

8. Resourcefulness

Resourcefulness is almost as important as communication in IT. You will need to be resourceful to solve new problems and learn new skills throughout your career.

IT professionals who know how to use available resources and seek out new ones are typically the most successful, according to CompTIA. Resourcefulness ensures that even if you don't know the answer to a problem, you do know how to find it.

How to Build Soft Skills in IT

Building soft skills starts during your IT degree program. While many IT degrees focus most of their coursework on building technical skills, some programs do put a lot of emphasis on soft skills development as well, said Schneider.

At SNHU, for example, an IT bachelor's degree program includes classes dedicated to communication in STEM professions, as well as courses related to project management, leadership and more.

Degree programs can also provide other natural opportunities for soft skills development. Assignments such as class discussions, group projects and peer review opportunities are all great ways to learn how to communicate complex ideas, work collaboratively and even disagree respectfully.

But while building soft skills during a degree program is important, Hawkins said, a lot of soft skill development happens on the job — and continues throughout your career.

“I believe that soft skills are actually something that you grow into as you work in the profession and learn more about yourself and how to communicate with others,” he said. “Soft skills get better with age and a lot of bumps along the way.”

How to Use Communication in IT to Get a Job

Because communication and other soft skills are in high demand in the IT field, they play an important role in helping you land your dream job.

Schneider said it starts by using soft skills to stand out during the application and interview process . Make sure that your resume is well-written  and that any written communication you have with company representatives is professional and clear. Then, prepare to discuss examples of your soft skills during the interview.

“The best way to demonstrate soft skills is to just be really prepared for the interview. That’s where you’re going to shine,” Schneider said. “Everybody in the waiting room has the technical skills. If they didn’t, they wouldn’t be sitting there. What will distinguish you from someone else is the soft skills.”

And if a long, successful career in IT is your goal, it’s also important to find a job that makes you happy and fulfilled, said Hawkins. Doing so can also give your soft skills a boost.

“Soft skills come about and improve with practice and making mistakes along the way,” Hawkins said. “It is far easier to develop soft skills when it is something that you like and are motivated by.”

Discover more about SNHU's IT degree online : Find out what courses you'll take, skills you'll learn and how to request information about the program.

Danielle Gagnon is a freelance writer focused on higher education. Connect with her on LinkedIn .

Explore more content like this article

Is a Cybersecurity Degree Worth It?

What Does a Data Analyst Do?

What Can You Do With an Associate Degree in Information Technology?

About southern new hampshire university.

SNHU is a nonprofit, accredited university with a mission to make high-quality education more accessible and affordable for everyone.

Founded in 1932, and online since 1995, we’ve helped countless students reach their goals with flexible, career-focused programs . Our 300-acre campus in Manchester, NH is home to over 3,000 students, and we serve over 135,000 students online. Visit our about SNHU  page to learn more about our mission, accreditations, leadership team, national recognitions and awards.

Problem-Solving Olympiad Puts Power Skills to the Test

• Share article

The inaugural NXTLVL Problem-Solving Olympiad brought students together online for a day of spirited competition, pushing them to their true potential. Middle school problem-solvers from four continents, including three of the top ten virtual schools ranked by World Schools, navigated complex challenges in teams. These challenges tested timeless Power Skills like creativity, critical thinking, collaboration, communication, emotional intelligence, and resilience.

NXTLVL is a pioneering edtech program that helps students develop Power Skills, preparing them for a rapidly evolving world driven by AI advancements and scientific innovations. Our game-based learning approach combines team challenges with expert coaching, equipping students with the skills needed to take on anything.

Many progressive schools, like those attending the Olympiad, are integrating competency-based education into their curricula, focusing on Power Skills to prepare their students for school, work and life.

Gabriel Hernandez, Director of Technology at our champion school Alverno Heights Academy believes “participation in such interactive activities not only enriches students’ learning experiences but also helps them develop essential skills that are beneficial for their personal and academic growth.”

The new Problem-Solving Olympiad offers an extraordinary learning environment for tomorrow’s problem-solvers to stretch their Power Skills by collaborating under pressure.

Power Skill award winners

To emphasize the importance of Power Skills, we rewarded exceptional examples.

The Emotional Intelligence Award went to Minerva’s Virtual Academy, a globally recognized online school based in the UK, for “anticipating the needs and strategies of allies and opponents to navigate conflicts.”

Williamsburg Academy of Colorado picked up the Resilience Award for “perseverance in pushing through setbacks without losing momentum.”

Laurel Springs School earned the Critical Thinking Award for “demonstrating exceptional analytical thinking, decoding complex problems with logical and strategically sound solutions.”

The Communication and Creativity Awards went to the Prisma Online School for “mastering divergent thinking, consistently generating and synthesizing innovative ideas, while communicating them clearly.”

The Champions

We witnessed the peak of escalating intensity in the Championship Level as four teams battled it out for the main prize. Fourth place went to Prisma Online School, third place to Hill Top Preparatory School, and second place to Minerva’s Virtual Academy.

Our overall champions were a team from Alverno Heights Academy, an independent Catholic school from California. They epitomized teamwork, securing the Power Skill Award for collaboration. With a perfect balance of leadership and emotional intelligence, they leveraged each other’s diverse skills and perspectives. Their dynamism and synchronicity were evident from start to finish. Worthy winners indeed.

Hernandez added, “This Olympiad provides a unique platform for students to engage in communication and critical thinking skills, which are essential in today’s educational landscape. While traditional sports often focus on teamwork and collaboration, this competition allows educators to reach a broader spectrum of students and foster these important skills collectively.”

One of the Alverno Heights Academy students emphasized the importance of “teamwork, communication, and lots of planning before each round,” which was key to their success.

The ultimate contest of wits

The Olympiad was a breathtaking experience. The speed at which all teams adapted to the surmounting challenges reminded us of what students are capable of when given the right platform. In just five hours, students transformed from being curious but uncertain to astute problem-solving teams.

Initially, they dove in without knowing the rules, requiring them to decode the game, develop hypotheses, and fine-tune their tactics. As the game evolved, they had to rework their strategies and adapt on the fly. This journey through failure, setbacks, and upended strategies led them to a finish line where the sweetness of victory was palpable.

The next level

Building on the success of the May event, we’re excited to announce the November Olympiad, which promises to be even more spectacular, expanding over multiple days to welcome more schools.

With early bird access, it’s free for the first four teams until July 1st.

Click here to register and give your students a head start on the future.

We extend a heartfelt thank you to the Elite Academic Academy for their invaluable support in hosting the event and the other schools that made it possible.

Alverno Heights Academy Boston College High School Colégio Bento Benedini Hill Top Preparatory School Laurel Springs School Leadership Academy of Utah Mesa Public Schools Minerva’s Virtual Academy Prisma Online School Repton Abu Dhabi Repton Al Barsha Repton Dubai Williamsburg Academy Williamsburg Academy of Colorado

Sign Up for EdWeek Tech Leader