importance of literature review with examples

Get science-backed answers as you write with Paperpal's Research feature

What is a Literature Review? How to Write It (with Examples)

literature review

A literature review is a critical analysis and synthesis of existing research on a particular topic. It provides an overview of the current state of knowledge, identifies gaps, and highlights key findings in the literature. 1 The purpose of a literature review is to situate your own research within the context of existing scholarship, demonstrating your understanding of the topic and showing how your work contributes to the ongoing conversation in the field. Learning how to write a literature review is a critical tool for successful research. Your ability to summarize and synthesize prior research pertaining to a certain topic demonstrates your grasp on the topic of study, and assists in the learning process. 

Table of Contents

  • What is the purpose of literature review? 
  • a. Habitat Loss and Species Extinction: 
  • b. Range Shifts and Phenological Changes: 
  • c. Ocean Acidification and Coral Reefs: 
  • d. Adaptive Strategies and Conservation Efforts: 

How to write a good literature review 

  • Choose a Topic and Define the Research Question: 
  • Decide on the Scope of Your Review: 
  • Select Databases for Searches: 
  • Conduct Searches and Keep Track: 
  • Review the Literature: 
  • Organize and Write Your Literature Review: 
  • How to write a literature review faster with Paperpal? 
  • Frequently asked questions 

What is a literature review?

A well-conducted literature review demonstrates the researcher’s familiarity with the existing literature, establishes the context for their own research, and contributes to scholarly conversations on the topic. One of the purposes of a literature review is also to help researchers avoid duplicating previous work and ensure that their research is informed by and builds upon the existing body of knowledge.

importance of literature review with examples

What is the purpose of literature review?

A literature review serves several important purposes within academic and research contexts. Here are some key objectives and functions of a literature review: 2  

1. Contextualizing the Research Problem: The literature review provides a background and context for the research problem under investigation. It helps to situate the study within the existing body of knowledge. 

2. Identifying Gaps in Knowledge: By identifying gaps, contradictions, or areas requiring further research, the researcher can shape the research question and justify the significance of the study. This is crucial for ensuring that the new research contributes something novel to the field. 

Find academic papers related to your research topic faster. Try Research on Paperpal  

3. Understanding Theoretical and Conceptual Frameworks: Literature reviews help researchers gain an understanding of the theoretical and conceptual frameworks used in previous studies. This aids in the development of a theoretical framework for the current research. 

4. Providing Methodological Insights: Another purpose of literature reviews is that it allows researchers to learn about the methodologies employed in previous studies. This can help in choosing appropriate research methods for the current study and avoiding pitfalls that others may have encountered. 

5. Establishing Credibility: A well-conducted literature review demonstrates the researcher’s familiarity with existing scholarship, establishing their credibility and expertise in the field. It also helps in building a solid foundation for the new research. 

6. Informing Hypotheses or Research Questions: The literature review guides the formulation of hypotheses or research questions by highlighting relevant findings and areas of uncertainty in existing literature. 

Literature review example

Let’s delve deeper with a literature review example: Let’s say your literature review is about the impact of climate change on biodiversity. You might format your literature review into sections such as the effects of climate change on habitat loss and species extinction, phenological changes, and marine biodiversity. Each section would then summarize and analyze relevant studies in those areas, highlighting key findings and identifying gaps in the research. The review would conclude by emphasizing the need for further research on specific aspects of the relationship between climate change and biodiversity. The following literature review template provides a glimpse into the recommended literature review structure and content, demonstrating how research findings are organized around specific themes within a broader topic. 

Literature Review on Climate Change Impacts on Biodiversity:

Climate change is a global phenomenon with far-reaching consequences, including significant impacts on biodiversity. This literature review synthesizes key findings from various studies: 

a. Habitat Loss and Species Extinction:

Climate change-induced alterations in temperature and precipitation patterns contribute to habitat loss, affecting numerous species (Thomas et al., 2004). The review discusses how these changes increase the risk of extinction, particularly for species with specific habitat requirements. 

b. Range Shifts and Phenological Changes:

Observations of range shifts and changes in the timing of biological events (phenology) are documented in response to changing climatic conditions (Parmesan & Yohe, 2003). These shifts affect ecosystems and may lead to mismatches between species and their resources. 

c. Ocean Acidification and Coral Reefs:

The review explores the impact of climate change on marine biodiversity, emphasizing ocean acidification’s threat to coral reefs (Hoegh-Guldberg et al., 2007). Changes in pH levels negatively affect coral calcification, disrupting the delicate balance of marine ecosystems. 

d. Adaptive Strategies and Conservation Efforts:

Recognizing the urgency of the situation, the literature review discusses various adaptive strategies adopted by species and conservation efforts aimed at mitigating the impacts of climate change on biodiversity (Hannah et al., 2007). It emphasizes the importance of interdisciplinary approaches for effective conservation planning. 

importance of literature review with examples

Strengthen your literature review with factual insights. Try Research on Paperpal for free!    

Writing a literature review involves summarizing and synthesizing existing research on a particular topic. A good literature review format should include the following elements. 

Introduction: The introduction sets the stage for your literature review, providing context and introducing the main focus of your review. 

  • Opening Statement: Begin with a general statement about the broader topic and its significance in the field. 
  • Scope and Purpose: Clearly define the scope of your literature review. Explain the specific research question or objective you aim to address. 
  • Organizational Framework: Briefly outline the structure of your literature review, indicating how you will categorize and discuss the existing research. 
  • Significance of the Study: Highlight why your literature review is important and how it contributes to the understanding of the chosen topic. 
  • Thesis Statement: Conclude the introduction with a concise thesis statement that outlines the main argument or perspective you will develop in the body of the literature review. 

Body: The body of the literature review is where you provide a comprehensive analysis of existing literature, grouping studies based on themes, methodologies, or other relevant criteria. 

  • Organize by Theme or Concept: Group studies that share common themes, concepts, or methodologies. Discuss each theme or concept in detail, summarizing key findings and identifying gaps or areas of disagreement. 
  • Critical Analysis: Evaluate the strengths and weaknesses of each study. Discuss the methodologies used, the quality of evidence, and the overall contribution of each work to the understanding of the topic. 
  • Synthesis of Findings: Synthesize the information from different studies to highlight trends, patterns, or areas of consensus in the literature. 
  • Identification of Gaps: Discuss any gaps or limitations in the existing research and explain how your review contributes to filling these gaps. 
  • Transition between Sections: Provide smooth transitions between different themes or concepts to maintain the flow of your literature review. 

Write and Cite as you go with Paperpal Research. Start now for free.   

Conclusion: The conclusion of your literature review should summarize the main findings, highlight the contributions of the review, and suggest avenues for future research. 

  • Summary of Key Findings: Recap the main findings from the literature and restate how they contribute to your research question or objective. 
  • Contributions to the Field: Discuss the overall contribution of your literature review to the existing knowledge in the field. 
  • Implications and Applications: Explore the practical implications of the findings and suggest how they might impact future research or practice. 
  • Recommendations for Future Research: Identify areas that require further investigation and propose potential directions for future research in the field. 
  • Final Thoughts: Conclude with a final reflection on the importance of your literature review and its relevance to the broader academic community. 

what is a literature review

Conducting a literature review

Conducting a literature review is an essential step in research that involves reviewing and analyzing existing literature on a specific topic. It’s important to know how to do a literature review effectively, so here are the steps to follow: 1  

Choose a Topic and Define the Research Question:

  • Select a topic that is relevant to your field of study. 
  • Clearly define your research question or objective. Determine what specific aspect of the topic do you want to explore? 

Decide on the Scope of Your Review:

  • Determine the timeframe for your literature review. Are you focusing on recent developments, or do you want a historical overview? 
  • Consider the geographical scope. Is your review global, or are you focusing on a specific region? 
  • Define the inclusion and exclusion criteria. What types of sources will you include? Are there specific types of studies or publications you will exclude? 

Select Databases for Searches:

  • Identify relevant databases for your field. Examples include PubMed, IEEE Xplore, Scopus, Web of Science, and Google Scholar. 
  • Consider searching in library catalogs, institutional repositories, and specialized databases related to your topic. 

Conduct Searches and Keep Track:

  • Develop a systematic search strategy using keywords, Boolean operators (AND, OR, NOT), and other search techniques. 
  • Record and document your search strategy for transparency and replicability. 
  • Keep track of the articles, including publication details, abstracts, and links. Use citation management tools like EndNote, Zotero, or Mendeley to organize your references. 

Review the Literature:

  • Evaluate the relevance and quality of each source. Consider the methodology, sample size, and results of studies. 
  • Organize the literature by themes or key concepts. Identify patterns, trends, and gaps in the existing research. 
  • Summarize key findings and arguments from each source. Compare and contrast different perspectives. 
  • Identify areas where there is a consensus in the literature and where there are conflicting opinions. 
  • Provide critical analysis and synthesis of the literature. What are the strengths and weaknesses of existing research? 

Organize and Write Your Literature Review:

  • Literature review outline should be based on themes, chronological order, or methodological approaches. 
  • Write a clear and coherent narrative that synthesizes the information gathered. 
  • Use proper citations for each source and ensure consistency in your citation style (APA, MLA, Chicago, etc.). 
  • Conclude your literature review by summarizing key findings, identifying gaps, and suggesting areas for future research. 

Whether you’re exploring a new research field or finding new angles to develop an existing topic, sifting through hundreds of papers can take more time than you have to spare. But what if you could find science-backed insights with verified citations in seconds? That’s the power of Paperpal’s new Research feature!  

How to write a literature review faster with Paperpal?

Paperpal, an AI writing assistant, integrates powerful academic search capabilities within its writing platform. With the Research feature, you get 100% factual insights, with citations backed by 250M+ verified research articles, directly within your writing interface with the option to save relevant references in your Citation Library. By eliminating the need to switch tabs to find answers to all your research questions, Paperpal saves time and helps you stay focused on your writing.   

Here’s how to use the Research feature:  

  • Ask a question: Get started with a new document on paperpal.com. Click on the “Research” feature and type your question in plain English. Paperpal will scour over 250 million research articles, including conference papers and preprints, to provide you with accurate insights and citations. 
  • Review and Save: Paperpal summarizes the information, while citing sources and listing relevant reads. You can quickly scan the results to identify relevant references and save these directly to your built-in citations library for later access. 
  • Cite with Confidence: Paperpal makes it easy to incorporate relevant citations and references into your writing, ensuring your arguments are well-supported by credible sources. This translates to a polished, well-researched literature review. 

The literature review sample and detailed advice on writing and conducting a review will help you produce a well-structured report. But remember that a good literature review is an ongoing process, and it may be necessary to revisit and update it as your research progresses. By combining effortless research with an easy citation process, Paperpal Research streamlines the literature review process and empowers you to write faster and with more confidence. Try Paperpal Research now and see for yourself.  

Frequently asked questions

A literature review is a critical and comprehensive analysis of existing literature (published and unpublished works) on a specific topic or research question and provides a synthesis of the current state of knowledge in a particular field. A well-conducted literature review is crucial for researchers to build upon existing knowledge, avoid duplication of efforts, and contribute to the advancement of their field. It also helps researchers situate their work within a broader context and facilitates the development of a sound theoretical and conceptual framework for their studies.

Literature review is a crucial component of research writing, providing a solid background for a research paper’s investigation. The aim is to keep professionals up to date by providing an understanding of ongoing developments within a specific field, including research methods, and experimental techniques used in that field, and present that knowledge in the form of a written report. Also, the depth and breadth of the literature review emphasizes the credibility of the scholar in his or her field.  

Before writing a literature review, it’s essential to undertake several preparatory steps to ensure that your review is well-researched, organized, and focused. This includes choosing a topic of general interest to you and doing exploratory research on that topic, writing an annotated bibliography, and noting major points, especially those that relate to the position you have taken on the topic. 

Literature reviews and academic research papers are essential components of scholarly work but serve different purposes within the academic realm. 3 A literature review aims to provide a foundation for understanding the current state of research on a particular topic, identify gaps or controversies, and lay the groundwork for future research. Therefore, it draws heavily from existing academic sources, including books, journal articles, and other scholarly publications. In contrast, an academic research paper aims to present new knowledge, contribute to the academic discourse, and advance the understanding of a specific research question. Therefore, it involves a mix of existing literature (in the introduction and literature review sections) and original data or findings obtained through research methods. 

Literature reviews are essential components of academic and research papers, and various strategies can be employed to conduct them effectively. If you want to know how to write a literature review for a research paper, here are four common approaches that are often used by researchers.  Chronological Review: This strategy involves organizing the literature based on the chronological order of publication. It helps to trace the development of a topic over time, showing how ideas, theories, and research have evolved.  Thematic Review: Thematic reviews focus on identifying and analyzing themes or topics that cut across different studies. Instead of organizing the literature chronologically, it is grouped by key themes or concepts, allowing for a comprehensive exploration of various aspects of the topic.  Methodological Review: This strategy involves organizing the literature based on the research methods employed in different studies. It helps to highlight the strengths and weaknesses of various methodologies and allows the reader to evaluate the reliability and validity of the research findings.  Theoretical Review: A theoretical review examines the literature based on the theoretical frameworks used in different studies. This approach helps to identify the key theories that have been applied to the topic and assess their contributions to the understanding of the subject.  It’s important to note that these strategies are not mutually exclusive, and a literature review may combine elements of more than one approach. The choice of strategy depends on the research question, the nature of the literature available, and the goals of the review. Additionally, other strategies, such as integrative reviews or systematic reviews, may be employed depending on the specific requirements of the research.

The literature review format can vary depending on the specific publication guidelines. However, there are some common elements and structures that are often followed. Here is a general guideline for the format of a literature review:  Introduction:   Provide an overview of the topic.  Define the scope and purpose of the literature review.  State the research question or objective.  Body:   Organize the literature by themes, concepts, or chronology.  Critically analyze and evaluate each source.  Discuss the strengths and weaknesses of the studies.  Highlight any methodological limitations or biases.  Identify patterns, connections, or contradictions in the existing research.  Conclusion:   Summarize the key points discussed in the literature review.  Highlight the research gap.  Address the research question or objective stated in the introduction.  Highlight the contributions of the review and suggest directions for future research.

Both annotated bibliographies and literature reviews involve the examination of scholarly sources. While annotated bibliographies focus on individual sources with brief annotations, literature reviews provide a more in-depth, integrated, and comprehensive analysis of existing literature on a specific topic. The key differences are as follows: 

References 

  • Denney, A. S., & Tewksbury, R. (2013). How to write a literature review.  Journal of criminal justice education ,  24 (2), 218-234. 
  • Pan, M. L. (2016).  Preparing literature reviews: Qualitative and quantitative approaches . Taylor & Francis. 
  • Cantero, C. (2019). How to write a literature review.  San José State University Writing Center . 

Paperpal is an AI writing assistant that help academics write better, faster with real-time suggestions for in-depth language and grammar correction. Trained on millions of research manuscripts enhanced by professional academic editors, Paperpal delivers human precision at machine speed.  

Try it for free or upgrade to  Paperpal Prime , which unlocks unlimited access to premium features like academic translation, paraphrasing, contextual synonyms, consistency checks and more. It’s like always having a professional academic editor by your side! Go beyond limitations and experience the future of academic writing.  Get Paperpal Prime now at just US$19 a month!

Related Reads:

  • Empirical Research: A Comprehensive Guide for Academics 
  • How to Write a Scientific Paper in 10 Steps 
  • How Long Should a Chapter Be?
  • How to Use Paperpal to Generate Emails & Cover Letters?

6 Tips for Post-Doc Researchers to Take Their Career to the Next Level

Self-plagiarism in research: what it is and how to avoid it, you may also like, how paperpal can boost comprehension and foster interdisciplinary..., what is the importance of a concept paper..., how to write the first draft of a..., mla works cited page: format, template & examples, how to ace grant writing for research funding..., powerful academic phrases to improve your essay writing , how to write a high-quality conference paper, how paperpal’s research feature helps you develop and..., how paperpal is enhancing academic productivity and accelerating..., how to write a successful book chapter for....

A Guide to Literature Reviews

Importance of a good literature review.

  • Conducting the Literature Review
  • Structure and Writing Style
  • Types of Literature Reviews
  • Citation Management Software This link opens in a new window
  • Acknowledgements

A literature review is not only a summary of key sources, but  has an organizational pattern which combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

  • Give a new interpretation of old material or combine new with old interpretations,
  • Trace the intellectual progression of the field, including major debates,
  • Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
  • Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

The purpose of a literature review is to:

  • Place each work in the context of its contribution to understanding the research problem being studied.
  • Describe the relationship of each work to the others under consideration.
  • Identify new ways to interpret prior research.
  • Reveal any gaps that exist in the literature.
  • Resolve conflicts amongst seemingly contradictory previous studies.
  • Identify areas of prior scholarship to prevent duplication of effort.
  • Point the way in fulfilling a need for additional research.
  • Locate your own research within the context of existing literature [very important].
  • << Previous: Definition
  • Next: Conducting the Literature Review >>
  • Last Updated: May 10, 2024 11:34 AM
  • URL: https://libguides.mcmaster.ca/litreview

The Writing Center • University of North Carolina at Chapel Hill

Literature Reviews

What this handout is about.

This handout will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.

Introduction

OK. You’ve got to write a literature review. You dust off a novel and a book of poetry, settle down in your chair, and get ready to issue a “thumbs up” or “thumbs down” as you leaf through the pages. “Literature review” done. Right?

Wrong! The “literature” of a literature review refers to any collection of materials on a topic, not necessarily the great literary texts of the world. “Literature” could be anything from a set of government pamphlets on British colonial methods in Africa to scholarly articles on the treatment of a torn ACL. And a review does not necessarily mean that your reader wants you to give your personal opinion on whether or not you liked these sources.

What is a literature review, then?

A literature review discusses published information in a particular subject area, and sometimes information in a particular subject area within a certain time period.

A literature review can be just a simple summary of the sources, but it usually has an organizational pattern and combines both summary and synthesis. A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information. It might give a new interpretation of old material or combine new with old interpretations. Or it might trace the intellectual progression of the field, including major debates. And depending on the situation, the literature review may evaluate the sources and advise the reader on the most pertinent or relevant.

But how is a literature review different from an academic research paper?

The main focus of an academic research paper is to develop a new argument, and a research paper is likely to contain a literature review as one of its parts. In a research paper, you use the literature as a foundation and as support for a new insight that you contribute. The focus of a literature review, however, is to summarize and synthesize the arguments and ideas of others without adding new contributions.

Why do we write literature reviews?

Literature reviews provide you with a handy guide to a particular topic. If you have limited time to conduct research, literature reviews can give you an overview or act as a stepping stone. For professionals, they are useful reports that keep them up to date with what is current in the field. For scholars, the depth and breadth of the literature review emphasizes the credibility of the writer in his or her field. Literature reviews also provide a solid background for a research paper’s investigation. Comprehensive knowledge of the literature of the field is essential to most research papers.

Who writes these things, anyway?

Literature reviews are written occasionally in the humanities, but mostly in the sciences and social sciences; in experiment and lab reports, they constitute a section of the paper. Sometimes a literature review is written as a paper in itself.

Let’s get to it! What should I do before writing the literature review?

If your assignment is not very specific, seek clarification from your instructor:

  • Roughly how many sources should you include?
  • What types of sources (books, journal articles, websites)?
  • Should you summarize, synthesize, or critique your sources by discussing a common theme or issue?
  • Should you evaluate your sources?
  • Should you provide subheadings and other background information, such as definitions and/or a history?

Find models

Look for other literature reviews in your area of interest or in the discipline and read them to get a sense of the types of themes you might want to look for in your own research or ways to organize your final review. You can simply put the word “review” in your search engine along with your other topic terms to find articles of this type on the Internet or in an electronic database. The bibliography or reference section of sources you’ve already read are also excellent entry points into your own research.

Narrow your topic

There are hundreds or even thousands of articles and books on most areas of study. The narrower your topic, the easier it will be to limit the number of sources you need to read in order to get a good survey of the material. Your instructor will probably not expect you to read everything that’s out there on the topic, but you’ll make your job easier if you first limit your scope.

Keep in mind that UNC Libraries have research guides and to databases relevant to many fields of study. You can reach out to the subject librarian for a consultation: https://library.unc.edu/support/consultations/ .

And don’t forget to tap into your professor’s (or other professors’) knowledge in the field. Ask your professor questions such as: “If you had to read only one book from the 90’s on topic X, what would it be?” Questions such as this help you to find and determine quickly the most seminal pieces in the field.

Consider whether your sources are current

Some disciplines require that you use information that is as current as possible. In the sciences, for instance, treatments for medical problems are constantly changing according to the latest studies. Information even two years old could be obsolete. However, if you are writing a review in the humanities, history, or social sciences, a survey of the history of the literature may be what is needed, because what is important is how perspectives have changed through the years or within a certain time period. Try sorting through some other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to consider what is currently of interest to scholars in this field and what is not.

Strategies for writing the literature review

Find a focus.

A literature review, like a term paper, is usually organized around ideas, not the sources themselves as an annotated bibliography would be organized. This means that you will not just simply list your sources and go into detail about each one of them, one at a time. No. As you read widely but selectively in your topic area, consider instead what themes or issues connect your sources together. Do they present one or different solutions? Is there an aspect of the field that is missing? How well do they present the material and do they portray it according to an appropriate theory? Do they reveal a trend in the field? A raging debate? Pick one of these themes to focus the organization of your review.

Convey it to your reader

A literature review may not have a traditional thesis statement (one that makes an argument), but you do need to tell readers what to expect. Try writing a simple statement that lets the reader know what is your main organizing principle. Here are a couple of examples:

The current trend in treatment for congestive heart failure combines surgery and medicine. More and more cultural studies scholars are accepting popular media as a subject worthy of academic consideration.

Consider organization

You’ve got a focus, and you’ve stated it clearly and directly. Now what is the most effective way of presenting the information? What are the most important topics, subtopics, etc., that your review needs to include? And in what order should you present them? Develop an organization for your review at both a global and local level:

First, cover the basic categories

Just like most academic papers, literature reviews also must contain at least three basic elements: an introduction or background information section; the body of the review containing the discussion of sources; and, finally, a conclusion and/or recommendations section to end the paper. The following provides a brief description of the content of each:

  • Introduction: Gives a quick idea of the topic of the literature review, such as the central theme or organizational pattern.
  • Body: Contains your discussion of sources and is organized either chronologically, thematically, or methodologically (see below for more information on each).
  • Conclusions/Recommendations: Discuss what you have drawn from reviewing literature so far. Where might the discussion proceed?

Organizing the body

Once you have the basic categories in place, then you must consider how you will present the sources themselves within the body of your paper. Create an organizational method to focus this section even further.

To help you come up with an overall organizational framework for your review, consider the following scenario:

You’ve decided to focus your literature review on materials dealing with sperm whales. This is because you’ve just finished reading Moby Dick, and you wonder if that whale’s portrayal is really real. You start with some articles about the physiology of sperm whales in biology journals written in the 1980’s. But these articles refer to some British biological studies performed on whales in the early 18th century. So you check those out. Then you look up a book written in 1968 with information on how sperm whales have been portrayed in other forms of art, such as in Alaskan poetry, in French painting, or on whale bone, as the whale hunters in the late 19th century used to do. This makes you wonder about American whaling methods during the time portrayed in Moby Dick, so you find some academic articles published in the last five years on how accurately Herman Melville portrayed the whaling scene in his novel.

Now consider some typical ways of organizing the sources into a review:

  • Chronological: If your review follows the chronological method, you could write about the materials above according to when they were published. For instance, first you would talk about the British biological studies of the 18th century, then about Moby Dick, published in 1851, then the book on sperm whales in other art (1968), and finally the biology articles (1980s) and the recent articles on American whaling of the 19th century. But there is relatively no continuity among subjects here. And notice that even though the sources on sperm whales in other art and on American whaling are written recently, they are about other subjects/objects that were created much earlier. Thus, the review loses its chronological focus.
  • By publication: Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on biological studies of sperm whales if the progression revealed a change in dissection practices of the researchers who wrote and/or conducted the studies.
  • By trend: A better way to organize the above sources chronologically is to examine the sources under another trend, such as the history of whaling. Then your review would have subsections according to eras within this period. For instance, the review might examine whaling from pre-1600-1699, 1700-1799, and 1800-1899. Under this method, you would combine the recent studies on American whaling in the 19th century with Moby Dick itself in the 1800-1899 category, even though the authors wrote a century apart.
  • Thematic: Thematic reviews of literature are organized around a topic or issue, rather than the progression of time. However, progression of time may still be an important factor in a thematic review. For instance, the sperm whale review could focus on the development of the harpoon for whale hunting. While the study focuses on one topic, harpoon technology, it will still be organized chronologically. The only difference here between a “chronological” and a “thematic” approach is what is emphasized the most: the development of the harpoon or the harpoon technology.But more authentic thematic reviews tend to break away from chronological order. For instance, a thematic review of material on sperm whales might examine how they are portrayed as “evil” in cultural documents. The subsections might include how they are personified, how their proportions are exaggerated, and their behaviors misunderstood. A review organized in this manner would shift between time periods within each section according to the point made.
  • Methodological: A methodological approach differs from the two above in that the focusing factor usually does not have to do with the content of the material. Instead, it focuses on the “methods” of the researcher or writer. For the sperm whale project, one methodological approach would be to look at cultural differences between the portrayal of whales in American, British, and French art work. Or the review might focus on the economic impact of whaling on a community. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed. Once you’ve decided on the organizational method for the body of the review, the sections you need to include in the paper should be easy to figure out. They should arise out of your organizational strategy. In other words, a chronological review would have subsections for each vital time period. A thematic review would have subtopics based upon factors that relate to the theme or issue.

Sometimes, though, you might need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. Put in only what is necessary. Here are a few other sections you might want to consider:

  • Current Situation: Information necessary to understand the topic or focus of the literature review.
  • History: The chronological progression of the field, the literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
  • Methods and/or Standards: The criteria you used to select the sources in your literature review or the way in which you present your information. For instance, you might explain that your review includes only peer-reviewed articles and journals.

Questions for Further Research: What questions about the field has the review sparked? How will you further your research as a result of the review?

Begin composing

Once you’ve settled on a general pattern of organization, you’re ready to write each section. There are a few guidelines you should follow during the writing stage as well. Here is a sample paragraph from a literature review about sexism and language to illuminate the following discussion:

However, other studies have shown that even gender-neutral antecedents are more likely to produce masculine images than feminine ones (Gastil, 1990). Hamilton (1988) asked students to complete sentences that required them to fill in pronouns that agreed with gender-neutral antecedents such as “writer,” “pedestrian,” and “persons.” The students were asked to describe any image they had when writing the sentence. Hamilton found that people imagined 3.3 men to each woman in the masculine “generic” condition and 1.5 men per woman in the unbiased condition. Thus, while ambient sexism accounted for some of the masculine bias, sexist language amplified the effect. (Source: Erika Falk and Jordan Mills, “Why Sexist Language Affects Persuasion: The Role of Homophily, Intended Audience, and Offense,” Women and Language19:2).

Use evidence

In the example above, the writers refer to several other sources when making their point. A literature review in this sense is just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence to show that what you are saying is valid.

Be selective

Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the review’s focus, whether it is thematic, methodological, or chronological.

Use quotes sparingly

Falk and Mills do not use any direct quotes. That is because the survey nature of the literature review does not allow for in-depth discussion or detailed quotes from the text. Some short quotes here and there are okay, though, if you want to emphasize a point, or if what the author said just cannot be rewritten in your own words. Notice that Falk and Mills do quote certain terms that were coined by the author, not common knowledge, or taken directly from the study. But if you find yourself wanting to put in more quotes, check with your instructor.

Summarize and synthesize

Remember to summarize and synthesize your sources within each paragraph as well as throughout the review. The authors here recapitulate important features of Hamilton’s study, but then synthesize it by rephrasing the study’s significance and relating it to their own work.

Keep your own voice

While the literature review presents others’ ideas, your voice (the writer’s) should remain front and center. Notice that Falk and Mills weave references to other sources into their own text, but they still maintain their own voice by starting and ending the paragraph with their own ideas and their own words. The sources support what Falk and Mills are saying.

Use caution when paraphrasing

When paraphrasing a source that is not your own, be sure to represent the author’s information or opinions accurately and in your own words. In the preceding example, Falk and Mills either directly refer in the text to the author of their source, such as Hamilton, or they provide ample notation in the text when the ideas they are mentioning are not their own, for example, Gastil’s. For more information, please see our handout on plagiarism .

Revise, revise, revise

Draft in hand? Now you’re ready to revise. Spending a lot of time revising is a wise idea, because your main objective is to present the material, not the argument. So check over your review again to make sure it follows the assignment and/or your outline. Then, just as you would for most other academic forms of writing, rewrite or rework the language of your review so that you’ve presented your information in the most concise manner possible. Be sure to use terminology familiar to your audience; get rid of unnecessary jargon or slang. Finally, double check that you’ve documented your sources and formatted the review appropriately for your discipline. For tips on the revising and editing process, see our handout on revising drafts .

Works consulted

We consulted these works while writing this handout. This is not a comprehensive list of resources on the handout’s topic, and we encourage you to do your own research to find additional publications. Please do not use this list as a model for the format of your own reference list, as it may not match the citation style you are using. For guidance on formatting citations, please see the UNC Libraries citation tutorial . We revise these tips periodically and welcome feedback.

Anson, Chris M., and Robert A. Schwegler. 2010. The Longman Handbook for Writers and Readers , 6th ed. New York: Longman.

Jones, Robert, Patrick Bizzaro, and Cynthia Selfe. 1997. The Harcourt Brace Guide to Writing in the Disciplines . New York: Harcourt Brace.

Lamb, Sandra E. 1998. How to Write It: A Complete Guide to Everything You’ll Ever Write . Berkeley: Ten Speed Press.

Rosen, Leonard J., and Laurence Behrens. 2003. The Allyn & Bacon Handbook , 5th ed. New York: Longman.

Troyka, Lynn Quittman, and Doug Hesse. 2016. Simon and Schuster Handbook for Writers , 11th ed. London: Pearson.

You may reproduce it for non-commercial use if you use the entire handout and attribute the source: The Writing Center, University of North Carolina at Chapel Hill

Make a Gift

University of Texas

  • University of Texas Libraries

Literature Reviews

  • What is a literature review?
  • Steps in the Literature Review Process
  • Define your research question
  • Determine inclusion and exclusion criteria
  • Choose databases and search
  • Review Results
  • Synthesize Results
  • Analyze Results
  • Librarian Support

What is a Literature Review?

A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important past and current research and practices. It provides background and context, and shows how your research will contribute to the field. 

A literature review should: 

  • Provide a comprehensive and updated review of the literature;
  • Explain why this review has taken place;
  • Articulate a position or hypothesis;
  • Acknowledge and account for conflicting and corroborating points of view

From  S age Research Methods

Purpose of a Literature Review

A literature review can be written as an introduction to a study to:

  • Demonstrate how a study fills a gap in research
  • Compare a study with other research that's been done

Or it can be a separate work (a research article on its own) which:

  • Organizes or describes a topic
  • Describes variables within a particular issue/problem

Limitations of a Literature Review

Some of the limitations of a literature review are:

  • It's a snapshot in time. Unlike other reviews, this one has beginning, a middle and an end. There may be future developments that could make your work less relevant.
  • It may be too focused. Some niche studies may miss the bigger picture.
  • It can be difficult to be comprehensive. There is no way to make sure all the literature on a topic was considered.
  • It is easy to be biased if you stick to top tier journals. There may be other places where people are publishing exemplary research. Look to open access publications and conferences to reflect a more inclusive collection. Also, make sure to include opposing views (and not just supporting evidence).

Source: Grant, Maria J., and Andrew Booth. “A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies.” Health Information & Libraries Journal, vol. 26, no. 2, June 2009, pp. 91–108. Wiley Online Library, doi:10.1111/j.1471-1842.2009.00848.x.

Meryl Brodsky : Communication and Information Studies

Hannah Chapman Tripp : Biology, Neuroscience

Carolyn Cunningham : Human Development & Family Sciences, Psychology, Sociology

Larayne Dallas : Engineering

Janelle Hedstrom : Special Education, Curriculum & Instruction, Ed Leadership & Policy ​

Susan Macicak : Linguistics

Imelda Vetter : Dell Medical School

For help in other subject areas, please see the guide to library specialists by subject .

Periodically, UT Libraries runs a workshop covering the basics and library support for literature reviews. While we try to offer these once per academic year, we find providing the recording to be helpful to community members who have missed the session. Following is the most recent recording of the workshop, Conducting a Literature Review. To view the recording, a UT login is required.

  • October 26, 2022 recording
  • Last Updated: Oct 26, 2022 2:49 PM
  • URL: https://guides.lib.utexas.edu/literaturereviews

Creative Commons License

  • UConn Library
  • Literature Review: The What, Why and How-to Guide
  • Introduction

Literature Review: The What, Why and How-to Guide — Introduction

  • Getting Started
  • How to Pick a Topic
  • Strategies to Find Sources
  • Evaluating Sources & Lit. Reviews
  • Tips for Writing Literature Reviews
  • Writing Literature Review: Useful Sites
  • Citation Resources
  • Other Academic Writings

What are Literature Reviews?

So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D.  The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.

Goals of Literature Reviews

What are the goals of creating a Literature Review?  A literature could be written to accomplish different aims:

  • To develop a theory or evaluate an existing theory
  • To summarize the historical or existing state of a research topic
  • Identify a problem in a field of research 

Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews .  Review of General Psychology , 1 (3), 311-320.

What kinds of sources require a Literature Review?

  • A research paper assigned in a course
  • A thesis or dissertation
  • A grant proposal
  • An article intended for publication in a journal

All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.

Types of Literature Reviews

What kinds of literature reviews are written?

Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.

  • Example : Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework:  10.1177/08948453211037398  

Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.

  • Example : The effect of leave policies on increasing fertility: a systematic review:  10.1057/s41599-022-01270-w

Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.

  • Example : Employment Instability and Fertility in Europe: A Meta-Analysis:  10.1215/00703370-9164737

Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts .  Journal of Advanced Nursing , 53 (3), 311-318.

  • Example : Women’s perspectives on career successes and barriers: A qualitative meta-synthesis:  10.1177/05390184221113735

Literature Reviews in the Health Sciences

  • UConn Health subject guide on systematic reviews Explanation of the different review types used in health sciences literature as well as tools to help you find the right review type
  • << Previous: Getting Started
  • Next: How to Pick a Topic >>
  • Last Updated: Sep 21, 2022 2:16 PM
  • URL: https://guides.lib.uconn.edu/literaturereview

Creative Commons

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

  • Knowledge Base
  • Dissertation
  • What is a Literature Review? | Guide, Template, & Examples

What is a Literature Review? | Guide, Template, & Examples

Published on 22 February 2022 by Shona McCombes . Revised on 7 June 2022.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research.

There are five key steps to writing a literature review:

  • Search for relevant literature
  • Evaluate sources
  • Identify themes, debates and gaps
  • Outline the structure
  • Write your literature review

A good literature review doesn’t just summarise sources – it analyses, synthesises, and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

upload-your-document-ai-proofreader

Table of contents

Why write a literature review, examples of literature reviews, step 1: search for relevant literature, step 2: evaluate and select sources, step 3: identify themes, debates and gaps, step 4: outline your literature review’s structure, step 5: write your literature review, frequently asked questions about literature reviews, introduction.

  • Quick Run-through
  • Step 1 & 2

When you write a dissertation or thesis, you will have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

  • Demonstrate your familiarity with the topic and scholarly context
  • Develop a theoretical framework and methodology for your research
  • Position yourself in relation to other researchers and theorists
  • Show how your dissertation addresses a gap or contributes to a debate

You might also have to write a literature review as a stand-alone assignment. In this case, the purpose is to evaluate the current state of research and demonstrate your knowledge of scholarly debates around a topic.

The content will look slightly different in each case, but the process of conducting a literature review follows the same steps. We’ve written a step-by-step guide that you can follow below.

Literature review guide

Prevent plagiarism, run a free check.

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

  • Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
  • Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
  • Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
  • Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research objectives and questions .

If you are writing a literature review as a stand-alone assignment, you will have to choose a focus and develop a central question to direct your search. Unlike a dissertation research question, this question has to be answerable without collecting original data. You should be able to answer it based only on a review of existing publications.

Make a list of keywords

Start by creating a list of keywords related to your research topic. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list if you discover new keywords in the process of your literature search.

  • Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
  • Body image, self-perception, self-esteem, mental health
  • Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some databases to search for journals and articles include:

  • Your university’s library catalogue
  • Google Scholar
  • Project Muse (humanities and social sciences)
  • Medline (life sciences and biomedicine)
  • EconLit (economics)
  • Inspec (physics, engineering and computer science)

You can use boolean operators to help narrow down your search:

Read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

To identify the most important publications on your topic, take note of recurring citations. If the same authors, books or articles keep appearing in your reading, make sure to seek them out.

You probably won’t be able to read absolutely everything that has been written on the topic – you’ll have to evaluate which sources are most relevant to your questions.

For each publication, ask yourself:

  • What question or problem is the author addressing?
  • What are the key concepts and how are they defined?
  • What are the key theories, models and methods? Does the research use established frameworks or take an innovative approach?
  • What are the results and conclusions of the study?
  • How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
  • How does the publication contribute to your understanding of the topic? What are its key insights and arguments?
  • What are the strengths and weaknesses of the research?

Make sure the sources you use are credible, and make sure you read any landmark studies and major theories in your field of research.

You can find out how many times an article has been cited on Google Scholar – a high citation count means the article has been influential in the field, and should certainly be included in your literature review.

The scope of your review will depend on your topic and discipline: in the sciences you usually only review recent literature, but in the humanities you might take a long historical perspective (for example, to trace how a concept has changed in meaning over time).

Remember that you can use our template to summarise and evaluate sources you’re thinking about using!

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It’s important to keep track of your sources with references to avoid plagiarism . It can be helpful to make an annotated bibliography, where you compile full reference information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

You can use our free APA Reference Generator for quick, correct, consistent citations.

The only proofreading tool specialized in correcting academic writing

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

importance of literature review with examples

Correct my document today

To begin organising your literature review’s argument and structure, you need to understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

  • Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
  • Themes: what questions or concepts recur across the literature?
  • Debates, conflicts and contradictions: where do sources disagree?
  • Pivotal publications: are there any influential theories or studies that changed the direction of the field?
  • Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

  • Most research has focused on young women.
  • There is an increasing interest in the visual aspects of social media.
  • But there is still a lack of robust research on highly-visual platforms like Instagram and Snapchat – this is a gap that you could address in your own research.

There are various approaches to organising the body of a literature review. You should have a rough idea of your strategy before you start writing.

Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarising sources in order.

Try to analyse patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organise your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

  • Look at what results have emerged in qualitative versus quantitative research
  • Discuss how the topic has been approached by empirical versus theoretical scholarship
  • Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text, your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

If you are writing the literature review as part of your dissertation or thesis, reiterate your central problem or research question and give a brief summary of the scholarly context. You can emphasise the timeliness of the topic (“many recent studies have focused on the problem of x”) or highlight a gap in the literature (“while there has been much research on x, few researchers have taken y into consideration”).

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, make sure to follow these tips:

  • Summarise and synthesise: give an overview of the main points of each source and combine them into a coherent whole.
  • Analyse and interpret: don’t just paraphrase other researchers – add your own interpretations, discussing the significance of findings in relation to the literature as a whole.
  • Critically evaluate: mention the strengths and weaknesses of your sources.
  • Write in well-structured paragraphs: use transitions and topic sentences to draw connections, comparisons and contrasts.

In the conclusion, you should summarise the key findings you have taken from the literature and emphasise their significance.

If the literature review is part of your dissertation or thesis, reiterate how your research addresses gaps and contributes new knowledge, or discuss how you have drawn on existing theories and methods to build a framework for your research. This can lead directly into your methodology section.

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a dissertation , thesis, research paper , or proposal .

There are several reasons to conduct a literature review at the beginning of a research project:

  • To familiarise yourself with the current state of knowledge on your topic
  • To ensure that you’re not just repeating what others have already done
  • To identify gaps in knowledge and unresolved problems that your research can address
  • To develop your theoretical framework and methodology
  • To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your  dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

McCombes, S. (2022, June 07). What is a Literature Review? | Guide, Template, & Examples. Scribbr. Retrieved 7 June 2024, from https://www.scribbr.co.uk/thesis-dissertation/literature-review/

Is this article helpful?

Shona McCombes

Shona McCombes

Other students also liked, how to write a dissertation proposal | a step-by-step guide, what is a theoretical framework | a step-by-step guide, what is a research methodology | steps & tips.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • CAREER FEATURE
  • 04 December 2020
  • Correction 09 December 2020

How to write a superb literature review

Andy Tay is a freelance writer based in Singapore.

You can also search for this author in PubMed   Google Scholar

Literature reviews are important resources for scientists. They provide historical context for a field while offering opinions on its future trajectory. Creating them can provide inspiration for one’s own research, as well as some practice in writing. But few scientists are trained in how to write a review — or in what constitutes an excellent one. Even picking the appropriate software to use can be an involved decision (see ‘Tools and techniques’). So Nature asked editors and working scientists with well-cited reviews for their tips.

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 51 print issues and online access

185,98 € per year

only 3,65 € per issue

Rent or buy this article

Prices vary by article type

Prices may be subject to local taxes which are calculated during checkout

doi: https://doi.org/10.1038/d41586-020-03422-x

Interviews have been edited for length and clarity.

Updates & Corrections

Correction 09 December 2020 : An earlier version of the tables in this article included some incorrect details about the programs Zotero, Endnote and Manubot. These have now been corrected.

Hsing, I.-M., Xu, Y. & Zhao, W. Electroanalysis 19 , 755–768 (2007).

Article   Google Scholar  

Ledesma, H. A. et al. Nature Nanotechnol. 14 , 645–657 (2019).

Article   PubMed   Google Scholar  

Brahlek, M., Koirala, N., Bansal, N. & Oh, S. Solid State Commun. 215–216 , 54–62 (2015).

Choi, Y. & Lee, S. Y. Nature Rev. Chem . https://doi.org/10.1038/s41570-020-00221-w (2020).

Download references

Related Articles

importance of literature review with examples

  • Research management

‘I saw that discrimination wasn’t hearsay or rumours — it really did exist’

‘I saw that discrimination wasn’t hearsay or rumours — it really did exist’

Career Q&A 05 JUN 24

Need a policy for using ChatGPT in the classroom? Try asking students

Need a policy for using ChatGPT in the classroom? Try asking students

Career Column 05 JUN 24

Why China has been a growing study destination for African students

Why China has been a growing study destination for African students

Nature Index 05 JUN 24

I was denied tenure — how do I cope?

I was denied tenure — how do I cope?

Career Feature 06 JUN 24

How I run a virtual lab group that’s collaborative, inclusive and productive

How I run a virtual lab group that’s collaborative, inclusive and productive

Career Column 31 MAY 24

Researcher parents are paying a high price for conference travel — here’s how to fix it

Researcher parents are paying a high price for conference travel — here’s how to fix it

Career Column 27 MAY 24

China seeks global impact and recognition

China seeks global impact and recognition

Chinese research collaborations shift to the Belt and Road

Chinese research collaborations shift to the Belt and Road

A guide to the Nature Index

A guide to the Nature Index

Professor/Associate Professor/Assistant Professor/Senior Lecturer/Lecturer

The School of Science and Engineering (SSE) at The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen) sincerely invites applications for mul...

Shenzhen, China

The Chinese University of Hong Kong, Shenzhen (CUHK Shenzhen)

importance of literature review with examples

Faculty Positions& Postdoctoral Research Fellow, School of Optical and Electronic Information, HUST

Job Opportunities: Leading talents, young talents, overseas outstanding young scholars, postdoctoral researchers.

Wuhan, Hubei, China

School of Optical and Electronic Information, Huazhong University of Science and Technology

importance of literature review with examples

Postdoctoral Fellowships at West China Hospital/West China School of Medicine of Sichuan University

Open to PhD students, PhD, Post-Doc and residents.

Chengdu, Sichuan, China

West China School of Medicine/West China Hospital

importance of literature review with examples

Welcome Global Talents to West China Hospital/West China School of Medicine of Sichuan University

Top Talents; Leading Talents; Excellent Overseas Young Talents on National level; Overseas Young Talents

importance of literature review with examples

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies
  • Privacy Policy

Research Method

Home » Literature Review – Types Writing Guide and Examples

Literature Review – Types Writing Guide and Examples

Table of Contents

Literature Review

Literature Review

Definition:

A literature review is a comprehensive and critical analysis of the existing literature on a particular topic or research question. It involves identifying, evaluating, and synthesizing relevant literature, including scholarly articles, books, and other sources, to provide a summary and critical assessment of what is known about the topic.

Types of Literature Review

Types of Literature Review are as follows:

  • Narrative literature review : This type of review involves a comprehensive summary and critical analysis of the available literature on a particular topic or research question. It is often used as an introductory section of a research paper.
  • Systematic literature review: This is a rigorous and structured review that follows a pre-defined protocol to identify, evaluate, and synthesize all relevant studies on a specific research question. It is often used in evidence-based practice and systematic reviews.
  • Meta-analysis: This is a quantitative review that uses statistical methods to combine data from multiple studies to derive a summary effect size. It provides a more precise estimate of the overall effect than any individual study.
  • Scoping review: This is a preliminary review that aims to map the existing literature on a broad topic area to identify research gaps and areas for further investigation.
  • Critical literature review : This type of review evaluates the strengths and weaknesses of the existing literature on a particular topic or research question. It aims to provide a critical analysis of the literature and identify areas where further research is needed.
  • Conceptual literature review: This review synthesizes and integrates theories and concepts from multiple sources to provide a new perspective on a particular topic. It aims to provide a theoretical framework for understanding a particular research question.
  • Rapid literature review: This is a quick review that provides a snapshot of the current state of knowledge on a specific research question or topic. It is often used when time and resources are limited.
  • Thematic literature review : This review identifies and analyzes common themes and patterns across a body of literature on a particular topic. It aims to provide a comprehensive overview of the literature and identify key themes and concepts.
  • Realist literature review: This review is often used in social science research and aims to identify how and why certain interventions work in certain contexts. It takes into account the context and complexities of real-world situations.
  • State-of-the-art literature review : This type of review provides an overview of the current state of knowledge in a particular field, highlighting the most recent and relevant research. It is often used in fields where knowledge is rapidly evolving, such as technology or medicine.
  • Integrative literature review: This type of review synthesizes and integrates findings from multiple studies on a particular topic to identify patterns, themes, and gaps in the literature. It aims to provide a comprehensive understanding of the current state of knowledge on a particular topic.
  • Umbrella literature review : This review is used to provide a broad overview of a large and diverse body of literature on a particular topic. It aims to identify common themes and patterns across different areas of research.
  • Historical literature review: This type of review examines the historical development of research on a particular topic or research question. It aims to provide a historical context for understanding the current state of knowledge on a particular topic.
  • Problem-oriented literature review : This review focuses on a specific problem or issue and examines the literature to identify potential solutions or interventions. It aims to provide practical recommendations for addressing a particular problem or issue.
  • Mixed-methods literature review : This type of review combines quantitative and qualitative methods to synthesize and analyze the available literature on a particular topic. It aims to provide a more comprehensive understanding of the research question by combining different types of evidence.

Parts of Literature Review

Parts of a literature review are as follows:

Introduction

The introduction of a literature review typically provides background information on the research topic and why it is important. It outlines the objectives of the review, the research question or hypothesis, and the scope of the review.

Literature Search

This section outlines the search strategy and databases used to identify relevant literature. The search terms used, inclusion and exclusion criteria, and any limitations of the search are described.

Literature Analysis

The literature analysis is the main body of the literature review. This section summarizes and synthesizes the literature that is relevant to the research question or hypothesis. The review should be organized thematically, chronologically, or by methodology, depending on the research objectives.

Critical Evaluation

Critical evaluation involves assessing the quality and validity of the literature. This includes evaluating the reliability and validity of the studies reviewed, the methodology used, and the strength of the evidence.

The conclusion of the literature review should summarize the main findings, identify any gaps in the literature, and suggest areas for future research. It should also reiterate the importance of the research question or hypothesis and the contribution of the literature review to the overall research project.

The references list includes all the sources cited in the literature review, and follows a specific referencing style (e.g., APA, MLA, Harvard).

How to write Literature Review

Here are some steps to follow when writing a literature review:

  • Define your research question or topic : Before starting your literature review, it is essential to define your research question or topic. This will help you identify relevant literature and determine the scope of your review.
  • Conduct a comprehensive search: Use databases and search engines to find relevant literature. Look for peer-reviewed articles, books, and other academic sources that are relevant to your research question or topic.
  • Evaluate the sources: Once you have found potential sources, evaluate them critically to determine their relevance, credibility, and quality. Look for recent publications, reputable authors, and reliable sources of data and evidence.
  • Organize your sources: Group the sources by theme, method, or research question. This will help you identify similarities and differences among the literature, and provide a structure for your literature review.
  • Analyze and synthesize the literature : Analyze each source in depth, identifying the key findings, methodologies, and conclusions. Then, synthesize the information from the sources, identifying patterns and themes in the literature.
  • Write the literature review : Start with an introduction that provides an overview of the topic and the purpose of the literature review. Then, organize the literature according to your chosen structure, and analyze and synthesize the sources. Finally, provide a conclusion that summarizes the key findings of the literature review, identifies gaps in knowledge, and suggests areas for future research.
  • Edit and proofread: Once you have written your literature review, edit and proofread it carefully to ensure that it is well-organized, clear, and concise.

Examples of Literature Review

Here’s an example of how a literature review can be conducted for a thesis on the topic of “ The Impact of Social Media on Teenagers’ Mental Health”:

  • Start by identifying the key terms related to your research topic. In this case, the key terms are “social media,” “teenagers,” and “mental health.”
  • Use academic databases like Google Scholar, JSTOR, or PubMed to search for relevant articles, books, and other publications. Use these keywords in your search to narrow down your results.
  • Evaluate the sources you find to determine if they are relevant to your research question. You may want to consider the publication date, author’s credentials, and the journal or book publisher.
  • Begin reading and taking notes on each source, paying attention to key findings, methodologies used, and any gaps in the research.
  • Organize your findings into themes or categories. For example, you might categorize your sources into those that examine the impact of social media on self-esteem, those that explore the effects of cyberbullying, and those that investigate the relationship between social media use and depression.
  • Synthesize your findings by summarizing the key themes and highlighting any gaps or inconsistencies in the research. Identify areas where further research is needed.
  • Use your literature review to inform your research questions and hypotheses for your thesis.

For example, after conducting a literature review on the impact of social media on teenagers’ mental health, a thesis might look like this:

“Using a mixed-methods approach, this study aims to investigate the relationship between social media use and mental health outcomes in teenagers. Specifically, the study will examine the effects of cyberbullying, social comparison, and excessive social media use on self-esteem, anxiety, and depression. Through an analysis of survey data and qualitative interviews with teenagers, the study will provide insight into the complex relationship between social media use and mental health outcomes, and identify strategies for promoting positive mental health outcomes in young people.”

Reference: Smith, J., Jones, M., & Lee, S. (2019). The effects of social media use on adolescent mental health: A systematic review. Journal of Adolescent Health, 65(2), 154-165. doi:10.1016/j.jadohealth.2019.03.024

Reference Example: Author, A. A., Author, B. B., & Author, C. C. (Year). Title of article. Title of Journal, volume number(issue number), page range. doi:0000000/000000000000 or URL

Applications of Literature Review

some applications of literature review in different fields:

  • Social Sciences: In social sciences, literature reviews are used to identify gaps in existing research, to develop research questions, and to provide a theoretical framework for research. Literature reviews are commonly used in fields such as sociology, psychology, anthropology, and political science.
  • Natural Sciences: In natural sciences, literature reviews are used to summarize and evaluate the current state of knowledge in a particular field or subfield. Literature reviews can help researchers identify areas where more research is needed and provide insights into the latest developments in a particular field. Fields such as biology, chemistry, and physics commonly use literature reviews.
  • Health Sciences: In health sciences, literature reviews are used to evaluate the effectiveness of treatments, identify best practices, and determine areas where more research is needed. Literature reviews are commonly used in fields such as medicine, nursing, and public health.
  • Humanities: In humanities, literature reviews are used to identify gaps in existing knowledge, develop new interpretations of texts or cultural artifacts, and provide a theoretical framework for research. Literature reviews are commonly used in fields such as history, literary studies, and philosophy.

Role of Literature Review in Research

Here are some applications of literature review in research:

  • Identifying Research Gaps : Literature review helps researchers identify gaps in existing research and literature related to their research question. This allows them to develop new research questions and hypotheses to fill those gaps.
  • Developing Theoretical Framework: Literature review helps researchers develop a theoretical framework for their research. By analyzing and synthesizing existing literature, researchers can identify the key concepts, theories, and models that are relevant to their research.
  • Selecting Research Methods : Literature review helps researchers select appropriate research methods and techniques based on previous research. It also helps researchers to identify potential biases or limitations of certain methods and techniques.
  • Data Collection and Analysis: Literature review helps researchers in data collection and analysis by providing a foundation for the development of data collection instruments and methods. It also helps researchers to identify relevant data sources and identify potential data analysis techniques.
  • Communicating Results: Literature review helps researchers to communicate their results effectively by providing a context for their research. It also helps to justify the significance of their findings in relation to existing research and literature.

Purpose of Literature Review

Some of the specific purposes of a literature review are as follows:

  • To provide context: A literature review helps to provide context for your research by situating it within the broader body of literature on the topic.
  • To identify gaps and inconsistencies: A literature review helps to identify areas where further research is needed or where there are inconsistencies in the existing literature.
  • To synthesize information: A literature review helps to synthesize the information from multiple sources and present a coherent and comprehensive picture of the current state of knowledge on the topic.
  • To identify key concepts and theories : A literature review helps to identify key concepts and theories that are relevant to your research question and provide a theoretical framework for your study.
  • To inform research design: A literature review can inform the design of your research study by identifying appropriate research methods, data sources, and research questions.

Characteristics of Literature Review

Some Characteristics of Literature Review are as follows:

  • Identifying gaps in knowledge: A literature review helps to identify gaps in the existing knowledge and research on a specific topic or research question. By analyzing and synthesizing the literature, you can identify areas where further research is needed and where new insights can be gained.
  • Establishing the significance of your research: A literature review helps to establish the significance of your own research by placing it in the context of existing research. By demonstrating the relevance of your research to the existing literature, you can establish its importance and value.
  • Informing research design and methodology : A literature review helps to inform research design and methodology by identifying the most appropriate research methods, techniques, and instruments. By reviewing the literature, you can identify the strengths and limitations of different research methods and techniques, and select the most appropriate ones for your own research.
  • Supporting arguments and claims: A literature review provides evidence to support arguments and claims made in academic writing. By citing and analyzing the literature, you can provide a solid foundation for your own arguments and claims.
  • I dentifying potential collaborators and mentors: A literature review can help identify potential collaborators and mentors by identifying researchers and practitioners who are working on related topics or using similar methods. By building relationships with these individuals, you can gain valuable insights and support for your own research and practice.
  • Keeping up-to-date with the latest research : A literature review helps to keep you up-to-date with the latest research on a specific topic or research question. By regularly reviewing the literature, you can stay informed about the latest findings and developments in your field.

Advantages of Literature Review

There are several advantages to conducting a literature review as part of a research project, including:

  • Establishing the significance of the research : A literature review helps to establish the significance of the research by demonstrating the gap or problem in the existing literature that the study aims to address.
  • Identifying key concepts and theories: A literature review can help to identify key concepts and theories that are relevant to the research question, and provide a theoretical framework for the study.
  • Supporting the research methodology : A literature review can inform the research methodology by identifying appropriate research methods, data sources, and research questions.
  • Providing a comprehensive overview of the literature : A literature review provides a comprehensive overview of the current state of knowledge on a topic, allowing the researcher to identify key themes, debates, and areas of agreement or disagreement.
  • Identifying potential research questions: A literature review can help to identify potential research questions and areas for further investigation.
  • Avoiding duplication of research: A literature review can help to avoid duplication of research by identifying what has already been done on a topic, and what remains to be done.
  • Enhancing the credibility of the research : A literature review helps to enhance the credibility of the research by demonstrating the researcher’s knowledge of the existing literature and their ability to situate their research within a broader context.

Limitations of Literature Review

Limitations of Literature Review are as follows:

  • Limited scope : Literature reviews can only cover the existing literature on a particular topic, which may be limited in scope or depth.
  • Publication bias : Literature reviews may be influenced by publication bias, which occurs when researchers are more likely to publish positive results than negative ones. This can lead to an incomplete or biased picture of the literature.
  • Quality of sources : The quality of the literature reviewed can vary widely, and not all sources may be reliable or valid.
  • Time-limited: Literature reviews can become quickly outdated as new research is published, making it difficult to keep up with the latest developments in a field.
  • Subjective interpretation : Literature reviews can be subjective, and the interpretation of the findings can vary depending on the researcher’s perspective or bias.
  • Lack of original data : Literature reviews do not generate new data, but rather rely on the analysis of existing studies.
  • Risk of plagiarism: It is important to ensure that literature reviews do not inadvertently contain plagiarism, which can occur when researchers use the work of others without proper attribution.

About the author

' src=

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Research Questions

Research Questions – Types, Examples and Writing...

Data collection

Data Collection – Methods Types and Examples

Research Gap

Research Gap – Types, Examples and How to...

Research Report

Research Report – Example, Writing Guide and...

Research Methodology

Research Methodology – Types, Examples and...

Research Paper Conclusion

Research Paper Conclusion – Writing Guide and...

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

OWL logo

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

  • An introductory paragraph that explains what your working topic and thesis is
  • A forecast of key topics or texts that will appear in the review
  • Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
  • Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
  • Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
  • Critically Evaluate: Mention the strengths and weaknesses of your sources
  • Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

  • Summarize the key findings you have taken from the literature and emphasize their significance
  • Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

  • Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
  • Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
  • Qualitative versus quantitative research
  • Empirical versus theoretical scholarship
  • Divide the research by sociological, historical, or cultural sources
  • Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

  • It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
  • Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
  • Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
  • Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

Harvey Cushing/John Hay Whitney Medical Library

  • Collections
  • Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

  • Biomedical Databases
  • Global (Public Health) Databases
  • Soc. Sci., History, and Law Databases
  • Grey Literature
  • Trials Registers
  • Data and Statistics
  • Public Policy
  • Google Tips
  • Recommended Books
  • Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Discovers relationships between research studies/ideas.
  • Identifies major themes, concepts, and researchers on a topic.
  • Identifies critical gaps and points of disagreement.
  • Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

Cover Art

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

  • Make sure your research question is not too broad or too narrow.  Is it manageable?
  • Begin writing down terms that are related to your question. These will be useful for searches later.
  • If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

  • This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

  • use the tabs on this guide
  • Find other databases in the Nursing Information Resources web page
  • More on the Medical Library web page
  • ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

  • Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
  • Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
  • Review the abstracts of research studies carefully. This will save you time.
  • Use the bibliographies and references of research studies you find to locate others.
  • Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
  • Ask your librarian for help at any time.
  • Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

  • What was the research question of the study you are reviewing? What were the authors trying to discover?
  • Was the research funded by a source that could influence the findings?
  • What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
  • Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
  • If there are conflicting studies, why do you think that is?
  • How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

  • Review the abstracts carefully.  
  • Keep careful notes so that you may track your thought processes during the research process.
  • Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
  • << Previous: Recommended Books
  • Last Updated: Jan 4, 2024 10:52 AM
  • URL: https://guides.library.yale.edu/YSNDoctoral
  • USC Libraries
  • Research Guides

Organizing Your Social Sciences Research Paper

  • 5. The Literature Review
  • Purpose of Guide
  • Design Flaws to Avoid
  • Independent and Dependent Variables
  • Glossary of Research Terms
  • Reading Research Effectively
  • Narrowing a Topic Idea
  • Broadening a Topic Idea
  • Extending the Timeliness of a Topic Idea
  • Academic Writing Style
  • Applying Critical Thinking
  • Choosing a Title
  • Making an Outline
  • Paragraph Development
  • Research Process Video Series
  • Executive Summary
  • The C.A.R.S. Model
  • Background Information
  • The Research Problem/Question
  • Theoretical Framework
  • Citation Tracking
  • Content Alert Services
  • Evaluating Sources
  • Primary Sources
  • Secondary Sources
  • Tiertiary Sources
  • Scholarly vs. Popular Publications
  • Qualitative Methods
  • Quantitative Methods
  • Insiderness
  • Using Non-Textual Elements
  • Limitations of the Study
  • Common Grammar Mistakes
  • Writing Concisely
  • Avoiding Plagiarism
  • Footnotes or Endnotes?
  • Further Readings
  • Generative AI and Writing
  • USC Libraries Tutorials and Other Guides
  • Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

  • Give a new interpretation of old material or combine new with old interpretations,
  • Trace the intellectual progression of the field, including major debates,
  • Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
  • Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

  • Place each work in the context of its contribution to understanding the research problem being studied.
  • Describe the relationship of each work to the others under consideration.
  • Identify new ways to interpret prior research.
  • Reveal any gaps that exist in the literature.
  • Resolve conflicts amongst seemingly contradictory previous studies.
  • Identify areas of prior scholarship to prevent duplication of effort.
  • Point the way in fulfilling a need for additional research.
  • Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE: Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

  • An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
  • Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
  • An explanation of how each work is similar to and how it varies from the others,
  • Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

  • Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
  • Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
  • Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
  • Persuasiveness -- which of the author's theses are most convincing or least convincing?
  • Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

  • Current Situation : Information necessary to understand the current topic or focus of the literature review.
  • Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
  • History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
  • Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
  • Standards : Description of the way in which you present your information.
  • Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

  • Sources in your literature review do not clearly relate to the research problem;
  • You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
  • Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
  • Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
  • Does not describe the search procedures that were used in identifying the literature to review;
  • Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
  • Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

  • How are they organizing their ideas?
  • What methods have they used to study the problem?
  • What theories have been used to explain, predict, or understand their research problem?
  • What sources have they cited to support their conclusions?
  • How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

  • Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
  • Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
  • Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

  • << Previous: Theoretical Framework
  • Next: Citation Tracking >>
  • Last Updated: May 30, 2024 9:38 AM
  • URL: https://libguides.usc.edu/writingguide

Banner

Literature Reviews in the Social Sciences: Home

  • Get started
  • Search tips
  • Select Databases
  • Organize your sources
  • Evaluate your sources
  • Structure your literature review

Literature Reviews in the Social Sciences

  This guide is designed to help you as you get started on a literature review in the social sciences.  It contains search tips, advice on where to look for sources, and information on how to organize and evaluate the sources you find.   

Doing a Literature Review

What's a Literature Review?

A literature review is the systematic written analysis of previously published research on a specific topic or subject. A literature review is not merely a summary of another scholar's articles or books. Instead, it provides a contextual analysis of the data, ideas, or theoretical concepts presented in the article, book, or other publication.

Why is a literature review important?

All scholars recognize the importance of the literature review. It provides the foundation for all scholarly research papers, theses, and dissertations. You can't write intelligently about a subject if you are unfamiliar with the existing literature. Therefore, the literature review is meant to showcase what has already been discussed or discovered in your topical area.

What types of resources should be used for a literature review?

 A literature review should be written using "credible" academic sources of information. This means using peer-reviewed, scholarly articles, books, and other publications in your subject area. You should avoid using popular magazines, unpublished works, blogs, or other resources deemed non-scholarly.

What other things should I consider while reading the source material?

Take careful notes of important ideas, concepts, or facts you find that are relevant to your overall topic or thesis. Most importantly, keep track of all the sources used. This will keep you from needing to relocate them later. If your paper is large in scope, use electronic bibliographic tools such as Endnote or RefWorks to keep track of all your citations while you write.

What about writing the literature review itself?

When you are prepared to begin writing your literature review, you should not simply summarize the articles and books you find. You should carefully consider the research and the author's interpretation of the subject matter. Then show how their research relates to your specific topic, from your unique point of view.

Annual Reviews / Dissertations & Theses

Many scholarly journals, dissertations, and theses also publish long and extremely detailed literature reviews. 

The Annual Reviews series of publications offer articles that analyze the most significant scholarly research published within the preceding year. Written by leading scholars and academics, the articles cover over 40 different subject disciplines in the social and hard sciences.

To search directly for a literature review, go to a library database and search for:

    "literature review" AND [your research topic] .

  • Annual Reviews This link opens in a new window Annual Reviews offers comprehensive, timely collections of critical reviews written by leading scientists. Annual Reviews volumes are published each year for 29 focused disciplines within the Biomedical, Physical, and Social Sciences.
  • Dissertations & Theses Global This link opens in a new window Dissertations and Theses Global contains indexes, dissertations and some theses. Full-text is available for many dissertations and theses, including those from NYU.

Books on Writing Literature Reviews

Cover Art

Sage Research Methods - Videos on Doing Literature Reviews

  • Sage Research Methods - Literature Reviews Professor Eric Jensen and Dr. Charles Laurie explain how to write a literature review, and why researchers need to do so. Literature reviews can be stand-alone research or part of a larger project. They communicate the state of academic knowledge on a given topic, specifically detailing what is still unknown.
  • How to Conduct an Effective Literature Review Claire White, an Associate professor from California State University Northridge, explains how to conduct an effective literature review using a literature review sketch.
  • Next: Get started >>
  • Last Updated: Apr 13, 2024 7:36 PM
  • URL: https://guides.nyu.edu/litreviews

Log in using your username and password

  • Search More Search for this keyword Advanced search
  • Latest content
  • Current issue
  • Write for Us
  • BMJ Journals More You are viewing from: Google Indexer

You are here

  • Volume 19, Issue 1
  • Reviewing the literature
  • Article Text
  • Article info
  • Citation Tools
  • Rapid Responses
  • Article metrics

Download PDF

  • Joanna Smith 1 ,
  • Helen Noble 2
  • 1 School of Healthcare, University of Leeds , Leeds , UK
  • 2 School of Nursing and Midwifery, Queens's University Belfast , Belfast , UK
  • Correspondence to Dr Joanna Smith , School of Healthcare, University of Leeds, Leeds LS2 9JT, UK; j.e.smith1{at}leeds.ac.uk

https://doi.org/10.1136/eb-2015-102252

Statistics from Altmetric.com

Request permissions.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Implementing evidence into practice requires nurses to identify, critically appraise and synthesise research. This may require a comprehensive literature review: this article aims to outline the approaches and stages required and provides a working example of a published review.

Are there different approaches to undertaking a literature review?

What stages are required to undertake a literature review.

The rationale for the review should be established; consider why the review is important and relevant to patient care/safety or service delivery. For example, Noble et al 's 4 review sought to understand and make recommendations for practice and research in relation to dialysis refusal and withdrawal in patients with end-stage renal disease, an area of care previously poorly described. If appropriate, highlight relevant policies and theoretical perspectives that might guide the review. Once the key issues related to the topic, including the challenges encountered in clinical practice, have been identified formulate a clear question, and/or develop an aim and specific objectives. The type of review undertaken is influenced by the purpose of the review and resources available. However, the stages or methods used to undertake a review are similar across approaches and include:

Formulating clear inclusion and exclusion criteria, for example, patient groups, ages, conditions/treatments, sources of evidence/research designs;

Justifying data bases and years searched, and whether strategies including hand searching of journals, conference proceedings and research not indexed in data bases (grey literature) will be undertaken;

Developing search terms, the PICU (P: patient, problem or population; I: intervention; C: comparison; O: outcome) framework is a useful guide when developing search terms;

Developing search skills (eg, understanding Boolean Operators, in particular the use of AND/OR) and knowledge of how data bases index topics (eg, MeSH headings). Working with a librarian experienced in undertaking health searches is invaluable when developing a search.

Once studies are selected, the quality of the research/evidence requires evaluation. Using a quality appraisal tool, such as the Critical Appraisal Skills Programme (CASP) tools, 5 results in a structured approach to assessing the rigour of studies being reviewed. 3 Approaches to data synthesis for quantitative studies may include a meta-analysis (statistical analysis of data from multiple studies of similar designs that have addressed the same question), or findings can be reported descriptively. 6 Methods applicable for synthesising qualitative studies include meta-ethnography (themes and concepts from different studies are explored and brought together using approaches similar to qualitative data analysis methods), narrative summary, thematic analysis and content analysis. 7 Table 1 outlines the stages undertaken for a published review that summarised research about parents’ experiences of living with a child with a long-term condition. 8

  • View inline

An example of rapid evidence assessment review

In summary, the type of literature review depends on the review purpose. For the novice reviewer undertaking a review can be a daunting and complex process; by following the stages outlined and being systematic a robust review is achievable. The importance of literature reviews should not be underestimated—they help summarise and make sense of an increasingly vast body of research promoting best evidence-based practice.

  • ↵ Centre for Reviews and Dissemination . Guidance for undertaking reviews in health care . 3rd edn . York : CRD, York University , 2009 .
  • ↵ Canadian Best Practices Portal. http://cbpp-pcpe.phac-aspc.gc.ca/interventions/selected-systematic-review-sites / ( accessed 7.8.2015 ).
  • Bridges J , et al
  • ↵ Critical Appraisal Skills Programme (CASP). http://www.casp-uk.net / ( accessed 7.8.2015 ).
  • Dixon-Woods M ,
  • Shaw R , et al
  • Agarwal S ,
  • Jones D , et al
  • Cheater F ,

Twitter Follow Joanna Smith at @josmith175

Competing interests None declared.

Read the full text or download the PDF:

Why is it important to do a literature review in research?

Why is it important to do a literature review in research?

Scientific Communication in Healthcare industry

The importance of scientific communication in the healthcare industry

importance and role of biostatistics in clinical research, biostatistics in public health, biostatistics in pharmacy, biostatistics in nursing,biostatistics in clinical trials,clinical biostatistics

The Importance and Role of Biostatistics in Clinical Research

 “A substantive, thorough, sophisticated literature review is a precondition for doing substantive, thorough, sophisticated research”. Boote and Baile 2005

Authors of manuscripts treat writing a literature review as a routine work or a mere formality. But a seasoned one knows the purpose and importance of a well-written literature review.  Since it is one of the basic needs for researches at any level, they have to be done vigilantly. Only then the reader will know that the basics of research have not been neglected.

Importance of Literature Review In Research

The aim of any literature review is to summarize and synthesize the arguments and ideas of existing knowledge in a particular field without adding any new contributions.   Being built on existing knowledge they help the researcher to even turn the wheels of the topic of research.  It is possible only with profound knowledge of what is wrong in the existing findings in detail to overpower them.  For other researches, the literature review gives the direction to be headed for its success. 

The common perception of literature review and reality:

As per the common belief, literature reviews are only a summary of the sources related to the research. And many authors of scientific manuscripts believe that they are only surveys of what are the researches are done on the chosen topic.  But on the contrary, it uses published information from pertinent and relevant sources like

  • Scholarly books
  • Scientific papers
  • Latest studies in the field
  • Established school of thoughts
  • Relevant articles from renowned scientific journals

and many more for a field of study or theory or a particular problem to do the following:

  • Summarize into a brief account of all information
  • Synthesize the information by restructuring and reorganizing
  • Critical evaluation of a concept or a school of thought or ideas
  • Familiarize the authors to the extent of knowledge in the particular field
  • Encapsulate
  • Compare & contrast

By doing the above on the relevant information, it provides the reader of the scientific manuscript with the following for a better understanding of it:

  • It establishes the authors’  in-depth understanding and knowledge of their field subject
  • It gives the background of the research
  • Portrays the scientific manuscript plan of examining the research result
  • Illuminates on how the knowledge has changed within the field
  • Highlights what has already been done in a particular field
  • Information of the generally accepted facts, emerging and current state of the topic of research
  • Identifies the research gap that is still unexplored or under-researched fields
  • Demonstrates how the research fits within a larger field of study
  • Provides an overview of the sources explored during the research of a particular topic

Importance of literature review in research:

The importance of literature review in scientific manuscripts can be condensed into an analytical feature to enable the multifold reach of its significance.  It adds value to the legitimacy of the research in many ways:

  • Provides the interpretation of existing literature in light of updated developments in the field to help in establishing the consistency in knowledge and relevancy of existing materials
  • It helps in calculating the impact of the latest information in the field by mapping their progress of knowledge.
  • It brings out the dialects of contradictions between various thoughts within the field to establish facts
  • The research gaps scrutinized initially are further explored to establish the latest facts of theories to add value to the field
  • Indicates the current research place in the schema of a particular field
  • Provides information for relevancy and coherency to check the research
  • Apart from elucidating the continuance of knowledge, it also points out areas that require further investigation and thus aid as a starting point of any future research
  • Justifies the research and sets up the research question
  • Sets up a theoretical framework comprising the concepts and theories of the research upon which its success can be judged
  • Helps to adopt a more appropriate methodology for the research by examining the strengths and weaknesses of existing research in the same field
  • Increases the significance of the results by comparing it with the existing literature
  • Provides a point of reference by writing the findings in the scientific manuscript
  • Helps to get the due credit from the audience for having done the fact-finding and fact-checking mission in the scientific manuscripts
  • The more the reference of relevant sources of it could increase more of its trustworthiness with the readers
  • Helps to prevent plagiarism by tailoring and uniquely tweaking the scientific manuscript not to repeat other’s original idea
  • By preventing plagiarism , it saves the scientific manuscript from rejection and thus also saves a lot of time and money
  • Helps to evaluate, condense and synthesize gist in the author’s own words to sharpen the research focus
  • Helps to compare and contrast to  show the originality and uniqueness of the research than that of the existing other researches
  • Rationalizes the need for conducting the particular research in a specified field
  • Helps to collect data accurately for allowing any new methodology of research than the existing ones
  • Enables the readers of the manuscript to answer the following questions of its readers for its better chances for publication
  • What do the researchers know?
  • What do they not know?
  • Is the scientific manuscript reliable and trustworthy?
  • What are the knowledge gaps of the researcher?

22. It helps the readers to identify the following for further reading of the scientific manuscript:

  • What has been already established, discredited and accepted in the particular field of research
  • Areas of controversy and conflicts among different schools of thought
  • Unsolved problems and issues in the connected field of research
  • The emerging trends and approaches
  • How the research extends, builds upon and leaves behind from the previous research

A profound literature review with many relevant sources of reference will enhance the chances of the scientific manuscript publication in renowned and reputed scientific journals .

References:

http://www.math.montana.edu/jobo/phdprep/phd6.pdf

journal Publishing services  |  Scientific Editing Services  |  Medical Writing Services  |  scientific research writing service  |  Scientific communication services

Related Topics:

Meta Analysis

Scientific Research Paper Writing

Medical Research Paper Writing

Scientific Communication in healthcare

pubrica academy

pubrica academy

Related posts.

importance of literature review with examples

Statistical analyses of case-control studies

importance of literature review with examples

PUB - Selecting material (e.g. excipient, active pharmaceutical ingredient) for drug development

Selecting material (e.g. excipient, active pharmaceutical ingredient, packaging material) for drug development

importance of literature review with examples

PUB - Health Economics of Data Modeling

Health economics in clinical trials

Comments are closed.

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • CBE Life Sci Educ
  • v.21(3); Fall 2022

Literature Reviews, Theoretical Frameworks, and Conceptual Frameworks: An Introduction for New Biology Education Researchers

Julie a. luft.

† Department of Mathematics, Social Studies, and Science Education, Mary Frances Early College of Education, University of Georgia, Athens, GA 30602-7124

Sophia Jeong

‡ Department of Teaching & Learning, College of Education & Human Ecology, Ohio State University, Columbus, OH 43210

Robert Idsardi

§ Department of Biology, Eastern Washington University, Cheney, WA 99004

Grant Gardner

∥ Department of Biology, Middle Tennessee State University, Murfreesboro, TN 37132

Associated Data

To frame their work, biology education researchers need to consider the role of literature reviews, theoretical frameworks, and conceptual frameworks as critical elements of the research and writing process. However, these elements can be confusing for scholars new to education research. This Research Methods article is designed to provide an overview of each of these elements and delineate the purpose of each in the educational research process. We describe what biology education researchers should consider as they conduct literature reviews, identify theoretical frameworks, and construct conceptual frameworks. Clarifying these different components of educational research studies can be helpful to new biology education researchers and the biology education research community at large in situating their work in the broader scholarly literature.

INTRODUCTION

Discipline-based education research (DBER) involves the purposeful and situated study of teaching and learning in specific disciplinary areas ( Singer et al. , 2012 ). Studies in DBER are guided by research questions that reflect disciplines’ priorities and worldviews. Researchers can use quantitative data, qualitative data, or both to answer these research questions through a variety of methodological traditions. Across all methodologies, there are different methods associated with planning and conducting educational research studies that include the use of surveys, interviews, observations, artifacts, or instruments. Ensuring the coherence of these elements to the discipline’s perspective also involves situating the work in the broader scholarly literature. The tools for doing this include literature reviews, theoretical frameworks, and conceptual frameworks. However, the purpose and function of each of these elements is often confusing to new education researchers. The goal of this article is to introduce new biology education researchers to these three important elements important in DBER scholarship and the broader educational literature.

The first element we discuss is a review of research (literature reviews), which highlights the need for a specific research question, study problem, or topic of investigation. Literature reviews situate the relevance of the study within a topic and a field. The process may seem familiar to science researchers entering DBER fields, but new researchers may still struggle in conducting the review. Booth et al. (2016b) highlight some of the challenges novice education researchers face when conducting a review of literature. They point out that novice researchers struggle in deciding how to focus the review, determining the scope of articles needed in the review, and knowing how to be critical of the articles in the review. Overcoming these challenges (and others) can help novice researchers construct a sound literature review that can inform the design of the study and help ensure the work makes a contribution to the field.

The second and third highlighted elements are theoretical and conceptual frameworks. These guide biology education research (BER) studies, and may be less familiar to science researchers. These elements are important in shaping the construction of new knowledge. Theoretical frameworks offer a way to explain and interpret the studied phenomenon, while conceptual frameworks clarify assumptions about the studied phenomenon. Despite the importance of these constructs in educational research, biology educational researchers have noted the limited use of theoretical or conceptual frameworks in published work ( DeHaan, 2011 ; Dirks, 2011 ; Lo et al. , 2019 ). In reviewing articles published in CBE—Life Sciences Education ( LSE ) between 2015 and 2019, we found that fewer than 25% of the research articles had a theoretical or conceptual framework (see the Supplemental Information), and at times there was an inconsistent use of theoretical and conceptual frameworks. Clearly, these frameworks are challenging for published biology education researchers, which suggests the importance of providing some initial guidance to new biology education researchers.

Fortunately, educational researchers have increased their explicit use of these frameworks over time, and this is influencing educational research in science, technology, engineering, and mathematics (STEM) fields. For instance, a quick search for theoretical or conceptual frameworks in the abstracts of articles in Educational Research Complete (a common database for educational research) in STEM fields demonstrates a dramatic change over the last 20 years: from only 778 articles published between 2000 and 2010 to 5703 articles published between 2010 and 2020, a more than sevenfold increase. Greater recognition of the importance of these frameworks is contributing to DBER authors being more explicit about such frameworks in their studies.

Collectively, literature reviews, theoretical frameworks, and conceptual frameworks work to guide methodological decisions and the elucidation of important findings. Each offers a different perspective on the problem of study and is an essential element in all forms of educational research. As new researchers seek to learn about these elements, they will find different resources, a variety of perspectives, and many suggestions about the construction and use of these elements. The wide range of available information can overwhelm the new researcher who just wants to learn the distinction between these elements or how to craft them adequately.

Our goal in writing this paper is not to offer specific advice about how to write these sections in scholarly work. Instead, we wanted to introduce these elements to those who are new to BER and who are interested in better distinguishing one from the other. In this paper, we share the purpose of each element in BER scholarship, along with important points on its construction. We also provide references for additional resources that may be beneficial to better understanding each element. Table 1 summarizes the key distinctions among these elements.

Comparison of literature reviews, theoretical frameworks, and conceptual reviews

This article is written for the new biology education researcher who is just learning about these different elements or for scientists looking to become more involved in BER. It is a result of our own work as science education and biology education researchers, whether as graduate students and postdoctoral scholars or newly hired and established faculty members. This is the article we wish had been available as we started to learn about these elements or discussed them with new educational researchers in biology.

LITERATURE REVIEWS

Purpose of a literature review.

A literature review is foundational to any research study in education or science. In education, a well-conceptualized and well-executed review provides a summary of the research that has already been done on a specific topic and identifies questions that remain to be answered, thus illustrating the current research project’s potential contribution to the field and the reasoning behind the methodological approach selected for the study ( Maxwell, 2012 ). BER is an evolving disciplinary area that is redefining areas of conceptual emphasis as well as orientations toward teaching and learning (e.g., Labov et al. , 2010 ; American Association for the Advancement of Science, 2011 ; Nehm, 2019 ). As a result, building comprehensive, critical, purposeful, and concise literature reviews can be a challenge for new biology education researchers.

Building Literature Reviews

There are different ways to approach and construct a literature review. Booth et al. (2016a) provide an overview that includes, for example, scoping reviews, which are focused only on notable studies and use a basic method of analysis, and integrative reviews, which are the result of exhaustive literature searches across different genres. Underlying each of these different review processes are attention to the s earch process, a ppraisa l of articles, s ynthesis of the literature, and a nalysis: SALSA ( Booth et al. , 2016a ). This useful acronym can help the researcher focus on the process while building a specific type of review.

However, new educational researchers often have questions about literature reviews that are foundational to SALSA or other approaches. Common questions concern determining which literature pertains to the topic of study or the role of the literature review in the design of the study. This section addresses such questions broadly while providing general guidance for writing a narrative literature review that evaluates the most pertinent studies.

The literature review process should begin before the research is conducted. As Boote and Beile (2005 , p. 3) suggested, researchers should be “scholars before researchers.” They point out that having a good working knowledge of the proposed topic helps illuminate avenues of study. Some subject areas have a deep body of work to read and reflect upon, providing a strong foundation for developing the research question(s). For instance, the teaching and learning of evolution is an area of long-standing interest in the BER community, generating many studies (e.g., Perry et al. , 2008 ; Barnes and Brownell, 2016 ) and reviews of research (e.g., Sickel and Friedrichsen, 2013 ; Ziadie and Andrews, 2018 ). Emerging areas of BER include the affective domain, issues of transfer, and metacognition ( Singer et al. , 2012 ). Many studies in these areas are transdisciplinary and not always specific to biology education (e.g., Rodrigo-Peiris et al. , 2018 ; Kolpikova et al. , 2019 ). These newer areas may require reading outside BER; fortunately, summaries of some of these topics can be found in the Current Insights section of the LSE website.

In focusing on a specific problem within a broader research strand, a new researcher will likely need to examine research outside BER. Depending upon the area of study, the expanded reading list might involve a mix of BER, DBER, and educational research studies. Determining the scope of the reading is not always straightforward. A simple way to focus one’s reading is to create a “summary phrase” or “research nugget,” which is a very brief descriptive statement about the study. It should focus on the essence of the study, for example, “first-year nonmajor students’ understanding of evolution,” “metacognitive prompts to enhance learning during biochemistry,” or “instructors’ inquiry-based instructional practices after professional development programming.” This type of phrase should help a new researcher identify two or more areas to review that pertain to the study. Focusing on recent research in the last 5 years is a good first step. Additional studies can be identified by reading relevant works referenced in those articles. It is also important to read seminal studies that are more than 5 years old. Reading a range of studies should give the researcher the necessary command of the subject in order to suggest a research question.

Given that the research question(s) arise from the literature review, the review should also substantiate the selected methodological approach. The review and research question(s) guide the researcher in determining how to collect and analyze data. Often the methodological approach used in a study is selected to contribute knowledge that expands upon what has been published previously about the topic (see Institute of Education Sciences and National Science Foundation, 2013 ). An emerging topic of study may need an exploratory approach that allows for a description of the phenomenon and development of a potential theory. This could, but not necessarily, require a methodological approach that uses interviews, observations, surveys, or other instruments. An extensively studied topic may call for the additional understanding of specific factors or variables; this type of study would be well suited to a verification or a causal research design. These could entail a methodological approach that uses valid and reliable instruments, observations, or interviews to determine an effect in the studied event. In either of these examples, the researcher(s) may use a qualitative, quantitative, or mixed methods methodological approach.

Even with a good research question, there is still more reading to be done. The complexity and focus of the research question dictates the depth and breadth of the literature to be examined. Questions that connect multiple topics can require broad literature reviews. For instance, a study that explores the impact of a biology faculty learning community on the inquiry instruction of faculty could have the following review areas: learning communities among biology faculty, inquiry instruction among biology faculty, and inquiry instruction among biology faculty as a result of professional learning. Biology education researchers need to consider whether their literature review requires studies from different disciplines within or outside DBER. For the example given, it would be fruitful to look at research focused on learning communities with faculty in STEM fields or in general education fields that result in instructional change. It is important not to be too narrow or too broad when reading. When the conclusions of articles start to sound similar or no new insights are gained, the researcher likely has a good foundation for a literature review. This level of reading should allow the researcher to demonstrate a mastery in understanding the researched topic, explain the suitability of the proposed research approach, and point to the need for the refined research question(s).

The literature review should include the researcher’s evaluation and critique of the selected studies. A researcher may have a large collection of studies, but not all of the studies will follow standards important in the reporting of empirical work in the social sciences. The American Educational Research Association ( Duran et al. , 2006 ), for example, offers a general discussion about standards for such work: an adequate review of research informing the study, the existence of sound and appropriate data collection and analysis methods, and appropriate conclusions that do not overstep or underexplore the analyzed data. The Institute of Education Sciences and National Science Foundation (2013) also offer Common Guidelines for Education Research and Development that can be used to evaluate collected studies.

Because not all journals adhere to such standards, it is important that a researcher review each study to determine the quality of published research, per the guidelines suggested earlier. In some instances, the research may be fatally flawed. Examples of such flaws include data that do not pertain to the question, a lack of discussion about the data collection, poorly constructed instruments, or an inadequate analysis. These types of errors result in studies that are incomplete, error-laden, or inaccurate and should be excluded from the review. Most studies have limitations, and the author(s) often make them explicit. For instance, there may be an instructor effect, recognized bias in the analysis, or issues with the sample population. Limitations are usually addressed by the research team in some way to ensure a sound and acceptable research process. Occasionally, the limitations associated with the study can be significant and not addressed adequately, which leaves a consequential decision in the hands of the researcher. Providing critiques of studies in the literature review process gives the reader confidence that the researcher has carefully examined relevant work in preparation for the study and, ultimately, the manuscript.

A solid literature review clearly anchors the proposed study in the field and connects the research question(s), the methodological approach, and the discussion. Reviewing extant research leads to research questions that will contribute to what is known in the field. By summarizing what is known, the literature review points to what needs to be known, which in turn guides decisions about methodology. Finally, notable findings of the new study are discussed in reference to those described in the literature review.

Within published BER studies, literature reviews can be placed in different locations in an article. When included in the introductory section of the study, the first few paragraphs of the manuscript set the stage, with the literature review following the opening paragraphs. Cooper et al. (2019) illustrate this approach in their study of course-based undergraduate research experiences (CUREs). An introduction discussing the potential of CURES is followed by an analysis of the existing literature relevant to the design of CUREs that allows for novel student discoveries. Within this review, the authors point out contradictory findings among research on novel student discoveries. This clarifies the need for their study, which is described and highlighted through specific research aims.

A literature reviews can also make up a separate section in a paper. For example, the introduction to Todd et al. (2019) illustrates the need for their research topic by highlighting the potential of learning progressions (LPs) and suggesting that LPs may help mitigate learning loss in genetics. At the end of the introduction, the authors state their specific research questions. The review of literature following this opening section comprises two subsections. One focuses on learning loss in general and examines a variety of studies and meta-analyses from the disciplines of medical education, mathematics, and reading. The second section focuses specifically on LPs in genetics and highlights student learning in the midst of LPs. These separate reviews provide insights into the stated research question.

Suggestions and Advice

A well-conceptualized, comprehensive, and critical literature review reveals the understanding of the topic that the researcher brings to the study. Literature reviews should not be so big that there is no clear area of focus; nor should they be so narrow that no real research question arises. The task for a researcher is to craft an efficient literature review that offers a critical analysis of published work, articulates the need for the study, guides the methodological approach to the topic of study, and provides an adequate foundation for the discussion of the findings.

In our own writing of literature reviews, there are often many drafts. An early draft may seem well suited to the study because the need for and approach to the study are well described. However, as the results of the study are analyzed and findings begin to emerge, the existing literature review may be inadequate and need revision. The need for an expanded discussion about the research area can result in the inclusion of new studies that support the explanation of a potential finding. The literature review may also prove to be too broad. Refocusing on a specific area allows for more contemplation of a finding.

It should be noted that there are different types of literature reviews, and many books and articles have been written about the different ways to embark on these types of reviews. Among these different resources, the following may be helpful in considering how to refine the review process for scholarly journals:

  • Booth, A., Sutton, A., & Papaioannou, D. (2016a). Systemic approaches to a successful literature review (2nd ed.). Los Angeles, CA: Sage. This book addresses different types of literature reviews and offers important suggestions pertaining to defining the scope of the literature review and assessing extant studies.
  • Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., & Fitzgerald, W. T. (2016b). The craft of research (4th ed.). Chicago: University of Chicago Press. This book can help the novice consider how to make the case for an area of study. While this book is not specifically about literature reviews, it offers suggestions about making the case for your study.
  • Galvan, J. L., & Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences (7th ed.). Routledge. This book offers guidance on writing different types of literature reviews. For the novice researcher, there are useful suggestions for creating coherent literature reviews.

THEORETICAL FRAMEWORKS

Purpose of theoretical frameworks.

As new education researchers may be less familiar with theoretical frameworks than with literature reviews, this discussion begins with an analogy. Envision a biologist, chemist, and physicist examining together the dramatic effect of a fog tsunami over the ocean. A biologist gazing at this phenomenon may be concerned with the effect of fog on various species. A chemist may be interested in the chemical composition of the fog as water vapor condenses around bits of salt. A physicist may be focused on the refraction of light to make fog appear to be “sitting” above the ocean. While observing the same “objective event,” the scientists are operating under different theoretical frameworks that provide a particular perspective or “lens” for the interpretation of the phenomenon. Each of these scientists brings specialized knowledge, experiences, and values to this phenomenon, and these influence the interpretation of the phenomenon. The scientists’ theoretical frameworks influence how they design and carry out their studies and interpret their data.

Within an educational study, a theoretical framework helps to explain a phenomenon through a particular lens and challenges and extends existing knowledge within the limitations of that lens. Theoretical frameworks are explicitly stated by an educational researcher in the paper’s framework, theory, or relevant literature section. The framework shapes the types of questions asked, guides the method by which data are collected and analyzed, and informs the discussion of the results of the study. It also reveals the researcher’s subjectivities, for example, values, social experience, and viewpoint ( Allen, 2017 ). It is essential that a novice researcher learn to explicitly state a theoretical framework, because all research questions are being asked from the researcher’s implicit or explicit assumptions of a phenomenon of interest ( Schwandt, 2000 ).

Selecting Theoretical Frameworks

Theoretical frameworks are one of the most contemplated elements in our work in educational research. In this section, we share three important considerations for new scholars selecting a theoretical framework.

The first step in identifying a theoretical framework involves reflecting on the phenomenon within the study and the assumptions aligned with the phenomenon. The phenomenon involves the studied event. There are many possibilities, for example, student learning, instructional approach, or group organization. A researcher holds assumptions about how the phenomenon will be effected, influenced, changed, or portrayed. It is ultimately the researcher’s assumption(s) about the phenomenon that aligns with a theoretical framework. An example can help illustrate how a researcher’s reflection on the phenomenon and acknowledgment of assumptions can result in the identification of a theoretical framework.

In our example, a biology education researcher may be interested in exploring how students’ learning of difficult biological concepts can be supported by the interactions of group members. The phenomenon of interest is the interactions among the peers, and the researcher assumes that more knowledgeable students are important in supporting the learning of the group. As a result, the researcher may draw on Vygotsky’s (1978) sociocultural theory of learning and development that is focused on the phenomenon of student learning in a social setting. This theory posits the critical nature of interactions among students and between students and teachers in the process of building knowledge. A researcher drawing upon this framework holds the assumption that learning is a dynamic social process involving questions and explanations among students in the classroom and that more knowledgeable peers play an important part in the process of building conceptual knowledge.

It is important to state at this point that there are many different theoretical frameworks. Some frameworks focus on learning and knowing, while other theoretical frameworks focus on equity, empowerment, or discourse. Some frameworks are well articulated, and others are still being refined. For a new researcher, it can be challenging to find a theoretical framework. Two of the best ways to look for theoretical frameworks is through published works that highlight different frameworks.

When a theoretical framework is selected, it should clearly connect to all parts of the study. The framework should augment the study by adding a perspective that provides greater insights into the phenomenon. It should clearly align with the studies described in the literature review. For instance, a framework focused on learning would correspond to research that reported different learning outcomes for similar studies. The methods for data collection and analysis should also correspond to the framework. For instance, a study about instructional interventions could use a theoretical framework concerned with learning and could collect data about the effect of the intervention on what is learned. When the data are analyzed, the theoretical framework should provide added meaning to the findings, and the findings should align with the theoretical framework.

A study by Jensen and Lawson (2011) provides an example of how a theoretical framework connects different parts of the study. They compared undergraduate biology students in heterogeneous and homogeneous groups over the course of a semester. Jensen and Lawson (2011) assumed that learning involved collaboration and more knowledgeable peers, which made Vygotsky’s (1978) theory a good fit for their study. They predicted that students in heterogeneous groups would experience greater improvement in their reasoning abilities and science achievements with much of the learning guided by the more knowledgeable peers.

In the enactment of the study, they collected data about the instruction in traditional and inquiry-oriented classes, while the students worked in homogeneous or heterogeneous groups. To determine the effect of working in groups, the authors also measured students’ reasoning abilities and achievement. Each data-collection and analysis decision connected to understanding the influence of collaborative work.

Their findings highlighted aspects of Vygotsky’s (1978) theory of learning. One finding, for instance, posited that inquiry instruction, as a whole, resulted in reasoning and achievement gains. This links to Vygotsky (1978) , because inquiry instruction involves interactions among group members. A more nuanced finding was that group composition had a conditional effect. Heterogeneous groups performed better with more traditional and didactic instruction, regardless of the reasoning ability of the group members. Homogeneous groups worked better during interaction-rich activities for students with low reasoning ability. The authors attributed the variation to the different types of helping behaviors of students. High-performing students provided the answers, while students with low reasoning ability had to work collectively through the material. In terms of Vygotsky (1978) , this finding provided new insights into the learning context in which productive interactions can occur for students.

Another consideration in the selection and use of a theoretical framework pertains to its orientation to the study. This can result in the theoretical framework prioritizing individuals, institutions, and/or policies ( Anfara and Mertz, 2014 ). Frameworks that connect to individuals, for instance, could contribute to understanding their actions, learning, or knowledge. Institutional frameworks, on the other hand, offer insights into how institutions, organizations, or groups can influence individuals or materials. Policy theories provide ways to understand how national or local policies can dictate an emphasis on outcomes or instructional design. These different types of frameworks highlight different aspects in an educational setting, which influences the design of the study and the collection of data. In addition, these different frameworks offer a way to make sense of the data. Aligning the data collection and analysis with the framework ensures that a study is coherent and can contribute to the field.

New understandings emerge when different theoretical frameworks are used. For instance, Ebert-May et al. (2015) prioritized the individual level within conceptual change theory (see Posner et al. , 1982 ). In this theory, an individual’s knowledge changes when it no longer fits the phenomenon. Ebert-May et al. (2015) designed a professional development program challenging biology postdoctoral scholars’ existing conceptions of teaching. The authors reported that the biology postdoctoral scholars’ teaching practices became more student-centered as they were challenged to explain their instructional decision making. According to the theory, the biology postdoctoral scholars’ dissatisfaction in their descriptions of teaching and learning initiated change in their knowledge and instruction. These results reveal how conceptual change theory can explain the learning of participants and guide the design of professional development programming.

The communities of practice (CoP) theoretical framework ( Lave, 1988 ; Wenger, 1998 ) prioritizes the institutional level , suggesting that learning occurs when individuals learn from and contribute to the communities in which they reside. Grounded in the assumption of community learning, the literature on CoP suggests that, as individuals interact regularly with the other members of their group, they learn about the rules, roles, and goals of the community ( Allee, 2000 ). A study conducted by Gehrke and Kezar (2017) used the CoP framework to understand organizational change by examining the involvement of individual faculty engaged in a cross-institutional CoP focused on changing the instructional practice of faculty at each institution. In the CoP, faculty members were involved in enhancing instructional materials within their department, which aligned with an overarching goal of instituting instruction that embraced active learning. Not surprisingly, Gehrke and Kezar (2017) revealed that faculty who perceived the community culture as important in their work cultivated institutional change. Furthermore, they found that institutional change was sustained when key leaders served as mentors and provided support for faculty, and as faculty themselves developed into leaders. This study reveals the complexity of individual roles in a COP in order to support institutional instructional change.

It is important to explicitly state the theoretical framework used in a study, but elucidating a theoretical framework can be challenging for a new educational researcher. The literature review can help to identify an applicable theoretical framework. Focal areas of the review or central terms often connect to assumptions and assertions associated with the framework that pertain to the phenomenon of interest. Another way to identify a theoretical framework is self-reflection by the researcher on personal beliefs and understandings about the nature of knowledge the researcher brings to the study ( Lysaght, 2011 ). In stating one’s beliefs and understandings related to the study (e.g., students construct their knowledge, instructional materials support learning), an orientation becomes evident that will suggest a particular theoretical framework. Theoretical frameworks are not arbitrary , but purposefully selected.

With experience, a researcher may find expanded roles for theoretical frameworks. Researchers may revise an existing framework that has limited explanatory power, or they may decide there is a need to develop a new theoretical framework. These frameworks can emerge from a current study or the need to explain a phenomenon in a new way. Researchers may also find that multiple theoretical frameworks are necessary to frame and explore a problem, as different frameworks can provide different insights into a problem.

Finally, it is important to recognize that choosing “x” theoretical framework does not necessarily mean a researcher chooses “y” methodology and so on, nor is there a clear-cut, linear process in selecting a theoretical framework for one’s study. In part, the nonlinear process of identifying a theoretical framework is what makes understanding and using theoretical frameworks challenging. For the novice scholar, contemplating and understanding theoretical frameworks is essential. Fortunately, there are articles and books that can help:

  • Creswell, J. W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Los Angeles, CA: Sage. This book provides an overview of theoretical frameworks in general educational research.
  • Ding, L. (2019). Theoretical perspectives of quantitative physics education research. Physical Review Physics Education Research , 15 (2), 020101-1–020101-13. This paper illustrates how a DBER field can use theoretical frameworks.
  • Nehm, R. (2019). Biology education research: Building integrative frameworks for teaching and learning about living systems. Disciplinary and Interdisciplinary Science Education Research , 1 , ar15. https://doi.org/10.1186/s43031-019-0017-6 . This paper articulates the need for studies in BER to explicitly state theoretical frameworks and provides examples of potential studies.
  • Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice . Sage. This book also provides an overview of theoretical frameworks, but for both research and evaluation.

CONCEPTUAL FRAMEWORKS

Purpose of a conceptual framework.

A conceptual framework is a description of the way a researcher understands the factors and/or variables that are involved in the study and their relationships to one another. The purpose of a conceptual framework is to articulate the concepts under study using relevant literature ( Rocco and Plakhotnik, 2009 ) and to clarify the presumed relationships among those concepts ( Rocco and Plakhotnik, 2009 ; Anfara and Mertz, 2014 ). Conceptual frameworks are different from theoretical frameworks in both their breadth and grounding in established findings. Whereas a theoretical framework articulates the lens through which a researcher views the work, the conceptual framework is often more mechanistic and malleable.

Conceptual frameworks are broader, encompassing both established theories (i.e., theoretical frameworks) and the researchers’ own emergent ideas. Emergent ideas, for example, may be rooted in informal and/or unpublished observations from experience. These emergent ideas would not be considered a “theory” if they are not yet tested, supported by systematically collected evidence, and peer reviewed. However, they do still play an important role in the way researchers approach their studies. The conceptual framework allows authors to clearly describe their emergent ideas so that connections among ideas in the study and the significance of the study are apparent to readers.

Constructing Conceptual Frameworks

Including a conceptual framework in a research study is important, but researchers often opt to include either a conceptual or a theoretical framework. Either may be adequate, but both provide greater insight into the research approach. For instance, a research team plans to test a novel component of an existing theory. In their study, they describe the existing theoretical framework that informs their work and then present their own conceptual framework. Within this conceptual framework, specific topics portray emergent ideas that are related to the theory. Describing both frameworks allows readers to better understand the researchers’ assumptions, orientations, and understanding of concepts being investigated. For example, Connolly et al. (2018) included a conceptual framework that described how they applied a theoretical framework of social cognitive career theory (SCCT) to their study on teaching programs for doctoral students. In their conceptual framework, the authors described SCCT, explained how it applied to the investigation, and drew upon results from previous studies to justify the proposed connections between the theory and their emergent ideas.

In some cases, authors may be able to sufficiently describe their conceptualization of the phenomenon under study in an introduction alone, without a separate conceptual framework section. However, incomplete descriptions of how the researchers conceptualize the components of the study may limit the significance of the study by making the research less intelligible to readers. This is especially problematic when studying topics in which researchers use the same terms for different constructs or different terms for similar and overlapping constructs (e.g., inquiry, teacher beliefs, pedagogical content knowledge, or active learning). Authors must describe their conceptualization of a construct if the research is to be understandable and useful.

There are some key areas to consider regarding the inclusion of a conceptual framework in a study. To begin with, it is important to recognize that conceptual frameworks are constructed by the researchers conducting the study ( Rocco and Plakhotnik, 2009 ; Maxwell, 2012 ). This is different from theoretical frameworks that are often taken from established literature. Researchers should bring together ideas from the literature, but they may be influenced by their own experiences as a student and/or instructor, the shared experiences of others, or thought experiments as they construct a description, model, or representation of their understanding of the phenomenon under study. This is an exercise in intellectual organization and clarity that often considers what is learned, known, and experienced. The conceptual framework makes these constructs explicitly visible to readers, who may have different understandings of the phenomenon based on their prior knowledge and experience. There is no single method to go about this intellectual work.

Reeves et al. (2016) is an example of an article that proposed a conceptual framework about graduate teaching assistant professional development evaluation and research. The authors used existing literature to create a novel framework that filled a gap in current research and practice related to the training of graduate teaching assistants. This conceptual framework can guide the systematic collection of data by other researchers because the framework describes the relationships among various factors that influence teaching and learning. The Reeves et al. (2016) conceptual framework may be modified as additional data are collected and analyzed by other researchers. This is not uncommon, as conceptual frameworks can serve as catalysts for concerted research efforts that systematically explore a phenomenon (e.g., Reynolds et al. , 2012 ; Brownell and Kloser, 2015 ).

Sabel et al. (2017) used a conceptual framework in their exploration of how scaffolds, an external factor, interact with internal factors to support student learning. Their conceptual framework integrated principles from two theoretical frameworks, self-regulated learning and metacognition, to illustrate how the research team conceptualized students’ use of scaffolds in their learning ( Figure 1 ). Sabel et al. (2017) created this model using their interpretations of these two frameworks in the context of their teaching.

An external file that holds a picture, illustration, etc.
Object name is cbe-21-rm33-g001.jpg

Conceptual framework from Sabel et al. (2017) .

A conceptual framework should describe the relationship among components of the investigation ( Anfara and Mertz, 2014 ). These relationships should guide the researcher’s methods of approaching the study ( Miles et al. , 2014 ) and inform both the data to be collected and how those data should be analyzed. Explicitly describing the connections among the ideas allows the researcher to justify the importance of the study and the rigor of the research design. Just as importantly, these frameworks help readers understand why certain components of a system were not explored in the study. This is a challenge in education research, which is rooted in complex environments with many variables that are difficult to control.

For example, Sabel et al. (2017) stated: “Scaffolds, such as enhanced answer keys and reflection questions, can help students and instructors bridge the external and internal factors and support learning” (p. 3). They connected the scaffolds in the study to the three dimensions of metacognition and the eventual transformation of existing ideas into new or revised ideas. Their framework provides a rationale for focusing on how students use two different scaffolds, and not on other factors that may influence a student’s success (self-efficacy, use of active learning, exam format, etc.).

In constructing conceptual frameworks, researchers should address needed areas of study and/or contradictions discovered in literature reviews. By attending to these areas, researchers can strengthen their arguments for the importance of a study. For instance, conceptual frameworks can address how the current study will fill gaps in the research, resolve contradictions in existing literature, or suggest a new area of study. While a literature review describes what is known and not known about the phenomenon, the conceptual framework leverages these gaps in describing the current study ( Maxwell, 2012 ). In the example of Sabel et al. (2017) , the authors indicated there was a gap in the literature regarding how scaffolds engage students in metacognition to promote learning in large classes. Their study helps fill that gap by describing how scaffolds can support students in the three dimensions of metacognition: intelligibility, plausibility, and wide applicability. In another example, Lane (2016) integrated research from science identity, the ethic of care, the sense of belonging, and an expertise model of student success to form a conceptual framework that addressed the critiques of other frameworks. In a more recent example, Sbeglia et al. (2021) illustrated how a conceptual framework influences the methodological choices and inferences in studies by educational researchers.

Sometimes researchers draw upon the conceptual frameworks of other researchers. When a researcher’s conceptual framework closely aligns with an existing framework, the discussion may be brief. For example, Ghee et al. (2016) referred to portions of SCCT as their conceptual framework to explain the significance of their work on students’ self-efficacy and career interests. Because the authors’ conceptualization of this phenomenon aligned with a previously described framework, they briefly mentioned the conceptual framework and provided additional citations that provided more detail for the readers.

Within both the BER and the broader DBER communities, conceptual frameworks have been used to describe different constructs. For example, some researchers have used the term “conceptual framework” to describe students’ conceptual understandings of a biological phenomenon. This is distinct from a researcher’s conceptual framework of the educational phenomenon under investigation, which may also need to be explicitly described in the article. Other studies have presented a research logic model or flowchart of the research design as a conceptual framework. These constructions can be quite valuable in helping readers understand the data-collection and analysis process. However, a model depicting the study design does not serve the same role as a conceptual framework. Researchers need to avoid conflating these constructs by differentiating the researchers’ conceptual framework that guides the study from the research design, when applicable.

Explicitly describing conceptual frameworks is essential in depicting the focus of the study. We have found that being explicit in a conceptual framework means using accepted terminology, referencing prior work, and clearly noting connections between terms. This description can also highlight gaps in the literature or suggest potential contributions to the field of study. A well-elucidated conceptual framework can suggest additional studies that may be warranted. This can also spur other researchers to consider how they would approach the examination of a phenomenon and could result in a revised conceptual framework.

It can be challenging to create conceptual frameworks, but they are important. Below are two resources that could be helpful in constructing and presenting conceptual frameworks in educational research:

  • Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Los Angeles, CA: Sage. Chapter 3 in this book describes how to construct conceptual frameworks.
  • Ravitch, S. M., & Riggan, M. (2016). Reason & rigor: How conceptual frameworks guide research . Los Angeles, CA: Sage. This book explains how conceptual frameworks guide the research questions, data collection, data analyses, and interpretation of results.

CONCLUDING THOUGHTS

Literature reviews, theoretical frameworks, and conceptual frameworks are all important in DBER and BER. Robust literature reviews reinforce the importance of a study. Theoretical frameworks connect the study to the base of knowledge in educational theory and specify the researcher’s assumptions. Conceptual frameworks allow researchers to explicitly describe their conceptualization of the relationships among the components of the phenomenon under study. Table 1 provides a general overview of these components in order to assist biology education researchers in thinking about these elements.

It is important to emphasize that these different elements are intertwined. When these elements are aligned and complement one another, the study is coherent, and the study findings contribute to knowledge in the field. When literature reviews, theoretical frameworks, and conceptual frameworks are disconnected from one another, the study suffers. The point of the study is lost, suggested findings are unsupported, or important conclusions are invisible to the researcher. In addition, this misalignment may be costly in terms of time and money.

Conducting a literature review, selecting a theoretical framework, and building a conceptual framework are some of the most difficult elements of a research study. It takes time to understand the relevant research, identify a theoretical framework that provides important insights into the study, and formulate a conceptual framework that organizes the finding. In the research process, there is often a constant back and forth among these elements as the study evolves. With an ongoing refinement of the review of literature, clarification of the theoretical framework, and articulation of a conceptual framework, a sound study can emerge that makes a contribution to the field. This is the goal of BER and education research.

Supplementary Material

  • Allee, V. (2000). Knowledge networks and communities of learning . OD Practitioner , 32 ( 4 ), 4–13. [ Google Scholar ]
  • Allen, M. (2017). The Sage encyclopedia of communication research methods (Vols. 1–4 ). Los Angeles, CA: Sage. 10.4135/9781483381411 [ CrossRef ] [ Google Scholar ]
  • American Association for the Advancement of Science. (2011). Vision and change in undergraduate biology education: A call to action . Washington, DC. [ Google Scholar ]
  • Anfara, V. A., Mertz, N. T. (2014). Setting the stage . In Anfara, V. A., Mertz, N. T. (eds.), Theoretical frameworks in qualitative research (pp. 1–22). Sage. [ Google Scholar ]
  • Barnes, M. E., Brownell, S. E. (2016). Practices and perspectives of college instructors on addressing religious beliefs when teaching evolution . CBE—Life Sciences Education , 15 ( 2 ), ar18. https://doi.org/10.1187/cbe.15-11-0243 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Boote, D. N., Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation . Educational Researcher , 34 ( 6 ), 3–15. 10.3102/0013189x034006003 [ CrossRef ] [ Google Scholar ]
  • Booth, A., Sutton, A., Papaioannou, D. (2016a). Systemic approaches to a successful literature review (2nd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., Fitzgerald, W. T. (2016b). The craft of research (4th ed.). Chicago, IL: University of Chicago Press. [ Google Scholar ]
  • Brownell, S. E., Kloser, M. J. (2015). Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology . Studies in Higher Education , 40 ( 3 ), 525–544. https://doi.org/10.1080/03075079.2015.1004234 [ Google Scholar ]
  • Connolly, M. R., Lee, Y. G., Savoy, J. N. (2018). The effects of doctoral teaching development on early-career STEM scholars’ college teaching self-efficacy . CBE—Life Sciences Education , 17 ( 1 ), ar14. https://doi.org/10.1187/cbe.17-02-0039 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Cooper, K. M., Blattman, J. N., Hendrix, T., Brownell, S. E. (2019). The impact of broadly relevant novel discoveries on student project ownership in a traditional lab course turned CURE . CBE—Life Sciences Education , 18 ( 4 ), ar57. https://doi.org/10.1187/cbe.19-06-0113 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Creswell, J. W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • DeHaan, R. L. (2011). Education research in the biological sciences: A nine decade review (Paper commissioned by the NAS/NRC Committee on the Status, Contributions, and Future Directions of Discipline Based Education Research) . Washington, DC: National Academies Press. Retrieved May 20, 2022, from www7.nationalacademies.org/bose/DBER_Mee ting2_commissioned_papers_page.html [ Google Scholar ]
  • Ding, L. (2019). Theoretical perspectives of quantitative physics education research . Physical Review Physics Education Research , 15 ( 2 ), 020101. [ Google Scholar ]
  • Dirks, C. (2011). The current status and future direction of biology education research . Paper presented at: Second Committee Meeting on the Status, Contributions, and Future Directions of Discipline-Based Education Research, 18–19 October (Washington, DC). Retrieved May 20, 2022, from http://sites.nationalacademies.org/DBASSE/BOSE/DBASSE_071087 [ Google Scholar ]
  • Duran, R. P., Eisenhart, M. A., Erickson, F. D., Grant, C. A., Green, J. L., Hedges, L. V., Schneider, B. L. (2006). Standards for reporting on empirical social science research in AERA publications: American Educational Research Association . Educational Researcher , 35 ( 6 ), 33–40. [ Google Scholar ]
  • Ebert-May, D., Derting, T. L., Henkel, T. P., Middlemis Maher, J., Momsen, J. L., Arnold, B., Passmore, H. A. (2015). Breaking the cycle: Future faculty begin teaching with learner-centered strategies after professional development . CBE—Life Sciences Education , 14 ( 2 ), ar22. https://doi.org/10.1187/cbe.14-12-0222 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Galvan, J. L., Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences (7th ed.). New York, NY: Routledge. https://doi.org/10.4324/9781315229386 [ Google Scholar ]
  • Gehrke, S., Kezar, A. (2017). The roles of STEM faculty communities of practice in institutional and departmental reform in higher education . American Educational Research Journal , 54 ( 5 ), 803–833. https://doi.org/10.3102/0002831217706736 [ Google Scholar ]
  • Ghee, M., Keels, M., Collins, D., Neal-Spence, C., Baker, E. (2016). Fine-tuning summer research programs to promote underrepresented students’ persistence in the STEM pathway . CBE—Life Sciences Education , 15 ( 3 ), ar28. https://doi.org/10.1187/cbe.16-01-0046 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Institute of Education Sciences & National Science Foundation. (2013). Common guidelines for education research and development . Retrieved May 20, 2022, from www.nsf.gov/pubs/2013/nsf13126/nsf13126.pdf
  • Jensen, J. L., Lawson, A. (2011). Effects of collaborative group composition and inquiry instruction on reasoning gains and achievement in undergraduate biology . CBE—Life Sciences Education , 10 ( 1 ), 64–73. https://doi.org/10.1187/cbe.19-05-0098 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Kolpikova, E. P., Chen, D. C., Doherty, J. H. (2019). Does the format of preclass reading quizzes matter? An evaluation of traditional and gamified, adaptive preclass reading quizzes . CBE—Life Sciences Education , 18 ( 4 ), ar52. https://doi.org/10.1187/cbe.19-05-0098 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Labov, J. B., Reid, A. H., Yamamoto, K. R. (2010). Integrated biology and undergraduate science education: A new biology education for the twenty-first century? CBE—Life Sciences Education , 9 ( 1 ), 10–16. https://doi.org/10.1187/cbe.09-12-0092 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Lane, T. B. (2016). Beyond academic and social integration: Understanding the impact of a STEM enrichment program on the retention and degree attainment of underrepresented students . CBE—Life Sciences Education , 15 ( 3 ), ar39. https://doi.org/10.1187/cbe.16-01-0070 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Lave, J. (1988). Cognition in practice: Mind, mathematics and culture in everyday life . New York, NY: Cambridge University Press. [ Google Scholar ]
  • Lo, S. M., Gardner, G. E., Reid, J., Napoleon-Fanis, V., Carroll, P., Smith, E., Sato, B. K. (2019). Prevailing questions and methodologies in biology education research: A longitudinal analysis of research in CBE — Life Sciences Education and at the Society for the Advancement of Biology Education Research . CBE—Life Sciences Education , 18 ( 1 ), ar9. https://doi.org/10.1187/cbe.18-08-0164 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Lysaght, Z. (2011). Epistemological and paradigmatic ecumenism in “Pasteur’s quadrant:” Tales from doctoral research . In Official Conference Proceedings of the Third Asian Conference on Education in Osaka, Japan . Retrieved May 20, 2022, from http://iafor.org/ace2011_offprint/ACE2011_offprint_0254.pdf
  • Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • Miles, M. B., Huberman, A. M., Saldaña, J. (2014). Qualitative data analysis (3rd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • Nehm, R. (2019). Biology education research: Building integrative frameworks for teaching and learning about living systems . Disciplinary and Interdisciplinary Science Education Research , 1 , ar15. https://doi.org/10.1186/s43031-019-0017-6 [ Google Scholar ]
  • Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice . Los Angeles, CA: Sage. [ Google Scholar ]
  • Perry, J., Meir, E., Herron, J. C., Maruca, S., Stal, D. (2008). Evaluating two approaches to helping college students understand evolutionary trees through diagramming tasks . CBE—Life Sciences Education , 7 ( 2 ), 193–201. https://doi.org/10.1187/cbe.07-01-0007 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Posner, G. J., Strike, K. A., Hewson, P. W., Gertzog, W. A. (1982). Accommodation of a scientific conception: Toward a theory of conceptual change . Science Education , 66 ( 2 ), 211–227. [ Google Scholar ]
  • Ravitch, S. M., Riggan, M. (2016). Reason & rigor: How conceptual frameworks guide research . Los Angeles, CA: Sage. [ Google Scholar ]
  • Reeves, T. D., Marbach-Ad, G., Miller, K. R., Ridgway, J., Gardner, G. E., Schussler, E. E., Wischusen, E. W. (2016). A conceptual framework for graduate teaching assistant professional development evaluation and research . CBE—Life Sciences Education , 15 ( 2 ), es2. https://doi.org/10.1187/cbe.15-10-0225 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Reynolds, J. A., Thaiss, C., Katkin, W., Thompson, R. J. Jr. (2012). Writing-to-learn in undergraduate science education: A community-based, conceptually driven approach . CBE—Life Sciences Education , 11 ( 1 ), 17–25. https://doi.org/10.1187/cbe.11-08-0064 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Rocco, T. S., Plakhotnik, M. S. (2009). Literature reviews, conceptual frameworks, and theoretical frameworks: Terms, functions, and distinctions . Human Resource Development Review , 8 ( 1 ), 120–130. https://doi.org/10.1177/1534484309332617 [ Google Scholar ]
  • Rodrigo-Peiris, T., Xiang, L., Cassone, V. M. (2018). A low-intensity, hybrid design between a “traditional” and a “course-based” research experience yields positive outcomes for science undergraduate freshmen and shows potential for large-scale application . CBE—Life Sciences Education , 17 ( 4 ), ar53. https://doi.org/10.1187/cbe.17-11-0248 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Sabel, J. L., Dauer, J. T., Forbes, C. T. (2017). Introductory biology students’ use of enhanced answer keys and reflection questions to engage in metacognition and enhance understanding . CBE—Life Sciences Education , 16 ( 3 ), ar40. https://doi.org/10.1187/cbe.16-10-0298 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Sbeglia, G. C., Goodridge, J. A., Gordon, L. H., Nehm, R. H. (2021). Are faculty changing? How reform frameworks, sampling intensities, and instrument measures impact inferences about student-centered teaching practices . CBE—Life Sciences Education , 20 ( 3 ), ar39. https://doi.org/10.1187/cbe.20-11-0259 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Schwandt, T. A. (2000). Three epistemological stances for qualitative inquiry: Interpretivism, hermeneutics, and social constructionism . In Denzin, N. K., Lincoln, Y. S. (Eds.), Handbook of qualitative research (2nd ed., pp. 189–213). Los Angeles, CA: Sage. [ Google Scholar ]
  • Sickel, A. J., Friedrichsen, P. (2013). Examining the evolution education literature with a focus on teachers: Major findings, goals for teacher preparation, and directions for future research . Evolution: Education and Outreach , 6 ( 1 ), 23. https://doi.org/10.1186/1936-6434-6-23 [ Google Scholar ]
  • Singer, S. R., Nielsen, N. R., Schweingruber, H. A. (2012). Discipline-based education research: Understanding and improving learning in undergraduate science and engineering . Washington, DC: National Academies Press. [ Google Scholar ]
  • Todd, A., Romine, W. L., Correa-Menendez, J. (2019). Modeling the transition from a phenotypic to genotypic conceptualization of genetics in a university-level introductory biology context . Research in Science Education , 49 ( 2 ), 569–589. https://doi.org/10.1007/s11165-017-9626-2 [ Google Scholar ]
  • Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes . Cambridge, MA: Harvard University Press. [ Google Scholar ]
  • Wenger, E. (1998). Communities of practice: Learning as a social system . Systems Thinker , 9 ( 5 ), 2–3. [ Google Scholar ]
  • Ziadie, M. A., Andrews, T. C. (2018). Moving evolution education forward: A systematic analysis of literature to identify gaps in collective knowledge for teaching . CBE—Life Sciences Education , 17 ( 1 ), ar11. https://doi.org/10.1187/cbe.17-08-0190 [ PMC free article ] [ PubMed ] [ Google Scholar ]

A systematic literature review of empirical research on ChatGPT in education

  • Open access
  • Published: 26 May 2024
  • Volume 3 , article number  60 , ( 2024 )

Cite this article

You have full access to this open access article

importance of literature review with examples

  • Yazid Albadarin   ORCID: orcid.org/0009-0005-8068-8902 1 ,
  • Mohammed Saqr 1 ,
  • Nicolas Pope 1 &
  • Markku Tukiainen 1  

699 Accesses

Explore all metrics

Over the last four decades, studies have investigated the incorporation of Artificial Intelligence (AI) into education. A recent prominent AI-powered technology that has impacted the education sector is ChatGPT. This article provides a systematic review of 14 empirical studies incorporating ChatGPT into various educational settings, published in 2022 and before the 10th of April 2023—the date of conducting the search process. It carefully followed the essential steps outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) guidelines, as well as Okoli’s (Okoli in Commun Assoc Inf Syst, 2015) steps for conducting a rigorous and transparent systematic review. In this review, we aimed to explore how students and teachers have utilized ChatGPT in various educational settings, as well as the primary findings of those studies. By employing Creswell’s (Creswell in Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook], Pearson Education, London, 2015) coding techniques for data extraction and interpretation, we sought to gain insight into their initial attempts at ChatGPT incorporation into education. This approach also enabled us to extract insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of this review show that learners have utilized ChatGPT as a virtual intelligent assistant, where it offered instant feedback, on-demand answers, and explanations of complex topics. Additionally, learners have used it to enhance their writing and language skills by generating ideas, composing essays, summarizing, translating, paraphrasing texts, or checking grammar. Moreover, learners turned to it as an aiding tool to facilitate their directed and personalized learning by assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. However, the results of specific studies (n = 3, 21.4%) show that overuse of ChatGPT may negatively impact innovative capacities and collaborative learning competencies among learners. Educators, on the other hand, have utilized ChatGPT to create lesson plans, generate quizzes, and provide additional resources, which helped them enhance their productivity and efficiency and promote different teaching methodologies. Despite these benefits, the majority of the reviewed studies recommend the importance of conducting structured training, support, and clear guidelines for both learners and educators to mitigate the drawbacks. This includes developing critical evaluation skills to assess the accuracy and relevance of information provided by ChatGPT, as well as strategies for integrating human interaction and collaboration into learning activities that involve AI tools. Furthermore, they also recommend ongoing research and proactive dialogue with policymakers, stakeholders, and educational practitioners to refine and enhance the use of AI in learning environments. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Similar content being viewed by others

importance of literature review with examples

Empowering learners with ChatGPT: insights from a systematic literature exploration

importance of literature review with examples

Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners

importance of literature review with examples

Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT

Avoid common mistakes on your manuscript.

1 Introduction

Educational technology, a rapidly evolving field, plays a crucial role in reshaping the landscape of teaching and learning [ 82 ]. One of the most transformative technological innovations of our era that has influenced the field of education is Artificial Intelligence (AI) [ 50 ]. Over the last four decades, AI in education (AIEd) has gained remarkable attention for its potential to make significant advancements in learning, instructional methods, and administrative tasks within educational settings [ 11 ]. In particular, a large language model (LLM), a type of AI algorithm that applies artificial neural networks (ANNs) and uses massively large data sets to understand, summarize, generate, and predict new content that is almost difficult to differentiate from human creations [ 79 ], has opened up novel possibilities for enhancing various aspects of education, from content creation to personalized instruction [ 35 ]. Chatbots that leverage the capabilities of LLMs to understand and generate human-like responses have also presented the capacity to enhance student learning and educational outcomes by engaging students, offering timely support, and fostering interactive learning experiences [ 46 ].

The ongoing and remarkable technological advancements in chatbots have made their use more convenient, increasingly natural and effortless, and have expanded their potential for deployment across various domains [ 70 ]. One prominent example of chatbot applications is the Chat Generative Pre-Trained Transformer, known as ChatGPT, which was introduced by OpenAI, a leading AI research lab, on November 30th, 2022. ChatGPT employs a variety of deep learning techniques to generate human-like text, with a particular focus on recurrent neural networks (RNNs). Long short-term memory (LSTM) allows it to grasp the context of the text being processed and retain information from previous inputs. Also, the transformer architecture, a neural network architecture based on the self-attention mechanism, allows it to analyze specific parts of the input, thereby enabling it to produce more natural-sounding and coherent output. Additionally, the unsupervised generative pre-training and the fine-tuning methods allow ChatGPT to generate more relevant and accurate text for specific tasks [ 31 , 62 ]. Furthermore, reinforcement learning from human feedback (RLHF), a machine learning approach that combines reinforcement learning techniques with human-provided feedback, has helped improve ChatGPT’s model by accelerating the learning process and making it significantly more efficient.

This cutting-edge natural language processing (NLP) tool is widely recognized as one of today's most advanced LLMs-based chatbots [ 70 ], allowing users to ask questions and receive detailed, coherent, systematic, personalized, convincing, and informative human-like responses [ 55 ], even within complex and ambiguous contexts [ 63 , 77 ]. ChatGPT is considered the fastest-growing technology in history: in just three months following its public launch, it amassed an estimated 120 million monthly active users [ 16 ] with an estimated 13 million daily queries [ 49 ], surpassing all other applications [ 64 ]. This remarkable growth can be attributed to the unique features and user-friendly interface that ChatGPT offers. Its intuitive design allows users to interact seamlessly with the technology, making it accessible to a diverse range of individuals, regardless of their technical expertise [ 78 ]. Additionally, its exceptional performance results from a combination of advanced algorithms, continuous enhancements, and extensive training on a diverse dataset that includes various text sources such as books, articles, websites, and online forums [ 63 ], have contributed to a more engaging and satisfying user experience [ 62 ]. These factors collectively explain its remarkable global growth and set it apart from predecessors like Bard, Bing Chat, ERNIE, and others.

In this context, several studies have explored the technological advancements of chatbots. One noteworthy recent research effort, conducted by Schöbel et al. [ 70 ], stands out for its comprehensive analysis of more than 5,000 studies on communication agents. This study offered a comprehensive overview of the historical progression and future prospects of communication agents, including ChatGPT. Moreover, other studies have focused on making comparisons, particularly between ChatGPT and alternative chatbots like Bard, Bing Chat, ERNIE, LaMDA, BlenderBot, and various others. For example, O’Leary [ 53 ] compared two chatbots, LaMDA and BlenderBot, with ChatGPT and revealed that ChatGPT outperformed both. This superiority arises from ChatGPT’s capacity to handle a wider range of questions and generate slightly varied perspectives within specific contexts. Similarly, ChatGPT exhibited an impressive ability to formulate interpretable responses that were easily understood when compared with Google's feature snippet [ 34 ]. Additionally, ChatGPT was compared to other LLMs-based chatbots, including Bard and BERT, as well as ERNIE. The findings indicated that ChatGPT exhibited strong performance in the given tasks, often outperforming the other models [ 59 ].

Furthermore, in the education context, a comprehensive study systematically compared a range of the most promising chatbots, including Bard, Bing Chat, ChatGPT, and Ernie across a multidisciplinary test that required higher-order thinking. The study revealed that ChatGPT achieved the highest score, surpassing Bing Chat and Bard [ 64 ]. Similarly, a comparative analysis was conducted to compare ChatGPT with Bard in answering a set of 30 mathematical questions and logic problems, grouped into two question sets. Set (A) is unavailable online, while Set (B) is available online. The results revealed ChatGPT's superiority in Set (A) over Bard. Nevertheless, Bard's advantage emerged in Set (B) due to its capacity to access the internet directly and retrieve answers, a capability that ChatGPT does not possess [ 57 ]. However, through these varied assessments, ChatGPT consistently highlights its exceptional prowess compared to various alternatives in the ever-evolving chatbot technology.

The widespread adoption of chatbots, especially ChatGPT, by millions of students and educators, has sparked extensive discussions regarding its incorporation into the education sector [ 64 ]. Accordingly, many scholars have contributed to the discourse, expressing both optimism and pessimism regarding the incorporation of ChatGPT into education. For example, ChatGPT has been highlighted for its capabilities in enriching the learning and teaching experience through its ability to support different learning approaches, including adaptive learning, personalized learning, and self-directed learning [ 58 , 60 , 91 ]), deliver summative and formative feedback to students and provide real-time responses to questions, increase the accessibility of information [ 22 , 40 , 43 ], foster students’ performance, engagement and motivation [ 14 , 44 , 58 ], and enhance teaching practices [ 17 , 18 , 64 , 74 ].

On the other hand, concerns have been also raised regarding its potential negative effects on learning and teaching. These include the dissemination of false information and references [ 12 , 23 , 61 , 85 ], biased reinforcement [ 47 , 50 ], compromised academic integrity [ 18 , 40 , 66 , 74 ], and the potential decline in students' skills [ 43 , 61 , 64 , 74 ]. As a result, ChatGPT has been banned in multiple countries, including Russia, China, Venezuela, Belarus, and Iran, as well as in various educational institutions in India, Italy, Western Australia, France, and the United States [ 52 , 90 ].

Clearly, the advent of chatbots, especially ChatGPT, has provoked significant controversy due to their potential impact on learning and teaching. This indicates the necessity for further exploration to gain a deeper understanding of this technology and carefully evaluate its potential benefits, limitations, challenges, and threats to education [ 79 ]. Therefore, conducting a systematic literature review will provide valuable insights into the potential prospects and obstacles linked to its incorporation into education. This systematic literature review will primarily focus on ChatGPT, driven by the aforementioned key factors outlined above.

However, the existing literature lacks a systematic literature review of empirical studies. Thus, this systematic literature review aims to address this gap by synthesizing the existing empirical studies conducted on chatbots, particularly ChatGPT, in the field of education, highlighting how ChatGPT has been utilized in educational settings, and identifying any existing gaps. This review may be particularly useful for researchers in the field and educators who are contemplating the integration of ChatGPT or any chatbot into education. The following research questions will guide this study:

What are students' and teachers' initial attempts at utilizing ChatGPT in education?

What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?

2 Methodology

To conduct this study, the authors followed the essential steps of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) and Okoli’s [ 54 ] steps for conducting a systematic review. These included identifying the study’s purpose, drafting a protocol, applying a practical screening process, searching the literature, extracting relevant data, evaluating the quality of the included studies, synthesizing the studies, and ultimately writing the review. The subsequent section provides an extensive explanation of how these steps were carried out in this study.

2.1 Identify the purpose

Given the widespread adoption of ChatGPT by students and teachers for various educational purposes, often without a thorough understanding of responsible and effective use or a clear recognition of its potential impact on learning and teaching, the authors recognized the need for further exploration of ChatGPT's impact on education in this early stage. Therefore, they have chosen to conduct a systematic literature review of existing empirical studies that incorporate ChatGPT into educational settings. Despite the limited number of empirical studies due to the novelty of the topic, their goal is to gain a deeper understanding of this technology and proactively evaluate its potential benefits, limitations, challenges, and threats to education. This effort could help to understand initial reactions and attempts at incorporating ChatGPT into education and bring out insights and considerations that can inform the future development of education.

2.2 Draft the protocol

The next step is formulating the protocol. This protocol serves to outline the study process in a rigorous and transparent manner, mitigating researcher bias in study selection and data extraction [ 88 ]. The protocol will include the following steps: generating the research question, predefining a literature search strategy, identifying search locations, establishing selection criteria, assessing the studies, developing a data extraction strategy, and creating a timeline.

2.3 Apply practical screen

The screening step aims to accurately filter the articles resulting from the searching step and select the empirical studies that have incorporated ChatGPT into educational contexts, which will guide us in answering the research questions and achieving the objectives of this study. To ensure the rigorous execution of this step, our inclusion and exclusion criteria were determined based on the authors' experience and informed by previous successful systematic reviews [ 21 ]. Table 1 summarizes the inclusion and exclusion criteria for study selection.

2.4 Literature search

We conducted a thorough literature search to identify articles that explored, examined, and addressed the use of ChatGPT in Educational contexts. We utilized two research databases: Dimensions.ai, which provides access to a large number of research publications, and lens.org, which offers access to over 300 million articles, patents, and other research outputs from diverse sources. Additionally, we included three databases, Scopus, Web of Knowledge, and ERIC, which contain relevant research on the topic that addresses our research questions. To browse and identify relevant articles, we used the following search formula: ("ChatGPT" AND "Education"), which included the Boolean operator "AND" to get more specific results. The subject area in the Scopus and ERIC databases were narrowed to "ChatGPT" and "Education" keywords, and in the WoS database was limited to the "Education" category. The search was conducted between the 3rd and 10th of April 2023, which resulted in 276 articles from all selected databases (111 articles from Dimensions.ai, 65 from Scopus, 28 from Web of Science, 14 from ERIC, and 58 from Lens.org). These articles were imported into the Rayyan web-based system for analysis. The duplicates were identified automatically by the system. Subsequently, the first author manually reviewed the duplicated articles ensured that they had the same content, and then removed them, leaving us with 135 unique articles. Afterward, the titles, abstracts, and keywords of the first 40 manuscripts were scanned and reviewed by the first author and were discussed with the second and third authors to resolve any disagreements. Subsequently, the first author proceeded with the filtering process for all articles and carefully applied the inclusion and exclusion criteria as presented in Table  1 . Articles that met any one of the exclusion criteria were eliminated, resulting in 26 articles. Afterward, the authors met to carefully scan and discuss them. The authors agreed to eliminate any empirical studies solely focused on checking ChatGPT capabilities, as these studies do not guide us in addressing the research questions and achieving the study's objectives. This resulted in 14 articles eligible for analysis.

2.5 Quality appraisal

The examination and evaluation of the quality of the extracted articles is a vital step [ 9 ]. Therefore, the extracted articles were carefully evaluated for quality using Fink’s [ 24 ] standards, which emphasize the necessity for detailed descriptions of methodology, results, conclusions, strengths, and limitations. The process began with a thorough assessment of each study's design, data collection, and analysis methods to ensure their appropriateness and comprehensive execution. The clarity, consistency, and logical progression from data to results and conclusions were also critically examined. Potential biases and recognized limitations within the studies were also scrutinized. Ultimately, two articles were excluded for failing to meet Fink’s criteria, particularly in providing sufficient detail on methodology, results, conclusions, strengths, or limitations. The review process is illustrated in Fig.  1 .

figure 1

The study selection process

2.6 Data extraction

The next step is data extraction, the process of capturing the key information and categories from the included studies. To improve efficiency, reduce variation among authors, and minimize errors in data analysis, the coding categories were constructed using Creswell's [ 15 ] coding techniques for data extraction and interpretation. The coding process involves three sequential steps. The initial stage encompasses open coding , where the researcher examines the data, generates codes to describe and categorize it, and gains a deeper understanding without preconceived ideas. Following open coding is axial coding , where the interrelationships between codes from open coding are analyzed to establish more comprehensive categories or themes. The process concludes with selective coding , refining and integrating categories or themes to identify core concepts emerging from the data. The first coder performed the coding process, then engaged in discussions with the second and third authors to finalize the coding categories for the first five articles. The first coder then proceeded to code all studies and engaged again in discussions with the other authors to ensure the finalization of the coding process. After a comprehensive analysis and capturing of the key information from the included studies, the data extraction and interpretation process yielded several themes. These themes have been categorized and are presented in Table  2 . It is important to note that open coding results were removed from Table  2 for aesthetic reasons, as it included many generic aspects, such as words, short phrases, or sentences mentioned in the studies.

2.7 Synthesize studies

In this stage, we will gather, discuss, and analyze the key findings that emerged from the selected studies. The synthesis stage is considered a transition from an author-centric to a concept-centric focus, enabling us to map all the provided information to achieve the most effective evaluation of the data [ 87 ]. Initially, the authors extracted data that included general information about the selected studies, including the author(s)' names, study titles, years of publication, educational levels, research methodologies, sample sizes, participants, main aims or objectives, raw data sources, and analysis methods. Following that, all key information and significant results from the selected studies were compiled using Creswell’s [ 15 ] coding techniques for data extraction and interpretation to identify core concepts and themes emerging from the data, focusing on those that directly contributed to our research questions and objectives, such as the initial utilization of ChatGPT in learning and teaching, learners' and educators' familiarity with ChatGPT, and the main findings of each study. Finally, the data related to each selected study were extracted into an Excel spreadsheet for data processing. The Excel spreadsheet was reviewed by the authors, including a series of discussions to ensure the finalization of this process and prepare it for further analysis. Afterward, the final result being analyzed and presented in various types of charts and graphs. Table 4 presents the extracted data from the selected studies, with each study labeled with a capital 'S' followed by a number.

This section consists of two main parts. The first part provides a descriptive analysis of the data compiled from the reviewed studies. The second part presents the answers to the research questions and the main findings of these studies.

3.1 Part 1: descriptive analysis

This section will provide a descriptive analysis of the reviewed studies, including educational levels and fields, participants distribution, country contribution, research methodologies, study sample size, study population, publication year, list of journals, familiarity with ChatGPT, source of data, and the main aims and objectives of the studies. Table 4 presents a comprehensive overview of the extracted data from the selected studies.

3.1.1 The number of the reviewed studies and publication years

The total number of the reviewed studies was 14. All studies were empirical studies and published in different journals focusing on Education and Technology. One study was published in 2022 [S1], while the remaining were published in 2023 [S2]-[S14]. Table 3 illustrates the year of publication, the names of the journals, and the number of reviewed studies published in each journal for the studies reviewed.

3.1.2 Educational levels and fields

The majority of the reviewed studies, 11 studies, were conducted in higher education institutions [S1]-[S10] and [S13]. Two studies did not specify the educational level of the population [S12] and [S14], while one study focused on elementary education [S11]. However, the reviewed studies covered various fields of education. Three studies focused on Arts and Humanities Education [S8], [S11], and [S14], specifically English Education. Two studies focused on Engineering Education, with one in Computer Engineering [S2] and the other in Construction Education [S3]. Two studies focused on Mathematics Education [S5] and [S12]. One study focused on Social Science Education [S13]. One study focused on Early Education [S4]. One study focused on Journalism Education [S9]. Finally, three studies did not specify the field of education [S1], [S6], and [S7]. Figure  2 represents the educational levels in the reviewed studies, while Fig.  3 represents the context of the reviewed studies.

figure 2

Educational levels in the reviewed studies

figure 3

Context of the reviewed studies

3.1.3 Participants distribution and countries contribution

The reviewed studies have been conducted across different geographic regions, providing a diverse representation of the studies. The majority of the studies, 10 in total, [S1]-[S3], [S5]-[S9], [S11], and [S14], primarily focused on participants from single countries such as Pakistan, the United Arab Emirates, China, Indonesia, Poland, Saudi Arabia, South Korea, Spain, Tajikistan, and the United States. In contrast, four studies, [S4], [S10], [S12], and [S13], involved participants from multiple countries, including China and the United States [S4], China, the United Kingdom, and the United States [S10], the United Arab Emirates, Oman, Saudi Arabia, and Jordan [S12], Turkey, Sweden, Canada, and Australia [ 13 ]. Figures  4 and 5 illustrate the distribution of participants, whether from single or multiple countries, and the contribution of each country in the reviewed studies, respectively.

figure 4

The reviewed studies conducted in single or multiple countries

figure 5

The Contribution of each country in the studies

3.1.4 Study population and sample size

Four study populations were included: university students, university teachers, university teachers and students, and elementary school teachers. Six studies involved university students [S2], [S3], [S5] and [S6]-[S8]. Three studies focused on university teachers [S1], [S4], and [S6], while one study specifically targeted elementary school teachers [S11]. Additionally, four studies included both university teachers and students [S10] and [ 12 , 13 , 14 ], and among them, study [S13] specifically included postgraduate students. In terms of the sample size of the reviewed studies, nine studies included a small sample size of less than 50 participants [S1], [S3], [S6], [S8], and [S10]-[S13]. Three studies had 50–100 participants [S2], [S9], and [S14]. Only one study had more than 100 participants [S7]. It is worth mentioning that study [S4] adopted a mixed methods approach, including 10 participants for qualitative analysis and 110 participants for quantitative analysis.

3.1.5 Participants’ familiarity with using ChatGPT

The reviewed studies recruited a diverse range of participants with varying levels of familiarity with ChatGPT. Five studies [S2], [S4], [S6], [S8], and [S12] involved participants already familiar with ChatGPT, while eight studies [S1], [S3], [S5], [S7], [S9], [S10], [S13] and [S14] included individuals with differing levels of familiarity. Notably, one study [S11] had participants who were entirely unfamiliar with ChatGPT. It is important to note that four studies [S3], [S5], [S9], and [S11] provided training or guidance to their participants before conducting their studies, while ten studies [S1], [S2], [S4], [S6]-[S8], [S10], and [S12]-[S14] did not provide training due to the participants' existing familiarity with ChatGPT.

3.1.6 Research methodology approaches and source(S) of data

The reviewed studies adopted various research methodology approaches. Seven studies adopted qualitative research methodology [S1], [S4], [S6], [S8], [S10], [S11], and [S12], while three studies adopted quantitative research methodology [S3], [S7], and [S14], and four studies employed mixed-methods, which involved a combination of both the strengths of qualitative and quantitative methods [S2], [S5], [S9], and [S13].

In terms of the source(s) of data, the reviewed studies obtained their data from various sources, such as interviews, questionnaires, and pre-and post-tests. Six studies relied on interviews as their primary source of data collection [S1], [S4], [S6], [S10], [S11], and [S12], four studies relied on questionnaires [S2], [S7], [S13], and [S14], two studies combined the use of pre-and post-tests and questionnaires for data collection [S3] and [S9], while two studies combined the use of questionnaires and interviews to obtain the data [S5] and [S8]. It is important to note that six of the reviewed studies were quasi-experimental [S3], [S5], [S8], [S9], [S12], and [S14], while the remaining ones were experimental studies [S1], [S2], [S4], [S6], [S7], [S10], [S11], and [S13]. Figures  6 and 7 illustrate the research methodologies and the source (s) of data used in the reviewed studies, respectively.

figure 6

Research methodologies in the reviewed studies

figure 7

Source of data in the reviewed studies

3.1.7 The aim and objectives of the studies

The reviewed studies encompassed a diverse set of aims, with several of them incorporating multiple primary objectives. Six studies [S3], [S6], [S7], [S8], [S11], and [S12] examined the integration of ChatGPT in educational contexts, and four studies [S4], [S5], [S13], and [S14] investigated the various implications of its use in education, while three studies [S2], [S9], and [S10] aimed to explore both its integration and implications in education. Additionally, seven studies explicitly explored attitudes and perceptions of students [S2] and [S3], educators [S1] and [S6], or both [S10], [S12], and [S13] regarding the utilization of ChatGPT in educational settings.

3.2 Part 2: research questions and main findings of the reviewed studies

This part will present the answers to the research questions and the main findings of the reviewed studies, classified into two main categories (learning and teaching) according to AI Education classification by [ 36 ]. Figure  8 summarizes the main findings of the reviewed studies in a visually informative diagram. Table 4 provides a detailed list of the key information extracted from the selected studies that led to generating these themes.

figure 8

The main findings in the reviewed studies

4 Students' initial attempts at utilizing ChatGPT in learning and main findings from students' perspective

4.1 virtual intelligent assistant.

Nine studies demonstrated that ChatGPT has been utilized by students as an intelligent assistant to enhance and support their learning. Students employed it for various purposes, such as answering on-demand questions [S2]-[S5], [S8], [S10], and [S12], providing valuable information and learning resources [S2]-[S5], [S6], and [S8], as well as receiving immediate feedback [S2], [S4], [S9], [S10], and [S12]. In this regard, students generally were confident in the accuracy of ChatGPT's responses, considering them relevant, reliable, and detailed [S3], [S4], [S5], and [S8]. However, some students indicated the need for improvement, as they found that answers are not always accurate [S2], and that misleading information may have been provided or that it may not always align with their expectations [S6] and [S10]. It was also observed by the students that the accuracy of ChatGPT is dependent on several factors, including the quality and specificity of the user's input, the complexity of the question or topic, and the scope and relevance of its training data [S12]. Many students felt that ChatGPT's answers were not always accurate and most of them believed that it requires good background knowledge to work with.

4.2 Writing and language proficiency assistant

Six of the reviewed studies highlighted that ChatGPT has been utilized by students as a valuable assistant tool to improve their academic writing skills and language proficiency. Among these studies, three mainly focused on English education, demonstrating that students showed sufficient mastery in using ChatGPT for generating ideas, summarizing, paraphrasing texts, and completing writing essays [S8], [S11], and [S14]. Furthermore, ChatGPT helped them in writing by making students active investigators rather than passive knowledge recipients and facilitated the development of their writing skills [S11] and [S14]. Similarly, ChatGPT allowed students to generate unique ideas and perspectives, leading to deeper analysis and reflection on their journalism writing [S9]. In terms of language proficiency, ChatGPT allowed participants to translate content into their home languages, making it more accessible and relevant to their context [S4]. It also enabled them to request changes in linguistic tones or flavors [S8]. Moreover, participants used it to check grammar or as a dictionary [S11].

4.3 Valuable resource for learning approaches

Five studies demonstrated that students used ChatGPT as a valuable complementary resource for self-directed learning. It provided learning resources and guidance on diverse educational topics and created a supportive home learning environment [S2] and [S4]. Moreover, it offered step-by-step guidance to grasp concepts at their own pace and enhance their understanding [S5], streamlined task and project completion carried out independently [S7], provided comprehensive and easy-to-understand explanations on various subjects [S10], and assisted in studying geometry operations, thereby empowering them to explore geometry operations at their own pace [S12]. Three studies showed that students used ChatGPT as a valuable learning resource for personalized learning. It delivered age-appropriate conversations and tailored teaching based on a child's interests [S4], acted as a personalized learning assistant, adapted to their needs and pace, which assisted them in understanding mathematical concepts [S12], and enabled personalized learning experiences in social sciences by adapting to students' needs and learning styles [S13]. On the other hand, it is important to note that, according to one study [S5], students suggested that using ChatGPT may negatively affect collaborative learning competencies between students.

4.4 Enhancing students' competencies

Six of the reviewed studies have shown that ChatGPT is a valuable tool for improving a wide range of skills among students. Two studies have provided evidence that ChatGPT led to improvements in students' critical thinking, reasoning skills, and hazard recognition competencies through engaging them in interactive conversations or activities and providing responses related to their disciplines in journalism [S5] and construction education [S9]. Furthermore, two studies focused on mathematical education have shown the positive impact of ChatGPT on students' problem-solving abilities in unraveling problem-solving questions [S12] and enhancing the students' understanding of the problem-solving process [S5]. Lastly, one study indicated that ChatGPT effectively contributed to the enhancement of conversational social skills [S4].

4.5 Supporting students' academic success

Seven of the reviewed studies highlighted that students found ChatGPT to be beneficial for learning as it enhanced learning efficiency and improved the learning experience. It has been observed to improve students' efficiency in computer engineering studies by providing well-structured responses and good explanations [S2]. Additionally, students found it extremely useful for hazard reporting [S3], and it also enhanced their efficiency in solving mathematics problems and capabilities [S5] and [S12]. Furthermore, by finding information, generating ideas, translating texts, and providing alternative questions, ChatGPT aided students in deepening their understanding of various subjects [S6]. It contributed to an increase in students' overall productivity [S7] and improved efficiency in composing written tasks [S8]. Regarding learning experiences, ChatGPT was instrumental in assisting students in identifying hazards that they might have otherwise overlooked [S3]. It also improved students' learning experiences in solving mathematics problems and developing abilities [S5] and [S12]. Moreover, it increased students' successful completion of important tasks in their studies [S7], particularly those involving average difficulty writing tasks [S8]. Additionally, ChatGPT increased the chances of educational success by providing students with baseline knowledge on various topics [S10].

5 Teachers' initial attempts at utilizing ChatGPT in teaching and main findings from teachers' perspective

5.1 valuable resource for teaching.

The reviewed studies showed that teachers have employed ChatGPT to recommend, modify, and generate diverse, creative, organized, and engaging educational contents, teaching materials, and testing resources more rapidly [S4], [S6], [S10] and [S11]. Additionally, teachers experienced increased productivity as ChatGPT facilitated quick and accurate responses to questions, fact-checking, and information searches [S1]. It also proved valuable in constructing new knowledge [S6] and providing timely answers to students' questions in classrooms [S11]. Moreover, ChatGPT enhanced teachers' efficiency by generating new ideas for activities and preplanning activities for their students [S4] and [S6], including interactive language game partners [S11].

5.2 Improving productivity and efficiency

The reviewed studies showed that participants' productivity and work efficiency have been significantly enhanced by using ChatGPT as it enabled them to allocate more time to other tasks and reduce their overall workloads [S6], [S10], [S11], [S13], and [S14]. However, three studies [S1], [S4], and [S11], indicated a negative perception and attitude among teachers toward using ChatGPT. This negativity stemmed from a lack of necessary skills to use it effectively [S1], a limited familiarity with it [S4], and occasional inaccuracies in the content provided by it [S10].

5.3 Catalyzing new teaching methodologies

Five of the reviewed studies highlighted that educators found the necessity of redefining their teaching profession with the assistance of ChatGPT [S11], developing new effective learning strategies [S4], and adapting teaching strategies and methodologies to ensure the development of essential skills for future engineers [S5]. They also emphasized the importance of adopting new educational philosophies and approaches that can evolve with the introduction of ChatGPT into the classroom [S12]. Furthermore, updating curricula to focus on improving human-specific features, such as emotional intelligence, creativity, and philosophical perspectives [S13], was found to be essential.

5.4 Effective utilization of CHATGPT in teaching

According to the reviewed studies, effective utilization of ChatGPT in education requires providing teachers with well-structured training, support, and adequate background on how to use ChatGPT responsibly [S1], [S3], [S11], and [S12]. Establishing clear rules and regulations regarding its usage is essential to ensure it positively impacts the teaching and learning processes, including students' skills [S1], [S4], [S5], [S8], [S9], and [S11]-[S14]. Moreover, conducting further research and engaging in discussions with policymakers and stakeholders is indeed crucial for the successful integration of ChatGPT in education and to maximize the benefits for both educators and students [S1], [S6]-[S10], and [S12]-[S14].

6 Discussion

The purpose of this review is to conduct a systematic review of empirical studies that have explored the utilization of ChatGPT, one of today’s most advanced LLM-based chatbots, in education. The findings of the reviewed studies showed several ways of ChatGPT utilization in different learning and teaching practices as well as it provided insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of the reviewed studies came from diverse fields of education, which helped us avoid a biased review that is limited to a specific field. Similarly, the reviewed studies have been conducted across different geographic regions. This kind of variety in geographic representation enriched the findings of this review.

In response to RQ1 , "What are students' and teachers' initial attempts at utilizing ChatGPT in education?", the findings from this review provide comprehensive insights. Chatbots, including ChatGPT, play a crucial role in supporting student learning, enhancing their learning experiences, and facilitating diverse learning approaches [ 42 , 43 ]. This review found that this tool, ChatGPT, has been instrumental in enhancing students' learning experiences by serving as a virtual intelligent assistant, providing immediate feedback, on-demand answers, and engaging in educational conversations. Additionally, students have benefited from ChatGPT’s ability to generate ideas, compose essays, and perform tasks like summarizing, translating, paraphrasing texts, or checking grammar, thereby enhancing their writing and language competencies. Furthermore, students have turned to ChatGPT for assistance in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks, which fosters a supportive home learning environment, allowing them to take responsibility for their own learning and cultivate the skills and approaches essential for supportive home learning environment [ 26 , 27 , 28 ]. This finding aligns with the study of Saqr et al. [ 68 , 69 ] who highlighted that, when students actively engage in their own learning process, it yields additional advantages, such as heightened motivation, enhanced achievement, and the cultivation of enthusiasm, turning them into advocates for their own learning.

Moreover, students have utilized ChatGPT for tailored teaching and step-by-step guidance on diverse educational topics, streamlining task and project completion, and generating and recommending educational content. This personalization enhances the learning environment, leading to increased academic success. This finding aligns with other recent studies [ 26 , 27 , 28 , 60 , 66 ] which revealed that ChatGPT has the potential to offer personalized learning experiences and support an effective learning process by providing students with customized feedback and explanations tailored to their needs and abilities. Ultimately, fostering students' performance, engagement, and motivation, leading to increase students' academic success [ 14 , 44 , 58 ]. This ultimate outcome is in line with the findings of Saqr et al. [ 68 , 69 ], which emphasized that learning strategies are important catalysts of students' learning, as students who utilize effective learning strategies are more likely to have better academic achievement.

Teachers, too, have capitalized on ChatGPT's capabilities to enhance productivity and efficiency, using it for creating lesson plans, generating quizzes, providing additional resources, generating and preplanning new ideas for activities, and aiding in answering students’ questions. This adoption of technology introduces new opportunities to support teaching and learning practices, enhancing teacher productivity. This finding aligns with those of Day [ 17 ], De Castro [ 18 ], and Su and Yang [ 74 ] as well as with those of Valtonen et al. [ 82 ], who revealed that emerging technological advancements have opened up novel opportunities and means to support teaching and learning practices, and enhance teachers’ productivity.

In response to RQ2 , "What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?", the findings from this review provide profound insights and raise significant concerns. Starting with the insights, chatbots, including ChatGPT, have demonstrated the potential to reshape and revolutionize education, creating new, novel opportunities for enhancing the learning process and outcomes [ 83 ], facilitating different learning approaches, and offering a range of pedagogical benefits [ 19 , 43 , 72 ]. In this context, this review found that ChatGPT could open avenues for educators to adopt or develop new effective learning and teaching strategies that can evolve with the introduction of ChatGPT into the classroom. Nonetheless, there is an evident lack of research understanding regarding the potential impact of generative machine learning models within diverse educational settings [ 83 ]. This necessitates teachers to attain a high level of proficiency in incorporating chatbots, such as ChatGPT, into their classrooms to create inventive, well-structured, and captivating learning strategies. In the same vein, the review also found that teachers without the requisite skills to utilize ChatGPT realized that it did not contribute positively to their work and could potentially have adverse effects [ 37 ]. This concern could lead to inequity of access to the benefits of chatbots, including ChatGPT, as individuals who lack the necessary expertise may not be able to harness their full potential, resulting in disparities in educational outcomes and opportunities. Therefore, immediate action is needed to address these potential issues. A potential solution is offering training, support, and competency development for teachers to ensure that all of them can leverage chatbots, including ChatGPT, effectively and equitably in their educational practices [ 5 , 28 , 80 ], which could enhance accessibility and inclusivity, and potentially result in innovative outcomes [ 82 , 83 ].

Additionally, chatbots, including ChatGPT, have the potential to significantly impact students' thinking abilities, including retention, reasoning, analysis skills [ 19 , 45 ], and foster innovation and creativity capabilities [ 83 ]. This review found that ChatGPT could contribute to improving a wide range of skills among students. However, it found that frequent use of ChatGPT may result in a decrease in innovative capacities, collaborative skills and cognitive capacities, and students' motivation to attend classes, as well as could lead to reduced higher-order thinking skills among students [ 22 , 29 ]. Therefore, immediate action is needed to carefully examine the long-term impact of chatbots such as ChatGPT, on learning outcomes as well as to explore its incorporation into educational settings as a supportive tool without compromising students' cognitive development and critical thinking abilities. In the same vein, the review also found that it is challenging to draw a consistent conclusion regarding the potential of ChatGPT to aid self-directed learning approach. This finding aligns with the recent study of Baskara [ 8 ]. Therefore, further research is needed to explore the potential of ChatGPT for self-directed learning. One potential solution involves utilizing learning analytics as a novel approach to examine various aspects of students' learning and support them in their individual endeavors [ 32 ]. This approach can bridge this gap by facilitating an in-depth analysis of how learners engage with ChatGPT, identifying trends in self-directed learning behavior, and assessing its influence on their outcomes.

Turning to the significant concerns, on the other hand, a fundamental challenge with LLM-based chatbots, including ChatGPT, is the accuracy and quality of the provided information and responses, as they provide false information as truth—a phenomenon often referred to as "hallucination" [ 3 , 49 ]. In this context, this review found that the provided information was not entirely satisfactory. Consequently, the utilization of chatbots presents potential concerns, such as generating and providing inaccurate or misleading information, especially for students who utilize it to support their learning. This finding aligns with other findings [ 6 , 30 , 35 , 40 ] which revealed that incorporating chatbots such as ChatGPT, into education presents challenges related to its accuracy and reliability due to its training on a large corpus of data, which may contain inaccuracies and the way users formulate or ask ChatGPT. Therefore, immediate action is needed to address these potential issues. One possible solution is to equip students with the necessary skills and competencies, which include a background understanding of how to use it effectively and the ability to assess and evaluate the information it generates, as the accuracy and the quality of the provided information depend on the input, its complexity, the topic, and the relevance of its training data [ 28 , 49 , 86 ]. However, it's also essential to examine how learners can be educated about how these models operate, the data used in their training, and how to recognize their limitations, challenges, and issues [ 79 ].

Furthermore, chatbots present a substantial challenge concerning maintaining academic integrity [ 20 , 56 ] and copyright violations [ 83 ], which are significant concerns in education. The review found that the potential misuse of ChatGPT might foster cheating, facilitate plagiarism, and threaten academic integrity. This issue is also affirmed by the research conducted by Basic et al. [ 7 ], who presented evidence that students who utilized ChatGPT in their writing assignments had more plagiarism cases than those who did not. These findings align with the conclusions drawn by Cotton et al. [ 13 ], Hisan and Amri [ 33 ] and Sullivan et al. [ 75 ], who revealed that the integration of chatbots such as ChatGPT into education poses a significant challenge to the preservation of academic integrity. Moreover, chatbots, including ChatGPT, have increased the difficulty in identifying plagiarism [ 47 , 67 , 76 ]. The findings from previous studies [ 1 , 84 ] indicate that AI-generated text often went undetected by plagiarism software, such as Turnitin. However, Turnitin and other similar plagiarism detection tools, such as ZeroGPT, GPTZero, and Copyleaks, have since evolved, incorporating enhanced techniques to detect AI-generated text, despite the possibility of false positives, as noted in different studies that have found these tools still not yet fully ready to accurately and reliably identify AI-generated text [ 10 , 51 ], and new novel detection methods may need to be created and implemented for AI-generated text detection [ 4 ]. This potential issue could lead to another concern, which is the difficulty of accurately evaluating student performance when they utilize chatbots such as ChatGPT assistance in their assignments. Consequently, the most LLM-driven chatbots present a substantial challenge to traditional assessments [ 64 ]. The findings from previous studies indicate the importance of rethinking, improving, and redesigning innovative assessment methods in the era of chatbots [ 14 , 20 , 64 , 75 ]. These methods should prioritize the process of evaluating students' ability to apply knowledge to complex cases and demonstrate comprehension, rather than solely focusing on the final product for assessment. Therefore, immediate action is needed to address these potential issues. One possible solution would be the development of clear guidelines, regulatory policies, and pedagogical guidance. These measures would help regulate the proper and ethical utilization of chatbots, such as ChatGPT, and must be established before their introduction to students [ 35 , 38 , 39 , 41 , 89 ].

In summary, our review has delved into the utilization of ChatGPT, a prominent example of chatbots, in education, addressing the question of how ChatGPT has been utilized in education. However, there remain significant gaps, which necessitate further research to shed light on this area.

7 Conclusions

This systematic review has shed light on the varied initial attempts at incorporating ChatGPT into education by both learners and educators, while also offering insights and considerations that can facilitate its effective and responsible use in future educational contexts. From the analysis of 14 selected studies, the review revealed the dual-edged impact of ChatGPT in educational settings. On the positive side, ChatGPT significantly aided the learning process in various ways. Learners have used it as a virtual intelligent assistant, benefiting from its ability to provide immediate feedback, on-demand answers, and easy access to educational resources. Additionally, it was clear that learners have used it to enhance their writing and language skills, engaging in practices such as generating ideas, composing essays, and performing tasks like summarizing, translating, paraphrasing texts, or checking grammar. Importantly, other learners have utilized it in supporting and facilitating their directed and personalized learning on a broad range of educational topics, assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. Educators, on the other hand, found ChatGPT beneficial for enhancing productivity and efficiency. They used it for creating lesson plans, generating quizzes, providing additional resources, and answers learners' questions, which saved time and allowed for more dynamic and engaging teaching strategies and methodologies.

However, the review also pointed out negative impacts. The results revealed that overuse of ChatGPT could decrease innovative capacities and collaborative learning among learners. Specifically, relying too much on ChatGPT for quick answers can inhibit learners' critical thinking and problem-solving skills. Learners might not engage deeply with the material or consider multiple solutions to a problem. This tendency was particularly evident in group projects, where learners preferred consulting ChatGPT individually for solutions over brainstorming and collaborating with peers, which negatively affected their teamwork abilities. On a broader level, integrating ChatGPT into education has also raised several concerns, including the potential for providing inaccurate or misleading information, issues of inequity in access, challenges related to academic integrity, and the possibility of misusing the technology.

Accordingly, this review emphasizes the urgency of developing clear rules, policies, and regulations to ensure ChatGPT's effective and responsible use in educational settings, alongside other chatbots, by both learners and educators. This requires providing well-structured training to educate them on responsible usage and understanding its limitations, along with offering sufficient background information. Moreover, it highlights the importance of rethinking, improving, and redesigning innovative teaching and assessment methods in the era of ChatGPT. Furthermore, conducting further research and engaging in discussions with policymakers and stakeholders are essential steps to maximize the benefits for both educators and learners and ensure academic integrity.

It is important to acknowledge that this review has certain limitations. Firstly, the limited inclusion of reviewed studies can be attributed to several reasons, including the novelty of the technology, as new technologies often face initial skepticism and cautious adoption; the lack of clear guidelines or best practices for leveraging this technology for educational purposes; and institutional or governmental policies affecting the utilization of this technology in educational contexts. These factors, in turn, have affected the number of studies available for review. Secondly, the utilization of the original version of ChatGPT, based on GPT-3 or GPT-3.5, implies that new studies utilizing the updated version, GPT-4 may lead to different findings. Therefore, conducting follow-up systematic reviews is essential once more empirical studies on ChatGPT are published. Additionally, long-term studies are necessary to thoroughly examine and assess the impact of ChatGPT on various educational practices.

Despite these limitations, this systematic review has highlighted the transformative potential of ChatGPT in education, revealing its diverse utilization by learners and educators alike and summarized the benefits of incorporating it into education, as well as the forefront critical concerns and challenges that must be addressed to facilitate its effective and responsible use in future educational contexts. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Data availability

The data supporting our findings are available upon request.

Abbreviations

  • Artificial intelligence

AI in education

Large language model

Artificial neural networks

Chat Generative Pre-Trained Transformer

Recurrent neural networks

Long short-term memory

Reinforcement learning from human feedback

Natural language processing

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

AlAfnan MA, Dishari S, Jovic M, Lomidze K. ChatGPT as an educational tool: opportunities, challenges, and recommendations for communication, business writing, and composition courses. J Artif Intell Technol. 2023. https://doi.org/10.37965/jait.2023.0184 .

Article   Google Scholar  

Ali JKM, Shamsan MAA, Hezam TA, Mohammed AAQ. Impact of ChatGPT on learning motivation. J Engl Stud Arabia Felix. 2023;2(1):41–9. https://doi.org/10.56540/jesaf.v2i1.51 .

Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023. https://doi.org/10.7759/cureus.35179 .

Anderson N, Belavý DL, Perle SM, Hendricks S, Hespanhol L, Verhagen E, Memon AR. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in sports & exercise medicine manuscript generation. BMJ Open Sport Exerc Med. 2023;9(1): e001568. https://doi.org/10.1136/bmjsem-2023-001568 .

Ausat AMA, Massang B, Efendi M, Nofirman N, Riady Y. Can chat GPT replace the role of the teacher in the classroom: a fundamental analysis. J Educ. 2023;5(4):16100–6.

Google Scholar  

Baidoo-Anu D, Ansah L. Education in the Era of generative artificial intelligence (AI): understanding the potential benefits of ChatGPT in promoting teaching and learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4337484 .

Basic Z, Banovac A, Kruzic I, Jerkovic I. Better by you, better than me, chatgpt3 as writing assistance in students essays. 2023. arXiv preprint arXiv:2302.04536 .‏

Baskara FR. The promises and pitfalls of using chat GPT for self-determined learning in higher education: an argumentative review. Prosiding Seminar Nasional Fakultas Tarbiyah dan Ilmu Keguruan IAIM Sinjai. 2023;2:95–101. https://doi.org/10.47435/sentikjar.v2i0.1825 .

Behera RK, Bala PK, Dhir A. The emerging role of cognitive computing in healthcare: a systematic literature review. Int J Med Inform. 2019;129:154–66. https://doi.org/10.1016/j.ijmedinf.2019.04.024 .

Chaka C. Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic: the case of five AI content detection tools. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.2.12 .

Chiu TKF, Xia Q, Zhou X, Chai CS, Cheng M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput Educ Artif Intell. 2023;4:100118. https://doi.org/10.1016/j.caeai.2022.100118 .

Choi EPH, Lee JJ, Ho M, Kwok JYY, Lok KYW. Chatting or cheating? The impacts of ChatGPT and other artificial intelligence language models on nurse education. Nurse Educ Today. 2023;125:105796. https://doi.org/10.1016/j.nedt.2023.105796 .

Cotton D, Cotton PA, Shipway JR. Chatting and cheating: ensuring academic integrity in the era of ChatGPT. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2190148 .

Crawford J, Cowling M, Allen K. Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.3.02 .

Creswell JW. Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook]. 4th ed. London: Pearson Education; 2015.

Curry D. ChatGPT Revenue and Usage Statistics (2023)—Business of Apps. 2023. https://www.businessofapps.com/data/chatgpt-statistics/

Day T. A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. Prof Geogr. 2023. https://doi.org/10.1080/00330124.2023.2190373 .

De Castro CA. A Discussion about the Impact of ChatGPT in education: benefits and concerns. J Bus Theor Pract. 2023;11(2):p28. https://doi.org/10.22158/jbtp.v11n2p28 .

Deng X, Yu Z. A meta-analysis and systematic review of the effect of Chatbot technology use in sustainable education. Sustainability. 2023;15(4):2940. https://doi.org/10.3390/su15042940 .

Eke DO. ChatGPT and the rise of generative AI: threat to academic integrity? J Responsib Technol. 2023;13:100060. https://doi.org/10.1016/j.jrt.2023.100060 .

Elmoazen R, Saqr M, Tedre M, Hirsto L. A systematic literature review of empirical research on epistemic network analysis in education. IEEE Access. 2022;10:17330–48. https://doi.org/10.1109/access.2022.3149812 .

Farrokhnia M, Banihashem SK, Noroozi O, Wals AEJ. A SWOT analysis of ChatGPT: implications for educational practice and research. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2195846 .

Fergus S, Botha M, Ostovar M. Evaluating academic answers generated using ChatGPT. J Chem Educ. 2023;100(4):1672–5. https://doi.org/10.1021/acs.jchemed.3c00087 .

Fink A. Conducting research literature reviews: from the Internet to Paper. Incorporated: SAGE Publications; 2010.

Firaina R, Sulisworo D. Exploring the usage of ChatGPT in higher education: frequency and impact on productivity. Buletin Edukasi Indonesia (BEI). 2023;2(01):39–46. https://doi.org/10.56741/bei.v2i01.310 .

Firat, M. (2023). How chat GPT can transform autodidactic experiences and open education.  Department of Distance Education, Open Education Faculty, Anadolu Unive .‏ https://orcid.org/0000-0001-8707-5918

Firat M. What ChatGPT means for universities: perceptions of scholars and students. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.22 .

Fuchs K. Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse? Front Educ. 2023. https://doi.org/10.3389/feduc.2023.1166682 .

García-Peñalvo FJ. La percepción de la inteligencia artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico. Educ Knowl Soc. 2023;24: e31279. https://doi.org/10.14201/eks.31279 .

Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor A, Chartash D. How does ChatGPT perform on the United States medical Licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023;9: e45312. https://doi.org/10.2196/45312 .

Hashana AJ, Brundha P, Ayoobkhan MUA, Fazila S. Deep Learning in ChatGPT—A Survey. In   2023 7th international conference on trends in electronics and informatics (ICOEI) . 2023. (pp. 1001–1005). IEEE. https://doi.org/10.1109/icoei56765.2023.10125852

Hirsto L, Saqr M, López-Pernas S, Valtonen T. (2022). A systematic narrative review of learning analytics research in K-12 and schools.  Proceedings . https://ceur-ws.org/Vol-3383/FLAIEC22_paper_9536.pdf

Hisan UK, Amri MM. ChatGPT and medical education: a double-edged sword. J Pedag Educ Sci. 2023;2(01):71–89. https://doi.org/10.13140/RG.2.2.31280.23043/1 .

Hopkins AM, Logan JM, Kichenadasse G, Sorich MJ. Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift. JNCI Cancer Spectr. 2023. https://doi.org/10.1093/jncics/pkad010 .

Househ M, AlSaad R, Alhuwail D, Ahmed A, Healy MG, Latifi S, Sheikh J. Large Language models in medical education: opportunities, challenges, and future directions. JMIR Med Educ. 2023;9: e48291. https://doi.org/10.2196/48291 .

Ilkka T. The impact of artificial intelligence on learning, teaching, and education. Minist de Educ. 2018. https://doi.org/10.2760/12297 .

Iqbal N, Ahmed H, Azhar KA. Exploring teachers’ attitudes towards using CHATGPT. Globa J Manag Adm Sci. 2022;3(4):97–111. https://doi.org/10.46568/gjmas.v3i4.163 .

Irfan M, Murray L, Ali S. Integration of Artificial intelligence in academia: a case study of critical teaching and learning in Higher education. Globa Soc Sci Rev. 2023;8(1):352–64. https://doi.org/10.31703/gssr.2023(viii-i).32 .

Jeon JH, Lee S. Large language models in education: a focus on the complementary relationship between human teachers and ChatGPT. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11834-1 .

Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT—Reshaping medical education and clinical management. Pak J Med Sci. 2023. https://doi.org/10.12669/pjms.39.2.7653 .

King MR. A conversation on artificial intelligence, Chatbots, and plagiarism in higher education. Cell Mol Bioeng. 2023;16(1):1–2. https://doi.org/10.1007/s12195-022-00754-8 .

Kooli C. Chatbots in education and research: a critical examination of ethical implications and solutions. Sustainability. 2023;15(7):5614. https://doi.org/10.3390/su15075614 .

Kuhail MA, Alturki N, Alramlawi S, Alhejori K. Interacting with educational chatbots: a systematic review. Educ Inf Technol. 2022;28(1):973–1018. https://doi.org/10.1007/s10639-022-11177-3 .

Lee H. The rise of ChatGPT: exploring its potential in medical education. Anat Sci Educ. 2023. https://doi.org/10.1002/ase.2270 .

Li L, Subbareddy R, Raghavendra CG. AI intelligence Chatbot to improve students learning in the higher education platform. J Interconnect Netw. 2022. https://doi.org/10.1142/s0219265921430325 .

Limna P. A Review of Artificial Intelligence (AI) in Education during the Digital Era. 2022. https://ssrn.com/abstract=4160798

Lo CK. What is the impact of ChatGPT on education? A rapid review of the literature. Educ Sci. 2023;13(4):410. https://doi.org/10.3390/educsci13040410 .

Luo W, He H, Liu J, Berson IR, Berson MJ, Zhou Y, Li H. Aladdin’s genie or pandora’s box For early childhood education? Experts chat on the roles, challenges, and developments of ChatGPT. Early Educ Dev. 2023. https://doi.org/10.1080/10409289.2023.2214181 .

Meyer JG, Urbanowicz RJ, Martin P, O’Connor K, Li R, Peng P, Moore JH. ChatGPT and large language models in academia: opportunities and challenges. Biodata Min. 2023. https://doi.org/10.1186/s13040-023-00339-9 .

Mhlanga D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4354422 .

Neumann, M., Rauschenberger, M., & Schön, E. M. (2023). “We Need To Talk About ChatGPT”: The Future of AI and Higher Education.‏ https://doi.org/10.1109/seeng59157.2023.00010

Nolan B. Here are the schools and colleges that have banned the use of ChatGPT over plagiarism and misinformation fears. Business Insider . 2023. https://www.businessinsider.com

O’Leary DE. An analysis of three chatbots: BlenderBot, ChatGPT and LaMDA. Int J Intell Syst Account, Financ Manag. 2023;30(1):41–54. https://doi.org/10.1002/isaf.1531 .

Okoli C. A guide to conducting a standalone systematic literature review. Commun Assoc Inf Syst. 2015. https://doi.org/10.17705/1cais.03743 .

OpenAI. (2023). https://openai.com/blog/chatgpt

Perkins M. Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.02.07 .

Plevris V, Papazafeiropoulos G, Rios AJ. Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard. arXiv (Cornell University) . 2023. https://doi.org/10.48550/arxiv.2305.18618

Rahman MM, Watanobe Y (2023) ChatGPT for education and research: opportunities, threats, and strategies. Appl Sci 13(9):5783. https://doi.org/10.3390/app13095783

Ram B, Verma P. Artificial intelligence AI-based Chatbot study of ChatGPT, google AI bard and baidu AI. World J Adv Eng Technol Sci. 2023;8(1):258–61. https://doi.org/10.30574/wjaets.2023.8.1.0045 .

Rasul T, Nair S, Kalendra D, Robin M, de Oliveira Santini F, Ladeira WJ, Heathcote L. The role of ChatGPT in higher education: benefits, challenges, and future research directions. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.29 .

Ratnam M, Sharm B, Tomer A. ChatGPT: educational artificial intelligence. Int J Adv Trends Comput Sci Eng. 2023;12(2):84–91. https://doi.org/10.30534/ijatcse/2023/091222023 .

Ray PP. ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys Syst. 2023;3:121–54. https://doi.org/10.1016/j.iotcps.2023.04.003 .

Roumeliotis KI, Tselikas ND. ChatGPT and Open-AI models: a preliminary review. Future Internet. 2023;15(6):192. https://doi.org/10.3390/fi15060192 .

Rudolph J, Tan S, Tan S. War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.23 .

Ruiz LMS, Moll-López S, Nuñez-Pérez A, Moraño J, Vega-Fleitas E. ChatGPT challenges blended learning methodologies in engineering education: a case study in mathematics. Appl Sci. 2023;13(10):6039. https://doi.org/10.3390/app13106039 .

Sallam M, Salim NA, Barakat M, Al-Tammemi AB. ChatGPT applications in medical, dental, pharmacy, and public health education: a descriptive study highlighting the advantages and limitations. Narra J. 2023;3(1): e103. https://doi.org/10.52225/narra.v3i1.103 .

Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023. https://doi.org/10.1186/s13054-023-04380-2 .

Saqr M, López-Pernas S, Helske S, Hrastinski S. The longitudinal association between engagement and achievement varies by time, students’ profiles, and achievement state: a full program study. Comput Educ. 2023;199:104787. https://doi.org/10.1016/j.compedu.2023.104787 .

Saqr M, Matcha W, Uzir N, Jovanović J, Gašević D, López-Pernas S. Transferring effective learning strategies across learning contexts matters: a study in problem-based learning. Australas J Educ Technol. 2023;39(3):9.

Schöbel S, Schmitt A, Benner D, Saqr M, Janson A, Leimeister JM. Charting the evolution and future of conversational agents: a research agenda along five waves and new frontiers. Inf Syst Front. 2023. https://doi.org/10.1007/s10796-023-10375-9 .

Shoufan A. Exploring students’ perceptions of CHATGPT: thematic analysis and follow-up survey. IEEE Access. 2023. https://doi.org/10.1109/access.2023.3268224 .

Sonderegger S, Seufert S. Chatbot-mediated learning: conceptual framework for the design of Chatbot use cases in education. Gallen: Institute for Educational Management and Technologies, University of St; 2022. https://doi.org/10.5220/0010999200003182 .

Book   Google Scholar  

Strzelecki A. To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interact Learn Environ. 2023. https://doi.org/10.1080/10494820.2023.2209881 .

Su J, Yang W. Unlocking the power of ChatGPT: a framework for applying generative AI in education. ECNU Rev Educ. 2023. https://doi.org/10.1177/20965311231168423 .

Sullivan M, Kelly A, McLaughlan P. ChatGPT in higher education: Considerations for academic integrity and student learning. J ApplLearn Teach. 2023;6(1):1–10. https://doi.org/10.37074/jalt.2023.6.1.17 .

Szabo A. ChatGPT is a breakthrough in science and education but fails a test in sports and exercise psychology. Balt J Sport Health Sci. 2023;1(128):25–40. https://doi.org/10.33607/bjshs.v127i4.1233 .

Taecharungroj V. “What can ChatGPT do?” analyzing early reactions to the innovative AI chatbot on Twitter. Big Data Cognit Comput. 2023;7(1):35. https://doi.org/10.3390/bdcc7010035 .

Tam S, Said RB. User preferences for ChatGPT-powered conversational interfaces versus traditional methods. Biomed Eng Soc. 2023. https://doi.org/10.58496/mjcsc/2023/004 .

Tedre M, Kahila J, Vartiainen H. (2023). Exploration on how co-designing with AI facilitates critical evaluation of ethics of AI in craft education. In: Langran E, Christensen P, Sanson J (Eds).  Proceedings of Society for Information Technology and Teacher Education International Conference . 2023. pp. 2289–2296.

Tlili A, Shehata B, Adarkwah MA, Bozkurt A, Hickey DT, Huang R, Agyemang B. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learn Environ. 2023. https://doi.org/10.1186/s40561-023-00237-x .

Uddin SMJ, Albert A, Ovid A, Alsharef A. Leveraging CHATGPT to aid construction hazard recognition and support safety education and training. Sustainability. 2023;15(9):7121. https://doi.org/10.3390/su15097121 .

Valtonen T, López-Pernas S, Saqr M, Vartiainen H, Sointu E, Tedre M. The nature and building blocks of educational technology research. Comput Hum Behav. 2022;128:107123. https://doi.org/10.1016/j.chb.2021.107123 .

Vartiainen H, Tedre M. Using artificial intelligence in craft education: crafting with text-to-image generative models. Digit Creat. 2023;34(1):1–21. https://doi.org/10.1080/14626268.2023.2174557 .

Ventayen RJM. OpenAI ChatGPT generated results: similarity index of artificial intelligence-based contents. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4332664 .

Wagner MW, Ertl-Wagner BB. Accuracy of information and references using ChatGPT-3 for retrieval of clinical radiological information. Can Assoc Radiol J. 2023. https://doi.org/10.1177/08465371231171125 .

Wardat Y, Tashtoush MA, AlAli R, Jarrah AM. ChatGPT: a revolutionary tool for teaching and learning mathematics. Eurasia J Math, Sci Technol Educ. 2023;19(7):em2286. https://doi.org/10.29333/ejmste/13272 .

Webster J, Watson RT. Analyzing the past to prepare for the future: writing a literature review. Manag Inf Syst Quart. 2002;26(2):3.

Xiao Y, Watson ME. Guidance on conducting a systematic literature review. J Plan Educ Res. 2017;39(1):93–112. https://doi.org/10.1177/0739456x17723971 .

Yan D. Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11742-4 .

Yu H. Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Front Psychol. 2023;14:1181712. https://doi.org/10.3389/fpsyg.2023.1181712 .

Zhu C, Sun M, Luo J, Li T, Wang M. How to harness the potential of ChatGPT in education? Knowl Manag ELearn. 2023;15(2):133–52. https://doi.org/10.34105/j.kmel.2023.15.008 .

Download references

The paper is co-funded by the Academy of Finland (Suomen Akatemia) Research Council for Natural Sciences and Engineering for the project Towards precision education: Idiographic learning analytics (TOPEILA), Decision Number 350560.

Author information

Authors and affiliations.

School of Computing, University of Eastern Finland, 80100, Joensuu, Finland

Yazid Albadarin, Mohammed Saqr, Nicolas Pope & Markku Tukiainen

You can also search for this author in PubMed   Google Scholar

Contributions

YA contributed to the literature search, data analysis, discussion, and conclusion. Additionally, YA contributed to the manuscript’s writing, editing, and finalization. MS contributed to the study’s design, conceptualization, acquisition of funding, project administration, allocation of resources, supervision, validation, literature search, and analysis of results. Furthermore, MS contributed to the manuscript's writing, revising, and approving it in its finalized state. NP contributed to the results, and discussions, and provided supervision. NP also contributed to the writing process, revisions, and the final approval of the manuscript in its finalized state. MT contributed to the study's conceptualization, resource management, supervision, writing, revising the manuscript, and approving it.

Corresponding author

Correspondence to Yazid Albadarin .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

See Table  4

The process of synthesizing the data presented in Table  4 involved identifying the relevant studies through a search process of databases (ERIC, Scopus, Web of Knowledge, Dimensions.ai, and lens.org) using specific keywords "ChatGPT" and "education". Following this, inclusion/exclusion criteria were applied, and data extraction was performed using Creswell's [ 15 ] coding techniques to capture key information and identify common themes across the included studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Albadarin, Y., Saqr, M., Pope, N. et al. A systematic literature review of empirical research on ChatGPT in education. Discov Educ 3 , 60 (2024). https://doi.org/10.1007/s44217-024-00138-2

Download citation

Received : 22 October 2023

Accepted : 10 May 2024

Published : 26 May 2024

DOI : https://doi.org/10.1007/s44217-024-00138-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Large language models
  • Educational technology
  • Systematic review

Advertisement

  • Find a journal
  • Publish with us
  • Track your research
  • Systematic Review
  • Open access
  • Published: 30 May 2024

Patient experiences: a qualitative systematic review of chemotherapy adherence

  • Amineh Rashidi 1 ,
  • Susma Thapa 1 ,
  • Wasana Sandamali Kahawaththa Palliya Guruge 1 &
  • Shubhpreet Kaur 1  

BMC Cancer volume  24 , Article number:  658 ( 2024 ) Cite this article

224 Accesses

Metrics details

Adherence to chemotherapy treatment is recognized as a crucial health concern, especially in managing cancer patients. Chemotherapy presents challenges for patients, as it can lead to potential side effects that may adversely affect their mobility and overall function. Patients may sometimes neglect to communicate these side effects to health professionals, which can impact treatment management and leave their unresolved needs unaddressed. However, there is limited understanding of how patients’ experiences contribute to improving adherence to chemotherapy treatment and the provision of appropriate support. Therefore, gaining insights into patients’ experiences is crucial for enhancing the accompaniment and support provided during chemotherapy.

This review synthesizes qualitative literature on chemotherapy adherence within the context of patients’ experiences. Data were collected from Medline, Web of Science, CINAHL, PsychINFO, Embase, Scopus, and the Cochrane Library, systematically searched from 2006 to 2023. Keywords and MeSH terms were utilized to identify relevant research published in English. Thirteen articles were included in this review. Five key themes were synthesized from the findings, including positive outlook, receiving support, side effects, concerns about efficacy, and unmet information needs. The review underscores the importance for healthcare providers, particularly nurses, to focus on providing comprehensive information about chemotherapy treatment to patients. Adopting recommended strategies may assist patients in clinical practice settings in enhancing adherence to chemotherapy treatment and improving health outcomes for individuals living with cancer.

Peer Review reports

Introduction

Cancer can affect anyone and is recognized as a chronic disease characterized by abnormal cell multiplication in the body [ 1 ]. While cancer is prevalent worldwide, approximately 70% of cancer-related deaths occur in low- to middle-income nations [ 1 ]. Disparities in cancer outcomes are primarily attributed to variations in the accessibility of comprehensive diagnosis and treatment among countries [ 1 , 2 ]. Cancer treatment comes in various forms; however, chemotherapy is the most widely used approach [ 3 ]. Patients undergoing chemotherapy experience both disease-related and treatment-related adverse effects, significantly impacting their quality of life [ 4 ]. Despite these challenges, many cancer patients adhere to treatment in the hope of survival [ 5 ]. However, some studies have shown that concerns about treatment efficacy may hinder treatment adherence [ 6 ]. Adherence is defined as “the extent to which a person’s behaviour aligns with the recommendations of healthcare providers“ [ 7 ]. Additionally, treatment adherence is influenced by the information provided by healthcare professionals following a cancer diagnosis [ 8 ]. Patient experiences suggest that the decision to adhere to treatment is often influenced by personal factors, with family support playing a crucial role [ 8 ]. Furthermore, providing adequate information about chemotherapy, including its benefits and consequences, can help individuals living with cancer gain a better understanding of the advantages associated with adhering to chemotherapy treatment [ 9 ].

Recognizing the importance of adhering to chemotherapy treatment and understanding the impact of individual experiences of chemotherapy adherence would aid in identifying determinants of adherence and non-adherence that are modifiable through effective interventions [ 10 ]. Recently, systematic reviews have focused on experiences and adherence in breast cancer [ 11 ], self-management of chemotherapy in cancer patients [ 12 ], and the influence of medication side effects on adherence [ 13 ]. However, these reviews were narrow in scope, and to date, no review has integrated the findings of qualitative studies designed to explore both positive and negative experiences regarding chemotherapy treatment adherence. This review aims to synthesize the qualitative literature on chemotherapy adherence within the context of patients’ experiences.

This review was conducted in accordance with the Joanna Briggs Institute [ 14 ] guidelines for systemic review involving meta-aggregation. This review was registered in PROSPERO (CRD42021270459).

Search methods

The searches for peer reviewed publications in English from January 2006-September 2023 were conducted by using keywords, medical subject headings (MeSH) terms and Boolean operators ‘AND’ and ‘OR’, which are presented in the table in Appendix 1 . The searches were performed in a systematic manner in core databases such including Embase, Medline, PsycINFO, CINAHL, Web of Science, Cochrane Library, Scopus and the Joanna Briggs Institute (JBI). The search strategy was developed from keywords and medical subject headings (MeSH) terms. Librarian’s support and advice were sought in forming of the search strategies.

Study selection and inclusion criteria

The systematic search was conducted on each database and all articles were exported to Endnote and duplicates records were removed. Then, title and abstract of the full text was screened by two independent reviewers against the inclusion criteria. For this review, populations were patients aged 18 and over with cancer, the phenomenon of interest was experiences on chemotherapy adherence and context was considered as hospitals, communities, rehabilitation centres, outpatient clinics, and residential aged care. All peer-reviewed qualitative study design were also considered for inclusion. Studies included in this review were classified as primary research, published in English since 2006, some intervention implemented to improve adherence to treatment. This review excluded any studies that related to with cancer and mental health condition, animal studies and grey literature.

Quality appraisal and data extraction

The JBI Qualitative Assessment and Review Instrument for qualitative studies was used to assess the methodological quality of the included studies, which was conducted by the primary and second reviewers independently. There was no disagreement between the reviews. The qualitative data on objectives, study population, context, study methods, and the phenomena of interest and findings form the included studies were extracted.

Data synthesis

The meta-aggregation approach was used to combine the results with similar meaning. The primary and secondary reviewers created categories based on the meanings and concept. These categories were supported by direct quotations from participants. The findings were assess based on three levels of evidence, including unequivocal, credible, and unsupported [ 15 , 16 ]. Findings with no quotation were not considered for synthesis in this review. The categories and findings were also discussed by the third and fourth reviewers until a consensus was reached. The review was approved by the Edith Cowan University Human Research Ethics Committee (2021–02896).

Study inclusion

A total of 4145 records were identified through a systematic search. Duplicates ( n  = 647) were excluded. Two independent reviewers conducted screening process. The remaining articles ( n  = 3498) were examined for title and abstract screening. Then, the full text screening conducted, yielded 13 articles to be included in the final synthesis see Appendix 2 .

Methodological quality of included studies

All included qualitative studies scored between 7 and 9, which is displayed in Appendix 3 . The congruity between the research methodology and the research question or objectives, followed by applying appropriate data collection and data analysis were observed in all included studies. Only one study [ 17 ] indicated the researcher’s statement regarding cultural or theoretical perspectives. Three studies [ 18 , 19 , 20 ] identified the influence of the researcher on the research and vice-versa.

Characteristics of included studies

Most of studies conducted semi-structured and in-depth interviews, one study used narrative stories [ 19 ], one study used focus group discussion [ 21 ], and one study combined focus group and interview [ 22 ] to collect data. All studies conducted outpatient’s clinic, community, or hospital settings [ 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 ]. The study characteristics presented in Appendix 4 .

Review findings

Eighteen findings were extracted and synthesised into five categories: positive outlook, support, side effects, concern about efficacy and unmet information needs.

Positive outlook

Five studies discussed the link between positivity and hope and chemotherapy adherence [ 19 , 20 , 23 , 27 , 28 ]. Five studies commented that feeling positive and avoid the negativity and worry could encourage people to adhere in their mindset chemotherapy: “ I think the main thing for me was just keeping a positive attitude and not worrying, not letting myself worry about it ” [ 20 ]. Participants also considered the positive thoughts as a coping mechanism, that would help them to adhere and complete chemotherapy: “ I’m just real positive on how everything is going. I’m confident in the chemo, and I’m hoping to get out of her soon ” [ 23 ]. Viewing chemotherapy as part of their treatment regimen and having awareness of negative consequences of non-adherence to chemotherapy encouraged them to adhere chemotherapy: “ If I do not take medicine, I do not think I will be able to live ” [ 28 ]. Adhering chemotherapy was described as a survivor tool which helped people to control cancer-related symptoms: “ it is what is going to restore me. If it wasn’t this treatment, maybe I wasn’t here talking to you. So, I have to focus in what he is going to give me, life !” [ 27 ]. Similarly, people accepted the medical facts and prevent their life from worsening; “ without the treatment, it goes the wrong way. It is hard, but I have accepted it from the beginning, yes. This is how it is. I cannot do anything about it. Just have to accept it ” [ 19 ].

Finding from six studies contributed to this category [ 20 , 21 , 23 , 24 , 25 , 29 ]. Providing support from families and friends most important to the people. Receiving support from family members enhanced a sense responsibility towards their families, as they believed to survive for their family even if suffered: “ yes, I just thought that if something comes back again and I say no, then I have to look my family and friends in the eye and say I could have prevented it, perhaps. Now, if something comes back again, I can say I did everything I could. Cancer is bad enough without someone saying: It’s your own fault!!” [ 29 ]. Also, emotional support from family was described as important in helping and meeting their needs, and through facilitation helped people to adhere chemotherapy: “ people who genuinely mean the support that they’re giving […] just the pure joy on my daughter’s face for helping me. she was there day and night for me if I needed it, and that I think is the main thing not to have someone begrudgingly looking after you ” [ 20 ]. Another study discussed the role family, friends and social media as the best source of support during their treatment to adhere and continue “ I have tons of friends on Facebook, believe it or not, and it’s amazing how many people are supportive in that way, you know, just sending get-well wishes. I can’t imagine going through this like 10 years ago whenever stuff like that wasn’t around ” [ 23 ]. Receiving support from social workers was particularly helpful during chemotherapy in encouraging adherence to the chemotherapy: “ the social worker told me that love is courage. That was a huge encouragement, and I began to encourage myself ” [ 25 ].

Side effects

Findings from five studies informed this category [ 17 , 21 , 22 , 25 , 26 ]. Physical side effects were described by some as the most unpleasure experience: “ the side effects were very uncomfortable. I felt pain, fatigue, nausea, and dizziness that limited my daily activities. Sometimes, I was thinking about not keeping to my chemotherapy schedule due to those side effect ” [ 17 ]. The impact of side effects affected peoples’ ability to maintain their independence and self-care: “ I couldn’t walk because I didn’t have the energy, but I wouldn’t have dared to go out because the diarrhoea was so bad. Sometimes I couldn’t even get to the toilet; that’s very embarrassing because you feel like you’re a baby ” [ 26 ]. Some perceived that this resulted in being unable to perform independently: “ I was incredibly weak and then you still have to do things and you can’t manage it ” [ 22 ]. These side effect also decreased their quality of life “ I felt nauseated whenever I smelled food. I simply had no appetite when food was placed in front of me. I lost my sense of taste. Food had no taste anymore ” [ 25 ]. Although, the side effects impacted on patients´ leisure and free-time activities, they continued to undertake treatment: “ I had to give up doing the things I liked the most, such as going for walks or going to the beach. Routines, daily life in general were affected ” [ 21 ].

Concern about efficacy

Findings form four studies informed this category [ 17 , 18 , 24 , 28 ]. Although being concerned about the efficacy of the chemotherapy and whether or not chemotherapy treatment would be successful, one participant who undertook treatment described: “the efficacy is not so great. It is said to expect about 10% improvement, but I assume that it declines over time ” [ 28 ]. People were worried that such treatment could not cure their cancer and that their body suffered more due to the disease: “ I was really worried about my treatment effectiveness, and I will die shortly ” [ 17 ]. There were doubts expressed about remaining the cancer in the body after chemotherapy: “ there’s always sort of hidden worries in there that whilst they’re not actually taking the tumour away, then you’re wondering whether it’s getting bigger or what’s happening to it, whether it’s spreading or whatever, you know ” [ 24 ]. Uncertainty around the outcome of such treatment, or whether recovering from cancer or not was described as: “it makes you feel confused. You don’t know whether you are going to get better or else whether the illness is going to drag along further” [ 18 ].

Unmet information needs

Five studies contributed to this category [ 17 , 21 , 22 , 23 , 26 ]. The need for adequate information to assimilate information and provide more clarity when discussing complex information were described. Providing information from clinicians was described as minimal: “they explain everything to you and show you the statistics, then you’re supposed to take it all on-board. You could probably go a little bit slower with the different kinds of chemo and grappling with these statistics” [ 26 ]. People also used the internet search to gain information about their cancer or treatments, “I’ve done it (consult google), but I stopped right away because there’s so much information and you don’t know whether it’s true or not ” [ 21 ]. The need to receive from their clinicians to obtain clearer information was described as” I look a lot of stuff up online because it is not explained to me by the team here at the hospital ” [ 23 ]. Feeling overwhelmed with the volume of information could inhibit people to gain a better understanding of chemotherapy treatment and its relevant information: “ you don’t absorb everything that’s being said and an awful lot of information is given to you ” [ 22 ]. People stated that the need to know more information about their cancer, as they were never dared to ask from their clinicians: “ I am a low educated person and come from a rural area; I just follow the doctor’s advice for my health, and I do not dare to ask anything” [ 17 ].

The purpose of this review was to explore patient’s experiences about the chemotherapy adherence. After finalizing the searches, thirteen papers were included in this review that met the inclusion criteria.

The findings of the present review suggest that social support is a crucial element in people’s positive experiences of adhering to chemotherapy. Such support can lead to positive outcomes by providing consistent and timely assistance from family members or healthcare professionals, who play vital roles in maintaining chemotherapy adherence [ 30 ]. Consistent with our study, previous research has highlighted the significant role of family members in offering emotional and physical support, which helps individuals cope better with chemotherapy treatment [ 31 , 32 ]. However, while receiving support from family members reinforces individuals’ sense of responsibility in managing their treatment and their family, it also instils a desire to survive cancer and undergo chemotherapy. One study found that assuming self-responsibility empowers patients undergoing chemotherapy, as they feel a sense of control over their therapy and are less dependent on family members or healthcare professionals [ 33 ]. A qualitative systematic review reported that support from family members enables patients to become more proactive and effective in adhering to their treatment plan [ 34 ]. This review highlights the importance of maintaining a positive outlook and rational beliefs as essential components of chemotherapy adherence. Positive thinking helps individuals recognize their role in chemotherapy treatment and cope more effectively with their illness by accepting it as part of their treatment regimen and viewing it as a tool for survival. This finding is supported by previous studies indicating that positivity and positive affirmations play critical roles in helping individuals adapt to their reality and construct attitudes conducive to chemotherapy adherence [ 35 , 36 ]. Similarly, maintaining a positive mindset can foster more favourable thoughts regarding chemotherapy adherence, ultimately enhancing adherence and overall well-being [ 37 ].

This review identified side effects as a significant negative aspect of the chemotherapy experience, with individuals expressing concerns about how these side effects affected their ability to perform personal self-care tasks and maintain independent living in their daily lives. Previous studies have shown that participants with a history of chemotherapy drug side effects were less likely to adhere to their treatment regimen due to worsening symptoms, which increased the burden of medication side effects [ 38 , 39 ]. For instance, cancer patients who experienced minimal side effects from chemotherapy were at least 3.5 times more likely to adhere to their treatment plan compared to those who experienced side effects [ 40 ]. Despite experiencing side effects, patients were generally willing to accept and adhere to their treatment program, although one study in this review indicated that side effects made some patients unable to maintain treatment adherence. Side effects also decreased quality of life and imposed restrictions on lifestyle, as seen in another study where adverse effects limited individuals in fulfilling daily commitments and returning to normal levels of functioning [ 41 ]. Additionally, unmet needs regarding information on patients’ needs and expectations were common. Healthcare professionals were considered the most important source of information, followed by consultation with the internet. Providing information from healthcare professionals, particularly nurses, can support patients effectively and reinforce treatment adherence [ 42 , 43 ]. Chemotherapy patients often preferred to base their decisions on the recommendations of their care providers and required adequate information retention. Related studies have highlighted that unmet needs among cancer patients are known factors associated with chemotherapy adherence, emphasizing the importance of providing precise information and delivering it by healthcare professionals to improve adherence [ 44 , 45 ]. Doubts about the efficacy of chemotherapy treatment, as the disease may remain latent, were considered negative experiences. Despite these doubts, patients continued their treatment, echoing findings from a study where doubts regarding efficacy were identified as a main concern for chemotherapy adherence. Further research is needed to understand how doubts about treatment efficacy can still encourage patients to adhere to chemotherapy treatment.

Strengths and limitation

The strength of this review lies in its comprehensive search strategy across databases to select appropriate articles. Additionally, the use of JBI guidelines provided a comprehensive and rigorous methodological approach in conducting this review. However, the exclusion of non-English studies, quantitative studies, and studies involving adolescents and children may limit the generalizability of the findings. Furthermore, this review focuses solely on chemotherapy treatment and does not encompass other types of cancer treatment.

Conclusion and practical implications

Based on the discussion of the findings, it is evident that maintaining a positive mentality and receiving social support can enhance chemotherapy adherence. Conversely, experiencing treatment side effects, concerns about efficacy, and unmet information needs may lead to lower adherence. These findings present an opportunity for healthcare professionals, particularly nurses, to develop standardized approaches aimed at facilitating chemotherapy treatment adherence, with a focus on providing comprehensive information. By assessing patients’ needs, healthcare professionals can tailor approaches to promote chemotherapy adherence and improve the survival rates of people living with cancer. Raising awareness and providing education about cancer and chemotherapy treatment can enhance patients’ understanding of the disease and its treatment options. Utilizing videos and reading materials in outpatient clinics and pharmacy settings can broaden the reach of educational efforts. Policy makers and healthcare providers can collaborate to develop sustainable patient education models to optimize patient outcomes in the context of cancer care. A deeper understanding of individual processes related to chemotherapy adherence is necessary to plan the implementation of interventions effectively. Further research examining the experiences of both adherent and non-adherent patients is essential to gain a comprehensive understanding of this topic.

Data availability

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request. on our submission system as well.

World Health Organization. Cancer 2021 [ https://www.who.int/news-room/fact-sheets/detail/cancer .

Klapheke A, Yap SA, Pan K, Cress RDDHSDCA. Sociodemographic disparities in chemotherapy treatment and impact on survival among patients with metastatic bladder cancer. Urologic Oncology: Seminars Original Investigations. 2018;36(6):19–308.

Article   Google Scholar  

Moth EB, Kiely BE, Naganathan V, Martin A, Blinman P. How do oncologists make decisions about chemotherapy for their older patients with cancer? A survey of Australian oncologists. Support Care Cancer. 2018;26(2):451–60.

Article   CAS   PubMed   Google Scholar  

Khamboon T, Pakanta I. Intervention for symptom cluster management of fatigue, loss of appetite, and anxiety among patients with lung cancer undergoing chemotherapy. Asia-Pacific J Oncol Nurs. 2021;8(3):267–75.

Garcia ACM, Camargos Junior JB, Sarto KK, Silva Marcelo CAd, Paiva EMC, Nogueira DA, Mills J. Quality of life, self-compassion and mindfulness in cancer patients undergoing chemotherapy: a cross-sectional study. Eur J Oncol Nurs. 2021;51:N.PAG-N.PAG.

Horne R, Chapman SCE, Parham R, Freemantle N, Forbes A, Cooper V. Understanding patients’ adherence-related beliefs about Medicines prescribed for long-term conditions: a Meta-Analytic Review of the necessity-concerns Framework. PLoS ONE. 2013;8(12):e80633.

Article   PubMed   PubMed Central   Google Scholar  

WHO. Adherence to long-term therapies: evidence for action. Geneva, Switzerland: World Health Organisation; 2003.

Google Scholar  

Warby A, Dhillon HM, Kao S, Vardy JL. A survey of patient and caregiver experience with malignant pleural mesothelioma. Support Care Cancer. 2019;27(12):4675–86.

Article   PubMed   Google Scholar  

Arunachalam SS, Shetty AP, Panniyadi N, Meena C, Kumari J, Rani B, et al. Study on knowledge of chemotherapy’s adverse effects and their self-care ability to manage - the cancer survivors impact. Clin Epidemiol Global Health. 2021;11:100765.

Article   CAS   Google Scholar  

Nizet P, Touchefeu Y, Pecout S, Cauchin E, Beaudouin E, Mayol S, et al. Exploring the factors influencing adherence to oral anticancer drugs in patients with digestive cancer: a qualitative study. Support Care Cancer. 2022;30(3):2591–604.

Clancy C, Lynch J, Oconnor P, Dowling M. Breast cancer patients’ experiences of adherence and persistence to oral endocrine therapy: a qualitative evidence synthesis. Eur J Oncol Nurs. 2020;44.

Magalhães B, Fernandes C, Lima L, Martinez-Galiano JM, Santos C. Cancer patients’ experiences on self-management of chemotherapy treatment-related symptoms: A systematic review and thematic synthesis. Eur J Oncol Nurs. 2020;49.

Peddie N, Agnew S, Crawford M, Dixon D, MacPherson I, Fleming L. The impact of medication side effects on adherence and persistence to hormone therapy in breast cancer survivors: a qualitative systematic review and thematic synthesis. Breast. 2021;58:147–59.

Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ: Br Med J. 2009;339(7716):332–6.

Joanna Briggs Institute. The Joanna Briggs Institute critical appraisal tools for use in JBI systematic reviews. Checklist for qualitative research. 2017.

Zachary M, Kylie P, Craig L, Edoardo A, Alan P. Establishing confidence in the output of qualitative research synthesis: the ConQual approach. BMC Med Res Methodol [Internet]. 2014;14(1):108.

Iskandarsyah A, de Klerk C, Suardi DR, Soemitro MP, Sadarjoen SS, Passchier J. Psychosocial and cultural reasons for Delay in seeking help and Nonadherence to treatment in Indonesian women with breast Cancer: a qualitative study. Health Psychol. 2014;33(3):214–21.

Chircop D, Scerri J. The lived experience of patients with Non-hodgkin’s lymphoma undergoing chemotherapy. Eur J Oncol Nurs. 2018;35:117–21.

Kvåle K, Synnes O. Living with life-prolonging chemotherapy—control and meaning‐making in the tension between life and death. Eur J Cancer Care. 2018;27(1):1.

Staneva AA, Beesley VL, Niranjan N, Gibson AF, Rowlands I, Webb PM. I wasn’t gonna let it stop me: exploring women’s experiences of getting through chemotherapy for ovarian cancer. Cancer Nurs. 2019;42(2):E31–8.

Talens A, Guilabert M, Lumbreras B, Aznar MT, López-Pintor E. Medication Experience and Adherence to Oral Chemotherapy: A Qualitative Study of Patients’ and Health Professionals’ Perspectives. Int J Environ Res Public Health. 2021;18(8).

Dumas L, Lidington E, Appadu L, Jupp P, Husson O, Banerjee S, et al. Exploring older women’s attitudes to and experience of treatment for advanced ovarian cancer: a qualitative phenomenological study. Cancers. 2021;13(6):1207.

Albrecht TA, Keim-Malpass J, Boyiadzis M, Rosenzweig M. Psychosocial experiences of young adults diagnosed with acute leukemia during hospitalization for induction chemotherapy treatment. J Hospice Palliat Nurs. 2019;21(2):167–73.

Beaver K, Williamson S, Briggs J. Exploring patient experiences of neo-adjuvant chemotherapy for breast cancer. Eur J Oncol Nurs. 2016;20:77–86.

Chou J-F, Lu YY. Intraperitoneal chemotherapy: the lived experiences of Taiwanese patients with ovarian cancer. Clin J Oncol Nurs. 2019;23(6):E100–6.

Farrell C, Heaven C. Understanding the impact of chemotherapy on dignity for older people and their partners. Eur J Oncol Nurs. 2018;36:82–8.

Wakiuchi J, Silva Marcon S, de Oliveira DC, Aparecida Sales C. Rebuilding subjectivity from the experience of cancer and its treatment. Revista Brasileira De Enfermagem. 2019;72(1):125–33.

Yagasaki K, Komatsu H, Takahashi T. Inner conflict in patients receiving oral anticancer agents: a qualitative study. BMJ Open [Internet]. 2015; 5(4).

Gassmann C, Kolbe N, Brenner A. Experiences and coping strategies of oncology patients undergoing oral chemotherapy: first steps of a grounded theory study. Eur J Oncol Nurs. 2016;23:106–14.

Tang GX, Yan PP, Yan CL, Fu B, Zhu SJ, Zhou LQ, et al. Determinants of suicidal ideation in gynecological cancer patients. Psycho-oncology. 2016;25(1):97–103.

Oven Ustaalioglu B, Acar E, Caliskan M. The predictive factors for perceived social support among cancer patients and caregiver burden of their family caregivers in Turkish population. Int J Psychiatry Clin Pract. 2018;22(1):63–9.

Levkovich I, Cohen M, Karkabi K. The experience of fatigue in breast Cancer patients 1–12 Month Post-chemotherapy: a qualitative study. Behav Med. 2019;45(1):7–18.

Simchowitz B, Shiman L, Spencer J, Brouillard D, Gross A, Connor M, Weingart SN. Perceptions and experiences of patients receiving oral chemotherapy. Clin J Oncol Nurs. 2010;14(4):447–53.

Rashidi A, Kaistha P, Whitehead L, Robinson S. Factors that influence adherence to treatment plans amongst people living with cardiovascular disease: a review of published qualitative research studies. Int J Nurs Stud 2020;110(103727).

Aydogan U, Doganer YC, Komurcu S, Ozturk B, Ozet A, Saglam K. Coping attitudes of cancer patients and their caregivers and quality of life of caregivers. Indian J Palliat Care. 2016;22(2):150–6.

Langford DJ, Morgan S, Cooper B, Paul S, Kober K, Wright F, et al. Association of personality profiles with coping and adjustment to cancer among patients undergoing chemotherapy. Psycho-oncology. 2020;29(6):1060–7.

Jamie MJ, Pensak NA, Sporn NJ, MacDonald JJ, Lennes IT, Safren SA et al. Treatment satisfaction and adherence to oral chemotherapy in patients with Cancer. J Oncol Pract. 2017;13(2).

Tsai Y-F, Huang W-C, Cho S-F, Hsiao H-H, Liu Y-C, Lin S-F, et al. Side effects and medication adherence of tyrosine kinase inhibitors for patients with chronic myeloid leukemia in Taiwan. Medicine. 2018;97(26):415.

D S, M P, G R, S H. Importance of medication adherence and factors affecting it. IP Int J Compr Adv Pharmacolog. 2020;3(2):69–77.

Bekalu YE, Wudu MA, Gashu AW. Adherence to Chemotherapy and Associated factors among patients with Cancer in Amhara Region, Northeastern Ethiopia, 2022. A cross-sectional study. Cancer Control. 2023;30.

Hsu H-C, Liou W-S, Chiang A-J, Tsai S-Y, Jeang S-R, Wu S-L, et al. Longitudinal perceptions of the side effects of chemotherapy in patients with gynecological cancer. Support Care Cancer. 2017;25(11):3457–64.

Gow K, Rashidi A, Whithead L. Factors influencing medication adherence among adults living with diabetes and comorbidities: a qualitative systematic review. Curr Diab Rep. 2023:1–7.

Rashidi A, Whitehead L, Kaistha P. Nurses’ perceptions of factors influencing treatment engagement among patients with cardiovascular diseases: a systematic review. BMC Nurs. 2021;20(1):251.

Zebrack BJ, Block R, Hayes-Lattin B, Embry L, Aguilar C, Meeske KA, et al. Psychosocial service use and unmet need among recently diagnosed adolescent and young adult cancer patients. Cancer. 2013;119(1):201–14.

Timmers L, Boons CCLM, van den Verbrugghe M, Van Hecke A, Hugtenburg JG. Supporting adherence to oral anticancer agents: clinical practice and clues to improve care provided by physicians, nurse practitioners, nurses and pharmacists. BMC Cancer. 2017;17(1).

Download references

Acknowledgements

Not applicable.

Author information

Authors and affiliations.

School of Nursing and Midwifery, Edith Cowan University, 270 Joondalup Drive, Joondalup, Perth, WA, 6027, Australia

Amineh Rashidi, Susma Thapa, Wasana Sandamali Kahawaththa Palliya Guruge & Shubhpreet Kaur

You can also search for this author in PubMed   Google Scholar

Contributions

First author (AR) and second author (ST) conceived the review and the second author oversight for all stages of the review provided by the second author. All authors (AR), (ST), (WG) and (SK) undertook the literature search. Data extraction, screening the included papers and quality appraisal were undertaken by all authors (AR), (ST), (WG) and (SK). First and second authors (AR) and (ST) analysed the data and wrote the first draft of the manuscript and revised the manuscript and all authors (AR), (ST), (WG) and (SK) approved the final version of the manuscript.

Corresponding author

Correspondence to Amineh Rashidi .

Ethics declarations

Ethics approval and consent to participate.

The review was approved by the Edith Cowan University Human Research Ethics Committee (2021–02896). A proposal for the systematic review was assessed by the Edith Cowan University Human Research Ethics Committee and deemed not appropriate for full ethical review. However, a Data Management Plan (2021-02896-RASHIDI) was approved and monitored as part of this procedure. Raw data was extracted from the published manuscripts and authors could not identify individual participants during or after this process.

Consent for publication

Competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary material 2, supplementary material 3, supplementary material 4, supplementary material 5, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Rashidi, A., Thapa, S., Kahawaththa Palliya Guruge, W. et al. Patient experiences: a qualitative systematic review of chemotherapy adherence. BMC Cancer 24 , 658 (2024). https://doi.org/10.1186/s12885-024-12353-z

Download citation

Received : 17 November 2023

Accepted : 07 May 2024

Published : 30 May 2024

DOI : https://doi.org/10.1186/s12885-024-12353-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Chemotherapy treatment
  • Medication adherence
  • Qualitative research
  • Patients experiences

ISSN: 1471-2407

importance of literature review with examples

  • Open access
  • Published: 03 June 2024

Evaluating competency-based medical education: a systematized review of current practices

  • Nouf Sulaiman Alharbi 1 , 2 , 3  

BMC Medical Education volume  24 , Article number:  612 ( 2024 ) Cite this article

183 Accesses

2 Altmetric

Metrics details

Few published articles provide a comprehensive overview of the available evidence on the topic of evaluating competency-based medical education (CBME) curricula. The purpose of this review is therefore to synthesize the available evidence on the evaluation practices for competency-based curricula employed in schools and programs for undergraduate and postgraduate health professionals.

This systematized review was conducted following the systematic reviews approach with minor modifications to synthesize the findings of published studies that examined the evaluation of CBME undergraduate and postgraduate programs for health professionals.

Thirty-eight articles met the inclusion criteria and reported evaluation practices in CBME curricula from various countries and regions worldwide, such as Canada, China, Turkey, and West Africa. 57% of the evaluated programs were at the postgraduate level, and 71% were in the field of medicine. The results revealed variation in reporting evaluation practices, with numerous studies failing to clarify evaluations’ objectives, approaches, tools, and standards as well as how evaluations were reported and communicated. It was noted that questionnaires were the primary tool employed for evaluating programs, often combined with interviews or focus groups. Furthermore, the utilized evaluation standards considered the well-known competencies framework, specialized association guidelines, and accreditation criteria.

This review calls attention to the importance of ensuring that reports of evaluation experiences include certain essential elements of evaluation to better inform theory and practice.

Peer Review reports

Medical education worldwide is embracing the move toward outcome-based education (OBME) [ 1 , 2 ]. One of the most popular outcome-based approaches being widely adopted by medical schools worldwide is competency-based medical education (CBME) [ 3 ]. CBME considers competencies as the ultimate outcomes that should guide curriculum development at all steps or stages—that is, implementation, assessment, and evaluation [ 3 , 4 , 5 ]. To embrace CBME and prepare medical students for practice, medical educators usually utilize an organized national or international competency framework that describes the abilities that physicians must possess to meet the needs of patients and society. There are numerous global competency frameworks that reflect the characteristics of a competent doctor, for example, CanMEDS, Scottish Doctor, Medical School Projects, ACGME Outcome Project, the Netherlands National Framework, and Saudi Meds [ 1 , 6 , 7 , 8 ].

With the worldwide implementation of CBME and availability of different competency frameworks, educators are expected to evaluate various modifications made to existing medical curricula [ 9 , 10 ]. Such evaluation is intended to explore whether the program is operating as planned and its outcomes are achieved as intended in comparison to predetermined standards as well as to ensure improvement [ 11 , 12 , 13 ]. Furthermore, program evaluation revolves around two main concepts, that is, merit and worth [ 12 , 14 ]. In 1981, Guba and Lincoln explained that the merits of a program are intrinsic, implicit, and independent and do not refer to a specific context or application, while evaluating a program’s worth entails judging the value of any aspect of it in reference to a certain context or precise application [ 12 , 14 ].

To enable educators to determine the merits and worth of an educational program or curriculum, evaluation experts have proposed several models [ 14 , 15 ]. Evaluation models are guiding frameworks that demonstrate what appropriate evaluation looks like and detail how it should be designed and implemented [ 16 ]. Although almost all evaluation models focus on exploring whether a program attains its objectives, they vary in numerous aspects, including their evaluation philosophy, approaches, and the specific areas that they encompass [ 17 ].

It is essential that educators choose a suitable evaluation model when they implement CBME, as the right model will enable them to pinpoint [ 15 , 18 , 19 ]. In other words, a program helps identify areas of success, challenges, and opportunities for improvement in CBME implementation, leading to a deeper comprehension of CBME strategies and their effectiveness. Moreover, implementing CBME demands significant efforts and a wide range of financial, human, time, and infrastructure resources [ 20 ]. Thus, ensuring that these efforts and resources are well utilized to enhance educational and healthcare outcomes is crucial. In addition, evaluation provides valuable evidence for accreditation, quality assurance, policies, and guidelines. Otherwise put, it supports informed decision-making on many levels [ 21 ]. On another front, sharing evaluation results and being transparent about evaluation processes can enhance public trust in available programs, colleges, and universities [ 19 ]. However, deciding which evaluation model to adopt can be challenging [ 9 ].

Not only can it be difficult to select an appropriate model to evaluate a CBME program, but CBME evaluation itself has numerous challenges, particularly given the lack of a common definition or standardized description of what constitutes a CBME program [ 9 , 22 , 23 ]. The complexity of CBME further tangles evaluation efforts, given the multilayered nature of CBME’s activities and outcomes and the need to engage a wide variety of stakeholders [ 11 ]. Moreover, the scarcity and variable quality of reporting in studies focusing on the evaluation of CBME curricula exacerbate these challenges [ 24 ]. Furthermore, few published articles provide a comprehensive overview of available evidence on the topic.

This review is therefore designed to synthesize the findings of published studies that have reported CBME evaluation practices in undergraduate and postgraduate medical schools and programs. Its objective is to explore which CBME program evaluation practices have been reported in the literature by inspecting which evaluation objectives, models, tools, and standards were described in the included studies. In addition, the review inspects the results of evaluations and how they were shared. Thus, the review will serve in supporting educators to make evidence-based decisions when designing a CBME program. In addition, it will provide a useful resource for educators to embrace what was done right, learn from what was done wrong, improve many current evaluation practices, and compare different CBME interventions across various contexts.

Following a preliminary search within relevant journals for publications addressing evaluation practices utilized to assess competency-based curricula in medical education, the researcher used the PEO (participant, educational aspect, and outcomes) model to set and formulate the search question [ 24 ] as follows: participants : healthcare professionals and healthcare profession students; educational aspect : CBME curricula; outcome : program evaluation practices.

Next, the researcher created a clear plan for the review protocol. This review is classified as a systematized review rather than a systematic review [ 25 ]. While it does not meet the criteria for a systematic review because it relies on a single researcher and does not evaluate the quality of the studies included, it adheres to most of the steps outlined in the “Systematic Reviews in Medical Education: A Practical Approach: AMEE guide 94” [ 26 ]. Moreover, the researcher met with a medical educator with a strong background in CBME, an expert in review methods, and a librarian who is an expert in available databases and provided guidance and support for navigating such databases. Feedback was obtained from all three and used to finalize the review protocol. The protocol was followed to ensure that the research progressed in a consistent and systematized manner.

For this review, full-text articles published in peer-reviewed journals in English from 1 January 2000 to 31 December 2022 were searched within the following electronic data bases: PubMed, ERIC, Education Source, and CINHAL. The following terms were utilized to conduct the search: (Competency Based Medical Education OR Outcome Based Medical Education) AND (Evaluation OR assessment) AND (Undergraduate OR Postgraduate) AND (Implementing OR Performance OR Framework OR Program* OR Project OR Curriculum OR Outcome) (Additional file 1 ).

The researcher included articles that were published in English and reported evaluation practices for CBME or OBME curricula whether for undergraduate or postgraduate healthcare professionals. The researcher did not consider research reviews, commentaries, perspective articles, conference proceedings, and graduate theses in this review. In addition, articles that addressed students’ assessments rather than program evaluation were not included. Furthermore, articles that focused on teaching a particular skill (e.g., communication skills) or specific educational strategies (e.g., the effectiveness of Problem Based Learning) were excluded from this review.

To facilitate the screening of articles and ensure the process was properly documented, an online review software that streamlines the production of reviews (Covidence) was utilized, and all the lists of articles retrieved from the specified databases were uploaded to the tool website (available at www.covidence.org ). The tool set the screening to start with the titles and abstracts then to proceed to full texts. During these stages, the reasons for excluding an article were precisely noted. Moreover, the PRISMA diagram (available at http://www.prisma-statement.org/ ) was produced by Covidence to illustrate the process of screening and including articles in this review.

After the decision was made to include an article, a data extraction tool created for the purpose of this review was used (Additional file 2 ). Since the term “program evaluation practices” is general and does not clearly define the method or focus of the analysis involved in critiquing evaluation efforts, the analysis of available evaluation practices in this review was based on the Embedded Evaluation Model (EEM) provided by Giancola (2020) for educators to consider when embedding evaluations into educational program designs and development [ 27 ]. The EEM outlines several steps. In the first step, “Define,” educators are expected to build an understanding of the evaluated program, including its logic and context. In the second step, “Plan,” educators must establish the evaluation-specific objectives and questions and select the model or approach along with the methods or tools that will be utilized to achieve those objectives. The next step, “Implement and Analyze,” requires educators to determine how the data will be collected, analyzed, and managed. In the fourth step, “Interpret the Results,” educators are expected to derive insights from the results in terms of how the evaluation can help with resolving issues and improving the program as well as how the results should be communicated and employed. Finally, in the “Inform and Refine” step, educators should focus on applying the results to realize improvements to the program and promote accountability [ 27 ].

In addition to supporting the aim of the current review, the theoretical insights from Giancola (2020) help to ensure alignment with best practices in curriculum evaluation. Thus, for each article, the extraction tool collected the following information: the author, the publication year, the country and name of the institution that implemented the CBME curriculum, the aim and method of the article, the type of curriculum based on the health profession specialty (e.g., medicine, nursing), the level of the curriculum (postgraduate or undergraduate), the evaluation objective, the approach/model or tool, the evaluation standard, the evaluation results, and the sharing of the evaluation results. The extracted information points are essential to contextualize the evaluation and allow educators to make sense of it and adapt or adjust it to their own situations. Understanding the context of an evaluation is important considering the wide variety of available educational environments, the diversity of evaluators, and the differences in goals, modes, and benchmarks for evaluation, all of which influence how an evaluation is framed and conducted [ 27 ].

The author, publication year , and name and country of the institution that implemented the CBME curriculum provide identifiers for the original article and enable educators to seek further information about a study. The aim and method of the article were highlighted because they clarify the general context in which the evaluation was conducted. For example, this information can help educators understand whether an evaluation was carried out as a single action in response to a certain problem or was a phase or part of a larger project. The type of curriculum based on the health profession specialty (e.g., medicine, nursing) along with the level of the curriculum (postgraduate or undergraduate) have specific implications related to the nature of each specialty and the level of the competencies associated with the advancement of the program. All of the previously mentioned information is vital for educators to define and understand the program they are aiming to evaluate, which is the first step in the EEM. The evaluation objective , approach/model or tool , evaluation standard , evaluation results , and sharing of the evaluation results help to answer the research question of the current review by dissecting various aspects of the evaluation activities. In addition, the reporting of these aspects provides valuable insight into evaluation directives, plans, and execution. For educators, the evaluation objective usually clarifies the focus of the evaluation (e.g., how the program was implemented, the action done to execute education or outcomes of the program, and its effectiveness). The approach/model or tool of an evaluation is a core element of the design and implementation of the evaluation, as it determines the theoretical guidelines that underlie the evaluation and the practical steps for its execution. Based on the evaluation standard, which refers to the target used to compare the evidence or results of the evaluation, educators can judge the relevance of the evaluation to their own practices or activities. This information aligns with steps two and three of the EEM. The evaluation results are the results of the evaluation, which form the cornerstone for emerging solutions or future improvements. Finally, sharing the evaluation results , or communicating the evaluation, is a key part of handling the results and working toward their application. This information is aligned with steps four and five of the EEM.

Search results

Searching the identified databases revealed a total of 640 articles, and 183 total duplicates were removed. A total of 457 articles was considered for screening (371 PubMed, 13 ERIC, 23 Education Source, 50 CINHAL) (Fig.  1 ). Of those articles, 87 were retrieved for full-text screening. Ultimately, 38 studies met the inclusion criteria and were considered eligible to be included in the current review.

figure 1

Flowchart illustrating the process of including articles in the review

Findings of the included studies

The 38 studies that met the inclusion criteria were published between 2010 and 2021, and the majority (15%; n  = 6) were published in 2019. The studies represented the following countries: Canada (37%, n  = 14) [ 10 , 11 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 ], USA (27.5%, n  = 11) [ 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 ], Australia (5%, n  = 2) [ 51 , 52 ], China (5%, n  = 2) [ 53 , 54 ], Dutch Caribbean islands (2.5%, n  = 1) [ 55 ], Germany (2.5%, n  = 1) [ 56 ], Guatemala (2.5%, n  = 1) [ 57 ], Korea (2.5%, n  = 1) [ 58 ], the Netherlands (2.5%, n  = 1) [ 59 ], New Zealand (2.5%, n  = 1) [ 60 ], The Republic of Haiti (2.5%, n  = 1) [ 61 ], Turkey (2.5%, n  = 1) [ 62 ], and the region of West Africa (2.5%, n  = 1) [ 63 ].

According to the evidence synthesized from the included studies, most of the evaluation practices were reported in competency-based curricula that targeted the level of postgraduate professionals (57%, n  = 22) and were medical in nature (71%, n  = 27) (Fig.  2 ).

figure 2

Curricula specialties in included articles

The findings showed that 37% ( n  = 14) of the articles did not report the precise objective of evaluating the curriculum. Moreover, 84% ( n  = 32) did not report the evaluation approach or model used to assess the described curricula. The approaches or models reported include Pawson’s model of realist program evaluation [ 37 ], theory-based evaluation approaches [ 10 ], Stufflebeam’s context, inputs, processes, and products (CIPP) model [ 62 ], the concerns-based adoption model, sensemaking and outcome harvesting [ 33 ]the CIPP model [ 48 ], and quality improvement (QI) for program and process improvement [ 50 ]. On the other hand, a wide variety of evaluation tools was reported including observations (3%, n  = 1) [ 28 ] surveys or questionnaires (58%, n  = 22) [ 10 , 28 , 29 , 31 , 34 , 35 , 36 , 38 , 39 , 41 , 42 , 45 , 49 , 50 , 51 , 52 , 53 , 55 , 56 , 58 , 59 , 63 ] interviews (16%, n  = 6) [ 10 , 28 , 37 , 41 , 47 , 62 ], focus groups (13%, n  = 5) [ 35 , 37 , 41 , 50 , 59 ], historical document review or analysis (8%, n  = 3) [ 10 , 29 , 33 ], educational activity assessment or analysis of the activity by separate reviewers (5%, n  = 2) [ 55 , 61 ], stakeholder discussions or reports about their inputs (5%, n  = 2) [ 43 , 44 ], curriculum mapping (3%, n  = 1) [ 32 ], feedback from external reviews from accrediting bodies (3%, n  = 1) [ 32 ], the Dundee Ready Education Environment Measure (DREEM) (3%, n  = 1) [ 56 ], and students’ or participants’ assessments (5%, n  = 2) [ 38 , 46 ].

Of the studies, 37% ( n  = 14) utilized multi methods [ 10 , 28 , 29 , 30 , 32 , 34 , 35 , 37 , 38 , 41 , 48 , 52 , 56 , 59 ]. Furthermore, 7.8% ( n  = 3) of the studies reported the nature of the tool, for example, quantitative or qualitative, without specifying the exact tool utilized [ 57 , 60 ]. Moreover, 63% ( n  = 24) of the studies included in this review did not report the evaluation standards applied while assessing the competency-based curricula addressed. Yet, those studies that reported their standards were stated in various ways as follows: some publications referred to the standards of specific specialized associations or societies, such as the American Academy of Family Physicians and College of Family Physicians Canada [ 61 ], Royal Australian and New Zealand College of Psychiatrists [ 60 ], and The American Association of Occupational Health Nurses [ 45 ]. Other publications utilized known competency frameworks as their standards, such as CanMED [ 36 , 37 , 59 ], or the competencies of the American Board of Surgery [ 43 ] Association of Canadian Faculties of Dentistry [ 31 ], Royal College of Ophthalmologists [ 52 ], The Florida Consortium for Geriatric Medical Education [ 50 ], or the Dutch Advisory Board for Postgraduate Curriculum Development for Medical Specialists [ 59 ]. Furthermore, many of the publications referred to accreditation standards, such as the Accreditation Standards of the Australian Medical Council [ 51 ], Competencies of Accreditation Council for Graduate Medical Education [ 43 ], Accreditation Body in the Competency-based Curriculum [ 32 ], and the Commission on Dental Accreditation of Canada [ 31 ]. All the publications included in the review reported the results of their evaluations.

Finally, the results revealed that almost half (52.6%, n  = 20) of the authors of the articles mentioned that they were publishing their experience with the intent of sharing lessons learned, yet they did not refer to any other means of sharing the results of their evaluations. In contrast, the other half did not mention any measures taken to communicate and share the evaluation results. Additional file 3 includes the characteristics and details of the data extracted from the studies included addressing evaluation practices in healthcare professionals’ education.

Evaluating a curriculum appropriately is important to ensure that the program is operating as intended [ 13 ]. The present study aimed to review the available literature on the evaluation practices of competency-based undergraduate and postgraduate health professionals’ schools and programs. This review inspected which evaluation objectives, models, tools, and standards were described as well as the results of evaluations and how the results were shared. The synthesized evidence indicates that most of the programs reporting evaluation practices were postgraduate-level medical programs. This focus on CMBE among postgraduate programs can be related to the fact that competency-based education is organized around the most critical competencies useful for health professionals after graduation. Thus, they are better judged at practice [ 64 , 65 , 66 ]. Moreover, although competency-based curricula were introduced to many health professions over 60 years ago, such as pharmacology and chiropractic therapy, within the medical field they have only evolved in the last decade [ 67 ].

Furthermore, the data revealed that there is a discrepancy in how evaluation practices were reported in the literature in terms of evaluation objectives, approaches/models, tools, standards, documenting of results, and communication plans. Each area will be further discussed in the following paragraphs considering the ten-task approach and embedded evaluation model [ 27 , 68 ]. Both guide evaluation as an important step in curriculum development in medical education, detail the evaluation process, and outline many important considerations from design to execution [ 27 , 68 ].

Evaluation is a crucial part of curriculum development, and it can serve many purposes, such as ensuring attaining educational objectives, identifying areas of improvement, improving decision-making, and assuring quality [ 13 , 27 ]. Consequently, when addressing evaluation, it is important for educators to start by explaining the logic of the curriculum by asking, for example, what the program’s outcomes are and whether it is designed for postgraduates or undergraduates [ 27 ]. Moreover, educators must be precise in setting evaluation objectives, which entails answering certain questions: who will use the evaluation data; how will the data be used at both the individual and program level; will the evaluation be summative or formative; and what evaluation questions must be answered [ 27 , 68 , 69 ] However, many of the studies included in this review did not clearly explain the context of the curricula or report the objectives of their evaluation endeavors; rather, they settled for clarifying the objectives of the study or of the publication itself. One reason for this is that evaluation and educational research have many similarities [ 13 ] Nevertheless, the distinction between the two should be clarified, as doing so will enable other medical educators to better understand and benefit from the evaluation experience shared. Moreover, since CBME outcomes are complicated and should be considered on many levels, evaluation plans should include a focus, level, and timeline. The focus of an evaluation can be educational, with outcomes relevant to learners, or clinical, with health outcomes relevant to patients. The level of an evaluation can be micro, meso, or macro, targeting an individual, a program, or a system, respectively. The timeline of an evaluation can investigate outcomes during the program, after the program (i.e., how well learners have put what they learned in a CBME program into practice), and in the long term (i.e., how well learners are doing as practicing physicians) [ 70 ].

Once the evaluation objectives are clearly identified and prioritized, it is logical to start considering the evaluation approach or model that is most appropriate to attain these objectives considering the available resources. In other words, evaluation design should be outlined [ 27 , 68 ]. The choice of an evaluation approach or model affects the accuracy of assessing certain tasks carried out by or to specific subjects in a particular setting [ 68 , 71 , 72 , 73 , 74 , 75 ] This accuracy is referred to as an evaluation’s internal validity. Yet, the external validity of an evaluation entails that the evaluation results are generalizable to other subjects and other settings [ 68 ]. Each model has its own strengths and weaknesses, which require careful examination when planning an evaluation [ 14 , 73 , 74 , 75 ]. Explaining and justifying why a particular evaluation approach was chosen for a specific curriculum can enrich the lessons learned from the evaluation and aid other educators. Furthermore, some of the available models were more utilized within various educational contexts than others [ 17 ] that calls for a continuous documentation of the evaluation approaches or models used to inform theory and practice. Considering the importance of reporting the approaches and models used, it is unfortunate that most of the publications did not indicate the approach/model they used for evaluation, which limits educators’ abilities to utilize the plans and build on their evidence.

Another critical task in the evaluation process is deciding on the measurement tool or instrument to be used. The tool choice will determine what data will be gathered and how they will be collected and analyzed [ 27 , 68 ]. Thus, the choice should consider the evaluation objective as well as the uses, strengths, and limitations of each tool. The evidence in this review indicates that questionnaires or surveys were the most utilized tools in evaluating competency-based curricula. This result can be attributed to the advantages of this method (for example, it is a convenient and economical tool that is easy to administer and analyze and can be utilized with many individuals) [ 27 , 68 ]. Nevertheless, it is important to highlight that questionnaires and surveys usually target attitudes and perceptions, which usually entails only a surface-level evaluation, according to the Kirkpatrick model [ 76 ]. The results also showed that in around 50% of the mixed-methods evaluations, the questionnaires were combined with another tool, such as interviews or focus groups. Understandably, utilizing an additional tool aims to deepen the level of the evaluation focus to include learning, behaviors, or results [ 76 ].

The evaluation evidence must be compared with a standard or target for educators to judge the program and make decisions [ 12 ]. Standards can be implicit or explicit, but they usually provide an understanding of what is ideal [ 12 ]. Worryingly, the results of this review revealed that many of the included studies did not clarify the standards they used to judge different CBME curricula. However, the studies that reported their standards used accreditation criteria or broad competencies frameworks, such as CanMeds, which consider the guides of specialized associations, such as family physicians or nursing. Although deciding what standard to use can be challenging to those designing and evaluating programs, evaluating without an understanding of the level of quality desired can lead to many complications and a waste of resources.

Communicating and reporting evaluation results are crucial to attaining the evaluation objectives [ 27 , 68 , 75 ]. Moreover, effective communication strategies have many important functions, such as providing decision makers with the necessary data to make an informed decision. Informing other stakeholders about the results is also important to achieve their support in implementing program changes and nourish a culture of quality [ 77 , 78 ]. Around half of the authors of studies included in this review indicated that they were publishing to share their own evaluation experiences, while the other half did not. Regardless, none of the studies shared or indicated how their results were reported and communicated, which is an important part of the evaluation cycle that should not be overlooked when sharing evaluation lessons within the scientific community. Reporting the results also ensures quality transformation by closing the evaluation cycle and encourages future engagement in evaluation among different stakeholders [ 78 , 79 , 80 ]. Moreover, the results of the evaluation should be shared publicly to contribute to increasing public trust in educational programs and their outcomes [ 19 , 69 ].

In summary, this review of evaluation practices within competency-based curricula for undergraduate and postgraduate health professional programs provides valuable insight into the current landscape. The results of the review show that most evaluation practices published pertain to postgraduate medical programs. In addition, by examining the objectives, models, tools, standards, and communication of evaluation results, this study exposes a discrepancy between the reported evaluation practices and identified evaluation elements. This discrepancy extends to the data that are reported, which makes it even more difficult to synthesize a holistic picture and definitively fulfill the aim of the review. Moreover, the issue of missing information poses serious challenges for educators who try to leverage existing knowledge to inform their curriculum development and improvement efforts, and it highlights the need for a more systematic and transparent approach to evaluation within CBME.

This review illustrates the importance of agreeing on the main evaluation elements to be reported when publishing a CBME evaluation. Establishing a shared understanding of these fundamental elements will give educators a framework for enhancing the practical utility of evaluation methodologies. In addition, educators and practitioners can ensure that the evaluation process yields more insightful outcomes and is better tailored to meet the needs of the educational context.

Data availability

The datasets used during the current study are available from the corresponding author on reasonable request.

Abbreviations

Outcome-Based Medical Education

Competency-Based Medical Education

Embedded Evaluation Model

Zaini R, Bin Abdulrahman K, Alkhotani A, Al-Hayani AA, Al-Alwani A, Jastaniah S. Saudi meds: a competence specification for Saudi medical graduates. Med Teach. 2011;33(7):582–4.

Article   Google Scholar  

Davis MH, Amin Z, Grande JP, O’Neill AE, Pawlina W, Viggiano TR et al. Case studies in outcome-based education. Med Teach. 2009; 29(7):717–22. https://doi.org/10.1080/01421590701691429

Caccia N, Nakajima A, Kent N. Competency-based medical education: The wave of the future. JOGC. 2015; 37(4):349–53. https://doi.org/10.1016/S1701-2163(15)30286-3

Danilovich N, Kitto S, Price D, Campbell C, Hodgson A, Hendry P. Implementing competency-based medical education in family medicine: a narrative review of current trends in assessment. Fam Med. 2021;53:9–22.

Hawkins RE, Welcher CM, Holmboe ES, Kirk LM, Norcini JJ, Simons KB et al. Implementation of competency-based medical education: Are we addressing the concerns and challenges? Med Educ. 2015 Oct. 22; 49(11):1086–102. https://doi.org/10.1111/medu.12831

Simpson JG, Furnace J, Crosby J, Cumming AD, Evans PA, David MF, Ben et al. The Scottish doctor-learning outcomes for the medical undergraduate in Scotland: A foundation for competent and reflective practitioners. Med Teach. 2002; 24(2):136–43. https://doi.org/10.1080/01421590220120713

Swing SR. The ACGME outcome project: retrospective and prospective. Med Teach. 2007; 29(7):648–54. https://doi.org/10.1080/01421590701392903

Frank JR, Danoff D. The CanMEDS initiative: Implementing an outcomes-based framework of physician competencies. Med Teach. 2007; 29(7):642–7. https://doi.org/10.1080/01421590701746983

van Melle E, Frank JR, Holmboe ES, Dagnone D, Stockley D, Sherbino J. A core components framework for evaluating implementation of competency-based medical education programs. Acad Med. 2019 Jul 1 [cited 2022 Mar 19]; 94(7):1002–9. https://pubmed.ncbi.nlm.nih.gov/30973365/

Hamza DM, Ross S, Oandasan I. Process and outcome evaluation of a CBME intervention guided by program theory. J Eval Clin Pract. 2020; 26(4):1096–104. https://doi.org/10.1111/jep.13344

Van Melle E, Frank J, Holmboe E, Dagnone D, Stockley D, Sherbino J. A core components framework for evaluating implementation of competency-based medical education programs. Acad Med. 2019;94:1.

Google Scholar  

Giancola SP. Program evaluation: Embedding evaluation into program design and development. SAGE Publications; 2020. https://books.google.com.sa/books?id=H-LFDwAAQBAJ

Morrison J, Evaluation. BMJ. 2003; 326(7385):385. http://www.bmj.com/content/326/7385/385.abstract

Glatthorn AA. Curriculum leadership: Strategies for development and implementation. 4th ed. Thousand Oaks, California: SAGE Publications, Inc., 2016. https://search.library.wisc.edu/catalog/9910219273702121

Stufflebeam D. Evaluation models. New Dir Eval. 2001; 2001(89):7–98.

Mertens D, Wilson A. Program evaluation theory and practice. 2nd ed. United States of America: The Guilford; 2019.

Nouraey P, Al-Badi A, Riasati M, Maata RL. Educational program and curriculum evaluation models: a mini systematic review of the recent trends. UJER. 2020;8:4048–55.

Sarah Schiekirka, Markus A, Feufel C, Herrmann-Lingen T, Raupach. Evaluation in medical education: a topical review of target parameters, data collection tools and confounding factors. Ger Med Sci. 2015; 13 (16).

Van Melle E, Hall A, Schumacher D, Kinnear B, Gruppen L, Thoma B, et al. Capturing outcomes of competency-based medical education: the call and the challenge. Med Teach. 2021;43:1–7.

Lomis KD, Mejicano GC, Caverzagie KJ, Monrad SU, Pusic M, Hauer KE. The critical role of infrastructure and organizational culture in implementing competency-based education and individualized pathways in undergraduate medical education. Med Teach. 2021; 43(sup2):S7–16. https://doi.org/10.1080/0142159X.2021.1924364

Taber S, Frank JR, Harris KA, Glasgow NJ, Iobst W, Talbot M. Identifying the policy implications of competency-based education. Med Teach. 2010; 32(8):687–91. https://doi.org/10.3109/0142159X.2010.500706

Zaini RG, bin Abdulrahman KA, Al-Khotani AA, Al-Hayani AMA, Al-Alwan IA, Jastaniah SD. Saudi Meds: A competence specification for Saudi medical graduates. Med Teach. 2011 Jul [cited 2022 Mar 19]; 33(7):582–4. https://pubmed.ncbi.nlm.nih.gov/21696288/

Leung WC. Competency based medical training: review * Commentary: The baby is thrown out with the bathwater. BMJ. 2002 Sept 28; 325(7366):693–6. https://doi.org/10.1136/BMJ.325.7366.693

Hall AK, Schumacher DJ, Thoma B, Caretta-Weyer H, Kinnear B, Gruppen L et al. Outcomes of competency-based medical education: A taxonomy for shared language. Med Teach. 2021;43(7):788–93. https://doi.org/10.1080/0142159X.2021.1925643

Masoomi R. What is the best evidence medical education? Res Dev Med Educ. 2012;1:3–5.

Grant MJ, Booth A. A typology of reviews: An analysis of 14 review types and associated methodologies. Health Info Libr J. 2009; 26(2):91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x

Sharma R, Gordon M, Dharamsi S, Gibbs T. Systematic reviews in medical education: A practical approach: AMEE Guide 94. Med Teach. 2015; 37(2):108–24. https://doi.org/10.3109/0142159X.2014.970996

Giancola SP. Program evaluation embedding evaluation into program design and development. Thousand Oaks: Sage Publication Ltd.; 2020.

Acai A, Cupido N, Weavers A, Saperson K, Ladhani M, Cameron S et al. Competence committees: The steep climb from concept to implementation. Med Educ. 2021; 55(9):1067–77. https://doi.org/10.1111/medu.14585

Zhang P, Hamza D, Ross S, Oandasan I. Exploring change after implementation of family medicine residency curriculum reform. Fam Med. 2019;51:331–7.

Thoma B, Hall A, Clark K, Meshkat N, Cheung W, Desaulniers P et al. Evaluation of a national competency-based assessment system in emergency medicine: a CanDREAM Study. J Grad Med Educ. 2020;12(4).

Schönwetter D, Law D, Mazurat R, Sileikyte R, Nazarko O. Assessing graduating dental students’ competencies: the impact of classroom, clinic and externships learning experiences. Eur J Dent Educ. 2011;15:142–52.

Nousiainen M, Mironova P, Hynes M, Takahashi S, Reznick R, Kraemer W, et al. Eight-year outcomes of a competency-based residency training program in orthopedic surgery. Med Teach. 2018;40:1–13.

Railer J, Stockley D, Flynn L, Hastings Truelove A, Hussain A. Using outcome harvesting: assessing the efficacy of CBME implementation. J Eval Clin Pract. 2020; 26(4).

Janssen P, Keen L, Soolsma J, Seymour L, Harris S, Klein M, et al. Perinatal nursing education for single-room maternity care: an evaluation of a competency-based model. J Clin Nurs. 2005;14:95–101.

Goudreau J, Pepin J, Dubois S, Boyer L, Larue C, Legault A. A second generation of the competency-based approach to nursing education. Int J Nurs Educ Scholarsh. 2009;6:Article15.

Fahim C, Bhandari M, Yang I, Sonnadara R. Development and early piloting of a CanMEDS competency-based feedback tool for surgical grand rounds. J Surg Educ. 2016;73(3):409–15.

Ellaway R, Mackay M, Lee S, Hofmeister M, Malin G, Archibald D, et al. The impact of a national competency-based medical education initiative in family medicine. Acad Med. 2018;93:1.

D’Souza L, Jaswal J, Chan F, Johnson M, Tay KY, Fung K et al. Evaluating the impact of an integrated multidisciplinary head & neck competency-based anatomy & radiology teaching approach in radiation oncology: a prospective cohort study. BMC Med Educ. 2014; 14(1):124. https://doi.org/10.1186/1472-6920-14-124

Crawford L, Cofie N, Mcewen L, Dagnone D, Taylor S. Perceptions and barriers to competency-based education in Canadian postgraduate medical education. J Eval Clin Pract. 2020;26(4):1124–31.

Cox K, Smith A, Lichtveld M. A competency-based approach to expanding the cancer care workforce part III—Improving cancer pain and palliative care competency. J Cancer Educ. 2012;27:507–14.

Freedman AM, Simmons S, Lloyd LM, Redd TR, Alperin MM, Salek SS et al. Public health training center evaluation: A framework for using logic models to improve practice and educate the public health workforce. Health Promot Pract. 2014; 15(1 Suppl):80S-8S. http://europepmc.org/abstract/MED/24578370

Kerfoot B, Baker H, Volkan K, Church P, Federman D, Masser B, et al. Development and initial evaluation of a novel urology curriculum for medical students. J Urol. 2004;172:278–81.

Ketteler E, Auyang E, Beard K, McBride E, McKee R, Russell J, et al. Competency champions in the clinical competency committee: a successful strategy to implement milestone evaluations and competency coaching. J Surg Educ. 2014;71:36–8.

Lipp M. An objectified competency-based course in the management of malocclusion and skeletal problems. J Dent Educ. 2008;72:543–52.

Randolph S, Rogers B, Ostendorf J. Evaluation of an occupational health nursing program through competency achievement on-campus and distance education, 2005 and 2008. AAOHN J. 2011;59:387–99.

Stefanidis D, Acker C, Swiderski D, Heniford BT, Greene F. Challenges during the implementation of a laparoscopic skills curriculum in a busy general surgery residency program. J Surg Educ. 2008;65:4–7.

Stucke R, Sorensen M, Rosser A, Jung S. The surgical consult entrustable professional activity (EPA): defining competence as a basis for evaluation. Am J Surg. 2018;219(2):253–7.

Swider S, Levin P, Ailey S, Breakwell S, Cowell J, Mcnaughton D, et al. Matching a graduate curriculum in public/community health nursing to practice competencies: the Rush University experience. Public Health Nurs. 2006;23:190–5.

Taleghani M, Solomon E, Wathen W. Non-graded clinical evaluation of dental students in a competency‐based education program. J Dent Educ. 2004;68:644–55.

Zuilen M, Mintzer M, Milanez M, Kaiser R, Rodriguez O, Paniagua M, et al. A competency-based medical student curriculum targeting key geriatric syndromes. Gerontol Geriatr Educ. 2008;28:29–45.

Gibson K, Boyle P, Black D, Bennett M, Grimm M, McNeil H. Enhancing evaluation in an undergraduate medical education program. Acad Med. 2008;83:787–93.

Succar T, McCluskey P, Grigg J. Enhancing medical student education by implementing a competency based ophthalmology curriculum. Asia-Pac J Ophthalmol. 2017;6:42–6.

Gruber P, Gomersall C, Joynt G, Shields F, Chu CM, Derrick J. Teaching acute care: a course for undergraduates. Resuscitation. 2007;74:142–9.

Zhang H, Wang B, Zhang L. Reform of the method for evaluating the teaching of medical linguistics to medical students. Chinese Education & Society. 2014; 47(3):60–4. https://doi.org/10.2753/CED1061-1932470305

Koeijers J, Busari J, Duits AJ. A case study of the implementation of a competency-based curriculum in a Caribbean teaching hospital. West Indian Med J. 2012;61:726–32.

Rotthoff T, Ostapczuk MS, de Bruin J, Kröncke KD, Decking U, Schneider M et al. Development and evaluation of a questionnaire to measure the perceived implementation of the mission statement of a competency based curriculum. BMC Med Educ. 2012; 12(1):109. https://doi.org/10.1186/1472-6920-12-109

Day S, Garcia J, Antillon F, Wilimas J, Mckeon L, Carty R, et al. A sustainable model for pediatric oncology nursing education in low-income countries. Pediatr Blood Cancer. 2012;58:163–6.

Lee BH, Chae YM, Hokama T, Kim S. Competency-based learning program in system analysis and design for health professionals. APJPH. 2010; 22(3):299–309. http://www.jstor.org/stable/26723774

Westein M, Vries H, Floor-Schreudering A, Koster A, Buurma H. Development of a postgraduate workplace-based curriculum for specialization of community pharmacists using CanMEDS competencies, entrustable professional activities and programmatic assessment. Am J Pharm Educ. 2018;83:ajpe6863.

de Beer W. Is the RANZCP CPD programme a competency-based educational programme? Australas Psychiatry. 2019; 27(4):404–8. https://doi.org/10.1177/1039856219859279

Battat R, Jhonson M, Wiseblatt L, Renard C, Habib L, Normil M, et al. The Haiti Medical Education Project: Development and analysis of a competency based continuing medical education course in Haiti through distance learning. BMC Med Educ. 2016;16:275.

İlhan E. Evaluation of competency based medical education curriculum. IJPE. 2021;17(3):153–68.

Ekenze SO, Ameh EA. Evaluation of relevance of the components of Pediatric Surgery residency training in West Africa. J Pediatr Surg. 2010; 45(4):801–5. https://www.sciencedirect.com/science/article/pii/S0022346809008495

Iobst WF, Sherbino J, Cate O, Ten, Richardson DL, Dath D, Swing SR et al. Competency-based medical education in postgraduate medical education. Med Teach. 2010; 32(8):651–6. https://doi.org/10.3109/0142159X.2010.500709

Vakani F, Jafri W, Jafri F, Ahmad A. Towards a competency-based postgraduate medical education. J Coll Physicians Surg Pak; 22(7): 476–7.

Pascual TNB, Ros S, Engel-Hills P, Chhem RK. Medical competency in postgraduate medical training programs. Radiology Education. 2012; pp. 29–45. https://doi.org/10.1007/978-3-642-27600-2_4

Frank J, Snell L, Ten Cate O, Holmboe E, Carraccio C, Swing S, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32:638–45.

Lindeman B, Kern D, Lipsett P. Step 6 evaluation and feedback. In: Thomas P, Kern D, Hughes M, Tackett S, Chen B, editors. Curriculum development for medical education: a six-step approach. 4th ed. Johns Hopkins University; 2022. pp. 142–97.

Morrison J. ABC of learning and teaching in medicine: Evaluation. BMJ. 2003; 326(7385):385–7. https://doi.org/10.1136/BMJ.326.7385.385

Wang MC, Ellett CD. Program validation. Topics Early Child Spec Educ. 1982; 1(4):35–49. https://doi.org/10.1177/027112148200100408

McCray E, Lottes JJ. The validation of educational programs. 1976.

Toosi M, Modarres M, Amini M, Geranmayeh M. Evaluation model in medical education: A systematic review. 2016.

Balmer DF, Rama JA, Simpson D. Program evaluation models: Evaluating processes and outcomes in graduate medical education. J Grad Med Educ. 2019; 11(1):99–100. https://doi.org/10.4300/JGME-D-18-01084.1

Vassar M, Wheeler DL, Davison M, Franklin J. Program evaluation in medical education: An overview of the utilization-focused approach. J Educ Eval Health Prof. 2010; 7:1. https://doi.org/10.3352/jeehp.2010.7.1

Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick’s four levels of training evaluation. Association for Talent Development; 2016. (BusinessPro collection). https://books.google.com.sa/books?id=mo--DAAAQBAJ

Moreau KA, Eady K. Program evaluation use in graduate medical education. J Grad Med Educ. 2023; 15(1):15–8. https://doi.org/10.4300/JGME-D-22-00397.1

Durning SJ, Hanson J, Gilliland W, McManigle JM, Waechter D, Pangaro LN. Using qualitative data from a program director’s evaluation form as an outcome measurement for medical school. Mil Med. 2010; 175(6):448–52. https://doi.org/10.7205/MILMED-D-09-00044

Kek M, Hunt L, Sankey M. Closing the loop: A case study of a post-evaluation strategy. 1998.

Wolfhagen HAP, Gijselaers WH, Dolmans D, Essed G, Schmidt HG. Improving clinical education through evaluation. Med Teach. 2009; 19(2):99–103. https://doi.org/10.3109/01421599709019360

Download references

Acknowledgements

The author would like to acknowledge the support that Prof. Ahmad Alrumayyan and Dr. Emad Masuadi gave this research by reviewing its protocol and providing general feedback. In addition, the author would like to acknowledge Dr. Noof Albaz for the discussions about educational program evaluation, which contributed to improving the final version of this manuscript. Thanks, are also due to Mr. Mohammad Alsawadi for reviewing the utilized search terminologies and participating in the selection of appropriate databases and searching them to obtain the needed lists of articles.

Not applicable.

Author information

Authors and affiliations.

Department of Medical Education, College of Medicine, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia

Nouf Sulaiman Alharbi

King Abdullah International Medical Research Center, Riyadh, Saudi Arabia

Ministry of the National Guard - Health Affairs, Riyadh, Saudi Arabia

You can also search for this author in PubMed   Google Scholar

Contributions

The author takes full responsibility for study conception, design, data collection, analysis, interpretation, and manuscript preparation.

Corresponding author

Correspondence to Nouf Sulaiman Alharbi .

Ethics declarations

Ethics approval and consent to participate.

Ethical clearance for conducting this review was attained from King Abdullah International Research Center (KAIMRC), King Saud Bin Abdulaziz University for Health Sciences (RYD-22-419812-52334).

Consent for publication

Competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary material 2, supplementary material 3, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Alharbi, N.S. Evaluating competency-based medical education: a systematized review of current practices. BMC Med Educ 24 , 612 (2024). https://doi.org/10.1186/s12909-024-05609-6

Download citation

Received : 13 November 2023

Accepted : 27 May 2024

Published : 03 June 2024

DOI : https://doi.org/10.1186/s12909-024-05609-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Competency-based medical education
  • Program evaluation
  • Undergraduate medical education
  • Postgraduate medical education
  • Curriculum development

BMC Medical Education

ISSN: 1472-6920

importance of literature review with examples

  • Open access
  • Published: 03 June 2024

Patients’ expectations surrounding revision total hip arthroplasty: a literature review

  • Omar Mohammad   ORCID: orcid.org/0000-0002-3054-2578 1 ,
  • Shahril Shaarani 2 ,
  • Adnan Mohammad 3 &
  • Sujith Konan 2  

Arthroplasty volume  6 , Article number:  28 ( 2024 ) Cite this article

67 Accesses

Metrics details

Revision total hip arthroplasties (RTHA) are associated with a higher complication rate than primary total hip arthroplasties (THA), and therefore it is important for patients to have realistic expectations regarding outcomes. The aim of this literature review was to gather and summarize the available evidence on patients’ expectations following RTHA.

A literature search was conducted in PubMed, PsycINFO, Cochrane, Google Scholar, Web of Science and Embase from inception to November 2023. Articles assessing patient expectations for RTHA were included. Methodological quality was assessed by two independent reviewers using the National Heart, Lung and Blood Institute (NIH) study quality assessment tool for observational cohort and cross-sectional studies. A qualitative analysis was performed involving the summarization of study characteristics and outcomes.

The search strategy generated 7,450 references, of which 5 articles met the inclusion criteria. Methodological quality scores ranged from 7–10. Patients had high expectations concerning future walking ability, pain and implant longevity relative to actual postoperative outcomes. A significant positive correlation was found between fulfilled expectations of pain and walking ability and patient satisfaction ( r  = 0.46–0.47). Only two studies assessed the fulfillment of patient expectations. Great variability was seen in the measurement of expectations.

Patients undergoing RTHA appeared to have high expectations for pain and functionality compared to postoperative outcomes. However, there was a paucity of high-quality data in this area, limiting the accuracy of the conclusion. Further research is needed, that emphasizes developing a sound theoretical framework for expectations, allowing for the consistent implementation of valid measurement tools for patient expectations.

Introduction

Total hip arthroplasty (THA) is a cost-effective procedure for improving a patient’s quality of life (QOL), pain, and function when conservative therapies have failed [ 1 , 2 , 3 ]. Despite the widely recognized success of THA, there is a certain level of risk that may necessitate a revision procedure. The incidence of revisions is on the rise and is projected to increase by 31% by 2030 in England & Wales, UK [ 4 ].

When compared to primary THA, revision THA (RTHA) is associated with higher rates of short- and long-term complications, elevated mortality rates, lower satisfaction, and smaller improvements in functional outcomes [ 5 , 6 , 7 , 8 , 9 , 10 , 11 ]. Whether patients undergo either primary or RTHA, they largely expect a reduction in pain and an improvement in both function and quality of life [ 12 , 13 , 14 , 15 ]. In the preoperative period, it is important to assess these expectations, to ensure that patients have a realistic perspective of the outcomes of the operation and are not dissatisfied. Aside from technical factors and the quality of existing bone, patient factors may also partially explain the less favourable outcomes of RTHA relative to primary THA [ 8 ].

There is a growing body of literature across a variety of medical specialties linking clinical outcomes with patients’ expectations and satisfaction. Patient satisfaction has been shown to lead to higher compliance and attendance for monitoring and follow-up care [ 16 ], which are integral factors in optimizing prosthesis longevity. Furthermore, patients’ expectations are strongly correlated with satisfaction, with satisfied patients having their expectations fulfilled [ 17 ] and unrealistic expectations being correlated with dissatisfaction [ 18 ]. This has led to increasing emphasis on measures of quality of life and patients’ feelings of satisfaction [ 19 , 20 ]. Therefore, as a reflection of this shift in emphasis, it has become essential to gain a better understanding of patients’ expectations.

Although patient expectations have been widely discussed in current primary THA research [ 17 , 18 , 21 ], there is an apparent sparsity in the RTHA literature. This literature review therefore aimed to comprehensively assess all relevant studies evaluating the expectations of patients undergoing RTHA, and how this in turn relates to post-operative outcomes where possible.

Materials and methods

Search strategy.

A comprehensive electronic literature search was performed in the following databases: PubMed, The Cochrane Library, Google Scholar, PsychINFO, Web of Science and Embase to identify eligible studies published until the 7th November 2023. Search terms were derived from MeSh terms in PubMed and free text terms relating to (1) hip arthroplasty, (2) revision and (3) expectations/expectancies (Table  1 ). Although Haanstra et al. offered distinct definitions for expectations and expectancies as being “cognitions regarding probable future events” and “the act or state of expecting” [ 22 ], the current literature uses the two terms interchangeably to show that an individual is “expecting something to occur in the future”. Therefore, whilst they are different concepts, no distinction was acknowledged between the two.

Inclusion criteria

The individual search results from each database were combined barring duplicates, and the remaining titles and abstracts were then screened against the inclusion criteria found below.

The studies had to meet the following inclusion criteria to be eligible:

The study included revision THA patients;

Patients’ expectations were assessed;

The study had to be written in English;

The patients were adults > 18 years of age.

If an article assessed both primary and RTHA groups but failed to report the data separately for each group, the study was excluded, as we would not be able to extract the relevant data.

Two reviewers (OM and SRS) independently assessed the full text articles, based on the title and abstract, against the inclusion criteria. If there was any uncertainty regarding the eligibility of a study the full text was examined. The results of the search are shown in Table  2 .

Data extraction and methodological quality assessment

The same two reviewers extracted relevant data from the included studies using a standardized data extraction form (Table  3 ). The form included information on study design, study population, follow-up period, measurement of expectations and outcome measurements. Moreover, data on the strength of the relationship between expectations and outcomes was extracted where possible (e.g., P -values and correlation coefficients).

Furthermore, the methodological quality of the selected studies was assessed using the National Heart, Lung and Blood Institute (NIH) study quality assessment tool for observational cohort and cross-sectional studies [ 26 ]. Each study was judged on key concepts for internal validity, such as sample size, exposure/outcome measurement and compatibility of the groups. There were fourteen questions in total, for which studies could score a maximum of 14 points in sum. If there was any disagreement between the two reviewers, it was agreed that a discussion would be held to reach a point of consensus. This did not occur.

Data analysis

Due to the heterogeneity of the measurement of patients’ expectations in the studies identified, it was not possible to statistically pool the data in a meta-analysis. Instead, a qualitative analysis was performed involving the summarization of study characteristics and outcomes, as well as a methodological assessment using the NIH quality assessment tool. Studies were noted as poor quality if they scored 0–4, fair if they scored 5–10 and good if they scored 11–14 out of 14 questions [ 27 ].

Study selection process

The literature search retrieved a total of 7,450 records. After removal of duplicates ( n  = 162), records not in English ( n  = 382), non-human studies ( n  = 251) and studies not on adults aged > 18 ( n  = 1,876), a total of 4,779 papers remained. After screening of the titles and abstracts, 4,742 studies were excluded, as they either did not assess patient expectations, did not include revision THA or were review articles. This left a total of 37 studies for further investigation. After full-text assessment, a further 32 articles were excluded, leaving 5 articles that met all the inclusion criteria [ 12 , 14 , 23 , 24 , 25 ] and were subsequently included in this review (Fig.  1 ).

figure 1

Flowchart of literature search and selection process

Study characteristics

Five cohort studies were included in this review. The sample size ranged from 60 to 320 participants. Four studies only included RTHA [ 12 , 14 , 23 , 25 ] and one included both primary and RTHA [ 24 ]. In the assessment of expectations, two studies utilized a single item measurement which utilized either a three-point Likert-scale [ 23 ] or a six-point Likert-scale [ 25 ], two studies implemented a two-item instrument utilizing either a 4-point Likert scale [ 12 ] or a close-ended multiple-choice format [ 24 ]. One study modified the pre-existing Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC scale—a validated instrument) to assess patients’ expectations of pain, stiffness and physical function in 6 months after the revision operation [ 14 ]. Overall, no validated instruments were used in the assessment of patients’ expectations in revision THA across all studies.

Methodological quality

The average quality score was 9 out of 14 (range 7–9) (Table  2 ). As expected, the lowest scoring items were:

“Were the outcome assessors blinded to the exposure status of the participants?” —due to all studies having utilized a self-reported questionnaire;

“For exposures that can vary in amount or level, did the study examine different levels of the exposure as related to the outcome”;

“Was the exposure(s) assessed more than once over time?”—as the exposure was a single revision THA.

Other notable methodological shortcomings were the common lack of sample size justification and often absent statistical analyses of confounding variables.

Expectations

The measurement of patient expectations varied across the studies included in this review. Two studies focused on revision longevity expectations [ 23 , 24 ]. Barrack et al. implemented a single postoperative question concerning implant longevity and scaled responses using a 3-point Likert scale. Hellman et al. also measured implant longevity expectations using a single retrospective question and graded responses with close-ended multiple-choice questions.

One study prospectively measured the expectations of future pain and walking ability utilizing two questions scaled via a 4-point Likert scale [ 12 ]. One study assessed patients’ expectations of pain, stiffness and physical function utilizing the modified WOMAC scale [ 14 ]. These were measured prospectively and used a 5-point Likert scale. Two studies examined fulfillment of patients’ expectations after surgery [ 12 , 25 ]. Eisler et al. postoperatively assessed fulfillment of expectations with two questions and utilized a 4-point Likert scale. Zhang et al. used one postoperative question with a 6-point Likert scale. Only one study measured how this in turn correlated with patient satisfaction [ 12 ].

Patients’ expectations of pain were measured in two studies. Eisler et al. found that 92% of patients expected to have no pain or to have much less pain, and only 8% expected a slight reduction in pain. Haddad et al. reported an average score of 7.4/25 (CI 6.2–8.6) for pain, with a lower score conferring a low expectation of pain.

Function was assessed in two studies [ 12 , 14 ]. Eisler et al. noted that 82% of patients expected the same walking ability as after the first THA or markedly improved walking ability, 15%, slightly improved and 3%, no difference in walking ability. Haddad et al. reported an average expectation of 28.1/85 (CI 24.0–32.2) for physical activity, with a lower score indicating a higher expectation of function. Additionally, only Haddad et al. assessed expectations on stiffness, with an average expectation of 3.5/10 (CI 3.0–4.0) for stiffness, with a lower score indicating a lower expectation for stiffness.

Fulfilled expectations

Eisler et al. found that 55 and 69% of patients had fulfilled expectations regarding walking ability and pain. Furthermore, fulfilled expectations about pain and walking ability demonstrated a modest positive correlation with satisfaction ( r  = 0.46–0.47). The absence of complications was the only predictor of fulfilled pain expectations during the postoperative hospital period (odds ratio (OR) 4.8; 95% confidence interval (CI) 1.1–20.8). Zhang et al. found that at 6 months postoperatively, distressed patients had significantly lower rates of fulfilled expectations compared to non-distressed patients (64.5% vs. 94.1%, P  = 0.027). At 2 years postoperatively, this was no longer significantly different (63.6% vs. 79.3%, P  = 0.342).

Implant longevity

Two studies assessed patients’ expectations concerning the longevity of their revision THA [ 23 , 24 ]. Barrack et al. found that most patients, regardless of original implant longevity, expected their revision to last longer. In patients in whom the primary THA lasted < 5 years: 77% expected revision to last longer and in those where the primary lasted 5–10 years: 76% expected revision to last longer. If the primary lasted 10–15 years: 69% expected the revision to last longer and in those where the primary THA lasted > 15 years: 62% expected the revision to last longer. Hellman et al. found that 35% of patients expected the revision to last for the rest of their lives.

This review found that RTHA patients tend to have unrealistically high expectations regarding pain relief, improvement in movement, and implant longevity. Furthermore, distressed patients are less likely to have their expectations fulfilled postoperatively in the short term [ 25 ]. Given poorer outcomes with revision surgery versus primary THA, these expectations are unlikely to be fulfilled and may result in patient dissatisfaction [ 8 , 12 , 14 ]. Only one study [ 12 ] assessed how fulfillment of these expectations correlated with postoperative satisfaction, revealing a moderate positive correlation with expectations of pain and walking ability. However, overall, there is a paucity of research concerning expectations following RTHA procedures, despite the higher risk of complications [ 28 ]. Additionally, there is significant variability in the way expectations are measured.

Important areas that need to be addressed in future research include (1) The theoretical framework of expectations; (2) the measurement of expectations; (3) the correlation of psychological and other demographic factors and (4) the relationship between fulfilled expectations and satisfaction.

Firstly, none of the papers in this review provided a definition of patient expectations. The absence of a consistent theoretical framework for expectations lends itself to an increased propensity for the heterogeneous use of terminology and measurements. If left unaddressed, this can lead to research plagued by discontinuity and poor methodological quality. In the past, several reviews [ 29 , 30 , 31 ] have acknowledged patient expectations as being a complex multifaceted construct. Kravitz [ 31 ] made a distinct delineation between value (reflecting the patient’s wishes/hopes) and probability expectations (the likelihood that an event will occur). Furthermore, Bandura [ 32 ] separated efficacy from outcome expectations. Given the different perspectives on expectations, it is necessary to utilize a consistent framework to allow for accurate classification and subsequent assessment. For example, Hobbs et al. [ 33 ] successfully utilized the International Classification of Functioning, Disability and Health (ICF) framework to classify patients’ expectations in primary THA. This involved assigning patients’ expectations to one of three domains: activity limitations, impairments to bodily function and structure, and participation restrictions. It was found that patients generally focused more on the recovery of valued activities rather than the reversal of their functional impairment. In future RTHA research investigating patient expectations, researchers should aim to map their findings to each of the core ICF constructs. If performed consistently, this has the potential to lead to more uniformity of definitions, better integration of data amongst different studies and improved validation of measurement instruments. Additionally, this method could be used to ascertain whether certain expectation domains, e.g., impairment, activity limitations or participation restriction expectations are predictors of patient reported outcome measures (PROMs).

As mentioned previously, the lack of a consistent theoretical framework for patient expectations has likely contributed to the absence of a valid and standardized measurement tool. This prevents the effective integration and comparison of data across studies [ 22 ]. Each study in this review implemented a unique instrument that was only used for one investigation. They often lacked a rationale behind their development, or data on reliability and validity, which limits the credibility of evidence collected. This issue has affected both primary THA research and research in other fields such as psychotherapy, where, for example, Constantino et al. [ 34 ] reported that the majority (67%) of measurements were of poor quality. A possible strategy may be to either adapt an already well-established patient-reported outcome tool (such as the WOMAC) or use a theory-guided approach, with testing in independent samples to gather data on reliability, construct validity and predictive validity. Alternatively, the Hospital for Special Surgery Total Hip Replacement Expectations Survey (HSS-HRES) could be used for RTHA patients. This survey is a well-validated 18-question expectations survey that is graded on a 5-point Likert scale and has been used effectively in past THA research [ 35 ]. Regardless, future researchers should aim to use a validated instrument.

Additionally, half of the studies included in this review measured patients’ expectations in the postoperative period. This is not optimal and increases the risk of bias, as the patients may not be able to accurately recall their preoperative expectations due to the time elapsed [ 36 ]. Furthermore, since patient dissatisfaction is secondary to a disequilibrium between expectations and fulfilled expectations [ 37 ], patients may therefore alter their expectations to match their current status, to prevent dissatisfaction [ 38 ]. A Canadian study in 2006, reported this phenomenon regarding total knee arthroplasty, where 35% of patients over- or underestimated their preoperative level of functioning [ 39 ]. However, there is another issue purported by Haanstra et al. which pertains to the timing of expectation measurement [ 22 ]. Given that patients’ expectations are likely to be widely influenced by their doctor, it is possible that the longer the patient is in contact with them and the later their expectations are measured, the more realistic and reliable they may be. Currently no investigation has measured the influence of time of measurement, but it is a variable to keep in mind, which could be offset by collecting data at different time points.

Moreover, only one study in this review collected data in the pre- and postoperative period to assess the percentage of fulfilled expectations, and only this study analyzed the correlation between fulfilled expectations and satisfaction [ 12 ]. Whilst expectations are an important preoperative factor, it is the fulfillment of these expectations that has been shown to be the more significant determinant of patient-reported outcomes and satisfaction [ 40 ]. High expectations are not inherently detrimental, but unrealistic expectations are [ 40 ]. Therefore, it is important to assess the percentage of patients with fulfilled expectations, as this information can be used to foster realistic, high expectations through effective preoperative education.

If patients are to be measured in the postoperative period, the length of the follow-up period needs to be addressed, as it may influence findings. Barlow et al. found that expectations may take up to two years post-surgery before they are fulfilled, due to function having the potential to improve for up to two years, alluding to the existence of a timing bias [ 41 ].

Finally, half of the available literature did not include a multivariate analysis of confounding variables such as age, gender, ethnicity and preoperative education level despite their influence on patient expectations [ 35 , 42 ]. Furthermore, psychological factors (depression, optimism and catastrophizing), which may interact with expectations or treatment outcomes, were rarely analyzed [ 22 ]. Future research should try to delineate these factors for further consideration.

A promising area of focus for future research is the consenting process. Patient recall of the consenting process, and the relevant risks and outcomes, is frequently poor [ 43 ]. A recent study demonstrated that patients undergoing THA, who were consented with the generic consent form, only recalled 0.67 risks four weeks after surgery. In contrast, those who were given a surgery-specific consent form, recalled 1.43 risks on average [ 44 ]. This surgery-specific consent form listed potential adverse events alongside appropriate explanations. With regards to RTHA, this could be implemented with the addition of a section on postoperative outcomes. This would help to ensure that patients have a better comprehension of the procedure and retain more information. This may, therefore, lead to more realistic expectations that can be fulfilled.

This study has limitations that need to be considered. Firstly, a meta-analysis was not possible due to the heterogeneity in the papers included and the poor standard of reporting. And so, we performed a qualitative analysis. However, a thorough, definitive analysis of the data is not possible using this method. Secondly, only a limited number of studies were available for review, due to the lack of research in this area. As a result, there are limited data available to analyse, which may not fully represent patient expectations. The data were also relatively old, with only 2 references being < 10 years ago. Patient expectations may have improved since then with changes in perioperative information. Therefore, the strength of conclusions made in the paper may not be accurate and should be taken with caution. Although a limitation, this highlights a clear deficit in current research that needs to be addressed.

As conclusions from RTHA literature are limited, we can look at adjacent literature concerning total knee arthroplasty (TKA), to better understand what patients tend to expect with a joint replacement procedure. Similarly, TKA patients have been shown to have unrealistically high expectations regarding postoperative pain, function and recovery [ 45 ]. Moreover, patient satisfaction has been shown to be highly correlated with expectation fulfillment [ 45 ]. Recent research has demonstrated improvements in patients’ WOMAC pain and satisfaction scores at over 1 year post operation in TKA patients, by setting realistic expectations [ 46 ]. Although a different procedure/patient demographic, these findings are similar to the current evidence base for RTHA and reinforce the importance of setting appropriate baseline patient expectations through perioperative counselling, to foster better PROMs.

A definitive conclusion is limited by the sparse data available. However, the current literature demonstrates that revision THA patients tend to have unrealistic expectations with regards to pain relief, function and implant longevity. Realistic patient education prior to surgery is necessary to avoid expectation/outcome mismatch and hence dissatisfaction. Nevertheless, this review demonstrates the lack of adequate research on patients’ expectations in revision THA, both in terms of absolute numbers, and methodological quality. More research is needed, which utilizes a standardized approach in assessment, in order to foster a better understanding of the relationship between patient expectations and postoperative outcome measures. Only then, can this information be effectively applied clinically to improve the outcome of revision THAs. We suggest counselling of patients before surgery and using a procedure-specific consent. As to collection of pre- and postoperative data—postoperative data should be collected at different points of time as the patients’ outcomes improve with time and so will the outcome and expectations. Patients-reported outcomes are a better tool to assess the patient outcomes.

Availability of data and materials

Not applicable.

Abbreviations

Total Hip Arthroplasty

Revision Total Hip Arthroplasty

National Heart, Lung and Blood Institute

Western Ontario and McMaster Universities Arthritis Index

Patient reported outcome measure

Nilsdotter A-K, Isaksson F. Patient relevant outcome 7 years after total hip replacement for OA - a prospective study. BMC Musculoskelet Disord. 2010;11(1):47. https://doi.org/10.1186/1471-2474-11-47 .

Article   PubMed   PubMed Central   Google Scholar  

Bachmeier CJM, March LM, Cross MJ, Lapsley HM, Tribe KL, Courtenay BG, Brooks PM. A comparison of outcomes in osteoarthritis patients undergoing total hip and knee replacement surgery. Osteoarthritis Cartilage. 2001;9(2):137–46. https://doi.org/10.1053/joca.2000.0369 .

Article   CAS   PubMed   Google Scholar  

Pivec R, Johnson AJ, Mears SC, Mont MA. Hip arthroplasty. Lancet. 2012;380(9855):1768–77. https://doi.org/10.1016/S0140-6736(12)60607-2 .

Article   PubMed   Google Scholar  

Patel A, Pavlou G, Mújica-Mota RE, Toms AD. The epidemiology of revision total knee and hip arthroplasty in England and Wales: a comparative analysis with projections for the United States. A study using the National Joint Registry dataset. Bone Joint J. 2015;97-B(8):1076–81. https://doi.org/10.1302/0301-620X.97B8.35170 .

Saleh KJ, Celebrezze M, Kassim R, Dykes DC, Gioe TJ, Callaghan JJ, Salvati EA. Functional outcome after revision hip arthroplasty: a metaanalysis. Clin Orthop Relat Res. 2003;416:254–64. https://doi.org/10.1097/01.blo.0000093006.90435.43 .

Article   Google Scholar  

Mahomed NN, Barrett JA, Katz JN, Phillips CB, Losina E, Lew RA, Guadagnoli E, Harris WH, Poss R, Baron JA. Rates and outcomes of primary and revision total hip replacement in the United States medicare population. J Bone Joint Surg Am. 2003;85(1):27–32. https://doi.org/10.2106/00004623-200301000-00005 .

de Thomasson E, Guingand O, Terracher R, Mazel C. Perioperative complications after total hip revision surgery and their predictive factors. A series of 181 consecutive procedures. Rev Chir Orthop Reparatrice Mot. 2001;87(5):477–88.

Google Scholar  

Mahomed N, Katz JN. Revision total hip arthroplasty Indications and outcomes. Arthritis Rheum. 1996;39(12):1939–50. https://doi.org/10.1002/art.1780391202 .

Pellicci PM, Wilson PD, Sledge CB, Salvati EA, Ranawat CS, Poss R. Revision total hip arthroplasty. Clin Orthop Relat Res. 1982;170:34–41.

Lie SA, Havelin LI, Furnes ON, Engesæter LB, Vollset SE. Failure rates for 4762 revision total hip arthroplasties in the Norwegian Arthroplasty Register. J Bone Joint Surg Br. 2004;86-B(4):504–9. https://doi.org/10.1302/0301-620X.86B4.14799 .

Ballard WT, Callaghan JJ, Johnston RC. Revision of total hip arthroplasty in octogenarians. J Bone Joint Surg Am. 1995;77(4):585–9. https://doi.org/10.2106/00004623-199504000-00012 .

Eisler T, Svensson O, Tengström A, Elmstedt E. Patient expectation and satisfaction in revision total hip arthroplasty. J Arthroplasty. 2002;17(4):457–62. https://doi.org/10.1054/arth.2002.31245 .

Greiner W, Weijnen T, Nieuwenhuizen M, Oppe S, Badia X, Busschbach J, Buxton M, Dolan P, Kind P, Krabbe P, Ohinmaa A, Parkin D, Roset M, Sintonen H, Tsuchiya A, de Charro F. A single European currency for EQ-5D health states. Results from a six-country study. Eur J Health Econ. 2003;4(3):222–31. https://doi.org/10.1007/s10198-003-0182-5 .

Haddad FS, Garbuz DS, Chambers GK, Jagpal TJ, Masri BA, Duncan CP. The expectations of patients undergoing revision hip arthroplasty. J Arthroplasty. 2001;16(1):87–91. https://doi.org/10.1054/arth.2001.17937 .

Mancuso CA, Jout J, Salvati EA, Sculco TP. Fulfillment of patients’ expectations for total hip arthroplasty. J Bone Joint Surg Am. 2009;91(9):2073–8. https://doi.org/10.2106/JBJS.H.01802 .

Linder-Pelz S. Social psychological determinants of patient satisfaction: a test of five hypothesis. Soc Sci Med. 1982;16(5):583–9. https://doi.org/10.1016/0277-9536(82)90312-4 .

Mancuso CA, Salvati EA, Johanson NA, Peterson MG, Charlson ME. Patients’ expectations and satisfaction with total hip arthroplasty. J Arthroplasty. 1997;12(4):387–96. https://doi.org/10.1016/s0883-5403(97)90194-7 .

Mahomed NN, Liang MH, Cook EF, Daltroy LH, Fortin PR, Fossel AH, Katz JN. The importance of patient expectations in predicting functional outcomes after total joint arthroplasty. J Rheumatol. 2002;29(6):1273–9.

PubMed   Google Scholar  

Katz JN, Phillips CB, Poss R, Harrast JJ, Fossel AH, Liang MH, Sledge CB. The validity and reliability of a total hip arthroplasty outcome evaluation questionnaire. J Bone Joint Surg Am. 1995;77(10):1528–34. https://doi.org/10.2106/00004623-199510000-00007 .

Liang MH, Katz JN, Phillips C, Sledge C, Cats-Baril W. The total hip arthroplasty outcome evaluation form of the American Academy of Orthopaedic Surgeons. Results of a nominal group process. The American Academy of Orthopaedic Surgeons Task Force on Outcome Studies. J Bone Joint Surg Am. 1991;73(5):639–46.

Burton KE, Wright V, Richards J. Patients’ expectations in relation to outcome of total hip replacment surgery. Ann Rheum Dis. 1979;38(5):471–4. https://doi.org/10.1136/ard.38.5.471 .

Article   CAS   PubMed   PubMed Central   Google Scholar  

Haanstra TM, van den Berg T, Ostelo RW, Poolman RW, Jansma IP, Cuijpers P, de Vet HC. Systematic review: do patient expectations influence treatment outcomes in total knee and total hip arthroplasty? Health Qual Life Outcomes. 2012;10(1):152. https://doi.org/10.1186/1477-7525-10-152 .

Barrack RL, McClure JT, Burak CF, Clohisy JC, Parvizi J, Hozack W. Revision total hip arthroplasty: the patient’s perspective. Clin Orthop Relat Res. 2006;453:173–7. https://doi.org/10.1097/01.blo.0000246537.67500.50 .

Hellman EJ, Feinberg JR, Capello WN. When is total hip arthroplasty a failure? The patients’ perspective. Iowa Orthop J. 1996;16:113–7.

CAS   PubMed   PubMed Central   Google Scholar  

Zhang S, Tay DK, Pang HN, Lo NN, Yeo SJ, Liow MH. Preoperative mental distress is associated with poorer physical improvements after revision total hip arthroplasty. J Orthop. 2023;35:18–23. https://doi.org/10.1016/j.jor.2022.10.007 .

National Heart, Lung, and Blood Institute. Study quality assessment tools. 2019. https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools .

Bagias C, Sukumar N, Weldeselassie Y, Oyebode O, Saravanan P. Cord blood adipocytokines and body composition in early childhood: a systematic review and meta-analysis. Int J Environ Res Public Health. 2021;18(4):1897. https://doi.org/10.3390/ijerph18041897 .

Robinson AH, Palmer CR, Villar RN. Is revision as good as primary hip replacement? A comparison of quality of life. J Bone Joint Surg Br. 1999;81(1):42–5. https://doi.org/10.1302/0301-620x.81b1.8728 .

Crow R, Gage H, Hampson S, Hart J, Kimber A, Thomas H. The role of expectancies in the placebo effect and their use in the delivery of health care: a systematic review. Health Technol Assess. 1999;3(3):1–96.

Bialosky JE, Bishop MD, Cleland JA. Individual expectation: an overlooked, but pertinent, factor in the treatment of individuals experiencing musculoskeletal pain. Phys Ther. 2010;90(9):1345–55. https://doi.org/10.2522/ptj.20090306 .

Kravitz RL. Patients’ expectations for medical care: an expanded formulation based on review of the literature. Med Care Res Rev. 1996;53(1):3–27. https://doi.org/10.1177/107755879605300101 .

Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Adv Behav Res Ther. 1978;1(4):139–61. https://doi.org/10.1016/0146-6402(78)90002-4 .

Hobbs N, Dixon D, Rasmussen S, Judge A, Dreinhöfer KE, Günther K-P, Dieppe P. Patient preoperative expectations of total hip replacement in European orthopedic centers. Arthritis Care Res. 2011;63(11):1521–7. https://doi.org/10.1002/acr.20596 .

Constantino MJ, Arnkoff DB, Glass CR, Ametrano RM, Smith JZ. Expectations. J Clin Psychol. 2011;67(2):184–92. https://doi.org/10.1002/jclp.20754 .

Mancuso CA, Graziano S, Briskie LM, Peterson MG, Pellicci PM, Salvati EA, Sculco TP. Randomized trials to modify patients’ preoperative expectations of hip and knee arthroplasties. Clin Orthop Relat Res. 2008;466(2):424–31. https://doi.org/10.1007/s11999-007-0052-z .

Coughlin SS. Recall bias in epidemiologic studies. J Clin Epidemiol. 1990;43(1):87–91. https://doi.org/10.1016/0895-4356(90)90060-3 .

Appleton-Knapp SL, Krentler KA. Measuring student expectations and their effects on satisfaction: the importance of managing student expectations. J Mark Educ. 2006;28(3):254–64. https://doi.org/10.1177/0273475306293359 .

Schwartz CE, Andresen EM, Nosek MA, Krahn GL, RRTC Expert Panel on Health Status Measurement. Response shift theory: important implications for measuring quality of life in people with disability. Arch Phys Med Rehabil. 2007;88(4):529–36. https://doi.org/10.1016/j.apmr.2006.12.032 .

Razmjou H, Yee A, Ford M, Finkelstein JA. Response shift in outcome assessment in patients undergoing total knee arthroplasty. J Bone Joint Surg Am. 2006;88(12):2590–5. https://doi.org/10.2106/JBJS.F.00283 .

Hafkamp FJ, Gosens T, de Vries J, den Oudsten BL. Do dissatisfied patients have unrealistic expectations? A systematic review and best-evidence synthesis in knee and hip arthroplasty patients. EFORT Open Rev. 2020;5(4):226–40. https://doi.org/10.1302/2058-5241.5.190015 .

Barlow T, Clark T, Dunbar M, Metcalfe A, Griffin D. The effect of expectation on satisfaction in total knee replacements: a systematic review. Springerplus. 2016;5(1):167. https://doi.org/10.1186/s40064-016-1804-6 .

Scott CEH, Bugler KE, Clement ND, MacDonald D, Howie CR, Biant LC. Patient expectations of arthroplasty of the hip and knee. J Bone Joint Surg Br. 2012;94(7):974–81. https://doi.org/10.1302/0301-620X.94B7.28219 .

Saigal R, Clark AJ, Scheer JK, Smith JS, Bess S, Mummaneni PV, McCarthy IM, Hart RA, Kebaish KM, Klineberg EO, Deviren V, Schwab F, Shaffrey CI, Ames CP. Adult spinal deformity patients recall fewer than 50% of the risks discussed in the informed consent process preoperatively and the recall rate worsens significantly in the postoperative period. Spine. 2015;40(14):1079–85. https://doi.org/10.1097/BRS.0000000000000964 .

Pomeroy E, Shaarani S, Kenyon R, Cashman J. Patient recall of informed consent at 4 weeks after total hip replacement with standardized versus procedure-specific consent forms. J Patient Saf. 2021;17(6):e575–81. https://doi.org/10.1097/PTS.0000000000000412 .

Noble PC, Conditt MA, Cook KF, Mathis KB. The John Insall Award: patient expectations affect satisfaction with total knee arthroplasty. Clin Orthop Relat Res. 2006;452:35–43. https://doi.org/10.1097/01.blo.0000238825.63648.1e .

Nam HS, Yoo HJ, Ho JPY, Kim YB, Lee YS. Preoperative education on realistic expectations improves the satisfaction of patients with central sensitization after total knee arthroplasty: a randomized-controlled trial. Knee Surg Sports Traumatol Arthrosc. 2023;31(11):4705–15. https://doi.org/10.1007/s00167-023-07487-9 .

Download references

Acknowledgements

Author information, authors and affiliations.

King’s College Hospital, Denmark Hill, London, SE5 9RS, UK

Omar Mohammad

Department of Trauma & Orthopaedics, University College London Hospitals, Ground Floor, 250 Euston Road, London, NW1 2PG, UK

Shahril Shaarani & Sujith Konan

East Surrey Hospital, Canada Avenue, Redhill, RH1 5RH, UK

Adnan Mohammad

You can also search for this author in PubMed   Google Scholar

Contributions

O.M. was involved in the literature search, analysis and evaluation of data and writing all sections of the paper; S.R.S. was involved in the literature search and analysis of the data. SRS contributed to the editing of the written sections; A.M. was involved in the literature search and the editing of written sections; S.K. was involved in the topic of the review and overview of the project. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Omar Mohammad .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Mohammad, O., Shaarani, S., Mohammad, A. et al. Patients’ expectations surrounding revision total hip arthroplasty: a literature review. Arthroplasty 6 , 28 (2024). https://doi.org/10.1186/s42836-024-00250-6

Download citation

Received : 29 November 2023

Accepted : 18 March 2024

Published : 03 June 2024

DOI : https://doi.org/10.1186/s42836-024-00250-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Expectation
  • Satisfaction
  • Revision total hip arthroplasty

Arthroplasty

ISSN: 2524-7948

  • Submission enquiries: Access here and click Contact Us

importance of literature review with examples

The four building blocks of change

Large-scale organizational change has always been difficult, and there’s no shortage of research showing that a majority of transformations continue to fail. Today’s dynamic environment adds an extra level of urgency and complexity. Companies must increasingly react to sudden shifts in the marketplace, to other external shocks, and to the imperatives of new business models. The stakes are higher than ever.

So what’s to be done? In both research and practice, we find that transformations stand the best chance of success when they focus on four key actions to change mind-sets and behavior: fostering understanding and conviction, reinforcing changes through formal mechanisms, developing talent and skills, and role modeling. Collectively labeled the “influence model,” these ideas were introduced more than a dozen years ago in a McKinsey Quarterly article, “ The psychology of change management .” They were based on academic research and practical experience—what we saw worked and what didn’t.

Digital technologies and the changing nature of the workforce have created new opportunities and challenges for the influence model (for more on the relationship between those trends and the model, see this article’s companion, “ Winning hearts and minds in the 21st century ”). But it still works overall, a decade and a half later (exhibit). In a recent McKinsey Global Survey, we examined successful transformations and found that they were nearly eight times more likely to use all four actions as opposed to just one. 1 1. See “ The science of organizational transformations ,” September 2015. Building both on classic and new academic research, the present article supplies a primer on the model and its four building blocks: what they are, how they work, and why they matter.

Fostering understanding and conviction

We know from research that human beings strive for congruence between their beliefs and their actions and experience dissonance when these are misaligned. Believing in the “why” behind a change can therefore inspire people to change their behavior. In practice, however, we find that many transformation leaders falsely assume that the “why” is clear to the broader organization and consequently fail to spend enough time communicating the rationale behind change efforts.

This common pitfall is predictable. Research shows that people frequently overestimate the extent to which others share their own attitudes, beliefs, and opinions—a tendency known as the false-consensus effect. Studies also highlight another contributing phenomenon, the “curse of knowledge”: people find it difficult to imagine that others don’t know something that they themselves do know. To illustrate this tendency, a Stanford study asked participants to tap out the rhythms of well-known songs and predict the likelihood that others would guess what they were. The tappers predicted that the listeners would identify half of the songs correctly; in reality, they did so less than 5 percent of the time. 2 2. Chip Heath and Dan Heath, “The curse of knowledge,” Harvard Business Review , December 2006, Volume 8, Number 6, hbr.org.

Therefore, in times of transformation, we recommend that leaders develop a change story that helps all stakeholders understand where the company is headed, why it is changing, and why this change is important. Building in a feedback loop to sense how the story is being received is also useful. These change stories not only help get out the message but also, recent research finds, serve as an effective influencing tool. Stories are particularly effective in selling brands. 3 3. Harrison Monarth, “The irresistible power of storytelling as a strategic business tool,” Harvard Business Review , March 11, 2014, hbr.org.

Even 15 years ago, at the time of the original article, digital advances were starting to make employees feel involved in transformations, allowing them to participate in shaping the direction of their companies. In 2006, for example, IBM used its intranet to conduct two 72-hour “jam sessions” to engage employees, clients, and other stakeholders in an online debate about business opportunities. No fewer than 150,000 visitors attended from 104 countries and 67 different companies, and there were 46,000 posts. 4 4. Icons of Progress , “A global innovation jam,” ibm.com. As we explain in “Winning hearts and minds in the 21st century,” social and mobile technologies have since created a wide range of new opportunities to build the commitment of employees to change.

Reinforcing with formal mechanisms

Psychologists have long known that behavior often stems from direct association and reinforcement. Back in the 1920s, Ivan Pavlov’s classical conditioning research showed how the repeated association between two stimuli—the sound of a bell and the delivery of food—eventually led dogs to salivate upon hearing the bell alone. Researchers later extended this work on conditioning to humans, demonstrating how children could learn to fear a rat when it was associated with a loud noise. 5 5. John B. Watson and Rosalie Rayner, “Conditioned emotional reactions,” Journal of Experimental Psychology , 1920, Volume 3, Number 1, pp. 1–14. Of course, this conditioning isn’t limited to negative associations or to animals. The perfume industry recognizes how the mere scent of someone you love can induce feelings of love and longing.

Reinforcement can also be conscious, shaped by the expected rewards and punishments associated with specific forms of behavior. B. F. Skinner’s work on operant conditioning showed how pairing positive reinforcements such as food with desired behavior could be used, for example, to teach pigeons to play Ping-Pong. This concept, which isn’t hard to grasp, is deeply embedded in organizations. Many people who have had commissions-based sales jobs will understand the point—being paid more for working harder can sometimes be a strong incentive.

Despite the importance of reinforcement, organizations often fail to use it correctly. In a seminal paper “On the folly of rewarding A, while hoping for B,” management scholar Steven Kerr described numerous examples of organizational-reward systems that are misaligned with the desired behavior, which is therefore neglected. 6 6. Steven Kerr, “On the folly of rewarding A, while hoping for B,” Academy of Management Journal , 1975, Volume 18, Number 4, pp. 769–83. Some of the paper’s examples—such as the way university professors are rewarded for their research publications, while society expects them to be good teachers—are still relevant today. We ourselves have witnessed this phenomenon in a global refining organization facing market pressure. By squeezing maintenance expenditures and rewarding employees who cut them, the company in effect treated that part of the budget as a “super KPI.” Yet at the same time, its stated objective was reliable maintenance.

Even when organizations use money as a reinforcement correctly, they often delude themselves into thinking that it alone will suffice. Research examining the relationship between money and experienced happiness—moods and general well-being—suggests a law of diminishing returns. The relationship may disappear altogether after around $75,000, a much lower ceiling than most executives assume. 7 7. Belinda Luscombe, “Do we need $75,000 a year to be happy?” Time , September 6, 2010, time.com.

Would you like to learn more about our People & Organizational Performance Practice ?

Money isn’t the only motivator, of course. Victor Vroom’s classic research on expectancy theory explained how the tendency to behave in certain ways depends on the expectation that the effort will result in the desired kind of performance, that this performance will be rewarded, and that the reward will be desirable. 8 8. Victor Vroom, Work and motivation , New York: John Wiley, 1964. When a Middle Eastern telecommunications company recently examined performance drivers, it found that collaboration and purpose were more important than compensation (see “Ahead of the curve: The future of performance management,” forthcoming on McKinsey.com). The company therefore moved from awarding minor individual bonuses for performance to celebrating how specific teams made a real difference in the lives of their customers. This move increased motivation while also saving the organization millions.

How these reinforcements are delivered also matters. It has long been clear that predictability makes them less effective; intermittent reinforcement provides a more powerful hook, as slot-machine operators have learned to their advantage. Further, people react negatively if they feel that reinforcements aren’t distributed fairly. Research on equity theory describes how employees compare their job inputs and outcomes with reference-comparison targets, such as coworkers who have been promoted ahead of them or their own experiences at past jobs. 9 9. J. S. Adams, “Inequity in social exchanges,” Advances in Experimental Social Psychology , 1965, Volume 2, pp. 267–300. We therefore recommend that organizations neutralize compensation as a source of anxiety and instead focus on what really drives performance—such as collaboration and purpose, in the case of the Middle Eastern telecom company previously mentioned.

Developing talent and skills

Thankfully, you can teach an old dog new tricks. Human brains are not fixed; neuroscience research shows that they remain plastic well into adulthood. Illustrating this concept, scientific investigation has found that the brains of London taxi drivers, who spend years memorizing thousands of streets and local attractions, showed unique gray-matter volume differences in the hippocampus compared with the brains of other people. Research linked these differences to the taxi drivers’ extraordinary special knowledge. 10 10. Eleanor Maguire, Katherine Woollett, and Hugo Spires, “London taxi drivers and bus drivers: A structural MRI and neuropsychological analysis,” Hippocampus , 2006, Volume 16, pp. 1091–1101.

Despite an amazing ability to learn new things, human beings all too often lack insight into what they need to know but don’t. Biases, for example, can lead people to overlook their limitations and be overconfident of their abilities. Highlighting this point, studies have found that over 90 percent of US drivers rate themselves above average, nearly 70 percent of professors consider themselves in the top 25 percent for teaching ability, and 84 percent of Frenchmen believe they are above-average lovers. 11 11. The art of thinking clearly, “The overconfidence effect: Why you systematically overestimate your knowledge and abilities,” blog entry by Rolf Dobelli, June 11, 2013, psychologytoday.com. This self-serving bias can lead to blind spots, making people too confident about some of their abilities and unaware of what they need to learn. In the workplace, the “mum effect”—a proclivity to keep quiet about unpleasant, unfavorable messages—often compounds these self-serving tendencies. 12 12. Eliezer Yariv, “‘Mum effect’: Principals’ reluctance to submit negative feedback,” Journal of Managerial Psychology , 2006, Volume 21, Number 6, pp. 533–46.

Even when people overcome such biases and actually want to improve, they can handicap themselves by doubting their ability to change. Classic psychological research by Martin Seligman and his colleagues explained how animals and people can fall into a state of learned helplessness—passive acceptance and resignation that develops as a result of repeated exposure to negative events perceived as unavoidable. The researchers found that dogs exposed to unavoidable shocks gave up trying to escape and, when later given an opportunity to do so, stayed put and accepted the shocks as inevitable. 13 13. Martin Seligman and Steven Maier, “Failure to escape traumatic shock,” Journal of Experimental Psychology , 1967, Volume 74, Number 1, pp. 1–9. Like animals, people who believe that developing new skills won’t change a situation are more likely to be passive. You see this all around the economy—from employees who stop offering new ideas after earlier ones have been challenged to unemployed job seekers who give up looking for work after multiple rejections.

Instilling a sense of control and competence can promote an active effort to improve. As expectancy theory holds, people are more motivated to achieve their goals when they believe that greater individual effort will increase performance. 14 14. Victor Vroom, Work and motivation , New York: John Wiley, 1964. Fortunately, new technologies now give organizations more creative opportunities than ever to showcase examples of how that can actually happen.

Role modeling

Research tells us that role modeling occurs both unconsciously and consciously. Unconsciously, people often find themselves mimicking the emotions, behavior, speech patterns, expressions, and moods of others without even realizing that they are doing so. They also consciously align their own thinking and behavior with those of other people—to learn, to determine what’s right, and sometimes just to fit in.

While role modeling is commonly associated with high-power leaders such as Abraham Lincoln and Bill Gates, it isn’t limited to people in formal positions of authority. Smart organizations seeking to win their employees’ support for major transformation efforts recognize that key opinion leaders may exert more influence than CEOs. Nor is role modeling limited to individuals. Everyone has the power to model roles, and groups of people may exert the most powerful influence of all. Robert Cialdini, a well-respected professor of psychology and marketing, examined the power of “social proof”—a mental shortcut people use to judge what is correct by determining what others think is correct. No wonder TV shows have been using canned laughter for decades; believing that other people find a show funny makes us more likely to find it funny too.

Today’s increasingly connected digital world provides more opportunities than ever to share information about how others think and behave. Ever found yourself swayed by the number of positive reviews on Yelp? Or perceiving a Twitter user with a million followers as more reputable than one with only a dozen? You’re not imagining this. Users can now “buy followers” to help those users or their brands seem popular or even start trending.

The endurance of the influence model shouldn’t be surprising: powerful forces of human nature underlie it. More surprising, perhaps, is how often leaders still embark on large-scale change efforts without seriously focusing on building conviction or reinforcing it through formal mechanisms, the development of skills, and role modeling. While these priorities sound like common sense, it’s easy to miss one or more of them amid the maelstrom of activity that often accompanies significant changes in organizational direction. Leaders should address these building blocks systematically because, as research and experience demonstrate, all four together make a bigger impact.

Tessa Basford is a consultant in McKinsey’s Washington, DC, office; Bill Schaninger is a director in the Philadelphia office.

Explore a career with us

Related articles.

Hearts-and-minds-V2-1536x1536_Standard

Winning hearts and minds in the 21st century

Change-management-1536x1536_100_Standard

Changing change management

Change_hives_1536x1536_Original

Digital hives: Creating a surge around change

Examples

Apostrophe in Literature

importance of literature review with examples

In literature, apostrophe is known to be a figure of speech . A writer or the literary speaker who uses apostrophe is directly speaking to someone who is either not physically present, to someone who is dead, or to an inanimate object. So the next time you talk to your phone like it’s your most treasured possession, guess what, you’re using a figure of speech.

  • 6+ Jargon Examples in Literature
  • Apostrophe Examples – Difference Between Personification and Apostrophe

Generally speaking, apostrophe and other figures of speech are what we call literary devices. To further explain, the literary devices are techniques that a writer uses to produce a special effect in their  general writing . When you read a novel or a poem and the writer starts talking directly to abstract concepts like love, death, or hope as if they are standing right in front of them, if you do not know, you are seeing a speech example of an apostrophe. To know more, you may look at these apostrophe samples first.

What is Apostrophe in Literature?

Examples of apostrophe in literature.

Examples-of-Apostrophe-in-Literature

  • O Romeo, Romeo! Wherefore art thou Romeo?” – William Shakespeare
  • “Death, be not proud, though some have called thee mighty and dreadful.” – John Donne
  • “O Captain! My Captain! Our fearful trip is done.” – Walt Whitman
  • “Twinkle, twinkle, little star, how I wonder what you are.” – Jane Taylor
  • “O, pardon me, thou bleeding piece of earth.” – William Shakespeare
  • “Is this a dagger which I see before me, the handle toward my hand?” – William Shakespeare
  • “O cunning Love! with tears thou keep’st me blind.” – William Shakespeare
  • “Roll on, thou deep and dark blue Ocean—roll!” – Lord Byron
  • “O happy dagger! This is thy sheath; there rust, and let me die.” – William Shakespeare
  • “O wild West Wind, thou breath of Autumn’s being.” – Percy Bysshe Shelley
  • “O, she doth teach the torches to burn bright!” – William Shakespeare
  • “O, how bitter a thing it is to look into happiness through another man’s eyes!” – William Shakespeare
  • “Milton! Thou shouldst be living at this hour: England hath need of thee.” – William Wordsworth
  • “Blow, winds, and crack your cheeks! Rage! Blow!” – William Shakespeare
  • “O cruel, irreligious piety!” – John Milton
  • “O Solitude! If I must with thee dwell.” – John Keats
  • “O, for a draught of vintage! that hath been cool’d a long age in the deep-delved earth.” – John Keats
  • “O, what a rogue and peasant slave am I!” – William Shakespeare
  • “O God! O God!” – William Shakespeare
  • “Bright star, would I were steadfast as thou art.” – John Keats

Basic Apostrophe Guide Example

Apostrophe Definition and Example

Size: 99 KB

Apostrophe as Literary Technique Guide Example

Apostrophe as a Literary Technique

Size: 51 KB

Simple Apostrophe Guide Example

Apostrophe Definition and Common Examples

Size: 47 KB

The Etymology of the Word Apostrophe

The word apostrophe comes from the Greek word “ apostrophé” which means “turning back” which is a common term in Greek literary drama and works such as in Homer’s  Odyssey.  However, in that novel’s case, the apostrophe was used to refer to times when a rather impersonal narrator intrudes in the storyline to provide additional information or some sort of commentary. You may also see alliteration examples in literature .

This simple writing technique is ubiquitous in old pieces of literature, and even in the literature of the nineteenth to mid-twentieth centuries. The apostrophe is used back then in cases where the writer uses an omniscient third-person point of view in his writing. The technique can be seen in most plays, but it can also be observed in a few poetry and prose pieces.

Apostrophe as a Literary Device and as a Punctuation Mark

Although they hold the same name, they play very different roles. Apostrophe as a punctuation mark that is used in contractions which refers to the process of omitting letters and sounds in a syllable, word or phrase. A few examples of these contracted terms include “I am” to “I’m,” “we have” to “we’ve,” or “do not” to “don’t.” On the other hand, the apostrophe can also pertain to a literary device. As mentioned earlier, this refers to a fictional character’s reference to an addressee who is not physically present in the scene. You may also check out meiosis examples .

Common Examples of Apostrophe

Apostrophe and figures of speech—hearing these words per discussed by your teacher or shared by your friend could be intimidating, leaving you with an impression that these terms are too fancy and poetic for your day-to-day interaction. However, apostrophes are actually used often more than you may have originally thought. You might also be interested in  onomatopoeia examples in literature .

If you still don’t believe that apostrophe is a usual part of your daily communication, there are various evident scenarios that would help you realize. First, remember those times you complained to your car when it refuses to start or those moments you begged to it to work long enough to take you to your office, the apostrophe was there. Also, when you shouted at your computer when it acts like a turtle, the apostrophe was also there.

Assuming that you are asked to cite some examples of an apostrophe, it could be very difficult for you to distinguish one. However, reflecting on your daily life and those absurdly weird moments when we talk or yell at things for some sort of reasons could make that task easy. To give you a broader overview, here are some of the most common apostrophes we utter without even realizing just how poetic we are being:

  • “Oh, coffee, my sweet dark coffee. What would I do without you?”
  • “Please, please clouds. Don’t rain today.”
  • “Let Hades come to me and swallow me whole.”
  • “Why do you have to be such a pain, math?”
  • “Shoes, my beautiful new shoes. You’ll look great with my black plaid skirt.”

Take another look at these examples. They seem normal to us, right? Of course, we’d talk to our coffee. It’s every morning’s lifesaver. Of course, we’d beg the clouds to not rain. Who else are we going to talk to about it? And what’s wrong with asking math why it’s being so difficult, right? You may also check out irony examples for kids .

But if you really think about it, all of the subjects of these so-called normal statements are all inanimate. (Well, Hades is technically alive, but he is also, technically, not real, so he doesn’t count.) How normal is it to talk to things that don’t even have life, much less a mouth, to hear us, comprehend us, and respond to us? Apparently, very much so. You might be interested in balanced sentences usage and examples .

Apostrophe in Literature Guide Example

Example of Apostrophe in Literature1

Size: 105 KB

Apostrophe in Poetry Guide Example

Apostrophe Example in Poetry

Size: 74 KB

Creative Apostrophe Guide Example

Common Example of Apostrophe

Size: 24 KB

Importance of Apostrophe in Literature

The Greeks who basically invented everything we now appreciate in this world (literature, art, and architecture, to name a few), used apostrophe as a part of the storytelling technique they used for their drama. And if the real founding fathers thought it necessary to incorporate apostrophe into their local theaters, then it must be a necessary element. You may also see antiphrasis examples .

Apostrophe gives the storyteller the chance to switch gears, to add his own commentary, and to simply state his feelings that have been awakened by inanimate or abstract concepts. Often, general statements and lines with apostrophes begin with the exclamatory sound “O,” which is used to signify a change in the addressee.

If 2 seconds ago, you were addressing Romeo, you can easily begin your next statement with “O” to tell your audience that you are no longer talking  to  Romeo but to somebody else, nobody can see. Death, for example. Such as in this famous scene in the classic play  Romeo and Juliet  by the literary master William Shakespeare. You may also like examples of assonance .

JULIET: Yea,  noise? Then I’ll be brief. O happy dagger! This is thy sheath; their rust, and let me die. 

These were the words that Juliet uttered when she awoke to Romeo’s dead body lying beside her. In this great example of the use of an apostrophe, we can see how Juliet talks to the dagger before she uses it to kill herself.

This dramatic scene is a symbol of Juliet’s incapability to talk to her lover who has just passed. So, to mark her final moment, she chooses to talk to an inanimate object because saying her goodbyes to Romeo is no longer possible. You may also check out examples of an oxymoron in sentences .

By addressing a person who is not present or an inanimate object who cannot feel or express emotions, a character can show his present state instead. We knew Juliet was suffering because of Romeo’s death. But we felt it more vividly when she started expressing her grief by talking to the dagger she would later use to take her own life. You might be interested in examples of sarcasm .

Apostrophe Importance Guide Example

Importance of Apostrophe in Literary Writing

Size: 124 KB

Apostrophe as Figure of Speech Guide Example

Apostrophe as a Figure of Speech

Size: 101 KB

Common Apostrophe Examples Guide

Common Examples of Apostrophe

Size: 88 KB

Apostrophe Examples in Poems

An apostrophe is a figurative language that can be used to make a simple expression more creative. Hence, it is natural to see them in poems. Talking about that, here are some examples of poems that encompasses apostrophe.

Famous Poem Lines with Apostrophe Examples

Famous Poem Lines with Apostrophe Examples

Size: 38 KB

Apostrophe in Poem Guidelines Example

Apostrophe in Poem Guidelines Example

Size: 868 KB

Apostrophe: Lyric of Turning Away Example

Apostrophe Lyric of Turning Away Example

Enhancing Apostrophe Poem Examples

Enhancing Apostrophe Poem Examples

Minimalist Apostrophe Poem Examples

Minimalist Apostrophe Poem Examples

Plain Apostrophe Guide

Plain Apostrophe Guide

Size: 81 KB

Downloadable Apostrophe Guide Example

Downloadable Apostrophe Guide Example

Size: 251 KB

Figurative Language: Apostrophe Worksheet Example

Figurative Language Apostrophe Worksheet Example

Size: 69 KB

Printable Apostrophe Example

Printable Apostrophe Example

Size: 52 KB

Basic Apostrophe Example

Basic Apostrophe Example

Size: 93 KB

Sample Apostrophe Example

Sample Apostrophe Example

Apostrophe Tip Sheet

Apostrophe Tip Sheet

Size: 347 KB

Apostrophe in PDF

Apostrophe in PDF

Size: 193 KB

Simple Apostrophe Example

Simple Apostrophe Example

Size: 308 KB

Professional Apostrophe Example

Professional Apostrophe Example

Size: 358 KB

Formal Apostrophe Example

Formal Apostrophe Example

Apostrophe Template

Apostrophe Template

How to Use Apostrophe in Literature

Using apostrophe in literature involves directly addressing an absent or imaginary person, an inanimate object, or an abstract idea as if it could respond

Choose Your Subject

Decide on what or whom you want to address. It could be an abstract idea like love or death, an inanimate object like the moon or a sword, or a person who is not present.

Create a Direct Addres

Write a line where the speaker talks directly to the chosen subject. Use “O” or “Oh” to start, though it’s not always necessary.

Express Strong Emotion

Use the apostrophe to convey strong emotions such as longing, admiration, anger, or despair. This helps to create a dramatic effect.

Personify the Subject

Treat the subject as if it has human qualities or the ability to respond. This personification can make your writing more vivid and engaging.

Tips for Using Apostrophe in Literature

  • Use Vivid Imagery: Paint a clear picture with descriptive language.
  • Express Strong Emotions: Convey intense feelings like longing, admiration, or despair.
  • Personify the Subject: Give human traits to inanimate objects or abstract ideas.
  • Ensure Contextual Relevance: Fit the apostrophe naturally within your work.
  • Incorporate Rhetorical Questions: Use questions to engage readers and add depth.
  • Utilize Repetition: Repeat key phrases for emphasis and rhythm.
  • Maintain Consistency: Keep the tone and style uniform throughout your piece.
  • Experiment with Placement: Try different positions within your work for the apostrophe.
  • Blend with Other Devices: Combine apostrophe with metaphors, similes, or alliteration.
  • Create Emotional Impact: Use apostrophe to heighten drama and connect with the reader’s emotions.

What is an Example of an Apostrophe in Literature?

An example is “O Death, where is thy sting?” from the Bible, addressing death as if it can hear and respond.

Why Do Authors Use Apostrophes in Literature?

Authors use apostrophes to convey strong emotions, address abstract concepts, and create dramatic or emotional effects in their writing.

How Is Apostrophe Used in Poetry?

In poetry, apostrophes address absent or imaginary entities, imbuing them with human traits to evoke emotion and enhance imagery.

How Do You Identify an Apostrophe in Literature?

Identify an apostrophe by looking for direct addresses to absent, imaginary, or non-human entities, often starting with “O” or “Oh.”

Is the Apostrophe Common in Academic Writing?

Apostrophes are rare in academic writing, which typically favors straightforward, formal language over dramatic or emotional expressions

What are some famous examples of apostrophes in literature?

Examples include “O Romeo, Romeo! Wherefore art thou Romeo?” by Shakespeare and “O Death, where is thy sting?” from the Bible.

Is the use of apostrophe limited to poetry?

No, apostrophes are found in poetry, drama, and prose. They are versatile and can be used in various forms of writing to convey emotion and dramatize the narrative.

How does an apostrophe differ from personification?

An apostrophe directly addresses an absent or non-human entity, while personification attributes human qualities to non-human things without necessarily addressing them directly.

Are apostrophes common in modern literature?

Apostrophes are less common in modern literature compared to classic works, but they are still used to add emotional depth and dramatic flair.

How does an apostrophe enhance a literary work?

Apostrophes enhance literary works by providing a means to express intense emotions, creating a direct connection between the speaker and the addressed entity, and adding dramatic intensity.

Twitter

AI Generator

Text prompt

  • Instructive
  • Professional

10 Examples of Public speaking

20 Examples of Gas lighting

Main Image

COMMENTS

  1. How to Write a Literature Review

    Examples of literature reviews. Step 1 - Search for relevant literature. Step 2 - Evaluate and select sources. Step 3 - Identify themes, debates, and gaps. Step 4 - Outline your literature review's structure. Step 5 - Write your literature review.

  2. What is a Literature Review? How to Write It (with Examples)

    A literature review is a critical analysis and synthesis of existing research on a particular topic. It provides an overview of the current state of knowledge, identifies gaps, and highlights key findings in the literature. 1 The purpose of a literature review is to situate your own research within the context of existing scholarship ...

  3. Importance of a Good Literature Review

    A literature review is not only a summary of key sources, but has an organizational pattern which combines both summary and synthesis, often within specific conceptual categories.A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem.

  4. PDF LITERATURE REVIEWS

    WRITING A TARGETED LITERATURE REVIEW a targeted literature review is NOT: ¡ a sophisticated evaluation of the entire literature or literatures related to your topic ¡ a set of thinly connected summaries of important related works haphazardly selected from many subfields a targeted literature review IS: ¡ a carefully curated set of sources from a small number of subfield literatures

  5. Literature Reviews

    A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information. It might give a new interpretation of old material or combine new with old interpretations. ... Here is a sample paragraph from a literature review about sexism and language to illuminate the following ...

  6. What is a literature review?

    A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important ...

  7. Literature Review: The What, Why and How-to Guide

    Example: Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework: 10.1177/08948453211037398 ; Systematic review: "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139).

  8. Literature review as a research methodology: An ...

    As mentioned previously, there are a number of existing guidelines for literature reviews. Depending on the methodology needed to achieve the purpose of the review, all types can be helpful and appropriate to reach a specific goal (for examples, please see Table 1).These approaches can be qualitative, quantitative, or have a mixed design depending on the phase of the review.

  9. What is a Literature Review?

    A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research. There are five key steps to writing a literature review: Search for relevant literature. Evaluate sources. Identify themes, debates and gaps.

  10. How to write a superb literature review

    The best proposals are timely and clearly explain why readers should pay attention to the proposed topic. It is not enough for a review to be a summary of the latest growth in the literature: the ...

  11. The Literature Review: A Foundation for High-Quality Medical Education

    Purpose and Importance of the Literature Review. An understanding of the current literature is critical for all phases of a research study. Lingard 9 recently invoked the "journal-as-conversation" metaphor as a way of understanding how one's research fits into the larger medical education conversation. As she described it: "Imagine yourself joining a conversation at a social event.

  12. PDF Writing an Effective Literature Review

    literature review in academia, at this point it might be useful to state what a literature review is not, before looking at what it is. It is not: § A list or annotated bibliography of the sources you have read § A simple summary of those sources or paraphrasing of the conclusions § Confined to description of the studies and their findings

  13. Literature Review

    Types of Literature Review are as follows: Narrative literature review: This type of review involves a comprehensive summary and critical analysis of the available literature on a particular topic or research question. It is often used as an introductory section of a research paper. Systematic literature review: This is a rigorous and ...

  14. Writing a Literature Review

    A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays).

  15. Steps in Conducting a Literature Review

    A literature review is an integrated analysis-- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

  16. Writing a literature review

    A formal literature review is an evidence-based, in-depth analysis of a subject. There are many reasons for writing one and these will influence the length and style of your review, but in essence a literature review is a critical appraisal of the current collective knowledge on a subject. Rather than just being an exhaustive list of all that ...

  17. 5. The Literature Review

    A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories.A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that ...

  18. Literature Reviews in the Social Sciences: Home

    A literature review is the systematic written analysis of previously published research on a specific topic or subject. A literature review is not merely a summary of another scholar's articles or books. Instead, it provides a contextual analysis of the data, ideas, or theoretical concepts presented in the article, book, or other publication.

  19. Chapter 9 Methods for Literature Reviews

    Literature reviews play a critical role in scholarship because science remains, first and foremost, a cumulative endeavour (vom Brocke et al., 2009). As in any academic discipline, rigorous knowledge syntheses are becoming indispensable in keeping up with an exponentially growing eHealth literature, assisting practitioners, academics, and graduate students in finding, evaluating, and ...

  20. A practical guide to data analysis in general literature reviews

    The general literature review is a synthesis and analysis of published research on a relevant clinical issue, and is a common format for academic theses at the bachelor's and master's levels in nursing, physiotherapy, occupational therapy, public health and other related fields. ... for example, are important for providing the study with ...

  21. Reviewing the literature

    Implementing evidence into practice requires nurses to identify, critically appraise and synthesise research. This may require a comprehensive literature review: this article aims to outline the approaches and stages required and provides a working example of a published review. Literature reviews aim to answer focused questions to: inform professionals and patients of the best available ...

  22. Why is it important to do a literature review in research?

    "A substantive, thorough, sophisticated literature review is a precondition for doing substantive, thorough, sophisticated research". Boote and Baile 2005 . Authors of manuscripts treat writing a literature review as a routine work or a mere formality. But a seasoned one knows the purpose and importance of a well-written literature review.

  23. Literature Reviews, Theoretical Frameworks, and Conceptual Frameworks

    The goal of this article is to introduce new biology education researchers to these three important elements important in DBER scholarship and the broader educational literature. The first element we discuss is a review of research (literature reviews), which highlights the need for a specific research question, study problem, or topic of ...

  24. Types of Reviews and Their Differences

    A student may do a review for an assignment, while a researcher could include a literature review as support in their grant proposal. Rigor: Some reviews may want to achieve a higher scholarly or objective standard, so they include pre-established or inclusion criteria for what publications can be included. Discipline norms: a literature review ...

  25. A systematic literature review of empirical research on ChatGPT in

    To conduct this study, the authors followed the essential steps of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) and Okoli's [] steps for conducting a systematic review.These included identifying the study's purpose, drafting a protocol, applying a practical screening process, searching the literature, extracting relevant data, evaluating the quality ...

  26. Patient experiences: a qualitative systematic review of chemotherapy

    A qualitative systematic review reported that support from family members enables patients to become more proactive and effective in adhering to their treatment plan . This review highlights the importance of maintaining a positive outlook and rational beliefs as essential components of chemotherapy adherence.

  27. Evaluating competency-based medical education: a systematized review of

    The present study aimed to review the available literature on the evaluation practices of competency-based undergraduate and postgraduate health professionals' schools and programs. This review inspected which evaluation objectives, models, tools, and standards were described as well as the results of evaluations and how the results were shared.

  28. Patients' expectations surrounding revision total hip arthroplasty: a

    Background Revision total hip arthroplasties (RTHA) are associated with a higher complication rate than primary total hip arthroplasties (THA), and therefore it is important for patients to have realistic expectations regarding outcomes. The aim of this literature review was to gather and summarize the available evidence on patients' expectations following RTHA. Methods A literature search ...

  29. A model for effective change management

    Despite the importance of reinforcement, organizations often fail to use it correctly. In a seminal paper "On the folly of rewarding A, while hoping for B," management scholar Steven Kerr described numerous examples of organizational-reward systems that are misaligned with the desired behavior, which is therefore neglected. 6

  30. Apostrophe in Literature

    Tips for Using Apostrophe in Literature. Use Vivid Imagery: Paint a clear picture with descriptive language. Express Strong Emotions: Convey intense feelings like longing, admiration, or despair. Personify the Subject: Give human traits to inanimate objects or abstract ideas. Ensure Contextual Relevance: Fit the apostrophe naturally within your work. ...