Academia Insider

How To Use ChatGPT To Write A Literature Review: Prompts & References

In the rapidly evolving world of academic research, the integration of AI tools like ChatGPT has transformed the traditional approach to literature reviews. As a researcher, you should also leverage on this tool to make your research work easier.

In this post, explore how ChatGPT can enhance the literature review process. We’ll explore how specific prompts can effectively guide this advanced AI model to generate insightful content, while ensuring accuracy, relevance, and academic integrity in their scholarly work.

How to Use ChatGPT for Writing a Literature Review

Understanding chatgpt’s limitations.

While it can efficiently generate content, streamline the research process, and provide a comprehensive understanding of relevant literature, its capabilities are not without constraints. Here are some for you to consider:

Dependence On Pre-Existing Datasets

Since ChatGPT is a language model trained on available data, it may not include the most recent research papers or cutting-edge findings in a specific field. This gap can lead to a lack of current state-of-research insights, particularly crucial in fields like technology and science where advancements happen rapidly.

May Lack Depth And Context

ChatGPT, while able to produce summaries and synthesize information, might not fully grasp the nuanced arguments or complex theories specific to a research topic. This limitation necessitates that researchers critically evaluate and supplement AI-generated text with thorough analysis and insights from recent systematic reviews and primary sources.

Risk Of Plagiarism

Although ChatGPT can generate human-like text, it’s vital to ensure that the content for your literature review is original and properly cited. Relying solely on ChatGPT to write a literature review defeats the purpose of engaging deeply with the material and developing a personal understanding of the literature.

Not A Total Replacement of A Researcher

While ChatGPT can assist non-native English speakers in crafting clear and concise academic writing, it’s not a replacement for the human ability to contextualize and interpret research findings. Researchers must guide the AI model with specific prompts and leverage it as a tool rather than a substitute for comprehensive analysis.

By keeping these limitations in mind, ChatGPT can be a valuable aid in the literature review process, but it should be used judiciously and in conjunction with traditional research methods.

Defining Research Objective

When starting on writing a literature review, the initial step involves using ChatGPT to define your research question or hypothesis.

The AI model’s ability to respond with a summary of the current state of research in your field can provide a comprehensive understanding, especially for systematic reviews or research papers.

For example, by inputting a prompt related to your research topic, ChatGPT can generate human-like text, summarizing prior research and highlighting relevant literature.

One insider tip for effectively using ChatGPT in the literature review process is to leverage its natural language processing capabilities to identify relevant keywords.

These keywords are crucial for non-native English speakers or those new to a research field, as they streamline the search for pertinent academic writing. Additionally, ChatGPT can guide you in understanding the context of your research topic, offering insights that are often challenging to find.

Using AI language models like ChatGPT for generating content for your literature review is efficient and effective, saving valuable time. However, it’s vital to critically evaluate the generated text to ensure it aligns with your research objectives and to avoid plagiarism.

how to get literature review from chatgpt

ChatGPT’s ability to synthesize large amounts of information can aid in developing a clear and concise outline, but remember, it’s a guide, not a replacement for human analysis.

Despite these limitations, ChatGPT provides a unique advantage in conducting literature reviews. It can automate mundane tasks, allowing researchers to focus on analysis and critical thinking.

Identifying Keywords and Search Terms

Using ChatGPT to identify relevant keywords related to your research topic can significantly streamline your workflow.

For instance, when you input a summary of your research question into ChatGPT, the AI model can generate a list of pertinent keywords.

These keywords are not just randomly selected; they are based on the vast amounts of information in ChatGPT’s dataset, making them highly relevant and often inclusive of terms that are current in your research field.

An insider tip for leveraging ChatGPT effectively is to guide the AI with clear and concise prompts.

For example, asking ChatGPT to: “summarize key themes in [specific field] research papers from the last five years” can yield a list of keywords and phrases that are not only relevant but also reflective of the current state of research.

This approach is particularly beneficial for conducting systematic reviews or for non-native English speakers who might be unfamiliar with specific academic jargon.

While ChatGPT can provide a comprehensive understanding of relevant literature and help automate the identification of keywords, it’s important to critically evaluate the generated content.

Researchers should use ChatGPT as a tool to augment their research process, not as a replacement for human insight.

It’s crucial to mind the limitations of the AI model and ensure that the keywords identified align with the research topic and objectives.

Creating an Initial Literature Review Outline

The key to using ChatGPT effectively in crafting an initial outline lies in its ability to generate content based on specific prompts.

For instance, a researcher working on organic photovoltaic devices can input a prompt into ChatGPT, such as “Help me create a structure for a literature review on organic photovoltaic devices.”

The AI model, using its comprehensive understanding of the research topic, can then produce a preliminary structure, including sections like:

  • Introduction
  • Advances in materials and technology, performance, and efficiency.

This generated outline serves as a valuable starting point. It helps in organizing thoughts and determining the key areas that the literature review should cover. I

mportantly, researchers can refine and expand this initial outline as they delve deeper into their topic, ensuring it aligns with their specific research question and the current state of research.

However, while ChatGPT can streamline the review process and save valuable time in creating an initial outline, researchers should not solely rely on it.

how to get literature review from chatgpt

The content generated by ChatGPT must be critically evaluated and supplemented with in-depth research. This involves:

  • Reading systematic reviews
  • Reading research papers, and
  • Summarizing relevant literature to ensure the review is comprehensive and up-to-date.

Get ChatGPT To Help You During Research, Using The Right Prompts

The key to effectively using ChatGPT in this process lies in crafting the right prompts, guiding the AI to generate relevant and useful content. 

When initiating a literature review, the prompt should aim for a broad understanding of the research topic. For instance, asking ChatGPT to:

  • “Give a brief overview of research done on [topic]”
  • “What are some of the recent findings on the [topic] in research?” or 
  • “Summarize the historical development of [topic] in academia”

Helps in capturing the general landscape of the field. These prompts assist in identifying key theories, methodologies, and authors within the research area. As the review progresses, more specific prompts are necessary to delve deeper into individual studies. Queries like:

  • “Summarize the main arguments and findings of [specific paper]” or
  • “What are the strengths and weaknesses of [specific paper]?”

enable ChatGPT to provide detailed insights into particular research papers, aiding in understanding their contribution to the broader field. Comparative prompts are also crucial in synthesizing information across multiple works. Asking ChatGPT to:

  • “Compare and contrast the methodologies of [paper 1] and [paper 2]” or
  • “How do the findings of [paper 1] and [paper 2] agree or disagree?”

helps in discerning the nuances and disparities in the literature. In the final stages of the literature review, prompts should focus on summarizing findings and identifying emerging trends or gaps. For example:

  • “What trends or patterns have emerged from the literature on [topic]?” or
  • “What future research directions are suggested by the literature on [topic]?”

We will share more on these ChatGPT prompts in the later part of this post, read on.

Reviewing ChatGPT’s Responses

When using ChatGPT to write a literature review, it’s crucial to critically evaluate its responses.

Firstly, researchers should cross-reference the information provided by ChatGPT with actual research papers.

This step ensures the accuracy of the data and helps in identifying any discrepancies or outdated information, given that ChatGPT’s dataset may not include the most recent studies.

Another essential aspect is assessing the coherence and depth of the AI-generated text. ChatGPT can summarize and synthesize information efficiently, but it might not capture the nuances of complex theories or research arguments.

Researchers should ensure that the content aligns with their research question and systematically reviews the topic comprehensively. This is where a researcher’s value comes in.

Additionally, verifying the originality of the content is vital to avoid plagiarism. While ChatGPT can generate human-like text, researchers must ensure that the AI-generated content is used as a guide rather than a verbatim source. 

Proper citations and references are essential to maintain the integrity of the literature review. Avoid torpedoing your own research by committing plagiarism.

Ensuring Coherence and Flow

One of the challenges when using such advanced AI language models is ensuring the coherence and flow of the final document. This aspect is crucial as it determines the readability and academic rigor of the literature review.

ChatGPT can generate vast amounts of content on a wide range of topics, responding efficiently to prompts and synthesizing information from its extensive dataset.

However, the content generated by ChatGPT, while informative, might not always align seamlessly with the specific research question or maintain a consistent narrative flow.

how to get literature review from chatgpt

To tackle this, researchers need to take an active role in guiding ChatGPT and subsequently refining its output.

A practical approach is to use ChatGPT as a starting point, leveraging its ability to quickly provide summaries, synthesize relevant literature, and identify key references and keywords related to the research topic. For example, prompts like:

  • “Summarize the current research on [topic]” or
  • “Identify key debates in [topic]”

Can yield valuable initial insights.

Once this foundational information is obtained, the crucial task is to carefully review and edit the AI-generated content.

This involves connecting the dots between different sections, ensuring that each part contributes meaningfully to addressing the research question, and refining the language to maintain academic standards.

It’s also essential to check for and avoid plagiarism, ensuring that all sources are correctly cited.

In addition, considering the vast amounts of information ChatGPT can access, it’s vital to verify the accuracy and relevance of the content.

Researchers should cross-reference AI-generated summaries with actual research papers, especially the most recent ones, as ChatGPT’s dataset may not include the latest studies.

Editing and Proofreading

Now that your literature review is mostly written out, now focus on the editing and proofreading. The content generated by ChatGPT needs to be meticulously reviewed and edited. Here are the steps:

  • Verifying the accuracy of the information. Researchers must cross-check the AI-generated content against actual research papers and systematic reviews. This ensures that the latest studies are accurately represented.
  • Improve coherence and flow. Researchers should restructure sentences, ensure logical progression of ideas, and maintain a consistent academic tone throughout the document.
  • Checking for plagiarism. Despite ChatGPT’s ability to generate human-like text, researchers must ensure that all sources are correctly cited and that the review does not inadvertently replicate existing material.
  • Check Grammar and Spelling: Editing should encompass grammar checks, vocabulary refinement, and ensuring that the language used is appropriate for an academic audience.
  • Update Citation: Review citation, or reference list to ensure everything is cited correctly, and the citation list is written out to your required standard, be it MLA, Chicago, or APA.

What ChatGPT Prompts To Use When Writing A Literature Review?

There are many ways to use ChatGPT to write literature review, usually by using the right prompts. Here’s how specific types of prompts can be effectively employed, with multiple examples for each category:

  • “Provide a comprehensive overview of the latest research on [topic].”
  • “Summarize the current understanding and key findings in the field of [topic].”
  • “Detail the dominant theoretical frameworks currently used in [topic].”
  • “Describe the evolution of theoretical approaches in [topic] over the past decade.”
  • “Identify and discuss the major debates or controversies in [topic].”
  • “What are the conflicting viewpoints or schools of thought in [topic]?”
  • “List the leading researchers in [topic] and summarize their key contributions.”
  • “Who are the emerging authors in [topic], and what unique perspectives do they offer?”
  • “Explain the most common research methodologies used in studies about [topic].”
  • “How have the methodologies in [topic] research evolved recently?”
  • “Trace the historical development and major milestones in [topic].”
  • “Provide a timeline of the key discoveries and shifts in understanding in [topic].”
  • “What significant paradigm shifts have occurred in [topic] in the last twenty years?”
  • “How has the focus of research in [topic] changed over time?”
  • “Analyze the methodology and conclusions of [specific paper].”
  • “Discuss the impact and reception of [specific paper] in the field of [topic].”
  • “Compare the results and methodologies of [paper 1] and [paper 2] in [topic].”
  • “How do [paper 1] and [paper 2] differ in their approach to [topic]?”
  • “Based on current literature, what are the suggested future research directions in [topic]?”
  • “Identify gaps in the literature of [topic] that could be explored in future studies.”

By using these types of prompts, researchers can guide ChatGPT to produce content that is not only relevant to their literature review but also rich in detail and scope.

Wrapping Up: Use Other AI Tools Too, Not Just ChatGPT

In conclusion, while ChatGPT serves as a powerful ally in the literature review process, it’s important to recognize it as one of many AI tools available to researchers as well. Diversifying your AI toolkit can enhance the depth and breadth of your review, offering varied perspectives and methodologies.

As AI continues to evolve, embracing a range of these tools can lead to more comprehensive, nuanced, and innovative academic writing, expanding the horizons of research and scholarly exploration beyond what we currently envision.

how to get literature review from chatgpt

Dr Andrew Stapleton has a Masters and PhD in Chemistry from the UK and Australia. He has many years of research experience and has worked as a Postdoctoral Fellow and Associate at a number of Universities. Although having secured funding for his own research, he left academia to help others with his YouTube channel all about the inner workings of academia and how to make it work for you.

Thank you for visiting Academia Insider.

We are here to help you navigate Academia as painlessly as possible. We are supported by our readers and by visiting you are helping us earn a small amount through ads and affiliate revenue - Thank you!

how to get literature review from chatgpt

2024 © Academia Insider

how to get literature review from chatgpt

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • J Pediatr Pharmacol Ther
  • v.28(6); 2023
  • PMC10731938

ChatGPT for Research and Publication: A Step-by-Step Guide

Som s. biswas.

Department of Pediatric Radiology, Le Bonheur Children’s Hospital, The University of Tennessee Health Science Center, Memphis, TN.

Introduction

This commentary provides a concise step-by-step guide on using ChatGPT, an advanced natural language processing (NLP) model, for research and publication purposes. The guide assesses crucial aspects, including data preprocessing, fine-tuning techniques, prompt engineering, and ethical considerations. By addressing challenges related to biases, interpretability, and plagiarism, this commentary offers insights and recommendations for the responsible and ethical use of ChatGPT. The guide empowers researchers to ethically integrate ChatGPT effectively into their workflows, enhancing productivity and improving the quality of their scientific publications. Through clear instructions and guidelines, researchers can tap into the transformative potential of ChatGPT, driving scientific progress in a language-driven world.

In recent years, the field of NLP has witnessed remarkable advancements, bringing us closer to the realm of humanlike language generation. Among these advancements, ChatGPT, based on the groundbreaking GPT-3.5 architecture developed by OpenAI, stands as an impressive language model capable of generating coherent and contextually relevant text responses. With its ability to understand and respond to user inputs, ChatGPT has opened up new possibilities for various applications, including research and publication. 1 – 3

The traditional process of conducting research and publishing scientific papers has been significantly transformed by the emergence of ChatGPT. Researchers and authors can now leverage the power of this sophisticated language model to streamline and enhance their workflow, leading to improved efficiency and higher-quality publications. However, using ChatGPT effectively in the research and publication domain requires a comprehensive understanding of its capabilities, limitations, and best practices.

In this commentary I offer my thoughts for a step-by-step guide for researchers and authors who seek to harness the potential of ChatGPT in their research endeavors and publication efforts. By exploring various aspects, such as data preprocessing, fine-tuning techniques, prompt engineering, and ethical considerations, this guide will equip researchers with the necessary knowledge to harness the full potential of ChatGPT in their scientific pursuits. Moreover, this commentary will delve into the challenges associated with using ChatGPT for research and publication, including biases, interpretability, and concerns regarding plagiarism. By addressing these challenges directly, I aim to provide researchers with valuable insights and recommendations to navigate these important issues and ensure the responsible and ethical use of ChatGPT as a research tool. 4

The significance of my guide lies in its potential to bridge the gap between the rapid progress of language models like ChatGPT and the research and publication process. By elucidating the intricacies of integrating ChatGPT into scientific workflows, researchers will be empowered to leverage this advanced technology effectively, thereby enhancing the overall quality and impact of their research output. 5 In the following sections, I present a comprehensive overview of the steps involved in using ChatGPT for research and publication.

Step 1: Title and Title Page Creation by ChatGPT

ChatGPT can be a valuable tool in generating titles for research papers. Its ability to understand and generate humanlike text allows it to analyze and synthesize information provided by researchers to craft concise and impactful titles. By leveraging its vast knowledge base and language capabilities, ChatGPT can assist in capturing the essence of a research paper, conveying the main focus and contributions succinctly. Researchers can collaborate with ChatGPT by providing relevant information, such as the subject, objectives, methodology, and key findings of their study. ChatGPT can then generate multiple title options, offering different perspectives and angles that researchers can consider. This collaboration with ChatGPT can save time and stimulate creativity, helping researchers refine their titles to accurately represent their work and engage potential readers. ChatGPT can then be used to create the entire title page and then can also customize based on each journal’s recommendations.

For example:

An external file that holds a picture, illustration, etc.
Object name is i2331-348X-28-6-576-f01.jpg

Thus, we see that ChatGPT can write an entire title page based on just the title and author details. We notice that ChatGPT has created an email address that is incorrect and needs manual rectification. However, the rest of the title page, including keywords and the running title, is appropriate.

Step 2: Abstract/Summary Creation by chatGPT

ChatGPT can assist in condensing complex information into a clear and engaging abstract/summary, helping researchers communicate the significance and novelty of their research to a wider audience. By leveraging the language proficiency of ChatGPT, researchers can save time and effort in crafting abstracts while ensuring that the key aspects of their study are accurately represented.

In this example, we demonstrate that ChatGPT can create an entire abstract just by using the title alone. However, the more information researchers provide (preferably the entire body of the paper should be entered into chatGPT), the more accurate the abstract becomes.

An external file that holds a picture, illustration, etc.
Object name is i2331-348X-28-6-576-f02.jpg

Step 3: Introduction Creation by ChatGPT

By collaborating with ChatGPT, researchers can provide key information, such as the background, significance, and objectives of their study. ChatGPT can then generate a well-structured introduction that sets the context, highlights the relevance of the research, and outlines the paper’s objectives. Also, ChatGPT can be used to generate keywords and generate an abbreviations list from the article by using prompts. However, it is important to note that the generated introduction should be reviewed, customized, and refined by the researchers to align with their specific study and writing style.

In the example below, we note that ChatGPT has not only created an introduction but also the objectives of the study, which can then be edited by the human author.

An external file that holds a picture, illustration, etc.
Object name is i2331-348X-28-6-576-f03.jpg

Step 4: Can ChatGPT Create a Literature Review?

Yes, ChatGPT can help generate a literature review, but it is important to note that it may not have access to the most up-to-date research articles and studies due to copyrights and limited access to some journals. Additionally, a literature review typically requires a comprehensive analysis of multiple sources, so the generated response may not cover all relevant studies. Nonetheless, it can assist in providing a basic literature review on a given topic, which will need human authors to add to and edit it.

An external file that holds a picture, illustration, etc.
Object name is i2331-348X-28-6-576-f04.jpg

As we can see, ChatGPT is not as good at giving a detailed review of the literature as it is at summarizing contents or creating an introduction. Thus, its use is limited, if there is any at all, in this section of the paper.

Step 5: Can ChatGPT Assist in Brainstorming the Methodology of Studies?

ChatGPT can be a helpful tool in conceptualizing the methodology for research papers. By engaging in a conversation with ChatGPT, researchers can discuss their research objectives, study design, data collection methods, and data analysis techniques. ChatGPT’s natural language understanding allows it to provide suggestions and insights based on its knowledge base and understanding of research methodologies. Although ChatGPT can assist in generating ideas and providing guidance, it is important for researchers to critically evaluate and adapt the suggestions to align with their specific research goals and requirements.

Although the methodology is something that is unique to each paper and needs a human researcher to conceptualize it, we see in this example that ChatGPT can assist by giving ideas and examples based on the input of the title by the human researcher. Thus, ChatGPT can be part of brainstorming sessions when conceptualizing a study, although this section needs significant editing by a human, unlike the introduction or summary.

An external file that holds a picture, illustration, etc.
Object name is i2331-348X-28-6-576-f05.jpg

Step 6: Do Not Use ChatGPT for Fabricating Patient Data or Results!

This section of the paper must be authentic, and ChatGPT has a limited role, if any, because patient data have to be original. ChatGPT also currently cannot analyze clinical data compared with statistical software, like SPSS Statistics and Base SAS. However, Microsoft appears to be developing an Excel copilot that uses AI to create graphs and plots, and its use needs to be evaluated once it is released to the public. 6

Step 7: Discussion and Conclusions

This section of the paper can be generated by ChatGPT if all results are pasted as input; however, this section also needs manual editing because inaccuracies are common. By discussing their research with ChatGPT, researchers can also identify potential limitations, discuss the broader implications of their findings, and propose future research directions. Although ChatGPT can generate suggestions and facilitate the thought process, it is important for researchers to critically evaluate the information provided and ensure that the Discussion and Conclusion sections align with the specific research objectives and findings of their study. Ultimately, ChatGPT can serve as a supportive tool in developing a comprehensive and well-rounded discussion and conclusion for research papers.

Step 8: References

As per the author's experience, although ChatGPT is capable of creating references for an article, most of them are incorrect. So, using ChatGPT for creating references is not recommended. However, ChatGPT can convert references into any journaling style if the references are entered into ChatGPT and it is asked to convert them into a specific style.

Disadvantages of Using ChatGPT in Research

Although ChatGPT offers numerous advantages for assisting in the writing of research papers, there are also some important potential disadvantages to consider:

  • Lack of domain expertise: ChatGPT is a general-purpose language model trained on a diverse range of Internet text, which means it may lack the specific domain expertise required for certain research topics. It may generate responses that are not accurate or well informed in specialized fields, potentially leading to incorrect or misleading information in research papers.
  • Inconsistency and variability: ChatGPT’s responses can be inconsistent and vary depending on the input phrasing or prompt formulation. This can lead to unpredictability in generating reliable and coherent content, requiring additional effort to refine and ensure accuracy in research papers.
  • Limited control over output: Although researchers can guide the model’s responses through prompts, ChatGPT’s generation process is still primarily autonomous. Researchers have limited control over the precise content and structure of the generated text, which may require careful editing and review to align with specific research goals, standards, and above all, accuracy.
  • Biases and ethical considerations: Language models like ChatGPT can inadvertently reflect biases present in the training data. These biases may perpetuate existing societal or cultural biases in research papers, potentially leading to unfair or discriminatory content. The careful examination and mitigation of biases are crucial to ensure ethical and unbiased research output. 7
  • Lack of interpretability: ChatGPT’s decision-making process is complex and not easily interpretable. Researchers may struggle to understand the reasoning behind the model’s generated responses, making it challenging to assess the reliability and credibility of the information provided. Ensuring transparency and interpretability in research papers becomes more challenging with such models. ChatGPT should cite the sources for its data, like Google Bard does.
  • Plagiarism concerns: Because of its vast training data from the Internet, ChatGPT may inadvertently generate text that resembles or replicates existing content without proper citation or attribution. Researchers must be cautious about unintentional plagiarism and ensure that generated content is appropriately referenced and original. So, all ChatGPt-generated articles need to be double checked using antiplagiarism software.

In this commentary I have provided a comprehensive step-by-step guide for researchers and authors on harnessing the power of ChatGPT in the realm of research and publication. By exploring crucial aspects, such as data preprocessing, fine-tuning techniques, prompt engineering, and ethical considerations, the guide equips researchers with the necessary knowledge and tools to effectively integrate ChatGPT into their scientific workflows. 8

Through clear instructions, examples, and guidelines, researchers can navigate the complexities of using ChatGPT, leading to enhanced productivity and improved quality in their research output. Moreover, I address the challenges associated with biases, interpretability, and plagiarism concerns, ensuring the responsible and ethical usage of ChatGPT as a research tool.

The significance of this research lies in its ability to bridge the gap between the rapid advancements in language models like ChatGPT and the research and publication process. By empowering researchers with the skills to leverage ChatGPT effectively, this guide fosters innovation, drives scientific progress, and opens up new possibilities for transformative contributions to various fields. 9

As language-driven technologies continue to evolve, researchers must stay abreast of the latest advancements and best practices. The step-by-step guide presented in this commentary serves as a valuable resource, providing researchers with the knowledge and guidance necessary to maximize the potential of ChatGPT in their research endeavors. By embracing the capabilities of ChatGPT and ensuring its responsible and ethical use, researchers can revolutionize the way research and publications are conducted. With ChatGPT as a powerful tool in their arsenal, researchers are poised to make significant strides in their respective fields, pushing the boundaries of scientific knowledge and ushering in a new era of language-driven innovation. 10

However, and to reiterate, I cannot overemphasize that ChatGPT has, at present, many disadvantages, including inconsistencies, bias, and plagiarism concerns, that must be addressed by the human author before the article is submitted for publication to a journal, as well as prior to publication, because the human author(s) is solely responsible for their research integrity and accurate reporting.

In conclusion, I have attempted to provide researchers with a comprehensive understanding of how to effectively leverage ChatGPT for research and publication purposes. It has also highlighted the problems and precautions that the human author(s) must take before publishing ChatGPT-generated content. By embracing this step-by-step guide, researchers can unlock the full potential of ChatGPT, driving scientific progress and shaping the future of research and publications.

  • Please use ChatGPT only if allowed by your institution, research lab, and the journal in question.
  • Please acknowledge ChatGPT within your manuscript/published paper wherever you are using it.
  • Please do not fabricate or plagiarize data. ChatGPT can be used only for summarizing texts, improving English writeups, and brainstorming ideas, and not for creating fabricated research raw data.

Acknowledgment.

The author acknowledges that this article was partially generated by ChatGPT (powered by OpenAI’s language model, GPT-3; http://openai.com ). The editing was performed by the human author.

Disclosures. The author declare no conflicts or financial interest in any product or service mentioned in the manuscript, including grants, equipment, medications, employment, gifts, and honoraria.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Published: 28 July 2023

Special feature

Application ChatGPT in conducting systematic reviews and meta-analyses

  • Simpy Amit Mahuli 1 ,
  • Arpita Rai 2 ,
  • Amit Vasant Mahuli 3 &
  • Ansul Kumar 4  

British Dental Journal volume  235 ,  pages 90–92 ( 2023 ) Cite this article

5102 Accesses

11 Citations

Metrics details

You have full access to this article via your institution.

Systematic reviews and meta-analyses, which involve thorough literature searches and synthesis, are essential for evidence-based decision-making. With the growing number of publications, thorough review takes more time. A systematic review often takes more than 15 months to complete, and the long conception-completion interval may render a systematic review outdated by the time they are ready to be submitted and published. 1 , 2

Artificial intelligence (AI)-based quick approaches are being developed in response to the growing demand for screening and data extraction techniques that are more effective. These techniques automate decision-making by utilising machine learning (ML) algorithms and natural language processing (NLP) to extract pertinent information from textual material. These AI-based methods have the potential to accelerate the processes of systematic reviews and evidence synthesis while requiring less human labour. 3 , 4

ChatGPT is a Large Language Model (LLM) developed by OpenAI (OpenAI, L.L.C., San Francisco, CA, USA) which has tremendous potential to revolutionise the healthcare industry. ChatGPT has been effectively used for a variety of tasks in healthcare, including conducting literature reviews, analysing datasets, writing academic papers, documentation, and enhancing clinical workflow. ChatGPT is a significant advancement in the field of NLP. It generates human-like text by mimicking human language processing abilities using deep learning techniques and neural networks. Owing to its training on diverse datasets, it is able to provide pertinent responses to human prompts by processing large amounts of information. The easy accessibility and free availability have contributed to the success ChatGPT version 3.5 platform. 5

We tried to use ChatGPT for conducting Risk of Bias analysis and data extraction from a randomised controlled trial. The response of ChatGPT was surprising, to say the least. Conducting such processes through ChatGPT is simple and straightforward.

Firstly, to conduct a ROB analysis effectively using AI, obtaining the full-text version of the article under evaluation is crucial. This ensures that all relevant information and details necessary for the assessment are available. As an AI tool, it does not have real-time browsing capabilities, so it cannot search the internet or access the latest research articles. Additionally, it being a text-based AI, we cannot upload or import text/pdf files into the chatbox. However, ChatGPT can still try to assist us with general questions or provide guidance based on the information we provide from the study. If we have any specific questions or excerpts from the study that we would like ChatGPT to analyse or discuss, we can paste them into the chat box, and ChatGPT will do its best to assist.

AI provides validation to the information obtained through human effort and may even catch some details that are missed by the human eye.

Secondly, we need to provide clear and specific instructions to the tool for it to provide an appropriate response. Hence when prompted 'Can you use the ROBINS-I tool to evaluate "(Materials and methods from the full-text article)"', it generated a detailed response highlighting the various lacunae in the methodology in context of the Biases included in the ROBINS-I tool ( Fig. 1 and Fig. 2 ). This assessment does not eliminate the need for a human expert; however, it considerably reduces the time and effort required for the process. Also, AI provides validation to the information obtained through human effort and may even catch some details that are missed by the human eye. Additionally, ChatGPT is extremely helpful in the interpretation of studies for those who are not so fluent in the language. While ChatGPT can comprehend and generate text in languages other than English to some extent, its proficiency may vary across different languages. It's worth noting that ChatGPT's performance is generally more robust in English, as the majority of its training data is in English.

figure 1

Screenshot of query for RoB analyis

figure 2

Screenshot of ChatGPT's response to RoB analysis

Next, we tried to use ChatGPT for data extraction. By sharing the complete text and specifying the desired information or data to be extracted, AI can be of assistance. Hence, following various prompts from us, ChatGPT extracted data like mean values, standard deviation and sample size for study groups and sub-groups and presented it. Also, it was able to extract information from the tables provided, though it is not possible to paste a table in the chatbox. We can paste the data in the table en masse into the chatbox and it was able to interpret and extract information from it ( Fig. 3 and Fig. 4 ). Needless to say, this will reduce the time required for data extraction as well as ensure accuracy of the values, thereby reducing human errors.

figure 3

Screenshot of query for data extraction from text

figure 4

Response from ChatGPT for various queries for data extraction

AI methods are increasingly integrated into healthcare reviews to streamline processes. A recent systematic review by Blaizot et al. identified and examined automated tools and platforms that utilise artificial intelligence (AI) techniques. It assessed the pros and cons associated with the use of these methods in conducting systematic reviews. They identified various tools like Rayyan, Robot Reviewer, EPPI-reviewer, SWIFT-review, and Abstrackr which were employed for different review stages. Most included reviews acknowledged that screening with AI methods generally demonstrates low risks and enhances efficiency. However, possibility of missing relevant articles and issues in data extraction required human intervention. 4

ChatGPT possesses several distinct advantages in comparison to other AI tools. Its ability to retain context and coherence during conversations equips it to comprehend and respond to complex queries. It is extremely versatile which is demonstrated through its proficiency in handling various tasks, including factual inquiries, explanatory responses, creative content generation, and problem-solving assistance. ChatGPT is continuously evolving through regular updates and fine-tuning based on user feedback and new training data, enhancing its performance and accuracy over time. 5

It is crucial to acknowledge that ChatGPT also has limitations. These include the potential for generating incorrect or biased responses and its reliance on pre-existing data. Users should exercise critical thinking and independently verify information obtained from any AI tool. Currently, it is unable to process visual information; however, this issue has been addressed in ChatGPT 4.0. Additionally, the model's output heavily relies on user input; minor changes in the query can lead to significant alterations in the response. 5

This was the first attempt to test the feasibility of using ChatGPT in the tedious task of conducting systematic reviews and meta-analyses. It shows promise in reducing workload and time, but careful implementation and validation are necessary. We as researchers need to interact more with this tool to completely understand its applicability in generating evidence.

Borah R, Brown A W, Capers P L, Kaiser K A. Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open 2017; doi: 10.1136/bmjopen-2016-012545.

Yaffe J, Montgomery P, Hopewell S, Shepard L D. Empty reviews: a description and consideration of Cochrane systematic reviews with no included studies. PLoS One 2012; doi: doi: 10.1371/journal.pone.0036626.

Chollet F. Deep learning with Python. pp 361. Shelter Island, New York: Manning Publications Co, 2018.

Blaizot A, Veettil S K, Saidoung P, Moreno-Garcia C F et al . Using artificial intelligence methods for systematic review in health sciences: A systematic review. Res Synth Methods 2022; 13: 353-362.

OpenAI. Introducing ChatGPT. Available at: https://openai.com/blog/chatgpt (accessed 19 May 2023).

Download references

Author information

Authors and affiliations.

PhD Scholar, Rajendra Institute of Medical Sciences (RIMS), Bariatu, Ranchi – 834009, India

Simpy Amit Mahuli

Associate Professor, Oral Medicine and Radiology, Rajendra Institute of Medical Sciences (RIMS), Bariatu, Ranchi – 834009, India

Associate Professor, Public Health Dentistry, Rajendra Institute of Medical Sciences (RIMS), Bariatu, Ranchi – 834009, India

Amit Vasant Mahuli

Associate Professor, Cardiothoracic and Vascular Surgery, Dental College, Rajendra Institute of Medical Sciences, Bariatu, India

Ansul Kumar

You can also search for this author in PubMed   Google Scholar

Corresponding authors

Correspondence to Simpy Amit Mahuli , Arpita Rai , Amit Vasant Mahuli or Ansul Kumar .

Rights and permissions

Reprints and permissions

About this article

Cite this article.

Mahuli, S., Rai, A., Mahuli, A. et al. Application ChatGPT in conducting systematic reviews and meta-analyses. Br Dent J 235 , 90–92 (2023). https://doi.org/10.1038/s41415-023-6132-y

Download citation

Published : 28 July 2023

Issue Date : 28 July 2023

DOI : https://doi.org/10.1038/s41415-023-6132-y

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Ai-assisted boolean search.

  • J. M. Cherian
  • K. G. Varghese

British Dental Journal (2023)

AI-based article screening

  • M. Mehrabanian

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

how to get literature review from chatgpt

Literature Reviews

  • Getting Started
  • Choosing a Type of Review
  • Developing a Research Question
  • Searching the Literature
  • Searching Tips
  • ChatGPT [beta]
  • ChatGPT Resources
  • Documenting your Search
  • Using Citation Managers
  • Concept Mapping
  • Writing the Review
  • Further Resources

UM's Report on GenerativeAI

The initial report from the U-M Generative Artificial Intelligence Advisory (GAIA) Committee.

how to get literature review from chatgpt

—User-friendly Interface that allows faculty, staff and students to engage in chat-based queries and benefit from the expertise of GENAI technology

— U-M GPT, enhances, teaching learning research in collaboration, providing a valuable and equitable resource for the entire university community

— designed to be accessible, including for use with screen readers

— provides access to GPT-3.5 and GPT-4 with no charge

how to get literature review from chatgpt

https://chat.openai.com

  • The knowledge cutoff for the ChatGPT 3.5 is September 2021 and it has no access to the Internet. Academic users may consider alternatives such as  Semantic Scholar,  Elicit,  Consensus  or other AI-powered tools for doing  real-time  literature reviews.
  • Input/ Output length  - ChatGPT-3.5 allows a maximum token limit of 4096 tokens. According to ChatGPT " On average, a token in English is roughly equivalent to 4 bytes or characters. English words are typically around 5 characters long. This means that, very roughly, you could fit around 800 to 1000 English words within 4096 tokens." 
  • Notes : (1) According to ChatGPT, the generated responses are non-deterministic by default. So if you run the searches again and get slightly or very different results than the ones listed on this guide, it's likely due to this factor. (2) While ChatGPT or Bing Chat searches offer conversational interaction, they might not be a substitute for the rigor and reliability of traditional academic database searches.  

KEYWORD GENERATION

Write a literature review abstract based on the following keywords: Keywords: Artificial Intelligence, Employment Trends, Skill Development, Future Workforce

Infant death Neonatal mortality  (referring specifically to deaths within the first 28 days of life) Perinatal mortality  (referring to deaths occurring during the period from 22 completed weeks of gestation to 7 completed days after birth) Early childhood mortality  (referring to deaths occurring within the first five years of life) Child mortality  (referring to deaths occurring before the age of 18) [Press the  Regenerate  button to get more.]

  • Example -   RELATED WORDS What are the related words of infant mortality?

Neonatal mortality, Post-neonatal mortality, Stillbirths, Low birth weight, Malnutrition, Infectious diseases, Vaccination, Maternal health,  Access to healthcare, Poverty, Social inequality, Sanitation, Hygiene, Water quality, Childbirth complications, Congenital abnormalities, Birth defects, Maternal age, Under-five mortality, Child mortality, Perinatal mortality, Preterm birth, Low birth weight, Sudden infant death syndrome (SIDS), Maternal mortality, Postnatal care, Malnutrition, Immunization, Access to healthcare, Clean water and sanitation, Congenital anomalies, Infant health disparities, Infant mortality rate (IMR), Infant survival.  

(("Infant Death"[Mesh] OR "Sudden Infant Death Syndrome"[Mesh] OR "Infant Mortality"[Mesh] OR "Perinatal Mortality"[Mesh] OR "Neonatal Mortality"[Mesh] OR "Fetal Mortality"[Mesh] OR "Infant Death" OR "Sudden Infant Death Syndrome" OR "Infant Mortality" OR "Perinatal Mortality" OR "Neonatal Mortality" OR "Fetal Mortality") AND ("Risk Factors"[Mesh] OR "Etiology"[Mesh] OR "Prevention and Control"[Mesh] OR "Interventions"[Mesh] OR "Public Health"[Mesh] OR "Health Disparities"[Mesh] OR "Healthcare Disparities"[Mesh] OR "Poverty"[Mesh] OR "Malnutrition"[Mesh] OR "Infection"[Mesh] OR "Congenital Abnormalities"[Mesh] OR "Prematurity"[Mesh] OR "Low Birth Weight"[Mesh] OR "Maternal Education"[Mesh] OR "Maternal Health"[Mesh] OR "Risk Factors" OR "Etiology" OR "Prevention and Control" OR "Interventions" OR "Public Health" OR "Health Disparities" OR "Healthcare Disparities" OR "Poverty" OR "Malnutrition" OR "Infection" OR "Congenital Abnormalities" OR "Prematurity" OR "Low Birth Weight" OR "Maternal Education" OR "Maternal Health"))

Comments and Suggestions: #1 -This search string may not work on all database platforms. For example,  Medline (OVID)  may not be able to run it,  Medline  &  CINAHL (EBSCO)  can run it without any problems while   PubMed  will run it but it will indicate which MeSH terms are not indexed. See PubMed's search  History and Details  under  Advanced . #2 -This is just one possible search string and you may need to adjust it based on your specific research questions and the databases you are using. #3 - It might be easier if you break the task into 3 parts: ask the chatbot give you the synonyms > ask it to give you the thesauri terms > and ask it to combine them.

RESEARCH QUESTION

Increased risk of sudden infant death syndrome (SIDS) Increased risk of premature birth Increased risk of low birth weight Increased risk of respiratory problems in newborns Increased risk of respiratory problems in infants exposed to secondhand smoke Increased risk of developing asthma and other respiratory illnesses later in life for infants exposed to secondhand smoke Please generate a literature review that addresses the research question: 'What are the effects of social media on the mental health of adolescents? [Author's note : If you ask for the specific studies, ChatGPT may generate   non-existent references or false knowledge. To find out   why Large Language Models   hallucinate, check out this WiKi article:  Hallucination (artificial intelligence)   and this blog post -   A Gentle Introduction to Hallucinations in Large Language Models  by Adrian Tam ]

DATABASE RECOMMENDATIONS  

Heath Science  -  Which databases to use to find articles on the EFFECTS OF MATERNAL SMOKING ON INFANT DEATH? PubMed:  This is a database of biomedical literature from the National Library of Medicine. It includes articles from medical journals and other sources on a wide range of health-related topics. Embase:  This is a database of biomedical literature that covers more international and pharmaceutical content than PubMed. It includes articles from medical journals and other sources on a wide range of health-related topics. Cochrane Library : This is a collection of databases that provides systematic reviews and meta-analyses of healthcare interventions, including interventions related to maternal smoking and infant death. Scopus:  This is a multidisciplinary database that covers research from a wide range of fields, including health sciences. It includes articles from scientific journals, books, and conference proceedings. Web of Science:  This is a database that covers research from a wide range of fields, including health sciences. It includes articles from scientific journals, books, and conference proceedings. CINAHL:  This is a database of nursing and allied health literature, including articles on maternal smoking and infant death. [Note: The response above was copied and pasted directly from ChatGPT. No editing was added.] Education  --  I am doing a  meta-analysis  on k-12 STEM education. What databases should I use? ERIC : This is a database of education research and information, including articles from journals, reports, and conference papers. It is a commonly used database for educational research. Education Source : This is a comprehensive database of education research and information, including articles from journals, books, and conference papers. Web of Science:  This is a multidisciplinary database that covers research from a wide range of fields, including education. It includes articles from scientific journals, books, and conference proceedings. Scopus:  This is another multidisciplinary database that covers research from a wide range of fields, including education. It includes articles from scientific journals, books, and conference proceedings. PsycINFO:  This is a database of psychology research, including articles from journals, books, and dissertations. It can be useful for research on STEM education that includes psychological factors. Cochrane Library : This is a collection of databases that provides systematic reviews and meta-analyses of healthcare interventions including interventions related to education.

Example:   ACT-AS-AN-EXPERT PROMPT Here's an alternative way to consolidate all the questions into a single consultation by using this popular Act-As-An-Expert prompt, aka, system message prompt:  I am going to conduct a systematic review on games and mathematics related to K-12 education  I want you to act as a systematic review expert. I will ask you some questions related to my research topic and you advise me on how to do it. 

GREY LITERATURE  

Please show me all the resources that offer grey literature for conducting research in the field of education     ERIC (Education Resources Information Center): https://eric.ed.gov/     OpenGrey: http://www.opengrey.eu/     British Education Index: https://www.ebscohost.com/academic/british-education-index     WorldCat: https://www.worldcat.org/     ProQuest Dissertations & Theses Global: https://www.proquest.com/products-services/pqdtglobal.html     EThOS (Electronic Theses Online Service): https://ethos.bl.uk/     Institutional Repositories of universities and academic institutions (search for specific institution repositories)     American Educational Research Association (AERA): https://www.aera.net/     National Education Association (NEA): https://www.nea.org/     Association for Supervision and Curriculum Development (ASCD): http://www.ascd.org/     RAND Corporation: https://www.rand.org/     National Center for Education Research (NCER): https://ies.ed.gov/ncer/     National Center for Education Statistics (NCES): https://nces.ed.gov/     European Educational Research Association (EERA): https://www.eera-ecer.de/     UNESCO International Institute for Educational Planning (IIEP): http://www.iiep.unesco.org/     Organization for Economic Cooperation and Development (OECD): https://www.oecd.org/education/     Education Development Center (EDC): https://www.edc.org/     National Institute for Educational Policy Research (NIER) - Japan: https://www.nier.go.jp/     Australian Council for Educational Research (ACER): https://www.acer.org/     Canadian Education Association (CEA): https://www.cea-ace.ca/ My topic is about stem education. Which grey literature databases should I use?    STEM Education Research Centre (SERC) Grey Literature Database    National STEM Education Research Repository (NSERR)    National Science Digital Library (NSDL)    STEM Education Resource Center (SERC) GrayLit Network    STEM Education Grey Literature Library

MORE RESOURCES

  • << Previous: AI Lit Searching [beta]
  • Next: Organizing the Literature >>
  • Last Updated: May 9, 2024 11:44 AM
  • URL: https://guides.lib.umich.edu/litreview
  • FIU Libraries
  • RefTech LibGuides
  • Artificial Intelligence Now: ChatGPT + AI Literacy Toolbox
  • Literature Reviews with Prompts

Artificial Intelligence Now: ChatGPT + AI Literacy Toolbox: Literature Reviews with Prompts

  • Literacy Tutorials
  • AI LibGuides
  • AI Literacy
  • AI + Art News
  • AI Plagiarism + Citation
  • Which AI tools should I choose?
  • Faculty + Academic Writing
  • ChatGPT on InfoLit
  • Libraries + AI
  • Art + Image Prompts
  • Prompt Literacy
  • Text Prompts
  • Scholarship + Publishing
  • Students + AI Use
  • FIU Library Resources
  • How does ChatGPT work?
  • Zoom Recordings: AI Workshops
  • ALA 2024: Breaking Boundaries

Resources on Lit Reviews & AI

  • How to Use ChatGPT to Accelerate Literature Review I’d like to show you how I use ChatGPT to speed up my literature review process. The topic I am exploring is heterogeneity(diversity) learning. I started with the keyword “Info-GAIL” as I read about it when using GAIL in the past.
  • ChatGPT Simple Literature Review Template The evolution of library services in the digital age has seen a significant shift towards automation and artificial intelligence applications, with OpenAI's ChatGPT being one of the most popular tools. This literature review explores the trends in the application of ChatGPT in library settings, focusing on user engagement and support services from 2015 to 2023.
  • ChatGPT as a Tool for Library Research – Some Notes and Suggestions I see ChatGPT and its alternatives as having partial value as tools for library searching. You can use them without any training, but they will perform better when you know some details about them.

9 Ways To Use ChatGPT To Write A Literature Review (WITHOUT Plagiarism) Video

  • Step-by-Step

How to Use ChatGPT to Write a Literature Review With Prompts

Dr. Somasundaram R | https://www.ilovephd.com/ | Copyright © 2019-2023 – iLovePhD | May 19, 2023

Writing a literature review can be a challenging task for researchers and students alike. It requires a comprehensive understanding of the existing body of research on a particular topic. However, with the advent of advanced language models like ChatGPT, the process has become more accessible and efficient.

Discover how to effectively utilize ChatGPT as a research assistant to write a comprehensive and SEO-friendly literature review. Follow our step-by-step guide to leverage this powerful tool, optimize your review for search engines, and contribute to the scholarly conversation in your field.

A Step-by-Step Guide: How to Use ChatGPT for Writing a Literature Review

Step 1: Defining Your Research Objective Before diving into the literature review process, it is crucial to define your research objective.

Clearly articulate the topic, research question, or hypothesis you aim to address through your literature review. This step will help you maintain focus and guide your search for relevant sources.

Step 2: Identifying Keywords and Search Terms To effectively use ChatGPT to assist in your literature review, you need to identify relevant keywords and search terms related to your research topic.

These keywords will help you narrow down your search and gather pertinent information. Consider using tools like Google Keyword Planner or other keyword research tools to discover commonly used terms in your field.

Step 3: Familiarizing Yourself with ChatGPT Before engaging with ChatGPT, it is essential to understand its capabilities and limitations. Familiarize yourself with the prompts and commands that work best with the model.

Keep in mind that ChatGPT is an AI language model trained on a vast amount of data, so it can provide valuable insights and suggestions, but it’s important to critically evaluate and validate the information it generates.

Step 4: Generating an Initial Literature Review Outline Start by creating an outline for your literature review. Outline the main sections, such as the introduction, methodology, results, discussion, and conclusion.

Within each section, jot down the key points or subtopics you want to cover. This will help you organize your thoughts and structure your review effectively.

Step 5: Engaging with ChatGPT for Research Assistance Once you have your outline ready, engage with ChatGPT for research assistance.

Begin by providing a clear and concise prompt that specifies the topic, context, and any specific questions you have. For example, “What are the current trends in [your research topic]?” or “Can you provide an overview of the main theories on [your research question]?”

Step 6: Reviewing and Selecting Generated Content ChatGPT will generate a response based on your prompt. Carefully review the content generated, considering its relevance, accuracy, and coherence.

Extract key points, relevant references, and insightful arguments from the response and incorporate them into your literature review. Be sure to cite and attribute the sources appropriately.

Step 7: Ensuring Coherence and Flow While ChatGPT can provide valuable content, it’s important to ensure the coherence and flow of your literature review.

Use your critical thinking skills to connect the generated content with your research objective and existing knowledge. Rearrange, rephrase, and expand upon the generated text to ensure it aligns with the structure and purpose of your review.

Step 8: Editing and Proofreading Once you have incorporated the generated content into your literature review, thoroughly edit and proofread the document.

Check for grammatical errors, consistency in referencing, and overall clarity. This step is crucial to ensure your literature review is polished and professional.

ChatGPT prompts to Write a Literature Review

Prompts you can use when engaging with ChatGPT for research assistance in writing a literature review:

“Can you provide an overview of the main theories and concepts related to [your research topic]?”

“What are the current trends and developments in [your research field]?”

“Can you suggest some key studies or research papers on [specific aspect of your research topic]?”

“What are the main methodologies used in conducting research on [your research topic]?”

“Can you provide a critical analysis of the existing literature on [your research question]?”

“Are there any gaps or areas of controversy in the literature on [your research topic] that need further exploration?”

“What are the key findings and conclusions from the most recent studies on [your research topic]?”

“Can you suggest some reputable journals or publications explore for relevant literature in [your research field]?”

“What are the different perspectives or schools of thought in the literature on [your research topic]?”

“Can you provide a summary of the historical background and evolution of research on [your research topic]?”

Remember to provide clear and specific instructions in your prompts to guide ChatGPT in generating relevant and accurate content for your literature review.

Using ChatGPT to write a literature review can greatly facilitate the research process. By following a step-by-step approach, researchers can effectively leverage ChatGPT’s capabilities to gather insights, generate content, and enhance the quality of their literature review. However, it is important to approach the generated content critically, validate it with reliable sources, and ensure coherence within the review.

  • << Previous: Art + Image Prompts
  • Next: Prompt Literacy >>
  • Last Updated: May 23, 2024 12:24 PM
  • URL: https://library.fiu.edu/ai

East Carolina University Libraries

  • Joyner Library
  • Laupus Health Sciences Library
  • Music Library
  • Digital Collections
  • Special Collections
  • North Carolina Collection
  • Teaching Resources
  • The ScholarShip Institutional Repository
  • Country Doctor Museum

Literature Review: Using ChatGPT

  • About Literature Reviews
  • How to Conduct your Lit Review
  • A Few Writing Tips
  • A Few Helpful Resources
  • A Silly Example
  • Using ChatGPT

What is AI, ChatGPT, and large-language modeling?

Artificial intelligence (AI) , in the context of this guide, is the use of datasets to train computer models to emulate human thought processes (IBM, n.d.). It is the emulation itself that may convince information consumers of the supposed "intelligence" of a machine; the more convincing the emulation, the more users are prone to trust the generated information.

ChatGPT is a generative large language model which has gained popularity since late 2021. The name stands for Chat Generative Pre-trained Transformer. GPT models are programmed to mimic the look and feel of engaging in a realistic conversation with another human being; however, bias and inaccuracy remain a considerable risk ( Kocoń, J., 2023).

Large language models (LLMs) are AI models that utilize networked datasets, emulating the neural pathways of the human brain, which assists in the appearance of actual cognition (Birhane et al., 2023).

Birhane, A., Kasirzadeh, A., Leslie, D., & Wachter, S. (2023). Science in the age of large language models. Nature Reviews Physics . https://www.nature.com/articles/s42254-023-00581-4

IBM. (n.d.). What is artificial intelligence (AI)? https://www.ibm.com/topics/artificial-intelligence Retrieved 27 April 2023.

Read more here: Generative AI in the Classroom & Research

What can I use ChatGPT for?

First and most importantly: check with your instructor that using generative AI is allowed for your class! This information should be added in your course syllabus with language indicating whether and to what extent AI can be used on assignments. If you are not sure, ask your instructor first .

From my biased perspective (that of a librarian), here is a brief list of ways you could use ChatGPT (if allowed for your class). This list is not exhaustive of all ideas.

  • Keyword generation. Having trouble thinking of other ways to describe a concept? Ask ChatGPT to help!
  • Narrowing/broadening your topic. Not getting any results? Getting way too many results? Use ChatGPT to help you brainstorm ways you can adjust your research question so that you can find the most effective sources.
  • Setting the right tone. Want to create a patient education document in plain language but not quite sure how to translate the nursing jargon into easy-to-understand statements? ChatGPT can help you think of ways to ensure your tone matches your preferred audience.

What shouldn't I use ChatGPT for?

Because of bias and limitations from human contributions, it is imperative to approach generative AI with caution.

If your instructor has approved the use of ChatGPT or other generative AI in the class, below is a brief list of ways you should NOT use it. Again, this list is not exhaustive.

  • Writing your assignments. This may be considered a form of plagiarism as the generated language is not your own original writing. If you use ChatGPT in this way without credit, you may be found in violation of the University's Academic Integrity policies. If you aren't sure, check with your instructor.
  • Searching for sources. Do not use ChatGPT in lieu of conducting a literature search through the library resources. ChatGPT has a bad habit of "hallucinating" results; in other words, it will generate answers that sound right but that are not actual sources that exist. ChatGPT is not a search engine or a database.
  • Creating accurate citations. ChatGPT is about as good as any other citation generator out there, which is to say that it is hit or miss. ChatGPT may leave off required elements of a citation, invent elements (for instance, generating incorrect DOIs or URLs), and fail to follow citation style formatting requirements. If you use ChatGPT for citation generation, be sure to double- and triple-check every citation thoroughly before submitting your assignment.

Ask a Librarian

Chat with a librarian is available 9-5 Monday-Saturday.

You can also  contact a librarian .

1-888-820-0522 (toll free)

252-744-2230

Or email us:

[email protected]

Provide Feedback on this Guide

Please follow the link below to complete a short survey and provide feedback on this guide.

Research Guide Satisfaction Survey

Should I cite ChatGPT?

Citing ChatGPT and other generative AI will allow your work to remain transparent while also demonstrating ethical considerations. If generative AI is used in research, best practice would dictate to mention the use of this tool in the narrative.

Suggestions for citations may be found below:

  • American Psychological Association (APA)
  • Chicago Manual of Style
  • Modern Language Association (MLA)
  • << Previous: A Silly Example
  • Last Updated: Jan 12, 2024 1:21 PM
  • URL: https://libguides.ecu.edu/lit_reviews
  • Interesting
  • Scholarships
  • UGC-CARE Journals

Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review With Prompts

Step-by-Step Guide: How to Use ChatGPT for Writing a Literature Review

Dr. Somasundaram R

Writing a literature review can be a challenging task for researchers and students alike. It requires a comprehensive understanding of the existing body of research on a particular topic. However, with the advent of advanced language models like ChatGPT, the process has become more accessible and efficient.

In this step-by-step guide, ilovephd will explore how you can leverage ChatGPT to write a compelling literature review that is both informative.

A Step-by-Step Guide: How to Use ChatGPT for Writing a Literature Review

Step 1: Defining Your Research Objective Before diving into the literature review process, it is crucial to define your research objective.

Clearly articulate the topic, research question, or hypothesis you aim to address through your literature review. This step will help you maintain focus and guide your search for relevant sources.

Step 2: Identifying Keywords and Search Terms To effectively use ChatGPT to assist in your literature review, you need to identify relevant keywords and search terms related to your research topic.

These keywords will help you narrow down your search and gather pertinent information. Consider using tools like Google Keyword Planner or other keyword research tools to discover commonly used terms in your field.

Step 3: Familiarizing Yourself with ChatGPT Before engaging with ChatGPT, it is essential to understand its capabilities and limitations. Familiarize yourself with the prompts and commands that work best with the model.

Keep in mind that ChatGPT is an AI language model trained on a vast amount of data, so it can provide valuable insights and suggestions, but it’s important to critically evaluate and validate the information it generates.

Step 4: Generating an Initial Literature Review Outline Start by creating an outline for your literature review. Outline the main sections, such as the introduction, methodology, results, discussion, and conclusion.

Within each section, jot down the key points or subtopics you want to cover. This will help you organize your thoughts and structure your review effectively.

Step 5: Engaging with ChatGPT for Research Assistance Once you have your outline ready, engage with ChatGPT for research assistance.

Begin by providing a clear and concise prompt that specifies the topic, context, and any specific questions you have. For example, “What are the current trends in [your research topic]?” or “Can you provide an overview of the main theories on [your research question]?”

Step 6: Reviewing and Selecting Generated Content ChatGPT will generate a response based on your prompt. Carefully review the content generated, considering its relevance, accuracy, and coherence.

Extract key points, relevant references, and insightful arguments from the response and incorporate them into your literature review. Be sure to cite and attribute the sources appropriately.

Step 7: Ensuring Coherence and Flow While ChatGPT can provide valuable content, it’s important to ensure the coherence and flow of your literature review.

Use your critical thinking skills to connect the generated content with your research objective and existing knowledge. Rearrange, rephrase, and expand upon the generated text to ensure it aligns with the structure and purpose of your review.

Step 8: Editing and Proofreading Once you have incorporated the generated content into your literature review, thoroughly edit and proofread the document.

Check for grammatical errors, consistency in referencing, and overall clarity. This step is crucial to ensure your literature review is polished and professional.

ChatGPT prompts to Write a Literature Review

Prompts you can use when engaging with ChatGPT for research assistance in writing a literature review:

  • “Can you provide an overview of the main theories and concepts related to [your research topic]?”
  • “What are the current trends and developments in [your research field]?”
  • “Can you suggest some key studies or research papers on [specific aspect of your research topic]?”
  • “What are the main methodologies used in conducting research on [your research topic]?”
  • “Can you provide a critical analysis of the existing literature on [your research question]?”
  • “Are there any gaps or areas of controversy in the literature on [your research topic] that need further exploration?”
  • “What are the key findings and conclusions from the most recent studies on [your research topic]?”
  • “Can you suggest some reputable journals or publications explore for relevant literature in [your research field]?”
  • “What are the different perspectives or schools of thought in the literature on [your research topic]?”
  • “Can you provide a summary of the historical background and evolution of research on [your research topic]?”

Remember to provide clear and specific instructions in your prompts to guide ChatGPT in generating relevant and accurate content for your literature review.

Using ChatGPT to write a literature review can greatly facilitate the research process. By following a step-by-step approach, researchers can effectively leverage ChatGPT’s capabilities to gather insights, generate content, and enhance the quality of their literature review. However, it is important to approach the generated content critically, validate it with reliable sources, and ensure coherence within the review.

  • Academic Writing
  • AI writing tool
  • literature review guide
  • literature review tips
  • research assistance
  • research process
  • research writing
  • write literature review

Dr. Somasundaram R

24 Best Online Plagiarism Checker Free – 2024

List of phd and postdoc fellowships in india 2024, google ai for phd research – tools and techniques, most popular, list of open access sci journals in computer science, scopus indexed journals list 2024, 5 free data analysis and graph plotting software for thesis, the hrd scheme india 2024-25, 6 best online chemical drawing software 2024, imu-simons research fellowship program (2024-2027), india science and research fellowship (isrf) 2024-25, how to write a research paper in a month, example of abstract for research paper – tips and dos and donts, best for you, what is phd, popular posts, how to check scopus indexed journals 2024, popular category.

  • POSTDOC 317
  • Interesting 258
  • Journals 234
  • Fellowship 130
  • Research Methodology 102
  • All Scopus Indexed Journals 92

ilovephd_logo

iLovePhD is a research education website to know updated research-related information. It helps researchers to find top journals for publishing research articles and get an easy manual for research tools. The main aim of this website is to help Ph.D. scholars who are working in various domains to get more valuable ideas to carry out their research. Learn the current groundbreaking research activities around the world, love the process of getting a Ph.D.

Contact us: [email protected]

Google News

Copyright © 2024 iLovePhD. All rights reserved

  • Artificial intelligence

how to get literature review from chatgpt

  • Learn Chat GPT
  • Learn Chat GPT (Advanced)

Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review With Prompts

Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review With Prompts

Writing a literature review can be a challenging task for researchers and students alike. It requires a comprehensive understanding of the existing body of research on a particular topic. However, with the advent of advanced language models like ChatGPT, the process has become more accessible and efficient.

In this step-by-step guide, ilovephd will explore how you can leverage ChatGPT to write a compelling literature review that is both informative.

Discover how to effectively utilize ChatGPT as a research assistant to write a comprehensive and SEO-friendly literature review. Follow our step-by-step guide to leverage this powerful tool, optimize your review for search engines, and contribute to the scholarly conversation in your field.

A Step-by-Step Guide: How to Use ChatGPT for Writing a Literature Review

Step 1: Defining Your Research Objective Before diving into the literature review process, it is crucial to define your research objective.

Clearly articulate the topic, research question, or hypothesis you aim to address through your literature review. This step will help you maintain focus and guide your search for relevant sources.

Step 2: Identifying Keywords and Search Terms To effectively use ChatGPT to assist in your literature review, you need to identify relevant keywords and search terms related to your research topic.

These keywords will help you narrow down your search and gather pertinent information. Consider using tools like Google Keyword Planner or other keyword research tools to discover commonly used terms in your field.

Step 3: Familiarizing Yourself with ChatGPT Before engaging with ChatGPT, it is essential to understand its capabilities and limitations. Familiarize yourself with the prompts and commands that work best with the model.

Keep in mind that ChatGPT is an AI language model trained on a vast amount of data, so it can provide valuable insights and suggestions, but it’s important to critically evaluate and validate the information it generates.

Step 4: Generating an Initial Literature Review Outline Start by creating an outline for your literature review. Outline the main sections, such as the introduction, methodology, results, discussion, and conclusion.

Within each section, jot down the key points or subtopics you want to cover. This will help you organize your thoughts and structure your review effectively.

Step 5: Engaging with ChatGPT for Research Assistance Once you have your outline ready, engage with ChatGPT for research assistance.

Begin by providing a clear and concise prompt that specifies the topic, context, and any specific questions you have. For example, “What are the current trends in [your research topic]?” or “Can you provide an overview of the main theories on [your research question]?”

Step 6: Reviewing and Selecting Generated Content ChatGPT will generate a response based on your prompt. Carefully review the content generated, considering its relevance, accuracy, and coherence.

Extract key points, relevant references, and insightful arguments from the response and incorporate them into your literature review. Be sure to cite and attribute the sources appropriately.

Step 7: Ensuring Coherence and Flow While ChatGPT can provide valuable content, it’s important to ensure the coherence and flow of your literature review.

Use your critical thinking skills to connect the generated content with your research objective and existing knowledge. Rearrange, rephrase, and expand upon the generated text to ensure it aligns with the structure and purpose of your review.

Step 8: Editing and Proofreading Once you have incorporated the generated content into your literature review, thoroughly edit and proofread the document.

Check for grammatical errors, consistency in referencing, and overall clarity. This step is crucial to ensure your literature review is polished and professional.

ChatGPT prompts to Write a Literature Review

Prompts you can use when engaging with ChatGPT for research assistance in writing a literature review:

“Can you provide an overview of the main theories and concepts related to [your research topic]?”

“What are the current trends and developments in [your research field]?”

“Can you suggest some key studies or research papers on [specific aspect of your research topic]?”

“What are the main methodologies used in conducting research on [your research topic]?”

“Can you provide a critical analysis of the existing literature on [your research question]?”

“Are there any gaps or areas of controversy in the literature on [your research topic] that need further exploration?”

“What are the key findings and conclusions from the most recent studies on [your research topic]?”

“Can you suggest some reputable journals or publications explore for relevant literature in [your research field]?”

“What are the different perspectives or schools of thought in the literature on [your research topic]?”

“Can you provide a summary of the historical background and evolution of research on [your research topic]?”

Remember to provide clear and specific instructions in your prompts to guide ChatGPT in generating relevant and accurate content for your literature review.

Using ChatGPT to write a literature review can greatly facilitate the research process. By following a step-by-step approach, researchers can effectively leverage ChatGPT’s capabilities to gather insights, generate content, and enhance the quality of their literature review. However, it is important to approach the generated content critically, validate it with reliable sources, and ensure coherence within the review.

Advanced ChatGPT Guide - How to build your own Chat GPT Site

By signing up, you agree to our User Agreement and Privacy Policy & Cookie Statement .

Using ChatGPT to conduct a literature review

Affiliation.

  • 1 Department of Humanities, Czech University of Life Sciences Prague; Prague, Czech Republic.
  • PMID: 36879536
  • DOI: 10.1080/08989621.2023.2185514

AI Habit

80+ ChatGPT Prompts for Literature Review

Conducting a literature review can often seem like a daunting task. It's an essential part of academic and research work, involving comprehensive and critical analysis of previously published research related to a specific topic. The goal is to gain a deep understanding of the state of knowledge on the topic, identify gaps, and provide a foundation for further research.

Traditionally, literature reviews have been manual, time-consuming processes. However, the advancement of technology, especially Artificial Intelligence (AI), is reshaping this landscape. One such development is ChatGPT, an AI developed by OpenAI. This tool can assist researchers in conducting more efficient and thorough literature reviews.

In this blog post, we will delve into the ways that ChatGPT, with its remarkable language understanding and generation capabilities, can be used to streamline your literature review process.

From explaining the basic capabilities of ChatGPT to providing essential prompts and tips to conduct a literature review, this post will serve as a comprehensive guide for those looking to leverage AI for academic research.

Stay tuned as we navigate this fascinating convergence of AI and research, and explore the potential of ChatGPT in making literature reviews more efficient and effective.

Table of Contents

The Power of AI in Literature Reviews

The role of Artificial Intelligence (AI) in academia and research is expanding rapidly. AI has emerged as a game-changing tool that can significantly enhance the process of conducting literature reviews.

The Benefits of AI in Conducting Literature Reviews

There are numerous advantages to using AI for literature reviews. Let's delve into these benefits:

Time Efficiency

AI can streamline the literature review process, significantly reducing the time taken. With AI, you can quickly scan vast amounts of literature, saving valuable time that can be used for analysis and synthesis.

Comprehensive Coverage

AI algorithms are capable of scanning and analyzing a far greater volume of literature than a human could reasonably manage. This ensures a comprehensive and exhaustive review of existing literature.

Consistency and Bias Reduction

AI maintains a level of consistency that is hard to achieve manually. It does not suffer from fatigue or bias, ensuring that all relevant literature is considered fairly.

The Role of ChatGPT in Literature Reviews

ChatGPT, developed by OpenAI, has proven to be a valuable tool for conducting literature reviews. It is a language model that can understand and generate human-like text, making it an excellent tool for understanding complex academic literature and providing summaries or insights.

Here are some example prompts that can be used to guide ChatGPT in assisting with literature reviews:

Example Prompts:

Generate a summary of this research paper.

What are the key findings of this study?

How does this research contribute to the field of [specific field]?

Identify the strengths and weaknesses of this study.

Compare this study with the previous study on the same topic.

What are the research gaps identified in this literature?

What future research directions are suggested by this study?

Preparing for a ChatGPT-Assisted Literature Review

Before diving into a literature review with ChatGPT, you need to set the stage right. Preparation is crucial to ensuring you get the most out of your AI-assisted literature review process.

Detailed Steps on How to Set Up for a Literature Review Using ChatGPT

  • Understand Your Topic : Before starting, ensure you have a clear understanding of your topic and the specific aspects you want to focus on in the literature review.
  • Gather Your Materials : Collect all the papers, articles, and sources you plan to include in your literature review.
  • Organize Your Materials : Categorize your sources based on various parameters like theme, methodology, results, etc. This will make it easier to navigate through them during the review.
  • Prepare Your Prompts : Create a list of prompts you plan to use with ChatGPT. These prompts should be designed to extract the information you need from each source.

Tips for Effective Use of ChatGPT in Literature Review

Preparing a list of keywords or topics.

Start with a broad overview of your research topic and gradually narrow down the scope by identifying specific sub-topics, methodologies, or research questions you want to explore. Use these as keywords for your prompts.

Having Clear Objectives for the Review

Before beginning your review, clearly outline what you hope to achieve. This could be understanding the current state of research, identifying gaps, comparing methodologies, etc.

Understanding the Limits of AI Assistance

While ChatGPT is a powerful tool, it's essential to remember it is a tool and not a replacement for human analysis. Use it to process and summarize information, but the interpretation and synthesis of this information should be done by you.

Provide an overview of the literature on [specific topic].

Summarize the methodologies used in the studies on [specific topic].

Identify common themes in the literature on [specific topic].

What are the disagreements in the literature about [specific topic]?

Analyze the impact of [specific study] on the broader field of [specific topic].

What are the emerging trends in the literature on [specific topic]?

What are the commonly cited sources in the literature on [specific topic]?

Essential ChatGPT Prompts for Literature Review

ChatGPT is a powerful tool for conducting literature reviews, and the key to using it effectively is crafting the right prompts. These prompts guide the AI in scanning, analyzing, and summarizing the literature based on your specific needs.

Need To Write A Thesis? ➡️ 87+ ChatGPT Prompts for Thesis Writing

Initial Exploration of a Topic

When you're just starting a literature review, you'll need prompts that help you gain a broad understanding of your research topic. These prompts can assist in grasping the general landscape of the literature.

Give a brief overview of research done on [topic].

What are the prominent theories or models in [topic]?

What are the key debates or controversies in [topic]?

Who are the key authors or researchers in [topic]?

What methodologies are commonly used in studies on [topic]?

Summarize the historical development of [topic] in academia.

What have been the significant shifts or changes in [topic] over time?

Deep Diving into Specific Studies

Once you have a broad understanding, you'll want to delve into specific studies or papers. These prompts help you extract detailed information from individual sources.

Summarize the main arguments and findings of [specific paper].

What methodology does [specific paper] use and why?

What are the strengths and weaknesses of [specific paper]?

How does [specific paper] contribute to the broader field of [topic]?

Compare the findings of [specific paper] with [another specific paper].

What future research does [specific paper] suggest or inspire?

How has [specific paper] been received or critiqued by other scholars in the field?

Comparing and Contrasting Different Works

ChatGPT can also help you identify similarities and differences between various sources. These prompts are useful for synthesizing information across multiple works.

Compare and contrast the methodologies of [paper 1] and [paper 2].

How do the findings of [paper 1] and [paper 2] agree or disagree?

How does [author 1]'s perspective on [topic] differ from [author 2]'s?

Compare the theoretical frameworks used in [paper 1] and [paper 2].

How does the approach to [topic] change over time as seen in [earlier paper] vs. [later paper]?

What themes are common across these studies on [topic]?

What disparities or contradictions exist in the literature on [topic]?

Summarizing Findings

Finally, as you conclude your literature review, you'll want to summarize your findings. These prompts help you consolidate your insights and present them clearly.

Summarize the key findings from my literature review on [topic].

What trends or patterns have emerged from the literature on [topic]?

What gaps or unanswered questions exist in the literature on [topic]?

How have perspectives on [topic] evolved over time, based on the literature?

What consensus, if any, exists in the literature on [topic]?

How does the literature inform our understanding of [topic]?

What future research directions are suggested by the literature on [topic]?

How to Create Effective ChatGPT Prompts

Crafting effective prompts for ChatGPT is part art, part science. It involves understanding the workings of the AI model, your research objectives, and the specific information you seek from your literature review.

Guidelines for Creating Effective ChatGPT Prompts

Here are some general guidelines to follow when crafting prompts for ChatGPT:

  • Be Specific : The more specific your prompt, the more focused and relevant the AI's response will be.
  • Use Clear Language : Make your prompts as clear and concise as possible. Avoid ambiguous terms and complex phrasing.
  • Guide the AI : To get the best results, guide the AI towards the kind of response you're looking for. For example, if you want a summary, explicitly ask for a summary.
  • Experiment and Iterate : Different prompts can yield different results. Don't be afraid to tweak your prompts and try different approaches to find what works best.

Tips for Refining and Iterating on Prompts

Prompts may not always work perfectly on the first try. Here are some tips for refining and iterating on your prompts:

  • Analyze the Responses : Look at the AI's responses to understand how it is interpreting your prompts. If the responses are not what you expected, tweak your prompt to guide the AI more accurately.
  • Try Different Angles : If a prompt isn't working, try approaching the question from a different angle or rephrasing the prompt.
  • Split Complex Prompts : If a prompt is too complex, try splitting it into multiple simpler prompts.

Provide a summary of the main arguments in [specific paper].

What are the primary findings of [specific paper]?

Analyze the methodology used in [specific paper].

What are the implications of [specific paper] for future research?

Compare the findings of [specific paper] with those of [another specific paper].

What critiques have been made about [specific paper]?

What are the key themes across the literature on [specific topic]?

Examples of Good and Less Effective Prompts

Here are some examples of good and less effective prompts to help guide your prompt crafting:

Good Prompts:

Less Effective Prompts:

  • Tell me about [specific paper]. (This is too vague and doesn't guide the AI towards the specific information you're seeking.)
  • What's interesting about [specific paper]? (This prompt is subjective and may not yield useful information for a literature review.)
  • What's everyone saying about [topic]? (This prompt is overly broad and might result in a wide range of responses that aren't focused enough for a literature review.)

Navigating Challenges in Using ChatGPT for Literature Reviews

While ChatGPT can be a powerful tool for conducting literature reviews, it's important to understand its limitations and potential challenges. Being aware of these can help you navigate the process more effectively.

Understanding the Limitations of ChatGPT

Despite its sophisticated capabilities, ChatGPT is not without its limitations. Here are some to keep in mind:

  • Dependency on Input Quality : The quality of ChatGPT's responses depends on the quality and clarity of the prompts you provide.
  • Lack of Critical Analysis : While ChatGPT can summarize and synthesize information, it can't provide the same level of critical analysis and judgment that a human researcher can.
  • Potential for Misinterpretation : ChatGPT may occasionally misinterpret prompts or generate responses that miss the mark.

Overcoming Challenges in Using ChatGPT for Literature Reviews

Despite these limitations, there are ways to overcome the challenges in using ChatGPT for literature reviews:

  • Carefully Craft Your Prompts : As noted earlier, the quality of your prompts greatly influences the AI's output. Spend time crafting and refining your prompts.
  • Double-Check the Information : Always cross-check the AI's responses against the original sources to ensure accuracy.
  • Combine AI and Human Analysis : Use ChatGPT as a tool to assist with your literature review, not as a replacement for your own analysis.

Here are some example prompts that can help you navigate potential challenges:

If the response seems off: Could you provide another summary of [specific paper]?

For double-checking information: What are the key findings of [specific paper]?

To ensure comprehensive coverage: Are there any other significant points in [specific paper] that haven't been mentioned?

If the response is too broad: Could you provide a more focused summary of the methodology in [specific paper]?

If the response is too narrow: What are the broader implications of [specific paper] for the field?

To clarify a complex point: Can you explain the main argument in [specific paper] in simpler terms?

To guide the AI's interpretation: Based on [specific paper], what are the potential areas for future research in this field?

More Great ChatGPT Prompts for Literature Reviews

An engaging literature review requires delving into a range of perspectives, methodologies, and findings within your chosen area of study. Crafting prompts that encourage varied and in-depth analysis can help you gain a comprehensive understanding of your topic. Here are more unique prompt ideas to enrich your literature review process using ChatGPT:

What are the key variables studied in relation to [topic]?

What theoretical frameworks have been applied to the study of [topic]?

Explain the significance of [specific study] in the field of [topic].

What are the ethical considerations discussed in the literature on [topic]?

How does [specific paper] challenge the prevailing understanding of [topic]?

What statistical methods are commonly used in studies on [topic]?

Discuss the influence of [specific author] on the research of [topic].

How have the research methods evolved over time in the study of [topic]?

What are the socio-cultural considerations in the literature on [topic]?

How does [specific paper] address the limitations of previous studies on [topic]?

Describe the study design of [specific paper] in the context of [topic].

What contributions does [specific paper] make to the existing literature on [topic]?

How have policy changes affected the research on [topic] over time?

What is the role of technology in the research of [topic]?

Identify the key longitudinal studies in the field of [topic].

What are the demographic considerations in studies on [topic]?

How does [specific paper] incorporate interdisciplinary approaches to [topic]?

What biases or assumptions are present in the literature on [topic]?

How does [specific paper] use empirical data to support its arguments on [topic]?

Discuss the replication studies in the field of [topic].

What are the implications of the literature on [topic] for practitioners?

How does the literature on [topic] align or contrast with public opinion?

What are the critical reviews or meta-analyses in the field of [topic]?

How does [specific paper] discuss the limitations of its own study on [topic]?

Identify the seminal works in the field of [topic] and explain their significance.

In the rapidly evolving world of AI, tools like ChatGPT have the potential to revolutionize the way we approach tasks such as literature reviews. This powerful AI model, when provided with carefully crafted prompts, can sift through and synthesize vast amounts of information, assisting you in navigating the complex landscape of academic literature.

Remember, the power of ChatGPT lies in its ability to respond to diverse prompts. While this blog post has offered several useful prompts and tips for conducting a literature review, don't hesitate to experiment and innovate with your own prompts. Your creativity and critical thinking, combined with ChatGPT's capabilities, can turn the daunting task of literature review into a more engaging and manageable process.

However, it's important to bear in mind the limitations of AI and to always complement AI-generated insights with your own critical analysis.

As you embark on your journey of exploration and discovery in your chosen field of study, may ChatGPT prove a valuable ally in helping you uncover the rich tapestry of ideas, debates, and breakthroughs that form the essence of academic literature.

75+ ChatGPT Prompts for Presentations

120+ ChatGPT Prompts for Social Media Posts

Author Avatar

About R.J. Adams

R.J. is an artificial intelligence aficionado, committed to demystifying the intricacies of this cutting-edge technology for enthusiasts and novices alike. Leveraging his comprehensive background in internet marketing, online tools, and communications, he continually ventures into the landscape of newly released AI tools, conducting thorough tests and analyses, as well as finding the best prompts to use on the latest AI tools. He can also solve Rubik's Cube in under 2 minutes.

Connect With Me:

Reach out to us for sponsorship opportunities..

We look forward to talking to you!

© 2024 AIHabit.net

how to get literature review from chatgpt

A systematic literature review of empirical research on ChatGPT in education

  • Open access
  • Published: 26 May 2024
  • Volume 3 , article number  60 , ( 2024 )

Cite this article

You have full access to this open access article

how to get literature review from chatgpt

  • Yazid Albadarin   ORCID: orcid.org/0009-0005-8068-8902 1 ,
  • Mohammed Saqr 1 ,
  • Nicolas Pope 1 &
  • Markku Tukiainen 1  

365 Accesses

Explore all metrics

Over the last four decades, studies have investigated the incorporation of Artificial Intelligence (AI) into education. A recent prominent AI-powered technology that has impacted the education sector is ChatGPT. This article provides a systematic review of 14 empirical studies incorporating ChatGPT into various educational settings, published in 2022 and before the 10th of April 2023—the date of conducting the search process. It carefully followed the essential steps outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) guidelines, as well as Okoli’s (Okoli in Commun Assoc Inf Syst, 2015) steps for conducting a rigorous and transparent systematic review. In this review, we aimed to explore how students and teachers have utilized ChatGPT in various educational settings, as well as the primary findings of those studies. By employing Creswell’s (Creswell in Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook], Pearson Education, London, 2015) coding techniques for data extraction and interpretation, we sought to gain insight into their initial attempts at ChatGPT incorporation into education. This approach also enabled us to extract insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of this review show that learners have utilized ChatGPT as a virtual intelligent assistant, where it offered instant feedback, on-demand answers, and explanations of complex topics. Additionally, learners have used it to enhance their writing and language skills by generating ideas, composing essays, summarizing, translating, paraphrasing texts, or checking grammar. Moreover, learners turned to it as an aiding tool to facilitate their directed and personalized learning by assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. However, the results of specific studies (n = 3, 21.4%) show that overuse of ChatGPT may negatively impact innovative capacities and collaborative learning competencies among learners. Educators, on the other hand, have utilized ChatGPT to create lesson plans, generate quizzes, and provide additional resources, which helped them enhance their productivity and efficiency and promote different teaching methodologies. Despite these benefits, the majority of the reviewed studies recommend the importance of conducting structured training, support, and clear guidelines for both learners and educators to mitigate the drawbacks. This includes developing critical evaluation skills to assess the accuracy and relevance of information provided by ChatGPT, as well as strategies for integrating human interaction and collaboration into learning activities that involve AI tools. Furthermore, they also recommend ongoing research and proactive dialogue with policymakers, stakeholders, and educational practitioners to refine and enhance the use of AI in learning environments. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Similar content being viewed by others

how to get literature review from chatgpt

Empowering learners with ChatGPT: insights from a systematic literature exploration

how to get literature review from chatgpt

Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners

how to get literature review from chatgpt

Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT

Avoid common mistakes on your manuscript.

1 Introduction

Educational technology, a rapidly evolving field, plays a crucial role in reshaping the landscape of teaching and learning [ 82 ]. One of the most transformative technological innovations of our era that has influenced the field of education is Artificial Intelligence (AI) [ 50 ]. Over the last four decades, AI in education (AIEd) has gained remarkable attention for its potential to make significant advancements in learning, instructional methods, and administrative tasks within educational settings [ 11 ]. In particular, a large language model (LLM), a type of AI algorithm that applies artificial neural networks (ANNs) and uses massively large data sets to understand, summarize, generate, and predict new content that is almost difficult to differentiate from human creations [ 79 ], has opened up novel possibilities for enhancing various aspects of education, from content creation to personalized instruction [ 35 ]. Chatbots that leverage the capabilities of LLMs to understand and generate human-like responses have also presented the capacity to enhance student learning and educational outcomes by engaging students, offering timely support, and fostering interactive learning experiences [ 46 ].

The ongoing and remarkable technological advancements in chatbots have made their use more convenient, increasingly natural and effortless, and have expanded their potential for deployment across various domains [ 70 ]. One prominent example of chatbot applications is the Chat Generative Pre-Trained Transformer, known as ChatGPT, which was introduced by OpenAI, a leading AI research lab, on November 30th, 2022. ChatGPT employs a variety of deep learning techniques to generate human-like text, with a particular focus on recurrent neural networks (RNNs). Long short-term memory (LSTM) allows it to grasp the context of the text being processed and retain information from previous inputs. Also, the transformer architecture, a neural network architecture based on the self-attention mechanism, allows it to analyze specific parts of the input, thereby enabling it to produce more natural-sounding and coherent output. Additionally, the unsupervised generative pre-training and the fine-tuning methods allow ChatGPT to generate more relevant and accurate text for specific tasks [ 31 , 62 ]. Furthermore, reinforcement learning from human feedback (RLHF), a machine learning approach that combines reinforcement learning techniques with human-provided feedback, has helped improve ChatGPT’s model by accelerating the learning process and making it significantly more efficient.

This cutting-edge natural language processing (NLP) tool is widely recognized as one of today's most advanced LLMs-based chatbots [ 70 ], allowing users to ask questions and receive detailed, coherent, systematic, personalized, convincing, and informative human-like responses [ 55 ], even within complex and ambiguous contexts [ 63 , 77 ]. ChatGPT is considered the fastest-growing technology in history: in just three months following its public launch, it amassed an estimated 120 million monthly active users [ 16 ] with an estimated 13 million daily queries [ 49 ], surpassing all other applications [ 64 ]. This remarkable growth can be attributed to the unique features and user-friendly interface that ChatGPT offers. Its intuitive design allows users to interact seamlessly with the technology, making it accessible to a diverse range of individuals, regardless of their technical expertise [ 78 ]. Additionally, its exceptional performance results from a combination of advanced algorithms, continuous enhancements, and extensive training on a diverse dataset that includes various text sources such as books, articles, websites, and online forums [ 63 ], have contributed to a more engaging and satisfying user experience [ 62 ]. These factors collectively explain its remarkable global growth and set it apart from predecessors like Bard, Bing Chat, ERNIE, and others.

In this context, several studies have explored the technological advancements of chatbots. One noteworthy recent research effort, conducted by Schöbel et al. [ 70 ], stands out for its comprehensive analysis of more than 5,000 studies on communication agents. This study offered a comprehensive overview of the historical progression and future prospects of communication agents, including ChatGPT. Moreover, other studies have focused on making comparisons, particularly between ChatGPT and alternative chatbots like Bard, Bing Chat, ERNIE, LaMDA, BlenderBot, and various others. For example, O’Leary [ 53 ] compared two chatbots, LaMDA and BlenderBot, with ChatGPT and revealed that ChatGPT outperformed both. This superiority arises from ChatGPT’s capacity to handle a wider range of questions and generate slightly varied perspectives within specific contexts. Similarly, ChatGPT exhibited an impressive ability to formulate interpretable responses that were easily understood when compared with Google's feature snippet [ 34 ]. Additionally, ChatGPT was compared to other LLMs-based chatbots, including Bard and BERT, as well as ERNIE. The findings indicated that ChatGPT exhibited strong performance in the given tasks, often outperforming the other models [ 59 ].

Furthermore, in the education context, a comprehensive study systematically compared a range of the most promising chatbots, including Bard, Bing Chat, ChatGPT, and Ernie across a multidisciplinary test that required higher-order thinking. The study revealed that ChatGPT achieved the highest score, surpassing Bing Chat and Bard [ 64 ]. Similarly, a comparative analysis was conducted to compare ChatGPT with Bard in answering a set of 30 mathematical questions and logic problems, grouped into two question sets. Set (A) is unavailable online, while Set (B) is available online. The results revealed ChatGPT's superiority in Set (A) over Bard. Nevertheless, Bard's advantage emerged in Set (B) due to its capacity to access the internet directly and retrieve answers, a capability that ChatGPT does not possess [ 57 ]. However, through these varied assessments, ChatGPT consistently highlights its exceptional prowess compared to various alternatives in the ever-evolving chatbot technology.

The widespread adoption of chatbots, especially ChatGPT, by millions of students and educators, has sparked extensive discussions regarding its incorporation into the education sector [ 64 ]. Accordingly, many scholars have contributed to the discourse, expressing both optimism and pessimism regarding the incorporation of ChatGPT into education. For example, ChatGPT has been highlighted for its capabilities in enriching the learning and teaching experience through its ability to support different learning approaches, including adaptive learning, personalized learning, and self-directed learning [ 58 , 60 , 91 ]), deliver summative and formative feedback to students and provide real-time responses to questions, increase the accessibility of information [ 22 , 40 , 43 ], foster students’ performance, engagement and motivation [ 14 , 44 , 58 ], and enhance teaching practices [ 17 , 18 , 64 , 74 ].

On the other hand, concerns have been also raised regarding its potential negative effects on learning and teaching. These include the dissemination of false information and references [ 12 , 23 , 61 , 85 ], biased reinforcement [ 47 , 50 ], compromised academic integrity [ 18 , 40 , 66 , 74 ], and the potential decline in students' skills [ 43 , 61 , 64 , 74 ]. As a result, ChatGPT has been banned in multiple countries, including Russia, China, Venezuela, Belarus, and Iran, as well as in various educational institutions in India, Italy, Western Australia, France, and the United States [ 52 , 90 ].

Clearly, the advent of chatbots, especially ChatGPT, has provoked significant controversy due to their potential impact on learning and teaching. This indicates the necessity for further exploration to gain a deeper understanding of this technology and carefully evaluate its potential benefits, limitations, challenges, and threats to education [ 79 ]. Therefore, conducting a systematic literature review will provide valuable insights into the potential prospects and obstacles linked to its incorporation into education. This systematic literature review will primarily focus on ChatGPT, driven by the aforementioned key factors outlined above.

However, the existing literature lacks a systematic literature review of empirical studies. Thus, this systematic literature review aims to address this gap by synthesizing the existing empirical studies conducted on chatbots, particularly ChatGPT, in the field of education, highlighting how ChatGPT has been utilized in educational settings, and identifying any existing gaps. This review may be particularly useful for researchers in the field and educators who are contemplating the integration of ChatGPT or any chatbot into education. The following research questions will guide this study:

What are students' and teachers' initial attempts at utilizing ChatGPT in education?

What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?

2 Methodology

To conduct this study, the authors followed the essential steps of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) and Okoli’s [ 54 ] steps for conducting a systematic review. These included identifying the study’s purpose, drafting a protocol, applying a practical screening process, searching the literature, extracting relevant data, evaluating the quality of the included studies, synthesizing the studies, and ultimately writing the review. The subsequent section provides an extensive explanation of how these steps were carried out in this study.

2.1 Identify the purpose

Given the widespread adoption of ChatGPT by students and teachers for various educational purposes, often without a thorough understanding of responsible and effective use or a clear recognition of its potential impact on learning and teaching, the authors recognized the need for further exploration of ChatGPT's impact on education in this early stage. Therefore, they have chosen to conduct a systematic literature review of existing empirical studies that incorporate ChatGPT into educational settings. Despite the limited number of empirical studies due to the novelty of the topic, their goal is to gain a deeper understanding of this technology and proactively evaluate its potential benefits, limitations, challenges, and threats to education. This effort could help to understand initial reactions and attempts at incorporating ChatGPT into education and bring out insights and considerations that can inform the future development of education.

2.2 Draft the protocol

The next step is formulating the protocol. This protocol serves to outline the study process in a rigorous and transparent manner, mitigating researcher bias in study selection and data extraction [ 88 ]. The protocol will include the following steps: generating the research question, predefining a literature search strategy, identifying search locations, establishing selection criteria, assessing the studies, developing a data extraction strategy, and creating a timeline.

2.3 Apply practical screen

The screening step aims to accurately filter the articles resulting from the searching step and select the empirical studies that have incorporated ChatGPT into educational contexts, which will guide us in answering the research questions and achieving the objectives of this study. To ensure the rigorous execution of this step, our inclusion and exclusion criteria were determined based on the authors' experience and informed by previous successful systematic reviews [ 21 ]. Table 1 summarizes the inclusion and exclusion criteria for study selection.

2.4 Literature search

We conducted a thorough literature search to identify articles that explored, examined, and addressed the use of ChatGPT in Educational contexts. We utilized two research databases: Dimensions.ai, which provides access to a large number of research publications, and lens.org, which offers access to over 300 million articles, patents, and other research outputs from diverse sources. Additionally, we included three databases, Scopus, Web of Knowledge, and ERIC, which contain relevant research on the topic that addresses our research questions. To browse and identify relevant articles, we used the following search formula: ("ChatGPT" AND "Education"), which included the Boolean operator "AND" to get more specific results. The subject area in the Scopus and ERIC databases were narrowed to "ChatGPT" and "Education" keywords, and in the WoS database was limited to the "Education" category. The search was conducted between the 3rd and 10th of April 2023, which resulted in 276 articles from all selected databases (111 articles from Dimensions.ai, 65 from Scopus, 28 from Web of Science, 14 from ERIC, and 58 from Lens.org). These articles were imported into the Rayyan web-based system for analysis. The duplicates were identified automatically by the system. Subsequently, the first author manually reviewed the duplicated articles ensured that they had the same content, and then removed them, leaving us with 135 unique articles. Afterward, the titles, abstracts, and keywords of the first 40 manuscripts were scanned and reviewed by the first author and were discussed with the second and third authors to resolve any disagreements. Subsequently, the first author proceeded with the filtering process for all articles and carefully applied the inclusion and exclusion criteria as presented in Table  1 . Articles that met any one of the exclusion criteria were eliminated, resulting in 26 articles. Afterward, the authors met to carefully scan and discuss them. The authors agreed to eliminate any empirical studies solely focused on checking ChatGPT capabilities, as these studies do not guide us in addressing the research questions and achieving the study's objectives. This resulted in 14 articles eligible for analysis.

2.5 Quality appraisal

The examination and evaluation of the quality of the extracted articles is a vital step [ 9 ]. Therefore, the extracted articles were carefully evaluated for quality using Fink’s [ 24 ] standards, which emphasize the necessity for detailed descriptions of methodology, results, conclusions, strengths, and limitations. The process began with a thorough assessment of each study's design, data collection, and analysis methods to ensure their appropriateness and comprehensive execution. The clarity, consistency, and logical progression from data to results and conclusions were also critically examined. Potential biases and recognized limitations within the studies were also scrutinized. Ultimately, two articles were excluded for failing to meet Fink’s criteria, particularly in providing sufficient detail on methodology, results, conclusions, strengths, or limitations. The review process is illustrated in Fig.  1 .

figure 1

The study selection process

2.6 Data extraction

The next step is data extraction, the process of capturing the key information and categories from the included studies. To improve efficiency, reduce variation among authors, and minimize errors in data analysis, the coding categories were constructed using Creswell's [ 15 ] coding techniques for data extraction and interpretation. The coding process involves three sequential steps. The initial stage encompasses open coding , where the researcher examines the data, generates codes to describe and categorize it, and gains a deeper understanding without preconceived ideas. Following open coding is axial coding , where the interrelationships between codes from open coding are analyzed to establish more comprehensive categories or themes. The process concludes with selective coding , refining and integrating categories or themes to identify core concepts emerging from the data. The first coder performed the coding process, then engaged in discussions with the second and third authors to finalize the coding categories for the first five articles. The first coder then proceeded to code all studies and engaged again in discussions with the other authors to ensure the finalization of the coding process. After a comprehensive analysis and capturing of the key information from the included studies, the data extraction and interpretation process yielded several themes. These themes have been categorized and are presented in Table  2 . It is important to note that open coding results were removed from Table  2 for aesthetic reasons, as it included many generic aspects, such as words, short phrases, or sentences mentioned in the studies.

2.7 Synthesize studies

In this stage, we will gather, discuss, and analyze the key findings that emerged from the selected studies. The synthesis stage is considered a transition from an author-centric to a concept-centric focus, enabling us to map all the provided information to achieve the most effective evaluation of the data [ 87 ]. Initially, the authors extracted data that included general information about the selected studies, including the author(s)' names, study titles, years of publication, educational levels, research methodologies, sample sizes, participants, main aims or objectives, raw data sources, and analysis methods. Following that, all key information and significant results from the selected studies were compiled using Creswell’s [ 15 ] coding techniques for data extraction and interpretation to identify core concepts and themes emerging from the data, focusing on those that directly contributed to our research questions and objectives, such as the initial utilization of ChatGPT in learning and teaching, learners' and educators' familiarity with ChatGPT, and the main findings of each study. Finally, the data related to each selected study were extracted into an Excel spreadsheet for data processing. The Excel spreadsheet was reviewed by the authors, including a series of discussions to ensure the finalization of this process and prepare it for further analysis. Afterward, the final result being analyzed and presented in various types of charts and graphs. Table 4 presents the extracted data from the selected studies, with each study labeled with a capital 'S' followed by a number.

This section consists of two main parts. The first part provides a descriptive analysis of the data compiled from the reviewed studies. The second part presents the answers to the research questions and the main findings of these studies.

3.1 Part 1: descriptive analysis

This section will provide a descriptive analysis of the reviewed studies, including educational levels and fields, participants distribution, country contribution, research methodologies, study sample size, study population, publication year, list of journals, familiarity with ChatGPT, source of data, and the main aims and objectives of the studies. Table 4 presents a comprehensive overview of the extracted data from the selected studies.

3.1.1 The number of the reviewed studies and publication years

The total number of the reviewed studies was 14. All studies were empirical studies and published in different journals focusing on Education and Technology. One study was published in 2022 [S1], while the remaining were published in 2023 [S2]-[S14]. Table 3 illustrates the year of publication, the names of the journals, and the number of reviewed studies published in each journal for the studies reviewed.

3.1.2 Educational levels and fields

The majority of the reviewed studies, 11 studies, were conducted in higher education institutions [S1]-[S10] and [S13]. Two studies did not specify the educational level of the population [S12] and [S14], while one study focused on elementary education [S11]. However, the reviewed studies covered various fields of education. Three studies focused on Arts and Humanities Education [S8], [S11], and [S14], specifically English Education. Two studies focused on Engineering Education, with one in Computer Engineering [S2] and the other in Construction Education [S3]. Two studies focused on Mathematics Education [S5] and [S12]. One study focused on Social Science Education [S13]. One study focused on Early Education [S4]. One study focused on Journalism Education [S9]. Finally, three studies did not specify the field of education [S1], [S6], and [S7]. Figure  2 represents the educational levels in the reviewed studies, while Fig.  3 represents the context of the reviewed studies.

figure 2

Educational levels in the reviewed studies

figure 3

Context of the reviewed studies

3.1.3 Participants distribution and countries contribution

The reviewed studies have been conducted across different geographic regions, providing a diverse representation of the studies. The majority of the studies, 10 in total, [S1]-[S3], [S5]-[S9], [S11], and [S14], primarily focused on participants from single countries such as Pakistan, the United Arab Emirates, China, Indonesia, Poland, Saudi Arabia, South Korea, Spain, Tajikistan, and the United States. In contrast, four studies, [S4], [S10], [S12], and [S13], involved participants from multiple countries, including China and the United States [S4], China, the United Kingdom, and the United States [S10], the United Arab Emirates, Oman, Saudi Arabia, and Jordan [S12], Turkey, Sweden, Canada, and Australia [ 13 ]. Figures  4 and 5 illustrate the distribution of participants, whether from single or multiple countries, and the contribution of each country in the reviewed studies, respectively.

figure 4

The reviewed studies conducted in single or multiple countries

figure 5

The Contribution of each country in the studies

3.1.4 Study population and sample size

Four study populations were included: university students, university teachers, university teachers and students, and elementary school teachers. Six studies involved university students [S2], [S3], [S5] and [S6]-[S8]. Three studies focused on university teachers [S1], [S4], and [S6], while one study specifically targeted elementary school teachers [S11]. Additionally, four studies included both university teachers and students [S10] and [ 12 , 13 , 14 ], and among them, study [S13] specifically included postgraduate students. In terms of the sample size of the reviewed studies, nine studies included a small sample size of less than 50 participants [S1], [S3], [S6], [S8], and [S10]-[S13]. Three studies had 50–100 participants [S2], [S9], and [S14]. Only one study had more than 100 participants [S7]. It is worth mentioning that study [S4] adopted a mixed methods approach, including 10 participants for qualitative analysis and 110 participants for quantitative analysis.

3.1.5 Participants’ familiarity with using ChatGPT

The reviewed studies recruited a diverse range of participants with varying levels of familiarity with ChatGPT. Five studies [S2], [S4], [S6], [S8], and [S12] involved participants already familiar with ChatGPT, while eight studies [S1], [S3], [S5], [S7], [S9], [S10], [S13] and [S14] included individuals with differing levels of familiarity. Notably, one study [S11] had participants who were entirely unfamiliar with ChatGPT. It is important to note that four studies [S3], [S5], [S9], and [S11] provided training or guidance to their participants before conducting their studies, while ten studies [S1], [S2], [S4], [S6]-[S8], [S10], and [S12]-[S14] did not provide training due to the participants' existing familiarity with ChatGPT.

3.1.6 Research methodology approaches and source(S) of data

The reviewed studies adopted various research methodology approaches. Seven studies adopted qualitative research methodology [S1], [S4], [S6], [S8], [S10], [S11], and [S12], while three studies adopted quantitative research methodology [S3], [S7], and [S14], and four studies employed mixed-methods, which involved a combination of both the strengths of qualitative and quantitative methods [S2], [S5], [S9], and [S13].

In terms of the source(s) of data, the reviewed studies obtained their data from various sources, such as interviews, questionnaires, and pre-and post-tests. Six studies relied on interviews as their primary source of data collection [S1], [S4], [S6], [S10], [S11], and [S12], four studies relied on questionnaires [S2], [S7], [S13], and [S14], two studies combined the use of pre-and post-tests and questionnaires for data collection [S3] and [S9], while two studies combined the use of questionnaires and interviews to obtain the data [S5] and [S8]. It is important to note that six of the reviewed studies were quasi-experimental [S3], [S5], [S8], [S9], [S12], and [S14], while the remaining ones were experimental studies [S1], [S2], [S4], [S6], [S7], [S10], [S11], and [S13]. Figures  6 and 7 illustrate the research methodologies and the source (s) of data used in the reviewed studies, respectively.

figure 6

Research methodologies in the reviewed studies

figure 7

Source of data in the reviewed studies

3.1.7 The aim and objectives of the studies

The reviewed studies encompassed a diverse set of aims, with several of them incorporating multiple primary objectives. Six studies [S3], [S6], [S7], [S8], [S11], and [S12] examined the integration of ChatGPT in educational contexts, and four studies [S4], [S5], [S13], and [S14] investigated the various implications of its use in education, while three studies [S2], [S9], and [S10] aimed to explore both its integration and implications in education. Additionally, seven studies explicitly explored attitudes and perceptions of students [S2] and [S3], educators [S1] and [S6], or both [S10], [S12], and [S13] regarding the utilization of ChatGPT in educational settings.

3.2 Part 2: research questions and main findings of the reviewed studies

This part will present the answers to the research questions and the main findings of the reviewed studies, classified into two main categories (learning and teaching) according to AI Education classification by [ 36 ]. Figure  8 summarizes the main findings of the reviewed studies in a visually informative diagram. Table 4 provides a detailed list of the key information extracted from the selected studies that led to generating these themes.

figure 8

The main findings in the reviewed studies

4 Students' initial attempts at utilizing ChatGPT in learning and main findings from students' perspective

4.1 virtual intelligent assistant.

Nine studies demonstrated that ChatGPT has been utilized by students as an intelligent assistant to enhance and support their learning. Students employed it for various purposes, such as answering on-demand questions [S2]-[S5], [S8], [S10], and [S12], providing valuable information and learning resources [S2]-[S5], [S6], and [S8], as well as receiving immediate feedback [S2], [S4], [S9], [S10], and [S12]. In this regard, students generally were confident in the accuracy of ChatGPT's responses, considering them relevant, reliable, and detailed [S3], [S4], [S5], and [S8]. However, some students indicated the need for improvement, as they found that answers are not always accurate [S2], and that misleading information may have been provided or that it may not always align with their expectations [S6] and [S10]. It was also observed by the students that the accuracy of ChatGPT is dependent on several factors, including the quality and specificity of the user's input, the complexity of the question or topic, and the scope and relevance of its training data [S12]. Many students felt that ChatGPT's answers were not always accurate and most of them believed that it requires good background knowledge to work with.

4.2 Writing and language proficiency assistant

Six of the reviewed studies highlighted that ChatGPT has been utilized by students as a valuable assistant tool to improve their academic writing skills and language proficiency. Among these studies, three mainly focused on English education, demonstrating that students showed sufficient mastery in using ChatGPT for generating ideas, summarizing, paraphrasing texts, and completing writing essays [S8], [S11], and [S14]. Furthermore, ChatGPT helped them in writing by making students active investigators rather than passive knowledge recipients and facilitated the development of their writing skills [S11] and [S14]. Similarly, ChatGPT allowed students to generate unique ideas and perspectives, leading to deeper analysis and reflection on their journalism writing [S9]. In terms of language proficiency, ChatGPT allowed participants to translate content into their home languages, making it more accessible and relevant to their context [S4]. It also enabled them to request changes in linguistic tones or flavors [S8]. Moreover, participants used it to check grammar or as a dictionary [S11].

4.3 Valuable resource for learning approaches

Five studies demonstrated that students used ChatGPT as a valuable complementary resource for self-directed learning. It provided learning resources and guidance on diverse educational topics and created a supportive home learning environment [S2] and [S4]. Moreover, it offered step-by-step guidance to grasp concepts at their own pace and enhance their understanding [S5], streamlined task and project completion carried out independently [S7], provided comprehensive and easy-to-understand explanations on various subjects [S10], and assisted in studying geometry operations, thereby empowering them to explore geometry operations at their own pace [S12]. Three studies showed that students used ChatGPT as a valuable learning resource for personalized learning. It delivered age-appropriate conversations and tailored teaching based on a child's interests [S4], acted as a personalized learning assistant, adapted to their needs and pace, which assisted them in understanding mathematical concepts [S12], and enabled personalized learning experiences in social sciences by adapting to students' needs and learning styles [S13]. On the other hand, it is important to note that, according to one study [S5], students suggested that using ChatGPT may negatively affect collaborative learning competencies between students.

4.4 Enhancing students' competencies

Six of the reviewed studies have shown that ChatGPT is a valuable tool for improving a wide range of skills among students. Two studies have provided evidence that ChatGPT led to improvements in students' critical thinking, reasoning skills, and hazard recognition competencies through engaging them in interactive conversations or activities and providing responses related to their disciplines in journalism [S5] and construction education [S9]. Furthermore, two studies focused on mathematical education have shown the positive impact of ChatGPT on students' problem-solving abilities in unraveling problem-solving questions [S12] and enhancing the students' understanding of the problem-solving process [S5]. Lastly, one study indicated that ChatGPT effectively contributed to the enhancement of conversational social skills [S4].

4.5 Supporting students' academic success

Seven of the reviewed studies highlighted that students found ChatGPT to be beneficial for learning as it enhanced learning efficiency and improved the learning experience. It has been observed to improve students' efficiency in computer engineering studies by providing well-structured responses and good explanations [S2]. Additionally, students found it extremely useful for hazard reporting [S3], and it also enhanced their efficiency in solving mathematics problems and capabilities [S5] and [S12]. Furthermore, by finding information, generating ideas, translating texts, and providing alternative questions, ChatGPT aided students in deepening their understanding of various subjects [S6]. It contributed to an increase in students' overall productivity [S7] and improved efficiency in composing written tasks [S8]. Regarding learning experiences, ChatGPT was instrumental in assisting students in identifying hazards that they might have otherwise overlooked [S3]. It also improved students' learning experiences in solving mathematics problems and developing abilities [S5] and [S12]. Moreover, it increased students' successful completion of important tasks in their studies [S7], particularly those involving average difficulty writing tasks [S8]. Additionally, ChatGPT increased the chances of educational success by providing students with baseline knowledge on various topics [S10].

5 Teachers' initial attempts at utilizing ChatGPT in teaching and main findings from teachers' perspective

5.1 valuable resource for teaching.

The reviewed studies showed that teachers have employed ChatGPT to recommend, modify, and generate diverse, creative, organized, and engaging educational contents, teaching materials, and testing resources more rapidly [S4], [S6], [S10] and [S11]. Additionally, teachers experienced increased productivity as ChatGPT facilitated quick and accurate responses to questions, fact-checking, and information searches [S1]. It also proved valuable in constructing new knowledge [S6] and providing timely answers to students' questions in classrooms [S11]. Moreover, ChatGPT enhanced teachers' efficiency by generating new ideas for activities and preplanning activities for their students [S4] and [S6], including interactive language game partners [S11].

5.2 Improving productivity and efficiency

The reviewed studies showed that participants' productivity and work efficiency have been significantly enhanced by using ChatGPT as it enabled them to allocate more time to other tasks and reduce their overall workloads [S6], [S10], [S11], [S13], and [S14]. However, three studies [S1], [S4], and [S11], indicated a negative perception and attitude among teachers toward using ChatGPT. This negativity stemmed from a lack of necessary skills to use it effectively [S1], a limited familiarity with it [S4], and occasional inaccuracies in the content provided by it [S10].

5.3 Catalyzing new teaching methodologies

Five of the reviewed studies highlighted that educators found the necessity of redefining their teaching profession with the assistance of ChatGPT [S11], developing new effective learning strategies [S4], and adapting teaching strategies and methodologies to ensure the development of essential skills for future engineers [S5]. They also emphasized the importance of adopting new educational philosophies and approaches that can evolve with the introduction of ChatGPT into the classroom [S12]. Furthermore, updating curricula to focus on improving human-specific features, such as emotional intelligence, creativity, and philosophical perspectives [S13], was found to be essential.

5.4 Effective utilization of CHATGPT in teaching

According to the reviewed studies, effective utilization of ChatGPT in education requires providing teachers with well-structured training, support, and adequate background on how to use ChatGPT responsibly [S1], [S3], [S11], and [S12]. Establishing clear rules and regulations regarding its usage is essential to ensure it positively impacts the teaching and learning processes, including students' skills [S1], [S4], [S5], [S8], [S9], and [S11]-[S14]. Moreover, conducting further research and engaging in discussions with policymakers and stakeholders is indeed crucial for the successful integration of ChatGPT in education and to maximize the benefits for both educators and students [S1], [S6]-[S10], and [S12]-[S14].

6 Discussion

The purpose of this review is to conduct a systematic review of empirical studies that have explored the utilization of ChatGPT, one of today’s most advanced LLM-based chatbots, in education. The findings of the reviewed studies showed several ways of ChatGPT utilization in different learning and teaching practices as well as it provided insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of the reviewed studies came from diverse fields of education, which helped us avoid a biased review that is limited to a specific field. Similarly, the reviewed studies have been conducted across different geographic regions. This kind of variety in geographic representation enriched the findings of this review.

In response to RQ1 , "What are students' and teachers' initial attempts at utilizing ChatGPT in education?", the findings from this review provide comprehensive insights. Chatbots, including ChatGPT, play a crucial role in supporting student learning, enhancing their learning experiences, and facilitating diverse learning approaches [ 42 , 43 ]. This review found that this tool, ChatGPT, has been instrumental in enhancing students' learning experiences by serving as a virtual intelligent assistant, providing immediate feedback, on-demand answers, and engaging in educational conversations. Additionally, students have benefited from ChatGPT’s ability to generate ideas, compose essays, and perform tasks like summarizing, translating, paraphrasing texts, or checking grammar, thereby enhancing their writing and language competencies. Furthermore, students have turned to ChatGPT for assistance in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks, which fosters a supportive home learning environment, allowing them to take responsibility for their own learning and cultivate the skills and approaches essential for supportive home learning environment [ 26 , 27 , 28 ]. This finding aligns with the study of Saqr et al. [ 68 , 69 ] who highlighted that, when students actively engage in their own learning process, it yields additional advantages, such as heightened motivation, enhanced achievement, and the cultivation of enthusiasm, turning them into advocates for their own learning.

Moreover, students have utilized ChatGPT for tailored teaching and step-by-step guidance on diverse educational topics, streamlining task and project completion, and generating and recommending educational content. This personalization enhances the learning environment, leading to increased academic success. This finding aligns with other recent studies [ 26 , 27 , 28 , 60 , 66 ] which revealed that ChatGPT has the potential to offer personalized learning experiences and support an effective learning process by providing students with customized feedback and explanations tailored to their needs and abilities. Ultimately, fostering students' performance, engagement, and motivation, leading to increase students' academic success [ 14 , 44 , 58 ]. This ultimate outcome is in line with the findings of Saqr et al. [ 68 , 69 ], which emphasized that learning strategies are important catalysts of students' learning, as students who utilize effective learning strategies are more likely to have better academic achievement.

Teachers, too, have capitalized on ChatGPT's capabilities to enhance productivity and efficiency, using it for creating lesson plans, generating quizzes, providing additional resources, generating and preplanning new ideas for activities, and aiding in answering students’ questions. This adoption of technology introduces new opportunities to support teaching and learning practices, enhancing teacher productivity. This finding aligns with those of Day [ 17 ], De Castro [ 18 ], and Su and Yang [ 74 ] as well as with those of Valtonen et al. [ 82 ], who revealed that emerging technological advancements have opened up novel opportunities and means to support teaching and learning practices, and enhance teachers’ productivity.

In response to RQ2 , "What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?", the findings from this review provide profound insights and raise significant concerns. Starting with the insights, chatbots, including ChatGPT, have demonstrated the potential to reshape and revolutionize education, creating new, novel opportunities for enhancing the learning process and outcomes [ 83 ], facilitating different learning approaches, and offering a range of pedagogical benefits [ 19 , 43 , 72 ]. In this context, this review found that ChatGPT could open avenues for educators to adopt or develop new effective learning and teaching strategies that can evolve with the introduction of ChatGPT into the classroom. Nonetheless, there is an evident lack of research understanding regarding the potential impact of generative machine learning models within diverse educational settings [ 83 ]. This necessitates teachers to attain a high level of proficiency in incorporating chatbots, such as ChatGPT, into their classrooms to create inventive, well-structured, and captivating learning strategies. In the same vein, the review also found that teachers without the requisite skills to utilize ChatGPT realized that it did not contribute positively to their work and could potentially have adverse effects [ 37 ]. This concern could lead to inequity of access to the benefits of chatbots, including ChatGPT, as individuals who lack the necessary expertise may not be able to harness their full potential, resulting in disparities in educational outcomes and opportunities. Therefore, immediate action is needed to address these potential issues. A potential solution is offering training, support, and competency development for teachers to ensure that all of them can leverage chatbots, including ChatGPT, effectively and equitably in their educational practices [ 5 , 28 , 80 ], which could enhance accessibility and inclusivity, and potentially result in innovative outcomes [ 82 , 83 ].

Additionally, chatbots, including ChatGPT, have the potential to significantly impact students' thinking abilities, including retention, reasoning, analysis skills [ 19 , 45 ], and foster innovation and creativity capabilities [ 83 ]. This review found that ChatGPT could contribute to improving a wide range of skills among students. However, it found that frequent use of ChatGPT may result in a decrease in innovative capacities, collaborative skills and cognitive capacities, and students' motivation to attend classes, as well as could lead to reduced higher-order thinking skills among students [ 22 , 29 ]. Therefore, immediate action is needed to carefully examine the long-term impact of chatbots such as ChatGPT, on learning outcomes as well as to explore its incorporation into educational settings as a supportive tool without compromising students' cognitive development and critical thinking abilities. In the same vein, the review also found that it is challenging to draw a consistent conclusion regarding the potential of ChatGPT to aid self-directed learning approach. This finding aligns with the recent study of Baskara [ 8 ]. Therefore, further research is needed to explore the potential of ChatGPT for self-directed learning. One potential solution involves utilizing learning analytics as a novel approach to examine various aspects of students' learning and support them in their individual endeavors [ 32 ]. This approach can bridge this gap by facilitating an in-depth analysis of how learners engage with ChatGPT, identifying trends in self-directed learning behavior, and assessing its influence on their outcomes.

Turning to the significant concerns, on the other hand, a fundamental challenge with LLM-based chatbots, including ChatGPT, is the accuracy and quality of the provided information and responses, as they provide false information as truth—a phenomenon often referred to as "hallucination" [ 3 , 49 ]. In this context, this review found that the provided information was not entirely satisfactory. Consequently, the utilization of chatbots presents potential concerns, such as generating and providing inaccurate or misleading information, especially for students who utilize it to support their learning. This finding aligns with other findings [ 6 , 30 , 35 , 40 ] which revealed that incorporating chatbots such as ChatGPT, into education presents challenges related to its accuracy and reliability due to its training on a large corpus of data, which may contain inaccuracies and the way users formulate or ask ChatGPT. Therefore, immediate action is needed to address these potential issues. One possible solution is to equip students with the necessary skills and competencies, which include a background understanding of how to use it effectively and the ability to assess and evaluate the information it generates, as the accuracy and the quality of the provided information depend on the input, its complexity, the topic, and the relevance of its training data [ 28 , 49 , 86 ]. However, it's also essential to examine how learners can be educated about how these models operate, the data used in their training, and how to recognize their limitations, challenges, and issues [ 79 ].

Furthermore, chatbots present a substantial challenge concerning maintaining academic integrity [ 20 , 56 ] and copyright violations [ 83 ], which are significant concerns in education. The review found that the potential misuse of ChatGPT might foster cheating, facilitate plagiarism, and threaten academic integrity. This issue is also affirmed by the research conducted by Basic et al. [ 7 ], who presented evidence that students who utilized ChatGPT in their writing assignments had more plagiarism cases than those who did not. These findings align with the conclusions drawn by Cotton et al. [ 13 ], Hisan and Amri [ 33 ] and Sullivan et al. [ 75 ], who revealed that the integration of chatbots such as ChatGPT into education poses a significant challenge to the preservation of academic integrity. Moreover, chatbots, including ChatGPT, have increased the difficulty in identifying plagiarism [ 47 , 67 , 76 ]. The findings from previous studies [ 1 , 84 ] indicate that AI-generated text often went undetected by plagiarism software, such as Turnitin. However, Turnitin and other similar plagiarism detection tools, such as ZeroGPT, GPTZero, and Copyleaks, have since evolved, incorporating enhanced techniques to detect AI-generated text, despite the possibility of false positives, as noted in different studies that have found these tools still not yet fully ready to accurately and reliably identify AI-generated text [ 10 , 51 ], and new novel detection methods may need to be created and implemented for AI-generated text detection [ 4 ]. This potential issue could lead to another concern, which is the difficulty of accurately evaluating student performance when they utilize chatbots such as ChatGPT assistance in their assignments. Consequently, the most LLM-driven chatbots present a substantial challenge to traditional assessments [ 64 ]. The findings from previous studies indicate the importance of rethinking, improving, and redesigning innovative assessment methods in the era of chatbots [ 14 , 20 , 64 , 75 ]. These methods should prioritize the process of evaluating students' ability to apply knowledge to complex cases and demonstrate comprehension, rather than solely focusing on the final product for assessment. Therefore, immediate action is needed to address these potential issues. One possible solution would be the development of clear guidelines, regulatory policies, and pedagogical guidance. These measures would help regulate the proper and ethical utilization of chatbots, such as ChatGPT, and must be established before their introduction to students [ 35 , 38 , 39 , 41 , 89 ].

In summary, our review has delved into the utilization of ChatGPT, a prominent example of chatbots, in education, addressing the question of how ChatGPT has been utilized in education. However, there remain significant gaps, which necessitate further research to shed light on this area.

7 Conclusions

This systematic review has shed light on the varied initial attempts at incorporating ChatGPT into education by both learners and educators, while also offering insights and considerations that can facilitate its effective and responsible use in future educational contexts. From the analysis of 14 selected studies, the review revealed the dual-edged impact of ChatGPT in educational settings. On the positive side, ChatGPT significantly aided the learning process in various ways. Learners have used it as a virtual intelligent assistant, benefiting from its ability to provide immediate feedback, on-demand answers, and easy access to educational resources. Additionally, it was clear that learners have used it to enhance their writing and language skills, engaging in practices such as generating ideas, composing essays, and performing tasks like summarizing, translating, paraphrasing texts, or checking grammar. Importantly, other learners have utilized it in supporting and facilitating their directed and personalized learning on a broad range of educational topics, assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. Educators, on the other hand, found ChatGPT beneficial for enhancing productivity and efficiency. They used it for creating lesson plans, generating quizzes, providing additional resources, and answers learners' questions, which saved time and allowed for more dynamic and engaging teaching strategies and methodologies.

However, the review also pointed out negative impacts. The results revealed that overuse of ChatGPT could decrease innovative capacities and collaborative learning among learners. Specifically, relying too much on ChatGPT for quick answers can inhibit learners' critical thinking and problem-solving skills. Learners might not engage deeply with the material or consider multiple solutions to a problem. This tendency was particularly evident in group projects, where learners preferred consulting ChatGPT individually for solutions over brainstorming and collaborating with peers, which negatively affected their teamwork abilities. On a broader level, integrating ChatGPT into education has also raised several concerns, including the potential for providing inaccurate or misleading information, issues of inequity in access, challenges related to academic integrity, and the possibility of misusing the technology.

Accordingly, this review emphasizes the urgency of developing clear rules, policies, and regulations to ensure ChatGPT's effective and responsible use in educational settings, alongside other chatbots, by both learners and educators. This requires providing well-structured training to educate them on responsible usage and understanding its limitations, along with offering sufficient background information. Moreover, it highlights the importance of rethinking, improving, and redesigning innovative teaching and assessment methods in the era of ChatGPT. Furthermore, conducting further research and engaging in discussions with policymakers and stakeholders are essential steps to maximize the benefits for both educators and learners and ensure academic integrity.

It is important to acknowledge that this review has certain limitations. Firstly, the limited inclusion of reviewed studies can be attributed to several reasons, including the novelty of the technology, as new technologies often face initial skepticism and cautious adoption; the lack of clear guidelines or best practices for leveraging this technology for educational purposes; and institutional or governmental policies affecting the utilization of this technology in educational contexts. These factors, in turn, have affected the number of studies available for review. Secondly, the utilization of the original version of ChatGPT, based on GPT-3 or GPT-3.5, implies that new studies utilizing the updated version, GPT-4 may lead to different findings. Therefore, conducting follow-up systematic reviews is essential once more empirical studies on ChatGPT are published. Additionally, long-term studies are necessary to thoroughly examine and assess the impact of ChatGPT on various educational practices.

Despite these limitations, this systematic review has highlighted the transformative potential of ChatGPT in education, revealing its diverse utilization by learners and educators alike and summarized the benefits of incorporating it into education, as well as the forefront critical concerns and challenges that must be addressed to facilitate its effective and responsible use in future educational contexts. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Data availability

The data supporting our findings are available upon request.

Abbreviations

  • Artificial intelligence

AI in education

Large language model

Artificial neural networks

Chat Generative Pre-Trained Transformer

Recurrent neural networks

Long short-term memory

Reinforcement learning from human feedback

Natural language processing

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

AlAfnan MA, Dishari S, Jovic M, Lomidze K. ChatGPT as an educational tool: opportunities, challenges, and recommendations for communication, business writing, and composition courses. J Artif Intell Technol. 2023. https://doi.org/10.37965/jait.2023.0184 .

Article   Google Scholar  

Ali JKM, Shamsan MAA, Hezam TA, Mohammed AAQ. Impact of ChatGPT on learning motivation. J Engl Stud Arabia Felix. 2023;2(1):41–9. https://doi.org/10.56540/jesaf.v2i1.51 .

Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023. https://doi.org/10.7759/cureus.35179 .

Anderson N, Belavý DL, Perle SM, Hendricks S, Hespanhol L, Verhagen E, Memon AR. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in sports & exercise medicine manuscript generation. BMJ Open Sport Exerc Med. 2023;9(1): e001568. https://doi.org/10.1136/bmjsem-2023-001568 .

Ausat AMA, Massang B, Efendi M, Nofirman N, Riady Y. Can chat GPT replace the role of the teacher in the classroom: a fundamental analysis. J Educ. 2023;5(4):16100–6.

Google Scholar  

Baidoo-Anu D, Ansah L. Education in the Era of generative artificial intelligence (AI): understanding the potential benefits of ChatGPT in promoting teaching and learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4337484 .

Basic Z, Banovac A, Kruzic I, Jerkovic I. Better by you, better than me, chatgpt3 as writing assistance in students essays. 2023. arXiv preprint arXiv:2302.04536 .‏

Baskara FR. The promises and pitfalls of using chat GPT for self-determined learning in higher education: an argumentative review. Prosiding Seminar Nasional Fakultas Tarbiyah dan Ilmu Keguruan IAIM Sinjai. 2023;2:95–101. https://doi.org/10.47435/sentikjar.v2i0.1825 .

Behera RK, Bala PK, Dhir A. The emerging role of cognitive computing in healthcare: a systematic literature review. Int J Med Inform. 2019;129:154–66. https://doi.org/10.1016/j.ijmedinf.2019.04.024 .

Chaka C. Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic: the case of five AI content detection tools. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.2.12 .

Chiu TKF, Xia Q, Zhou X, Chai CS, Cheng M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput Educ Artif Intell. 2023;4:100118. https://doi.org/10.1016/j.caeai.2022.100118 .

Choi EPH, Lee JJ, Ho M, Kwok JYY, Lok KYW. Chatting or cheating? The impacts of ChatGPT and other artificial intelligence language models on nurse education. Nurse Educ Today. 2023;125:105796. https://doi.org/10.1016/j.nedt.2023.105796 .

Cotton D, Cotton PA, Shipway JR. Chatting and cheating: ensuring academic integrity in the era of ChatGPT. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2190148 .

Crawford J, Cowling M, Allen K. Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.3.02 .

Creswell JW. Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook]. 4th ed. London: Pearson Education; 2015.

Curry D. ChatGPT Revenue and Usage Statistics (2023)—Business of Apps. 2023. https://www.businessofapps.com/data/chatgpt-statistics/

Day T. A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. Prof Geogr. 2023. https://doi.org/10.1080/00330124.2023.2190373 .

De Castro CA. A Discussion about the Impact of ChatGPT in education: benefits and concerns. J Bus Theor Pract. 2023;11(2):p28. https://doi.org/10.22158/jbtp.v11n2p28 .

Deng X, Yu Z. A meta-analysis and systematic review of the effect of Chatbot technology use in sustainable education. Sustainability. 2023;15(4):2940. https://doi.org/10.3390/su15042940 .

Eke DO. ChatGPT and the rise of generative AI: threat to academic integrity? J Responsib Technol. 2023;13:100060. https://doi.org/10.1016/j.jrt.2023.100060 .

Elmoazen R, Saqr M, Tedre M, Hirsto L. A systematic literature review of empirical research on epistemic network analysis in education. IEEE Access. 2022;10:17330–48. https://doi.org/10.1109/access.2022.3149812 .

Farrokhnia M, Banihashem SK, Noroozi O, Wals AEJ. A SWOT analysis of ChatGPT: implications for educational practice and research. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2195846 .

Fergus S, Botha M, Ostovar M. Evaluating academic answers generated using ChatGPT. J Chem Educ. 2023;100(4):1672–5. https://doi.org/10.1021/acs.jchemed.3c00087 .

Fink A. Conducting research literature reviews: from the Internet to Paper. Incorporated: SAGE Publications; 2010.

Firaina R, Sulisworo D. Exploring the usage of ChatGPT in higher education: frequency and impact on productivity. Buletin Edukasi Indonesia (BEI). 2023;2(01):39–46. https://doi.org/10.56741/bei.v2i01.310 .

Firat, M. (2023). How chat GPT can transform autodidactic experiences and open education.  Department of Distance Education, Open Education Faculty, Anadolu Unive .‏ https://orcid.org/0000-0001-8707-5918

Firat M. What ChatGPT means for universities: perceptions of scholars and students. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.22 .

Fuchs K. Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse? Front Educ. 2023. https://doi.org/10.3389/feduc.2023.1166682 .

García-Peñalvo FJ. La percepción de la inteligencia artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico. Educ Knowl Soc. 2023;24: e31279. https://doi.org/10.14201/eks.31279 .

Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor A, Chartash D. How does ChatGPT perform on the United States medical Licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023;9: e45312. https://doi.org/10.2196/45312 .

Hashana AJ, Brundha P, Ayoobkhan MUA, Fazila S. Deep Learning in ChatGPT—A Survey. In   2023 7th international conference on trends in electronics and informatics (ICOEI) . 2023. (pp. 1001–1005). IEEE. https://doi.org/10.1109/icoei56765.2023.10125852

Hirsto L, Saqr M, López-Pernas S, Valtonen T. (2022). A systematic narrative review of learning analytics research in K-12 and schools.  Proceedings . https://ceur-ws.org/Vol-3383/FLAIEC22_paper_9536.pdf

Hisan UK, Amri MM. ChatGPT and medical education: a double-edged sword. J Pedag Educ Sci. 2023;2(01):71–89. https://doi.org/10.13140/RG.2.2.31280.23043/1 .

Hopkins AM, Logan JM, Kichenadasse G, Sorich MJ. Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift. JNCI Cancer Spectr. 2023. https://doi.org/10.1093/jncics/pkad010 .

Househ M, AlSaad R, Alhuwail D, Ahmed A, Healy MG, Latifi S, Sheikh J. Large Language models in medical education: opportunities, challenges, and future directions. JMIR Med Educ. 2023;9: e48291. https://doi.org/10.2196/48291 .

Ilkka T. The impact of artificial intelligence on learning, teaching, and education. Minist de Educ. 2018. https://doi.org/10.2760/12297 .

Iqbal N, Ahmed H, Azhar KA. Exploring teachers’ attitudes towards using CHATGPT. Globa J Manag Adm Sci. 2022;3(4):97–111. https://doi.org/10.46568/gjmas.v3i4.163 .

Irfan M, Murray L, Ali S. Integration of Artificial intelligence in academia: a case study of critical teaching and learning in Higher education. Globa Soc Sci Rev. 2023;8(1):352–64. https://doi.org/10.31703/gssr.2023(viii-i).32 .

Jeon JH, Lee S. Large language models in education: a focus on the complementary relationship between human teachers and ChatGPT. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11834-1 .

Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT—Reshaping medical education and clinical management. Pak J Med Sci. 2023. https://doi.org/10.12669/pjms.39.2.7653 .

King MR. A conversation on artificial intelligence, Chatbots, and plagiarism in higher education. Cell Mol Bioeng. 2023;16(1):1–2. https://doi.org/10.1007/s12195-022-00754-8 .

Kooli C. Chatbots in education and research: a critical examination of ethical implications and solutions. Sustainability. 2023;15(7):5614. https://doi.org/10.3390/su15075614 .

Kuhail MA, Alturki N, Alramlawi S, Alhejori K. Interacting with educational chatbots: a systematic review. Educ Inf Technol. 2022;28(1):973–1018. https://doi.org/10.1007/s10639-022-11177-3 .

Lee H. The rise of ChatGPT: exploring its potential in medical education. Anat Sci Educ. 2023. https://doi.org/10.1002/ase.2270 .

Li L, Subbareddy R, Raghavendra CG. AI intelligence Chatbot to improve students learning in the higher education platform. J Interconnect Netw. 2022. https://doi.org/10.1142/s0219265921430325 .

Limna P. A Review of Artificial Intelligence (AI) in Education during the Digital Era. 2022. https://ssrn.com/abstract=4160798

Lo CK. What is the impact of ChatGPT on education? A rapid review of the literature. Educ Sci. 2023;13(4):410. https://doi.org/10.3390/educsci13040410 .

Luo W, He H, Liu J, Berson IR, Berson MJ, Zhou Y, Li H. Aladdin’s genie or pandora’s box For early childhood education? Experts chat on the roles, challenges, and developments of ChatGPT. Early Educ Dev. 2023. https://doi.org/10.1080/10409289.2023.2214181 .

Meyer JG, Urbanowicz RJ, Martin P, O’Connor K, Li R, Peng P, Moore JH. ChatGPT and large language models in academia: opportunities and challenges. Biodata Min. 2023. https://doi.org/10.1186/s13040-023-00339-9 .

Mhlanga D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4354422 .

Neumann, M., Rauschenberger, M., & Schön, E. M. (2023). “We Need To Talk About ChatGPT”: The Future of AI and Higher Education.‏ https://doi.org/10.1109/seeng59157.2023.00010

Nolan B. Here are the schools and colleges that have banned the use of ChatGPT over plagiarism and misinformation fears. Business Insider . 2023. https://www.businessinsider.com

O’Leary DE. An analysis of three chatbots: BlenderBot, ChatGPT and LaMDA. Int J Intell Syst Account, Financ Manag. 2023;30(1):41–54. https://doi.org/10.1002/isaf.1531 .

Okoli C. A guide to conducting a standalone systematic literature review. Commun Assoc Inf Syst. 2015. https://doi.org/10.17705/1cais.03743 .

OpenAI. (2023). https://openai.com/blog/chatgpt

Perkins M. Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.02.07 .

Plevris V, Papazafeiropoulos G, Rios AJ. Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard. arXiv (Cornell University) . 2023. https://doi.org/10.48550/arxiv.2305.18618

Rahman MM, Watanobe Y (2023) ChatGPT for education and research: opportunities, threats, and strategies. Appl Sci 13(9):5783. https://doi.org/10.3390/app13095783

Ram B, Verma P. Artificial intelligence AI-based Chatbot study of ChatGPT, google AI bard and baidu AI. World J Adv Eng Technol Sci. 2023;8(1):258–61. https://doi.org/10.30574/wjaets.2023.8.1.0045 .

Rasul T, Nair S, Kalendra D, Robin M, de Oliveira Santini F, Ladeira WJ, Heathcote L. The role of ChatGPT in higher education: benefits, challenges, and future research directions. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.29 .

Ratnam M, Sharm B, Tomer A. ChatGPT: educational artificial intelligence. Int J Adv Trends Comput Sci Eng. 2023;12(2):84–91. https://doi.org/10.30534/ijatcse/2023/091222023 .

Ray PP. ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys Syst. 2023;3:121–54. https://doi.org/10.1016/j.iotcps.2023.04.003 .

Roumeliotis KI, Tselikas ND. ChatGPT and Open-AI models: a preliminary review. Future Internet. 2023;15(6):192. https://doi.org/10.3390/fi15060192 .

Rudolph J, Tan S, Tan S. War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.23 .

Ruiz LMS, Moll-López S, Nuñez-Pérez A, Moraño J, Vega-Fleitas E. ChatGPT challenges blended learning methodologies in engineering education: a case study in mathematics. Appl Sci. 2023;13(10):6039. https://doi.org/10.3390/app13106039 .

Sallam M, Salim NA, Barakat M, Al-Tammemi AB. ChatGPT applications in medical, dental, pharmacy, and public health education: a descriptive study highlighting the advantages and limitations. Narra J. 2023;3(1): e103. https://doi.org/10.52225/narra.v3i1.103 .

Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023. https://doi.org/10.1186/s13054-023-04380-2 .

Saqr M, López-Pernas S, Helske S, Hrastinski S. The longitudinal association between engagement and achievement varies by time, students’ profiles, and achievement state: a full program study. Comput Educ. 2023;199:104787. https://doi.org/10.1016/j.compedu.2023.104787 .

Saqr M, Matcha W, Uzir N, Jovanović J, Gašević D, López-Pernas S. Transferring effective learning strategies across learning contexts matters: a study in problem-based learning. Australas J Educ Technol. 2023;39(3):9.

Schöbel S, Schmitt A, Benner D, Saqr M, Janson A, Leimeister JM. Charting the evolution and future of conversational agents: a research agenda along five waves and new frontiers. Inf Syst Front. 2023. https://doi.org/10.1007/s10796-023-10375-9 .

Shoufan A. Exploring students’ perceptions of CHATGPT: thematic analysis and follow-up survey. IEEE Access. 2023. https://doi.org/10.1109/access.2023.3268224 .

Sonderegger S, Seufert S. Chatbot-mediated learning: conceptual framework for the design of Chatbot use cases in education. Gallen: Institute for Educational Management and Technologies, University of St; 2022. https://doi.org/10.5220/0010999200003182 .

Book   Google Scholar  

Strzelecki A. To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interact Learn Environ. 2023. https://doi.org/10.1080/10494820.2023.2209881 .

Su J, Yang W. Unlocking the power of ChatGPT: a framework for applying generative AI in education. ECNU Rev Educ. 2023. https://doi.org/10.1177/20965311231168423 .

Sullivan M, Kelly A, McLaughlan P. ChatGPT in higher education: Considerations for academic integrity and student learning. J ApplLearn Teach. 2023;6(1):1–10. https://doi.org/10.37074/jalt.2023.6.1.17 .

Szabo A. ChatGPT is a breakthrough in science and education but fails a test in sports and exercise psychology. Balt J Sport Health Sci. 2023;1(128):25–40. https://doi.org/10.33607/bjshs.v127i4.1233 .

Taecharungroj V. “What can ChatGPT do?” analyzing early reactions to the innovative AI chatbot on Twitter. Big Data Cognit Comput. 2023;7(1):35. https://doi.org/10.3390/bdcc7010035 .

Tam S, Said RB. User preferences for ChatGPT-powered conversational interfaces versus traditional methods. Biomed Eng Soc. 2023. https://doi.org/10.58496/mjcsc/2023/004 .

Tedre M, Kahila J, Vartiainen H. (2023). Exploration on how co-designing with AI facilitates critical evaluation of ethics of AI in craft education. In: Langran E, Christensen P, Sanson J (Eds).  Proceedings of Society for Information Technology and Teacher Education International Conference . 2023. pp. 2289–2296.

Tlili A, Shehata B, Adarkwah MA, Bozkurt A, Hickey DT, Huang R, Agyemang B. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learn Environ. 2023. https://doi.org/10.1186/s40561-023-00237-x .

Uddin SMJ, Albert A, Ovid A, Alsharef A. Leveraging CHATGPT to aid construction hazard recognition and support safety education and training. Sustainability. 2023;15(9):7121. https://doi.org/10.3390/su15097121 .

Valtonen T, López-Pernas S, Saqr M, Vartiainen H, Sointu E, Tedre M. The nature and building blocks of educational technology research. Comput Hum Behav. 2022;128:107123. https://doi.org/10.1016/j.chb.2021.107123 .

Vartiainen H, Tedre M. Using artificial intelligence in craft education: crafting with text-to-image generative models. Digit Creat. 2023;34(1):1–21. https://doi.org/10.1080/14626268.2023.2174557 .

Ventayen RJM. OpenAI ChatGPT generated results: similarity index of artificial intelligence-based contents. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4332664 .

Wagner MW, Ertl-Wagner BB. Accuracy of information and references using ChatGPT-3 for retrieval of clinical radiological information. Can Assoc Radiol J. 2023. https://doi.org/10.1177/08465371231171125 .

Wardat Y, Tashtoush MA, AlAli R, Jarrah AM. ChatGPT: a revolutionary tool for teaching and learning mathematics. Eurasia J Math, Sci Technol Educ. 2023;19(7):em2286. https://doi.org/10.29333/ejmste/13272 .

Webster J, Watson RT. Analyzing the past to prepare for the future: writing a literature review. Manag Inf Syst Quart. 2002;26(2):3.

Xiao Y, Watson ME. Guidance on conducting a systematic literature review. J Plan Educ Res. 2017;39(1):93–112. https://doi.org/10.1177/0739456x17723971 .

Yan D. Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11742-4 .

Yu H. Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Front Psychol. 2023;14:1181712. https://doi.org/10.3389/fpsyg.2023.1181712 .

Zhu C, Sun M, Luo J, Li T, Wang M. How to harness the potential of ChatGPT in education? Knowl Manag ELearn. 2023;15(2):133–52. https://doi.org/10.34105/j.kmel.2023.15.008 .

Download references

The paper is co-funded by the Academy of Finland (Suomen Akatemia) Research Council for Natural Sciences and Engineering for the project Towards precision education: Idiographic learning analytics (TOPEILA), Decision Number 350560.

Author information

Authors and affiliations.

School of Computing, University of Eastern Finland, 80100, Joensuu, Finland

Yazid Albadarin, Mohammed Saqr, Nicolas Pope & Markku Tukiainen

You can also search for this author in PubMed   Google Scholar

Contributions

YA contributed to the literature search, data analysis, discussion, and conclusion. Additionally, YA contributed to the manuscript’s writing, editing, and finalization. MS contributed to the study’s design, conceptualization, acquisition of funding, project administration, allocation of resources, supervision, validation, literature search, and analysis of results. Furthermore, MS contributed to the manuscript's writing, revising, and approving it in its finalized state. NP contributed to the results, and discussions, and provided supervision. NP also contributed to the writing process, revisions, and the final approval of the manuscript in its finalized state. MT contributed to the study's conceptualization, resource management, supervision, writing, revising the manuscript, and approving it.

Corresponding author

Correspondence to Yazid Albadarin .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

See Table  4

The process of synthesizing the data presented in Table  4 involved identifying the relevant studies through a search process of databases (ERIC, Scopus, Web of Knowledge, Dimensions.ai, and lens.org) using specific keywords "ChatGPT" and "education". Following this, inclusion/exclusion criteria were applied, and data extraction was performed using Creswell's [ 15 ] coding techniques to capture key information and identify common themes across the included studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Albadarin, Y., Saqr, M., Pope, N. et al. A systematic literature review of empirical research on ChatGPT in education. Discov Educ 3 , 60 (2024). https://doi.org/10.1007/s44217-024-00138-2

Download citation

Received : 22 October 2023

Accepted : 10 May 2024

Published : 26 May 2024

DOI : https://doi.org/10.1007/s44217-024-00138-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Large language models
  • Educational technology
  • Systematic review

Advertisement

  • Find a journal
  • Publish with us
  • Track your research

Center for Teaching & Learning home

5 Things To Know About ChatGPT

Generative ai tools and resources at ut-austin.

ChatGPT is one of many generative AI tools now being used in educational contexts. We expect that new tools designed for specific purposes and applicable to different disciplinary contexts will be rapidly emerging in the near future. To that end, this resource, focused on ChatGPT, is designed to be adapted to fit different tools and pedagogical approaches. The CTL will continue to update our site with links to UT resources, News articles focusing on generative AI tools, and outlines of suggested approaches to adopting these tools. 

The following is a list of existing UT resources. We will continue to add to this list as new resources are developed. 

  • Recommended Practices for Requiring the Use of Generative AI in the Classroom : The Office of Academic Technology (OAT) and the Office of Academic Affairs have developed recommendations for instructors who wish to require the use of generative AI tools in their classrooms. This guidance will be updated on an ongoing basis. If you have questions about these recommendations, please contact the OAT at  [email protected] .
  • Addressing the Limitations of Using Generative AI for Learning : The Office of Academic Technology (OAT) has developed a set of guidelines for evaluating the limitations of generative AI tools. 
  • Acceptable Use of ChatGPT and Similar AI Tools : This policy-based resource, from the Information Security Office (ISO) at UT-Austin, provides guidance on how to use generative AI Tools safely, without putting institutional, personal, or proprietary information at risk
  • Statement on Artificial Intelligence (AI) Tools in Art & Design Courses : Developed by the AI Tools in Education Taskforce, Arts and Design faculty subcommittee at UT Austin, this document includes resources on best practices for instructors specific to the adoption and use of tools in their classrooms, including syllabus script recommendations.
  • Statement on Artificial Intelligence in Writing Flag Classes : The Faculty Writing Committee in the Center for the Skills and Experience Flags has been reviewing ChatGPT in light of other writing-related AI tools such as grammar checkers, plagiarism detection services, and automated citation systems. This resource is a summary of the committee's guidance, followed by a fuller discussion of high-level key points. Suggestions are grounded in essential writing pedagogy for the use of AI, including chatGPT, in the writing classroom.
  • Texas McCombs' Instructional Innovation Resources : Developed by the the McCombs School of Business, this Canvas resource provides guidance on integrating technology into courses. It contains a rich set of resources and recommendations for ChatGPT/Generative AI. 
  • "Reconsider ChatGPT for Academic Use" ( Daily Texan , February 16, 2023): This article offers the perspective of several students on the use of ChatGPT and generative AI tools. 
  • Summer 2023 Webinars Recordings : Playlist of Summer 2023 CTL sessions on ChatGPT and GenerativeAI 

While questions about the impact of artificial intelligence in higher education are not new, the emergence of a new tool called ChatGPT that uses increasingly popular chatbot technology to generate human-like, long-form writing has opened the door to new curiosities and concerns.

This document provides suggestions for instructors who wonder how this tool may affect their course design and teaching. The content has been generated by our team, our campus community, and nationally/internationally recognized teaching and learning professionals. Please note this is a rapidly evolving issue with new perspectives, articles, and resources emerging regularly. CTL will continue to monitor developments and share them with the campus community as we are able, as well as create new resources and opportunities for interactions to guide our collective thinking.

1. What is ChatGPT? How does it work?

ChatGPT is a type of artificial intelligence model trained to generate coherent, human-like pieces of writing on a given topic. “ChatGPT was optimized for dialogue,” (1) which means users interact with a chatbot in a conversational context, and the chatbot will compose text based upon the user’s prompts. The bot is capable of generating text on a variety of topics and in a variety of styles, “you simply type in a question or give it a command and it generates text for you.” (2)

You may be interested in experimenting with the tool to learn more: https://chat.openai.com   Please be aware that ChatGPT is “free” because it collects information from its users (e.g., when and how users interact with the tool, users’ IP address, browser type, time zone, type of device, operating system, and country) and may share information with third-party vendors and affiliates (3). For those reasons, we suggest you avoid submitting any sensitive or personal information. In addition, we suggest you review the privacy policy and terms of service with students as a learning exercise.

For more information about ChatGPT, our colleague from the Office of Academic Technology Dr. Juile Schell created this brief video on what ChatGPT is, how to sign up for it, and how it works.

Another helpful resource to learn more about Chat GPT is this presentation developed by Dr. Torrey Trust (U Mass Amherst) that includes a variety of previously submitted prompts and completed output. (4)

2. Why is ChatGPT significant?

Students can enter an assignment prompt and receive a product they can turn in as their work. The text generated by the chatbot could be a well-composed and accurate response depending on the complexity of the assignment and the student’s skill in creating effective prompts. Many higher education instructors and scholars testing the tool report mixed responses, including: 

  • ChatGPT-generated papers received B+ to A- minus grades according to a set rubric. 
  • A ChatCPT-generated paper did not flag the Turnitin plagiarism detector tool (i.e., no plagiarism was detected).
  • ChatGPT chatbot produced grammatically well-written papers relevant to the topic, but struggled with creating detailed responses that demonstrate deep understanding
  • ChatGPT was able to do everything asked, including using APA formatting and correct citation; for Nursing content, it was accurate and specific.

In addition, many higher education scholars and practitioners have noted that the tool might be appealing for students in large courses where it can be a challenge to integrate personal approaches to teaching writing and providing in-depth feedback.

3. What are the downsides?

  • Submitting personal information to the OpenAI website without an awareness of how the data will be used by OpenAI
  • Students not mastering skills needed to succeed, such as audience design, global organization, and researching a topic
  • Ethical violations, a lack of integrity
  • Uncritical use of digital technologies

At the same time, there is also a downside to banning this technology and neglecting to understand why it was created and the problems it is attempting to solve.

4. Where is ChatGPT going?

The applications of artificial intelligence technology will continue to evolve in ways that currently may not be clear, requiring ongoing conversations focused on ethics, instructional values, and effective pedagogy.

5. What are the implications for UT Austin instructors?

As a first step, learning about this tool will help instructors gain awareness and know to seek assistance when issues related to ChatGPT arise. In addition, the release of ChatGPT encourages us to revisit the best ways to assess student learning in a variety of instructional contexts (5). It invites us to ask important questions, such as:

  • Why and how do we best equip students as strong writers?
  • What other ways can students demonstrate learning in addition to written papers? 
  • What is the best way to solicit student writing that is meaningful and authentic?
  • If students rely on ChatGPT as a source of information to answer factual questions, how will that affect their development of research skills?

This focus on the relationship between students and instructors and the educational mission of the university fits with broader efforts underway to reinforce the importance of the process of learning, including making and correcting mistakes. The university is in the process of refreshing our honor code and honor code affirmation to renew our commitment to supporting students in their journey to master complex knowledge and skills. 

With these types of questions and issues in mind, we have gathered a variety of suggestions you can pick and choose to incorporate in your teaching practice if students’ use of ChatGPT is relevant for you.

Incorporating one or two of the following approaches may help ease concerns and challenges that could arise with the introduction of the ChatGPT tool:

As you get ready to begin your class by preparing course documents and resources, make sure that you address appropriate or inappropriate uses of generative AI tools such as ChatGPT in a section of your syllabus. You may choose to place it within or near statements address academic integrity. Please explore the Provost's "Your Syllabus at UT Austin" website as well as UT's Student Conduct and Academic Integrity site for additional options and resources.  

As you craft your syllabus statements, you may wish to adopt one of the following three models and use them as templates: 

"The use of artificial intelligence tools (such as ChatGPT) in this class:

  • …is strictly prohibited. This includes using AI to generate ideas, to outline an approach, to answer questions, to solve problems, or to create original language. All work in this course must be your own or created in group work, where allowed).
  • …shall be permitted on a limited basis. You will be informed as to the assignments for which AI may be utilized. You are also welcome to seek my prior-approval to use AI writing tools on any assignment. In either instance, AI writing tools should be used with caution and proper citation, as the use of AI should be properly attributed. Using AI writing tools without my permission or authorization, or failing to properly cite AI even where permitted, shall constitute a violation of UT Austin’s Institutional Rules on academic integrity.
  • …is permitted for students who wish to use them, provided the content generated by AI is properly cited.

If you are considering the use of AI writing tools but are unsure if you are allowed or the extent to which they may be utilized appropriately, please ask."

For additional suggested syllabi statements, please visit our CTL webpage that contains a range of different statements that you may use and adapt.

  • Be clear on what you want your students to know and be able to do or demonstrate by the end of the course and why that knowledge is valuable to their lives. (See this resource for assistance in developing learning outcomes for your course.) Help students see that the ways you are assessing their learning are key to understanding what they are gaining from the course and where they may need extra coaching and support. (6)
  • In particular, “If you can explain to students the value of writing, and convince them that you are genuinely interested in their ideas, they are less likely to reach for the workaround.” (7)
  • Have an open discussion with your students about the ethical implications of ChatGPT and the value of authentic learning for students’ lifelong development as learners. This may include having conversations around digital literacy and bias in research and scholarship, as AI writing tools like ChatGPT are limited to the public source material they have access to on the internet. Don’t feel you have to have all of the answers, as this is a continually evolving issue. (6)
  • Ask students to reference and/or cite class materials, notes, and sources ( particularly sources that are normally behind paywalls but available through the UT Libraries subscription databases and journals. ) in their written assignments. This instruction is valuable because ChatGPT draws on text models from public websites.
  • “Require students to reflect more deeply and critically on course topics. This tip is always a good assessment strategy and ChatGPT currently performs better on more superficial and less detailed responses.” (8)
  • Use in-class time for students to demonstrate knowledge and understanding in a variety of ways through low-tech, low stakes in-person activities like freewriting and live presentations.
  • Craft an assignment where you generate a ChatGPT output based on a prompt and ask your students to critique the response, indicating where it did a good job of articulating key points and what nuances it missed. (For 10 other ways to creatively use ChatGPT in course assignments, see “Update your course syllabus for ChatGPT” ; keep in mind that asking students to engage with ChatGPT may generate privacy concerns, so it may be better practice to provide them with a copy of ChatGPT responses that they can use.)
  • Give a hug: empathy, collaboration, communication, and leadership skills;
  • Solve a mystery: generating questions and problem finding; and
  • Tell a story: finding what's relevant in a sea of data or applying values, ethics, morals, or aesthetic principles to a situation. (9)
  • Carefully scaffold assignments with time and space for students to complete each step along the way, and consider whether the number of time-intensive tasks might require more bandwidth than students have to spend. Students are more likely to utilize a tool like ChatGPT when they are short on time. (6)
  • Treat ChatGPT as a tool that some students may want to use to help get started writing. For example, students who have difficulty starting writing assignments might be encouraged to generate a paragraph with ChatGPT as a stub that enables them to continue writing. As long as the student ultimately adds significant new material and thoroughly edits or ultimately eliminates the output from ChatGPT, they are producing a document that reflects their own work.

One way to help encourage students to make better decisions about using tools such as ChatGPT is to design your classroom climate to engender mastery approaches to learning, which involve a focus on deeply understanding the knowledge and skills rather than simply achieving a particular score on an assessment. In a mastery-oriented classroom, students are more likely to engage in strategies that will help them truly learn the material rather than for the goal of performing a task and receiving a grade for their work.

Three simple tips for encouraging mastery approaches in higher education classrooms include:

  • offering flexible evaluation design: consider providing opportunities for students to revise and redo specific portions of assignments; 
  • focusing feedback on process and effort: offer feedback oriented toward student effort and their learning processes rather than on high grades and performance relative to others. When possible offer elaborative feedback rather than feedback based simply on correctness.
  • building a sense of belonging: discuss, emphasize, and model that making errors and mistakes is part of everyone's learning processes rather than something that only poor performers or people who "don't get it" do.

Larger, Ongoing Issues for UT Austin & Higher Education

UT Austin is putting in place a structure to respond to new developments such as ChatGPT. The Academic Affairs team consists of experts in teaching and learning, assessment, and academic technology. The team also engages with faculty from across campus and welcomes your participation in our activities. This portfolio will convene campus conversations to evaluate investments in tools, technologies, and instructional practices that help us accomplish the objectives articulated in the strategic plan. Excellence in these areas of work can be achieved through strong partnerships and collaborative vision. 

Next Steps for CTL 

  • Continue to learn about the tool and stay updated on new developments
  • Convene campus conversations to hear from multiple perspectives
  • Create resources to support the teaching community
  • Identify policies and practices that advance authentic assessment in courses

In-text citations

  • ChatGPT FAQ | OpenAI Help Center
  • AI ChatGPT Overview.pdf, Center for Teaching and Learning, American University of Armenia
  • ChatGPT, Dr. Torrey Trust
  • ChatGPT & Education, Dr. Torrey Trust
  • What If We Create a Culture of “Transparent Assessment” (AI & AI), Maha Bali
  • Update Your Course Syllabus for chatGPT | by Ryan Watkins | Dec, 2022 | Medium
  • Will ChatGPT Change the Way You Teach? EdSurge Podcast
  • https://utexas.instructure.com/courses/1293240/pages/chatgpt-faculty-resources (unauthorized)
  • 3 Things People Can Do In The Classroom That Robots Can't : NPR Ed

Additional resources

  • Faculty Writing Committee Statement on AI in Writing Flag Classes
  • "Teaching" Newsletter, Jan. 5, 2022, Chronicle of Higher Education
  • Some ill-formed thoughts about AI, robot colleagues, resistance, refusal. Anne-Marie Scott
  • Teaching Experts Are Worried About ChatGPT, but Not for the Reasons You Think, Beth McMurtrie, Chronicle of Higher Education
  • How People Learn II  (See page 121) - Mastery Learning Resources

Acknowledgements:

The content of this document is inspired by the format from the Educause “7 Things You Should Know About” series.

In addition, many of the perspectives and strategies shared in this document were formed through conversation with our colleagues on campus who support teaching and learning at UT, including Brandon Campitelli, Mary Crawford, Linda Neavel Dickens, Rachelle (Shelly) Furness, Mario Guerra, Jeannette Herman, Kristie Loescher, Art Markman, Michele Ostrow, Julie Schell, George Schorn, and Sean White. We are grateful for this growing network of partners that help us respond to rapid changes affecting higher education.

Title: Chatbots and ChatGPT: a bibliometric analysis and systematic review of publications in Web of Science and Scopus databases

Authors : Hamed Khosravi; Mohammad Reza Shafie; Morteza Hajiabadi; Ahmed Shoyeb Raihan; Imtiaz Ahmed

Addresses : Department of Industrial and Management Systems Engineering, West Virginia University, Morgantown, WV 26505, USA ' Department of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran ' School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran ' Department of Industrial and Management Systems Engineering, West Virginia University, Morgantown, WV 26505, USA ' Department of Industrial and Management Systems Engineering, West Virginia University, Morgantown, WV 26505, USA

Abstract : This paper presents a bibliometric analysis of the scientific literature related to chatbots, focusing specifically on ChatGPT. Chatbots have gained increasing attention recently, with an annual growth rate of 19.16% and 27.19% on the Web of Sciences (WoS) and Scopus, respectively. The research consists of two study phases: 1) an analysis of chatbot literature; 2) a comprehensive review of scientific documents on ChatGPT. In the first phase, a bibliometric analysis is conducted on all the published literature from both Scopus (5,839) and WoS (2,531) databases covering the period from 1998 to 2023. Consequently, bibliometric analysis has been carried out on ChatGPT publications, and 45 published studies have been analysed thoroughly based on their methods, novelty, and conclusions. Overall, the study aims to provide guidelines for researchers to conduct their research more effectively in the field of chatbots and specifically highlight significant areas for future investigation into ChatGPT.

Keywords : chatbot; ChatGPT; bibliometrics; artificial intelligence; natural language processing; NLP; generative artificial intelligence.

DOI : 10.1504/IJDMMM.2024.138824

International Journal of Data Mining, Modelling and Management, 2024 Vol.16 No.2, pp.113 - 147

Received: 12 Jul 2023 Accepted: 04 Oct 2023 Published online: 31 May 2024 *

Keep up-to-date

  • Our Newsletter ( subscribe for free )
  • New issue alerts
  • Inderscience is a member of publishing organisations including:

CLOCKSS

  • Open access
  • Published: 30 May 2024

Enhancing AI competence in health management: students’ experiences with ChatGPT as a learning Tool

  • Lior Naamati-Schneider 1  

BMC Medical Education volume  24 , Article number:  598 ( 2024 ) Cite this article

133 Accesses

Metrics details

The healthcare industry has had to adapt to significant shifts caused by technological advancements, demographic changes, economic pressures, and political dynamics. These factors are reshaping the complex ecosystem in which healthcare organizations operate and have forced them to modify their operations in response to the rapidly evolving landscape. The increase in automation and the growing importance of digital and virtual environments are the key drivers necessitating this change. In the healthcare sector in particular, processes of change, including the incorporation of artificial intelligent language models like ChatGPT into daily life, necessitate a reevaluation of digital literacy skills.

This study proposes a novel pedagogical framework that integrates problem-based learning with the use of ChatGPT for undergraduate healthcare management students, while qualitatively exploring the students’ experiences with this technology through a thematic analysis of the reflective journals of 65 students.

Through the data analysis, the researcher identified five main categories: (1) Use of Literacy Skills; (2) User Experiences with ChatGPT; (3) ChatGPT Information Credibility; (4) Challenges and Barriers when Working with ChatGPT; (5) Mastering ChatGPT-Prompting Competencies . The findings show that incorporating digital tools, and particularly ChatGPT, in medical education has a positive impact on students’ digital literacy and on AI Literacy skills.

Conclusions

The results underscore the evolving nature of these skills in an AI-integrated educational environment and offer valuable insights into students’ perceptions and experiences. The study contributes to the broader discourse about the need for updated AI literacy skills in medical education from the early stages of education.

Peer Review reports

Introduction

In recent years, the healthcare sector has undergone significant shifts in both local and global contexts. These shifts are primarily attributed to demographic, technological, economic, and political factors. These changes have had a profound impact on the healthcare ecosystem, requiring organizations to adapt their operations and strategies to this evolving landscape [ 1 , 2 ]. In response, healthcare organizations have had to modify their behavior to adapt to this ever-changing reality [ 3 ]. Among the factors that have most significantly affected the healthcare system are technological advancements, automation, and the rise of digital and virtual environments. The impact of these factors gained momentum in December 2019, primarily due to the COVID-19 pandemic. Technological advances, particularly the rise of artificial intelligence (AI) and digital tools, have been central to this transformation, with the COVID-19 pandemic accelerating the need for healthcare systems to adapt and innovate [ 3 , 4 , 5 , 6 , 7 , 8 ]. The integration of AI in healthcare, including the deployment of chatbots like ChatGPT that utilize the Generative Pre-trained Transformer (GPT)—a type of large language model (LLM)—underscores a shift toward digital and AI literacy in medical education and practice. [ 9 , 10 ].

The adoption of AI in healthcare, highlighted by the use of systems like ChatGPT, marks a pivotal shift towards greater digital and AI literacy in medical education and practice [ 9 , 10 , 11 , 12 ]. This reflects the healthcare sector’s broader move towards technological innovation, aiming to enhance patient care and revolutionize healthcare professional training. Incorporating AI, such as ChatGPT, into educational frameworks prepares students for the complexities of modern healthcare, demonstrating AI’s potential to transform both healthcare delivery and professional skill development [ 11 , 12 ].

In the rapidly evolving landscape of AI, where technological developments are occurring at an accelerated pace, there is a significant need for comprehensive research to navigate this ever-changing landscape. In particular, research into the impact of AI on healthcare is still limited, highlighting the urgent need for more focused studies on the implications for medical education and the effective training of healthcare professionals in the use of AI technologies [ 13 , 14 ]. The emergence of LLMs, such as GPT, and their applications in educational frameworks, including chatbots like ChatGPT, has increased the urgency of reassessing the skills required, with a particular focus on digital literacy. This reassessment is essential to determine the continued relevance of these skills or whether a fundamental refocusing is required. Such a re-examination is essential to ensure that the healthcare workforce is adequately prepared for the challenges and opportunities presented by the integration of AI into healthcare practice [ 11 ].

Studies [ 15 , 16 , 17 , 18 ] have identified a significant gap in understanding how digital literacy skills—such as accessing, analyzing, evaluating, and creating digital content—play a role in effectively leveraging LLMs like GPT and their applications, including chatbots such as ChatGPT, within educational frameworks. Furthermore, the successful integration of ChatGPT into educational settings may potentially lessen the reliance on traditional digital literacy skills, prompting a reevaluation of their ongoing relevance [ 19 , 20 ]. This gap underscores the need for more research into the critical role that digital literacy skills hold in the efficient use of technologies like ChatGPT for educational aims, as highlighted by recent literature [ 15 , 17 , 18 ]. ChatGPT’s access to accurate medical information could reduce the need for individual data analysis skills [ 21 , 22 ]. Yet, concerns persist among researchers that its content generation might hinder critical thinking development, including source evaluation and idea generation [ 23 , 24 ].

This qualitative study introduces a pedagogical framework that synergizes problem-based learning with the application of ChatGPT among undergraduate healthcare management students. It aims to qualitatively examine their interactions with this technology, focusing on the transition from traditional digital literacy towards a more advanced AI literacy. This evolution in educational focus is poised to revolutionize the requisite competencies for navigating the dynamic healthcare sector of today.

The rationale behind focusing on ChatGPT stems from its notable accessibility, user-friendly design, and versatility as a comprehensive tool in healthcare settings. Its capability to simulate human-like dialogues positions it as a prime resource for educational initiatives, thereby enriching the pedagogical domain of healthcare management and clinical practices. The unrestricted access to ChatGPT, along with its wide-ranging utility in executing diverse healthcare operations, underscores its capacity to significantly contribute to and spearhead innovation within healthcare education and practices. The selection of ChatGPT, attributed to its approachability and adaptability, marks a strategic endeavor to investigate the impact of artificial intelligence amidst the shifting paradigms of healthcare requirements. Yet, despite the widespread integration of ChatGPT in healthcare, research into the long-term effects and the necessary adaptation of skills and methods remains lacking. [ 11 , 12 ].

Literature review

Ai tools in medical settings.

AI involves creating systems that mimic human cognitive functions such as perception, speech recognition, and decision-making through machine learning. It excels in analyzing data, identifying patterns, and making predictions, offering improvements over traditional data processing. AI’s applications span multiple sectors, including healthcare, at various levels from individual to global [ 25 , 26 ]. The integration of AI into healthcare enhances diagnostic, treatment, and patient care, offering advanced decision-making and predictions [ 9 , 10 , 25 , 27 ].AI technologies enhance clinical decision-making, diagnosis, and treatment by analyzing patient data through machine learning for informed decisions, offering 24/7 support via AI chatbots, and enabling remote monitoring with AI-powered devices like wearable sensors [ 9 , 28 ].

AI facilitates remote patient monitoring, minimizing in-person healthcare visits [ 29 ]. It improves service personalization, with AI assistants managing appointments and reminders, and chatbots streamlining insurance claims, easing provider workloads [ 9 ]. AI automates routine administrative tasks, freeing providers to concentrate on patient care. It streamlines operations, cuts bureaucracy, and analyzes data to improve healthcare management and predict service demand, allowing for better resource allocation. AI’s analysis of patient feedback further aids in enhancing service delivery [ 10 ]. AI integration can transform patient-caregiver dynamics, enhancing diagnosis, treatment, and self-management of health conditions [ 30 ]. While AI integration in healthcare promises significant advancements, it presents challenges, including data management issues and the need for specialized skills.

Sallam [ 14 ] highlights ChatGPT’s potential advantages in healthcare, including enhancing clinical workflows, diagnostics, and personalized medicine. However, challenges such as ethical dilemmas, interpretability issues, and content accuracy must be tackled. In healthcare education, although ChatGPT holds promise for customized learning and creating lifelike clinical scenarios, concerns about bias, plagiarism, and content quality persist. Addressing these concerns necessitates preparing healthcare professionals and students through education and training to navigate the complexities of AI. Additionally, extensive research in these domains is essential [ 6 , 9 , 14 , 31 , 32 ].

Teaching with AI and about AI: advancing education in the digital age

To be able to utilize AI tools effectively and integrate them seamlessly into their everyday work, healthcare professionals need early exposure to AI tools in their education to boost their proficiency and confidence, understanding both their potential and limitations [ 9 , 32 , 33 ]. York et al. [ 32 ] explored medical professionals’ attitudes towards AI in radiology, revealing a positive outlook on AI’s healthcare benefits but also highlighting a notable gap in AI knowledge. This emphasizes the need for enhanced AI training in medical education.

According to Sallam [ 14 ], ChatGPT and other models based on lLLMs have significantly improved healthcare education. They customize responses to student inquiries, curate relevant educational material, and tailor content to individual learning styles. For instance, ChatGPT generates personalized quiz questions, suggests resources to fill knowledge gaps, and adjusts explanations to suit diverse learning preferences. Moreover, it simplifies complex medical concepts, employs analogies and examples for clarity, and offers supplementary materials to enhance comprehension.

Breeding et al. [ 11 ] argued that in medical education, ChatGPT should be viewed as a supplementary tool rather than a substitute for traditional sources. While it offers clear and organized information, medical students still perceive evidence-based sources as more comprehensive. Eysenbach [ 33 ] engaged in a series of dialogues with ChatGPT to explore its integration into medical education. ChatGPT demonstrated proficiency in various tasks, such as grading essays, providing feedback, creating virtual patient scenarios, enhancing medical textbooks, summarizing research articles, and explaining key findings. Nevertheless, it also demonstrated a tendency to produce erroneous responses and fabricated data, including references. Such inaccuracies have the potential to generate student misconceptions, spread misinformation, and cause a decline in critical thinking skills [ 33 ]. Han et al. [ 34 ] conducted a comprehensive examination of ChatGPT’s effectiveness as a pedagogical tool in medical education, focusing on the chatbot’s interaction with delineated educational objectives and tasks. Their findings suggest that while ChatGPT is capable of providing elementary data and explanations, it is not impervious to constraints and sometimes provides incorrect or partial information. The study stresses active learning and analytical reasoning in medical education, emphasizing the importance of understanding basic sciences and the need for expert oversight to ensure AI-generated information accuracy [ 34 ].

Das et al. [ 35 ] evaluated ChatGPT’s efficacy in medical education, focusing on microbiology questions at different difficulty levels. They found that ChatGPT could answer basic and complex microbiology queries with roughly 80% accuracy, indicating its potential as an automated educational tool in medicine. The study underscores the importance of ongoing improvements in training language models to enhance their effectiveness for academic use [ 35 , 36 ].AI implementation in healthcare must be carefully managed to maximize benefits and minimize risks [ 11 , 12 , 35 , 36 ]. With the rapid development of digital technologies and AI tools, particularly in healthcare, students need appropriate resources to use these technologies effectively [ 37 ]. Digital literacy is essential in the 21st century, including skills for interacting with digital content [ 16 , 18 ]. Hence, medical literacy skills should start early in the education of healthcare students.

Digital literacy and eHealth literacy skills

Digital literacy skills encompass a collection of essential abilities necessary for using digital technologies effectively in accessing and retrieving information [ 38 ]. These skills are often viewed as foundational digital literacies that are critical for full participation in the digital era [ 39 ]. The European Commission emphasizes the importance of digital literacy for employability and citizenship. They advocate for policies and programs to enhance digital skills across all segments of society. The EU aims for 70% of adults to have basic digital skills by 2025, focusing on analytical, evaluative, and critical thinking abilities crucial for assessing digital information’s quality and credibility [ 40 ]. Individuals need these skills to discern biases and misinformation in various media formats [ 16 , 17 , 41 ] and evaluate the credibility of online sources [ 42 ]. Critical thinking is crucial for distinguishing between accurate information and misinformation [ 43 ], while data literacy is essential for interpreting data and detecting misleading statistics [ 44 ]. These competencies are fundamental for navigating today’s complex digital information landscape.

eHealth literacy, which incorporates the digital skills needed to access and utilize medical information from digital platforms [ 45 ], is gaining recognition as an integral component of overall health literacy. Enhanced online medical literacy is vital for healthcare professionals and administrators [ 46 ] to adapt to changing demands and improve care management within evolving healthcare paradigms [ 47 ]. Additionally, acquisition of digital competencies has been identified as a valuable strategy that healthcare providers and managers can use to manage the psychological effects of heightened workloads and uncertainty, such as the fear, stress, and anxiety emerging from the COVID-19 pandemic [ 48 ]. These skills enable individuals to use AI as both an independent tool and a supplementary aid in decision-making. However, addressing challenges like bias and academic integrity is crucial when integrating AI into medical education [ 32 , 33 , 49 ]. Critical thinking skills are essential for analyzing digital information, identifying inconsistencies, and evaluating arguments. In today’s era of misinformation, users must verify the accuracy of online content and distinguish between reliable sources and hoaxes [ 43 ]. Data literacy skills are also crucial for interpreting data accurately, detecting misleading statistics, and making informed decisions based on credible sources in the digital age [ 44 ].

Research on digital literacy emphasizes the importance of analytical and evaluative skills. Morgan et al. [ 17 ] found that higher education students struggle most with evaluating digital content for bias and quality. They excel in social literacy skills like communication. This highlights the need to prioritize adaptability in digital literacy, integrating industry-relevant experiences into education to ensure students can navigate and critically assess digital information for real-world applications.

Indeed, since the introduction of ChatGPT in 2022, it has been beneficial in various educational contexts. Nevertheless, concerns have been raised about potential inaccuracies and misinformation that may affect student learning and critical thinking [ 20 ]. Moreover, the potential redundancy of certain digital skills as a result of ChatGPT’s capabilities has also sparked discussions on changing educational objectives [ 19 , 21 , 22 ]. The development of ChatGPT may replace some digital skills as it takes over tasks previously expected of students. Researchers [ 21 , 22 ] argue that it is constantly improving its ability to access accurate medical information, providing reliable advice and treatment options from reputable sources. This ability may render the need for individuals to be adept at information retrieval and evaluation redundant. In other words, ChatGPT’s growing proficiency in tasks such as translation, text summarization, and sentiment analysis, and its ability to generate content like movies [ 23 ] may potentially lead to the underdevelopment of critical thinking skills, including the ability to evaluate source quality and reliability, formulate informed judgments, and generate creative and original ideas [ 24 ]. Indeed, the integration of AI into the healthcare sector raises critical questions about the nature and scope of the digital skills required in the future [ 19 , 20 ].

As AI advances, essential digital competencies may need reassessment to keep pace with technology. This requires forward-thinking digital literacy initiatives, particularly in healthcare education and practice. Proactively addressing the potential impact of AI on human interactions with digital healthcare technologies is critical. This will ensure that healthcare professionals and students are skilled in current digital practices, and prepared for the evolving role of AI in the sector. Despite the swift integration of AI tools in healthcare, and applications like ChatGPT, research on their long-term impacts, effects on users, and the necessary adaptation of skills and methodologies in the ever-evolving learning environment remains insufficient [ 11 , 12 , 15 , 17 , 18 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 ].

This study aims to address the intersection of AI adoption in healthcare and its implications for medical education, specifically focusing on the skills required by healthcare professionals. With the rapid incorporation of AI, into healthcare settings, there is an urgent need to reassess the digital literacy skills traditionally emphasized in medical education. This reassessment prompts questions about the ongoing relevance of these skills as AI technologies continue to evolve and expand their role in healthcare [ 13 , 15 , 16 , 17 , 18 , 19 , 20 ].

Research questions

Given the context, this study aims to explore the following qualitative research questions:

How does a pedagogical framework integrating problem-based learning with ChatGPT affect healthcare management undergraduates’ digital literacy skills?

What are students’ experiences with the combined use of problem-based learning and ChatGPT in their healthcare management education?

How do students perceive the shift towards AI-relevant skills as a result of engaging with this integrated pedagogical approach?

Methodology

Methodological approach.

The present research adopts the case study methodology, which entails in-depth empirical research of a current phenomenon within its real-world context [ 50 ]. This approach involves collecting data on human activities within a defined time and space setting, thereby facilitating an understanding of the various processes occurring within the research case. In qualitative research, and particularly in case study research, themes are formulated from the participants’ narratives, thus allowing for the development of arguments or generalizations derived deductively from participants’ statements [ 51 ]. By focusing on our research questions and using a methodological framework that emphasizes depth and context, the study aims to shed light on the transformative impact of AI on medical education and the development of the skills required for future healthcare professionals.

The research was conducted and analyzed by the researcher, who has a PhD in Healthcare Management and over 15 years of experience in qualitative analysis. Her expertise ensures a deep understanding of the study’s qualitative data. Throughout the research, she engaged in continuous reflexive practices to evaluate how her subjectivity and context influenced the study. This included reflecting on her assumptions, considering power dynamics with participants, aligning research paradigms and methods, and understanding the research context [ 59 ].

Participants and research population

The study involved 89 third-year undergraduate students enrolled in a Health System Management degree program, specifically participating in a course on Service Quality in the Healthcare System during the 2023 academic year. The researcher, serving as the lecturer for this course, integrated writing reflective journals into the curriculum as part of the learning process. Following the course’s conclusion and after grades were distributed, the researcher asked students, in adherence to ethical guidelines, if they consented to have their reflective journals analyzed for research purposes, as outlined in the data collection section. Only students who completed all components of the intervention plan outlined for the class were considered potential participants in the research population.

From this group, qualitative data was extracted from the reflective journals of 65 students who consented to participate. The demographic breakdown of this participant subset included 80% females, with an average age of 24.26 years (Standard Deviation = 3.80).

Data collection

Throughout the course, participants were required to keep a reflective journal documenting their learning journey, to be submitted at the end of the semester. The aim of writing the journal was to capture their personal perceptions of their learning experience. They were encouraged to articulate various challenges, obstacles, and positive and negative aspects they encountered [ 52 ]. Specifically, they were asked to describe the main challenges they faced and the obstacles they overcame, and to provide an introspective account of their experiences. The practice of writing a personal journal not only served as a tool for reflection but also helped them adopt a comprehensive perspective on their educational process [ 53 ].

The credibility of the reflective journal prompts was assured by grounding their development in an extensive literature review and expert consultations within the field of healthcare education. This process ensured that the prompts accurately reflected the constructs of interest, facilitating consistent and meaningful student reflections. Content validity was emphasized to ensure the journal prompts were aligned with the study’s objectives and relevant to students’ experiences in healthcare management education. Refinement of these prompts to effectively meet research objectives was facilitated through expert input. A detailed coding scheme was developed, featuring definitions and categories reflecting the study’s aims and insights from the journals. The coding was applied to a subset of journals by the researcher to ensure credibility.

The data were collected from the reflective journals in accordance with the intervention plan outlined in the Instructional Method section. The study carefully complied with several ethical guidelines for research with human subjects. The nature and purpose of the research were fully explained to the students, with particular emphasis on the use of reflective journals to evaluate the intervention plan. The students gave their informed consent and signed consent forms. To ensure confidentiality, participants were informed that all names would be replaced by pseudonyms and all identifying details would be removed from the final research report. They were also explicitly told that the journal entries would be processed anonymously. The research was approved by the college’s Ethics Committee.

Instructional method procedure (intervention plan)

The focus of this study is a required course titled Introducing Quality into the Health System, which had formerly been taught using traditional frontal teaching methods. The study examines the transformation of this course into a course taught using ChatGPT-mediated online guided learning. This innovative learning approach provides learners a comprehensive experience that entails self-directed learning. The approach emphasizes problem-based learning and focuses on identifying ethical dilemmas and analyzing them within organizational contexts. The intervention plan was strategically organized into five primary stages. Each stage comprised a series of carefully constructed steps that were specifically designed to build upon the knowledge and skills acquired in the previous stages, thus ensuring a coherent and cumulative educational progression. Figure  1 summarizes the instructional method.

Initial Familiarization with ChatGPT

At the beginning of the course, students were introduced to ChatGPT to develop their understanding and proficiency with the tool. This involved providing them detailed instructions on effective usage and encouraging them to engage in interactive dialogues with ChatGPT. The aim was to foster a sense of familiarity and ease, thereby facilitating an informal, hands-on learning experience.

Exploratory Analysis of a Dilemma using ChatGPT

In this exploratory stage, students began to examine the topic of hospital accreditation. Through interactions with ChatGPT, they were introduced to the pros and cons of the accreditation process and to the dilemmas posed by following the accreditation guidelines. The issue of accreditation is central to the discourse on how to improve healthcare quality, but it is also fraught with challenges, such as staff shortages and funding issues. Hospitals have had to make significant changes to meet accreditation standards, leading to debates about possible abolition of the accreditation system. While accreditation is crucial for quality control, its associated costs, particularly those related to inspections and the need for additional staff, pose significant challenges. Without proportional funding, compulsory accreditation has placed financial pressures on hospitals, creating a complex dynamic for both the Ministry of Health and healthcare institutions as they navigate the accreditation process.

To explore the topic of accreditation in depth, students were instructed to develop a series of questions to input to ChatGPT aimed at extracting detailed information about the accreditation dilemma. Students engaged with ChatGPT by posing questions and critically analyzing the answers from three perspectives: organizational, healthcare worker, and patient/customer. They iteratively refined their queries to increase precision until they achieved a comprehensive understanding. Following guidelines, they condensed and reorganized the information into a structured paragraph, incorporating the core dilemmas and arguments from each perspective. To meet objectives, students demonstrated digital media skills, including locating and sharing relevant materials, analyzing ChatGPT responses, verifying sources, and assessing content credibility.

Synthesis and Documentation of Concepts Emerging through ChatGPT Interaction

In the third stage, students were required to submit a comprehensive list detailing new concepts, themes, and sub-themes that emerged from their learning experience with ChatGPT. Their submitted list was not limited to the final results, but also included documentation of all stages of their work, including their initial set of questions, their subsequent refinement of these questions, and the process of their development throughout the learning journey. In addition, they were required to provide a final section summarizing the culmination of their exploration and learning process with ChatGPT. This comprehensive approach was designed to demonstrate the students’ engagement and progression with the tool and to highlight their ability to develop their inquiries and synthesize information effectively.

Analytical Structuring of Learning Outcomes

In the fourth stage, students attempted to refine the learning outcomes they had previously generated. Following the established guidelines, their main objective was to identify and highlight the pros and cons of the various arguments related to the dilemmas they had studied, making sure to consider them from different perspectives. The challenge was to present their arguments in a coherent and logical order, for example by comparing budgetary considerations with quality considerations. They were also expected to support each argument with scientific evidence, thereby aligning their analysis with academic accuracy and empirical research. This stage was crucial in developing their ability to critically evaluate and articulate complex issues, particularly in the field of healthcare.

Final project: Integrative Analysis and multidimensional presentation

In the final stage, students developed and presented a final project, building upon their prior work to explore a comprehensive research question or delve into a specific aspect of their study. This included presenting organizational and managerial viewpoints. The choice of format and tools for their project and presentation—ranging from e-posters and slides to video clips, using familiar technologies like PowerPoint and ThingLink—was left to the students. This method fostered diversity and empowered students by allowing them to select their preferred presentation technique. Moreover, the project featured a peer review phase where students critiqued each other’s work through insightful questions and suggestions, enhancing the discussion. This interactive element aimed to bolster critical thinking and collaborative learning.

figure 1

Summary of instructional method

Reflective Journaling: documenting the Learning Journey

Throughout the semester, students kept a reflective journal, which they submitted at the end of the course. The primary aim of this journal was to document their personal learning experiences. The journal provided a window on their challenges, difficulties and successes they encountered, all viewed through the lens of their own perceptions and experiences.

Data analysis

The present research employed a deductive-inductive method for categorical analysis of the dataset. Integration of these deductive and inductive approaches was essential to facilitate investigation of predefined categories that are grounded in extant literature and theoretical frameworks, as well as to permit the discovery of novel categories that surfaced during the analysis process [ 51 ]. Initially, the deductive stage was conducted, focusing on predefined categories derived from existing literature and theoretical frameworks. Following this, the inductive stage allowed for the identification and development of novel categories based on the data analysis. The inclusion of episodes, thoughts, and feelings expressed by the students in this study serves to reinforce the reliability of the identified themes. The analysis of the reflective journals began with in-depth reading to identify initial themes from students’ narratives. Inductive coding facilitated the identification and development of themes by the researcher, rather than merely allowing them to ‘emerge.’ This active interpretation and organization of the data by the researcher led to a compilation of key insights. After ensuring the reliability and validity of these findings through careful review, the researcher then organized the codes into themes and sub-themes, ensuring they accurately reflected the data and provided a clear narrative of the students’ experiences.

The findings

The researcher’s analysis of the reflective journals actively uncovered five main categories: (1) Use of Literacy Skills; (2) User Experiences with ChatGPT; (3) ChatGPT Information Credibility; (4) Challenges and Barriers when Working with ChatGPT; (5) Mastering ChatGPT Prompting Competencies. Table  1 summarizes the identified categories and subcategories. To further clarify each category, the table includes representative quotations from the data for illustrative purposes. Throughout the manuscript, pseudonyms have been used with quotations. This approach ensures confidentiality and anonymity for all participants.

Use of literacy skills

The category comprising the use of literacy skills, the code refers to instances where participants relate literacy skills such as reading comprehension, searching evaluation of Information, etc., in their interactions with ChatGPT.

It includes three subcategories: Search Strategies and Access to Data in ChatGPT Use; Data Analysis Enhancement with ChatGPT ; and Evaluation of Information in ChatGPT Interactions Search Strategies and Access to Data in ChatGPT Use.

In the reflective journals, the students consistently expressed their high regard for the efficiency and ease of searching for and accessing information through ChatGPT. The chat interface significantly improved the process of retrieving information by removing the necessity to navigate through multiple websites or sources, thereby making the material more accessible. Furthermore, the interface’s user-friendly and accessible content format played a crucial role in significantly enhancing students’ understanding of the material. Shir wrote: The chat was super easy and helpful in making the dilemma clearer for me. It put all the info I needed in one spot, and everything was explained in a way that was simple to understand.

The analysis of the student journals underscored the remarkable proficiency of ChatGPT in rapidly and effortlessly providing information for various tasks. This technology alleviated the necessity for students to delve into multiple sources, offering a direct approach for understanding concepts, interpreting implications, and compiling data for complex issues. ChatGPT’s swift and handy information retrieval supported autonomous learning on the topic. As an accessible and user-friendly tool, it saved considerable time. Moreover, its accessibility and constant availability helped in tailoring learning experiences to fit the learner’s schedule, independent of external factors or intermediaries. ChatGPT’s use of simple, everyday language, coupled with its capacity to deconstruct and elucidate complex concepts, rendered it exceedingly approachable and beneficial for information searches and for enhancing the accessibility of educational content. Lihi also acknowledged the efficacy of ChatGPT in facilitating the rapid acquisition and expansion of her conceptual knowledge. She underscored that the ChatGPT tool obviated the need to consult multiple databases and websites for extracting conceptual information: ChatGPT is really fast and easy to use when you need info on lots of different things. It’s great for finding technical stuff, explaining problems, understanding things better, and getting new ideas on the spot. You don’t even have to go looking for more sources – it’s all right there.

Data synthesis and analysis enhancement with ChatGPT

Analysis of the reflective journals indicates that students found the synthesis, editing, and analysis of content facilitated by ChatGPT to be extremely beneficial. The tool significantly reduced the technical complexity of gathering and synthesizing information from different sources, tasks that had previously been their responsibility. As a result, they were spared the need for synthesizing, editing, and analyzing the raw data, with ChatGPT efficiently performing these functions on their behalf. Meir wrote: ChatGPT really helped us out. It gave us a full picture of the whole process, including the good and bad parts, and how to handle them. We didn’t even need to look at any other info sources at that point .

Evaluation of information in ChatGPT Interaction

The streamlined data collection procedures enabled the students to engage in more advanced learning processes, such as distinguishing between facts and assumptions, differentiating critical from non-critical information, and developing arguments as they advanced to more complex stages. The students observed that although ChatGPT presented data objectively, it did not offer explicit arguments, thus requiring them to actively interpret and formulate their own positions regarding the dilemma and identify the foundational principles for their principal arguments. For example, Miri’s reflections highlighted her need to formulate and develop a stance on the dilemma, which compelled her to engage in critical assessment of the situation:

ChatGPT didn’t really point out which arguments were more important or less important. It kind of listed them all the same way, which made me decide for myself what to focus on. I had to pick the arguments I thought were key and then find evidence to back them up.

Furthermore, the students were asked to support their arguments with evidence from the academic literature, necessitating a thorough evaluation and critical analysis of the information. This process led them to make informed decisions and formulate solutions. In their reflective journals, students documented a cautious approach, emphasizing the need not to simply accept information as it is presented. Instead, they highlighted the importance of thoroughly evaluating the information’s accuracy. Amir similarly addressed this issue, noting his necessity to independently navigate the “thinking part” and acquire the skills to construct strong arguments or effectively employ academic resources: The chat didn’t really help me figure out what’s important and what’s not when I write. It also didn’t teach me how to make strong arguments or how to use academic stuff to back up my points.

User experiences with ChatGPT

This category refers to the qualitative data related to participants’ overall experiences, perceptions, and attitudes towards interacting with ChatGPT. The theme of user experiences is divided into three sub-themes: Time Efficiency using ChatGPT; Accessibility and Availability of ChatGPT; and User-Friendly Dynamics . Overall, analysis of the students’ reflective journals reveals broad agreement about ChatGPT’s user-friendliness and ease of use. Many students noted the chatbot’s intuitive interface and straightforward functionality, which made it accessible to those who may not be tech-savvy. This consensus highlights the effectiveness of ChatGPT as a tool that simplifies information acquisition and supports learning without the typical complexities associated with advanced technological tools.

Time efficiency using ChatGPT

In this sub-category, analysis of the student journals revealed the major time-saving benefits of using ChatGPT for various tasks. ChatGPT successfully eliminated the need for students to sift through numerous sources of information. By providing a straightforward way to understand a concept, grasp its implications, and gather information on complex dilemmas, ChatGPT demonstrated its efficiency in saving students’ time. Riad mentioned the significant time efficiency gained from using the tool, highlighting how it saved him considerable time: You can find out a lot about all sorts of things really quickly. The chat gives you detailed breakdowns and explanations, sorting everything into different arguments and topics; it saves you a lot of time.

Ali also referred to this point: I was not very familiar with the details of accreditation, including its benefits and challenges, but within minutes I was able to grasp its essence and understand the importance of the whole process.

The time efficiency extended not only to data retrieval and collection but also encompassed information synthesis, significantly reducing the amount of time usually required for comprehensive and coherent processing and reformulating of acquired data. Mai observed that the time saved was also because she didn’t need to search for data across multiple sources and combine it together:

The amount of time I save is insane. If I had to search for this stuff on the internet instead of using the chat, it would take me way longer to find an answer. And even after finding it, I’d have to summarize what I found and then rephrase it in my own words, which takes so much time.

Accessibility and availability of ChatGPT

A majority of the students noted that the tool’s immediate accessibility and availability significantly facilitated the personalization of learning approaches. This customization seamlessly interfaced with the unique scheduling needs of each learner, offering flexibility that in traditional learning settings is typically constrained by external factors or intermediaries. Hana highlighted ChatGPT’s anytime, anywhere accessibility through a simple interface, enabling quick and comprehensive responses without the wait for expert assistance: ChatGPT is available to use anytime, anywhere using a simple and convenient interface. This would allow you to get a quick and comprehensive response at any time of the day, without having to wait around for people or experts to help you out.

Lina similarly noted: It’s pretty great how available it is (as long as it’s not too busy…). Any question I have, I get an answer. It saved me a lot of Google searches and reading articles and stuff. I get a quick and clear answer to everything I ask and it’s all super fast.

ChatGPT Information credibility

This category involves instances where participants discuss the credibility, reliability, and trustworthiness of the information provided by ChatGPT. Analysis of the reflective journals showed that interaction with ChatGPT facilitated students’ ability to acquire fundamental knowledge, which could then be expanded upon through subsequent inquiries and verification. Nevertheless, as students proceeded in their tasks, particularly those that required articulating arguments and substantiating their stances on complex dilemmas, they acknowledged the limitations of relying solely on ChatGPT. These limitations focused primarily on concerns about the tool’s credibility in providing sufficiently authoritative information. In this regard, Ofri appreciated ChatGPT’s quick access to information but expressed concerns over its credibility and occasional inaccuracies, leading to unexpected disappointment:

I have found that ChatGPT has a lot of good points. It can quickly give you a lot of information on so many topics and you can really use that information. But I have also learned that this tool has its drawbacks. It is not always right, and it certainly doesn’t always give you things that are based on solid academic facts. Sometimes ChatGPT just makes things up. To be honest, realizing this was a bit of a shock to me.

Students also noted that they were often faced with an overwhelming amount of information, some of which was irrelevant or incorrect, requiring them to evaluate the information and determine its quality. Dalia noted that while ChatGPT provided extensive information initially, aiding in learning about the topic, it also required discernment to distinguish between accurate and less relevant information: In the first stage, the chat gave us a lot of information, which was great because it helped us learn more about the topic. But at the same time, we had to decide which information was really important and accurate and which wasn’t.

Students’ understanding of the limitations of relying solely on the information provided to justify arguments and articulate positions in dilemmas motivated them to examine and assess its reliability. They did so by asking specific questions and consulting established academic references. From the students’ point of view, this careful research and critical evaluation process not only provided them with the opportunity to refine their powers of critical thinking and analysis, it also equipped them with the capacity to critically evaluate the credibility of the information presented. Lina wrote:

I attempted to back up the info I found with academic sources, but then I figured out that the chat isn’t always reliable…. I went through each article that I got results from…to check where is it from, and whether the author actually existed or was just made up… After that, I did another check with other databases. This whole process made me super cautious and thorough in checking everything.

The students expressed unanimous agreement that the need to assess the information provided by the chat forced them to be critical and use evaluation skills. Not only was this a skill they needed to be able to put to good use. It also constituted a challenge in using ChatGPT, as Limor stated that, contrary to reducing critical thinking, proper use of ChatGPT can enhance it by prompting users to reconsider and verify information, despite the challenge:

It might seem that using ChatGPT would make you think less because, well, it’s like chatting to a robot. But actually, if you use it properly and really get into it, it adds a lot to your knowledge and makes you think more broadly and deeper. This is because it makes you think about things over and over again, and double-check the information… it wasn’t easy.

Challenges and barriers in Working with ChatGPT

This category encompasses the various obstacles, difficulties, and limitations encountered by participants while using ChatGPT, including technical issues, comprehension challenges, and frustration. The analysis suggests that despite the students’ widespread agreement on the advantages of using ChatGPT, such as its ease of use, constant availability, and user-friendliness, its accompanying challenges should also be considered. Among these challenges are hesitation in adopting new, cutting-edge technology, difficulties in learning how to use the tool, and language barriers. The language issue was particularly significant, as ChatGPT operates mainly in English, which is not the first language of many of the students. Shir faced difficulties with English translation but viewed it as an opportunity to improve language skills, eventually becoming more comfortable with the chat and reducing reliance on outside translation help:

One big problem I had was writing in English and then translating it to express what I wanted to say. But I decided to take it on as a challenge and use it as a chance to improve my reading and writing in English. Since we didn’t have to use English much, at first it felt like it took forever to understand or read stuff. But gradually, we got the hang of the chat and didn’t need as much help with translating from outside sources.

Some students noted that they also faced some technical issues, revealing the downside of depending exclusively on online tools for studying. For many students, this was their first time using AI including applications like ChatGPT that are built on large language models. As they continued to use it, however, they became more accustomed to it. Ali found initially accessing the GPT chat difficult and, despite its ease of use, experienced issues with site access due to high traffic and occasional freezing, hindering continuous use:

When I first tried the GPT chat for my task, it was a bit tough to get onto the site. But after a while, I noticed that even though the chat is easy to use, it’s got its problems. Sometimes, you can’t even get into the chat because too many people are trying to use it at the same time, and other times, it just freezes up, and you can’t keep using it.

Mastering ChatGPT-Prompting competency

This category involves instances where participants demonstrate proficiency in formulating effective prompts and questions to elicit accurate and relevant responses from ChatGPT. Analysis of the reflective journals revealed that this theme posed a notable challenge for the students, primarily due to their unfamiliarity with the tool. Indeed, they needed to learn how to use the chat effectively to elicit the correct responses and achieve their desired outcomes. Additionally, they encountered challenges in ensuring accuracy and setting the right parameters to establish a reliable and precise database. Despite these obstacles, the students recognized that their efforts to achieve accuracy and their practice of asking repetitive questions were instrumental in developing higher-order thinking skills and being able to organize and manage the required information proficiently. Liya related to this challenge by noted that dealing with inaccurate responses from the model involves clarifying questions with more details, considering alternative answers, and emphasizing the importance of verifying the information received:

Sometimes the model may give you wrong information or answers… to cope with getting answers that are not accurate, you should make your question clearer and add more details. Also think about using different choices of answers. And it is really important to always check the answers you’re getting.

Analysis of the reflective journals showed that systematic demonstration of these activities, along with comprehensive detailing of early learning stages and the cumulative nature of the tasks, provided students the chance to assess and revisit each step retrospectively. This reflective review allowed them to seek explanations for any aspects that were unclear, ask more questions and craft more targeted prompts, and gain a deeper understanding of the entire process. Rim, for example, explained: The chat lets us get information in a series, like being able to ask another question to get a better understanding or clear up something from the first questions we asked. This helped us keep track of everything by linking all our questions together.

Nir noted that the need to aim for accuracy by repeatedly refining the questions really helped in dealing with the assigned tasks effectively:

From my experience with ChatGPT, I have learned that if you want good answers, you have to be really clear about what you are asking. You need to know what you want to achieve with the chat. It is best to give specific instructions to obtain the exact info you need. Also, you should think carefully about the answers you get, making sure the facts are right, and using your own thinking to make wise decisions.

This qualitative study examined the process of introducing and using a pedagogical framework that integrates problem-based learning with the use of ChatGPT among undergraduate healthcare management students. The study also provided a qualitative exploration of their experiences using this technology and assessed how the use of ChatGPT can shift the focus from traditional digital literacy skills to advanced AI literacy skills. It demonstrated how the use of the ChatGPT platform can be managed to encourage the development of critical thinking and evaluation skills through active student engagement. These skills are considered critical for learning and working with AI platforms.

The analysis of students’ reflective journals indicated a perception of the platform as user-friendly. Minichiello et al. [ 54 ] expand the definition of “user experience” beyond mere interaction with user interfaces to include design, information presentation, technological features, and factors related to emotion, personal connection, and experience. Students described their experience with the platform positively, citing it as an incentive for ongoing engagement.

The analysis also showed that the platform’s efficiency was significantly influenced by its high availability and accessibility, which were key factors in its attractiveness to users. This attractiveness was further enhanced by its ease of use. A critical aspect of the platform’s effectiveness was its efficiency in providing key materials in a timely manner, drastically reducing the time required to retrieve information. Users particularly appreciated this aspect of the platform as it streamlined their access to information and significantly improved their learning efficiency. The platform’s ability to deliver relevant information quickly and efficiently was instrumental in its positive reception. In an academic environment where efficient time management and quick access to educational materials are essential, the platform’s ability to meet these needs effectively constituted a notable advantage.

However, students noted initial difficulties and obstacles in utilizing ChatGPT, primarily related to data credibility. These challenges, highlighted in the qualitative data, necessitated the application of critical thinking and conducting various checks to verify the information received. This concern over the credibility of information from AI tools aligns with observations by Mohamad-Hani et al. [ 55 ], who reported similar credibility issues with ChatGPT data among healthcare professionals.

Another significant challenge for the students focused on how to retrieve relevant and accurate information. To this end, they had to refine their question formulation to extract the most relevant and accurate data from the tool. Such challenges have increasingly become a focus of academic attention due to the emerging recognition of the importance of developing prompting skills for effective interaction with platforms such as ChatGPT and other AI tools [ 19 , 20 ].

In terms of digital literacy skills, the findings of this study suggest that basic literacy skills such as locating, retrieving, synthesizing, and summarizing information may become less important as AI systems improve. Yet students still must be trained to evaluate and think critically about AI tools and what they can accomplish, especially since AI technologies like ChatGPT are not always completely trustworthy. Therefore, students need to learn how to evaluate the information these tools provide. These findings also offer some support for the notion that while digital literacy is undeniably recognized as crucial for the 21st century, especially in the healthcare arena [ 36 , 45 ], the definition of digital literacy is changing as technological tools develop. For decades, education focused on developing basic skills. Over time, however, there was a shift toward the cultivation of more complex skills involving information evaluation, synthesis, and assessment [ 56 , 57 ]. Yet as AI continues to penetrate everyday life, there has been a noticeable evolution in the forms of literacy required.

This evolution marks a transition from traditional data digital literacy, which emphasizes a basic understanding and processing of information, to AI digital literacy, which goes beyond mere data consumption to include using digital tools skillfully, understanding the nature of digital content, and effectively navigating the complex digital landscape. This shift reflects the changing demands of a technology-driven society, in which digital literacy is becoming increasingly essential for both personal and professional development [ 58 ]. As AI becomes integrated into different dimensions of work and daily life, especially in the healthcare industry, AI digital literacy will continue to evolve to meet the new demands. This will require a different set of skills, including prompting skills that allow users to better interact with AI tools [ 19 , 20 ].

These results highlight the importance of rethinking the educational use of AI tools such as ChatGPT, potentially leading to changes in future learning curricula. Without the ability to use digital tools, students are liable to fall behind when it comes to adapting to new technologies, thus limiting their ability to learn key skills. Therefore, AI tools must be taught and used in a way that supports students’ holistic learning. These findings align with those of other researchers who focus on the use of the AI platform in education [ 40 , 42 , 43 ]. Such an approach will ensure that students are prepared for the evolving challenges and opportunities of our increasingly digital world. This is especially important in the medical education field, as AI is increasingly being used in different ways to improve the accuracy of disease diagnosis, treatment strategies, and prediction of patient outcomes [ 9 , 10 , 25 , 27 ].

Given that AI technology is still developing and is anticipated to advance and become more widely used [ 21 , 22 ], the need to adapt and acquire new literacy skills is growing. As AI evolves, reliance on traditional basic skills may decline over time, underscoring the importance of learning how to effectively utilize and interact with emerging technologies. Learning to engage with AI tools such as ChatGPT from an early stage in their education can greatly enhance students’ learning experiences. This early exposure will not only provide them with a deeper understanding of these tools. It will also boost their motivation to learn how to use them more effectively, thus highlighting the importance of training students to handle such technologies proficiently. Equally important is the need to guide students through these learning processes to ensure they acquire the necessary skills and knowledge to navigate and utilize AI tools successfully in their educational journey [ 11 ].

Limitations and future research directions

This study utilized a pedagogical framework that integrates problem-based learning with the use of ChatGPT. While the researcher focused on the pedagogical aspect, future research is warranted to compare this digitally supported activity to a non-digital equivalent and examine the impact on students’ literacy and skills. Such a comparison would make it possible to assess what the digital instrument contributes to skill development and to identify any challenges encountered.

The use of this tool across different teaching methods could also be explored to determine whether it is particularly effective for certain types of tasks or requirements. The current study focused on health management. Implementation of this teaching approach in other academic areas should be examined to assess its effectiveness in acquiring competencies in different arenas. The findings of this study highlight the need for further research into the use of AI in learning environments that focus on goal-oriented pedagogy. Such research can help in developing educational strategies that promote the skills essential for lifelong learning.

Conclusions and recommendations

In conclusion, revisiting the research questions in the context of our findings highlights the transformative potential of integrating ChatGPT with problem-based learning in healthcare management education. This study underscores how such integration not only shifts the focus from traditional digital literacy to advanced AI literacy skills but also enhances critical thinking and evaluation capabilities among students. These competencies are indispensable as AI continues to reshape the landscape of healthcare and medical education. AI is emerging as a transformative force that will fundamentally change the global landscape. Although we are still in the early stages of integrating and understanding AI capabilities, its potential to shape our future is clear. Adapting to this digital transformation, especially in healthcare, is crucial [ 4 , 6 ].

Integrating AI into healthcare systems poses significant challenges and raises many unanswered questions [ 9 , 10 ]. These issues require careful consideration and strategic planning to maximize benefits while addressing implementation complexities. The extent and impact of these transformations on the health system and its workforce remain uncertain. However, it is crucial to prepare for these changes at both individual and organizational levels. Educational institutions must update their teaching methods to meet digital demands, recognizing the critical role of educators in developing effective support strategies.

To enable healthcare professionals to integrate AI tools effectively, these tools should be introduced early in education, such as during undergraduate studies or initial professional training [ 9 , 32 , 33 ]. Hands-on experience allows learners to build confidence and understand the tools’ limitations. Additionally, AI tools and especially LLMs such as GPT and their applications, including platforms like ChatGPT, can serve as user-friendly and efficient learning aids, as demonstrated in this research. In addition, researchers should strive to develop innovative pedagogical methods for integrating these tools into different curricula, as exemplified here by the effective use of dilemma-based learning enhanced by ChatGPT. These studies should focus on determining which skills will become redundant and on highlighting essential competencies needed for AI literacy, including prompting, evaluation skills, and critical thinking, all of which are essential for effectively integrating AI and LLMs into medical education and daily practice. Participants in such studies have noted that the acquisition of such skills, particularly in the area of effective prompting, significantly improves the quality of AI responses. Similar to learning a new language, learning to use AI requires precise phrasing and an in-depth understanding of context. Not only will AI skills improve student engagement and comprehension, they will also encourage critical thinking, leading to better educational outcomes. Students who formulate well-structured search queries obtain more accurate responses from AI, which are critical to improving healthcare and learning outcomes.

It is therefore imperative that academia and higher education institutions, including medical education institutions, adopt methods for effectively guiding and training students in using AI. This approach is essential to address the evolving global educational landscape and to embrace the shift in roles. Educators should move from being primarily providers of knowledge to being facilitators of cultural understanding and skill development. Such a shift is essential to promote the transformative evolution of the role of educators in the modern educational context.

Availability of data and materials

Data are available upon request from the Corresponding author.

Counte MA, Howard SW, Chang L, Aaronson W. Global advances in value-based payment and their implications for global health management education, development, and practice. Front Public Health. 2019;6:379. https://doi.org/10.3389/fpubh.2018.00379 .

Article   Google Scholar  

WHO. World Health Organisation. Universal health coverage. 2019. Retrieved from https://www.who.int/news-room/fact-sheets/detail/universal-health-coverage-(uhc) . June 2022.

Naamati Schneider N. Public-private: unequal competition: Israeli public hospitals vs. the private healthcare system following government reforms. Int J Organ Anal. 2021. https://doi.org/10.1108/IJOA-06-2020-2237 .

Deshpande N, Arora VM, Vollbrecht H, Meltzer DO, Press V. eHealth literacy and patient portal use and attitudes: cross-sectional observational study. JMIR Hum Factors. 2023;10:e40105. https://doi.org/10.2196/40105

Naamati Schneider L. Strategic management as an adaptation to changes in the ecosystems of public hospitals in Israel. Isr J Health Policy Res. 2020;9:65. https://doi.org/10.1186/s13584-020-00424-y .

Naamati-Schneider L. The effect of digitalization on service orientation and service perception among Israeli healthcare professionals: a qualitative study. Digit Health. 2023;9. https://doi.org/10.1177/20552076231191892 .

Naamati-Schneider L, Salvatore FP. Sustainability for healthcare organisations and systems: cultivating strategy and governance processes for a better future. In: Vrontis D, Thrassou A, Efthymiou L, Weber Y, Shams SMR, Tsoukatos E, editors. Business for sustainability. 2023; Volume I. pp.227–249. Palgrave studies in cross-disciplinary business research, in association with EuroMed Academy of Business. Cham: Palgrave Macmillan. https://doi.org/10.1007/978-3-031-37361-9_11 .

Naamati-Schneider L, Zaks O. Public hospitals in crisis: managerial and strategic adaptation. In: Vrontis D, Thrassou A, Weber Y, Shams SMR, Tsoukatos E, Efthymiou L, editors. Business under crisis: volume II. Palgrave Macmillan; 2022. p. 43–64. https://doi.org/10.1007/978-3-030-76575-0_3 .

Ali O, Abdelbaki W, Shrestha A, Elbasi E, Alryalat MAA, Dwivedi YK. A systematic literature review of artificial intelligence in the healthcare sector: benefits, challenges, methodologies, and functionalities. J Innov Knowl. 2023;8(1):100333.  https://doi.org/10.1016/j.jik.2023.100333

Manne R, Kantheti SC. Application of artificial intelligence in healthcare: chances and challenges. Curr J Appl Sci Technol. 2021;40(6):78–89. https://doi.org/10.9734/cjast/2021/v40i631320 .

Breeding T, Martinez B, Patel H, et al. The utilization of ChatGPT in reshaping future medical education and learning perspectives: a curse or a blessing? Am Surg. 2024;90(4):560–6. https://doi.org/10.1177/00031348231180950 .

Boscardin CK, Gin B, Golde PB, Hauer KE. ChatGPT and generative artificial intelligence for medical education: potential impact and opportunity. Acad Med. 2024;99(1):22–7. https://doi.org/10.1097/ACM.0000000000005439 .

Tinmaz H, Fanea-Ivanovici M, Baber H. A snapshot of digital literacy. Libr Hi Tech News. 2023;40(1):20–3. https://doi.org/10.1108/LHTN-12-2021-0095 .

Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthc. 2023;11(6):887. https://doi.org/10.3390/healthcare11060887 .

Buchholz BA, DeHart J, Moorman G. Digital citizenship during a global pandemic: moving beyond digital literacy. J Adolesc Adult Lit. 2020;64(1):11–7. https://doi.org/10.1002/jaal.1076 .

Kuatbekov A, Vershitskaya E, Kosareva I, Ananishnev V. E-learning as a basis for the development of media competences in students. J Inform Sci. 2023;49(4):1111–25.

Morgan A, Sibson R, Jackson D. Digital demand and digital deficit: conceptualising digital literacy and gauging proficiency among higher education students. J High Educ Policy Manag. 2022;44(3):258–75. https://doi.org/10.1080/1360080X.2022.2030275 .

van Laar E, van Deursen AJ, van Dijk JA. Developing policy aimed at 21st-century digital skills for the creative industries: an interview study with founders and managing directors. J Educ Work. 2022;35(2):195–209. https://doi.org/10.1080/13639080.2022.2036710 .

Eager B, Brunton R. Prompting higher education towards AI-augmented teaching and learning practice. J Univ Teach Learn Pract. 2023;20(5):02. https://doi.org/10.53761/1.20.5.02 .

Kasneci E, Seßler K, Küchemann S, Bannert M, Dementieva D, Fischer F, Kasneci G. ChatGPT for good? On opportunities and challenges of large language models for education. Learn Indiv Differ. 2023;103:102274. https://doi.org/10.1016/j.lindif.2023.102274 .

He N, Yan Y, Wu Z, Cheng Y, Liu F, Li X, Zhai S. ChatGPT-4 significantly surpasses GPT-3.5 in drug information queries. J Telemed Telecare. 2023;2023:1–3. https://doi.org/10.1177/1357633X231181922 .

Javaid M, Haleem A, Singh RP. ChatGPT for healthcare services: an emerging stage for an innovative perspective. BenchCouncil Trans Benchmarks Stand Eval. 2023;3(1):100105. https://doi.org/10.1016/j.tbench.2023.100105 .

Haleem A, Javaid M, Singh RP. An era of ChatGPT as a significant futuristic support tool: a study on features, abilities, and challenges. BenchCouncil Trans Benchmarks Stand Eval. 2022;2(4):100089.  https://doi.org/10.1016/j.tbench.2023.100089

Fuchs K. Exploring the opportunities and challenges of NLP models in higher education: is ChatGPT a blessing or a curse? Front Educ. 2023;8:8. https://doi.org/10.3389/feduc.2023.1166682 .

Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, Wang Y. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2017;2(4):e000101. https://doi.org/10.1136/svn-2017-000101 .

Tekkeşin Aİ. Artificial intelligence in healthcare. Anatol J Cardiol. 2019;22(1):8–9. https://doi.org/10.14744/AnatolJCardiol.2019.28 .

Jimma BL. Artificial intelligence in healthcare: a bibliometric analysis. Telemat Inform Rep. 2023:100041.‏ https://doi.org/10.1016/j.teler.2023.10004 .

Yu KH, Beam AL, Kohane IS. Artificial intelligence in healthcare. Nat Biomed Eng. 2018;2(10):719–31.

Rong G, Mendez A, Assi EB, Zhao B, Sawan M. Artificial intelligence in healthcare: review and prediction case studies. Engineering. 2020;6(3):291–301. https://doi.org/10.1016/j.eng.2019.08.015 .

Sqalli MT, Al-Thani D. AI-supported health coaching model for patients with chronic diseases. In: 2019 16th International Symposium on Wireless Communication Systems (ISWCS). IEEE; 2019. p. 452–456. https://doi.org/10.1109/ISWCS.2019.8877113 .

Matheny ME, Whicher D, Thadaney Israni S. Artificial intelligence in health care: a report from the national academy of medicine. JAMA. 2020;323(6):509–10. https://doi.org/10.1001/jama.2019.21579 .

York TJ, Raj S, Ashdown T, Jones G. Clinician and computer: a study on doctors’ perceptions of artificial intelligence in skeletal radiography. BMC Med Educ. 2023;23(1):1–10. https://doi.org/10.1186/s12909-022-03976-6 .

Eysenbach G. The role of ChatGPT, generative language models, and artificial intelligence in medical education: a conversation with ChatGPT and a call for papers. JMIR Med Educ. 2023;9:e46885. https://doi.org/10.2196/46885

Han Z, Battaglia F, Udaiyar A, Fooks A, Terlecky SR. An explorative assessment of ChatGPT as an aid in medical education: use it with caution. medRxiv. 2023.‏ https://doi.org/10.1101/2023.02.13.23285879 .

Das D, Kumar N, Longjam LA, Sinha R, Roy AD, Mondal H, Gupta P. Assessing the capability of ChatGPT in answering first-and second-order knowledge questions on microbiology as per competency-based medical education curriculum. Cureus. 2023;15(3):e36034. https://doi.org/10.7759/cureus.36034 .

Thurzo A, Strunga M, Urban R, Surovková J, Afrashtehfar KI. Impact of artificial intelligence on dental education: a review and guide for curriculum update. Educ Sci. 2023;13:150. https://doi.org/10.3390/educsci13020150 .

Veikkolainen P, Tuovinen T, Jarva E, Tuomikoski AM, Männistö M, Pääkkönen J, et al. eHealth competence building for future doctors and nurses–attitudes and capabilities. Int J Med Inform. 2023;169:104912. https://doi.org/10.1016/j.ijmedinf.2022.104912 .

Baro EE, Obaro OG, Aduba ED. An assessment of digital literacy skills and knowledge-based competencies among librarians working in university libraries in Africa. Digit Libr Perspect. 2019;35(3/4):172–92. https://doi.org/10.1108/DLP-04-2019-0013 .

Falloon G. From digital literacy to digital competence: the teacher digital competency (TDC) framework. Educ Tech Res Dev. 2020;68:2449–72. https://doi.org/10.1007/s11423-020-09767-4 .

Polizzi G. Digital literacy and the national curriculum for England: learning from how the experts engage with and evaluate online content. Comput Educ. 2020;152:103859.  https://doi.org/10.1016/j.compedu.2020.103859

Tynes BM, Stewart A, Hamilton M, Willis HA. From google searches to russian disinformation: adolescent critical race digital literacy needs and skills. Int J Multicult Educ. 2021;23(1):110–30. https://doi.org/10.18251/ijme.v23i1.2463 .

Ahmed ST, Roche T. Making the connection: examining the relationship between undergraduate students’ digital literacy and academic success in an English medium instruction (EMI) university. Educ Info Technol. 2021;26(4):4601–20. https://doi.org/10.1007/s10639-021-10443-0 .

Musi E, Aloumpi M, Carmi E, Yates S, O'Halloran K. Developing fake news immunity: fallacies as misinformation triggers during the pandemic. Online J Commun Media Technol. 2022;12(3). https://doi.org/10.30935/ojcmt%2F12083 .

Pangrazio L, Sefton-Green J. The social utility of ‘data literacy.’ Learn Media Technol. 2020;45(2):208–20. https://doi.org/10.1080/17439884.2020.1707223 .

Mehoudar O. Health literacy, and eHealth literacy: access to health information as a key to equal opportunity in society. Kidum Briut Isr. 2014;5:25–34 (Hebrew).

Google Scholar  

Alt D, Naamati-Schneider L, Meirovich A. Future problem-solving practiced during COVID-19: implications for health management students’ e-health literacy identity. Front Psychol. 2022;13:829243. https://doi.org/10.3389/fpsyg.2022.829243 .

Kaper MS, Reijneveld SA, van Es FD, de Zeeuw J, Almansa J, Koot J, de Winter AF. Effectiveness of a comprehensive health literacy consultation skills training for undergraduate medical students: a randomized controlled trial. Int J Environ Res Public Health. 2019;17(1):81. https://doi.org/10.3390/ijerph17010081 .

Nguyen HT, Do BN, Pham KM, Kim GB, Dam H, Nguyen TT, Nguyen T, Nguyen YH, Sørensen K, Pleasant A, Duong TV. Fear of COVID-19 scale-associations of its scores with health literacy and health-related behaviors among medical students. Int J Environ Res Public Health. 2020;17(11):4164. https://doi.org/10.3390/ijerph17114164 .

TerKonda SP, Fish EM. Artificial intelligence viewed through the lens of state regulation. Intell Based Med. 2023:100088. https://doi.org/10.1016/j.ibmed.2023.100088 .

Yin RK. Case study research design and methods. 5th ed. California: Sage; 2014.

Creswell JW. Educational research: planning, conducting, and evaluating quantitative and qualitative research. 4th ed. Nebraska-Lincoln: Merrill; 2012.

Tripto J, Ben-Zvi Assaraf O, Snapir Z, Amit M. The ‘What is a system’ reflection interview as a knowledge integration activity for high school students’ understanding of complex systems in human biology. Int J Sci Educ. 2016;38(4):564–95. https://doi.org/10.1080/09500693.2016.1150620 .

Zohar A, Barzilai S. A review of research on metacognition in science education: current and future directions. Stud Sci Educ. 2013;49:121–69. https://doi.org/10.1080/03057267.2013.84726 .

Minichiello A, Hood JR, Harkness DS. Bringing user experience design to bear on STEM education: a narrative literature review. J STEM Educ Res. 2018;1:7–33. https://doi.org/10.1007/s41979-018-0005-3 .

Mohamad-Hani T, Aljamaan F, Malki KH, Alhasan K, Altamimi I, Aljarbou R, Al-Eyadhy A. ChatGPT and the future of digital health: a study on healthcare workers’ perceptions and expectations. Healthcare. 2023;11(13):1812. https://doi.org/10.3390/healthcare11131812 .

Alt D, Raichel N. Enhancing perceived digital literacy skills and creative self-concept through gamified learning environments: insights from a longitudinal study. Int J Educ Res. 2020;101:101561. https://doi.org/10.1016/j.ijer.2020.101561 .

UNESCO. Digital skills critical for job and social inclusion. 2018. Retrieved from https://en.unesco.org/news/digital-skills-critical-jobs-and-social-inclusion .

Kreinsen M, Schulz S. Towards the triad of digital literacy, data literacy, and AI literacy in teacher education: a discussion in light of the accessibility of novel generative AI. A position paper. 2023. https://doi.org/10.1177/0163443710393382 .

Olmos-Vega FM, Stalmeijer RE, Varpio L, Kahlke R. A practical guide to reflexivity in qualitative research: AMEE Guide No. 149. Med Teach. 2023;45(3):241–51.

Download references

Acknowledgements

Conflict of interest.

The author confirms that there are no known conflicts of interest associated with this publication, and there has been no financial support for this work that could have influenced its outcome.

Author information

Authors and affiliations.

Health Systems Management Department, Hadassah Academic College, Jerusalem, Israel

Lior Naamati-Schneider

You can also search for this author in PubMed   Google Scholar

Contributions

L.N.S.: Conceptualization, data curation, methodology, writing- original draft preparation writing- reviewing and editing. The author read and approved the final manuscript.

Corresponding author

Correspondence to Lior Naamati-Schneider .

Ethics declarations

Ethics approval and consent to participate.

Informed consent was obtained from all participants involved in the study. The research was approved by the Hadassah Academic College’s Ethics Committee.

Consent for publication

Competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Naamati-Schneider, L. Enhancing AI competence in health management: students’ experiences with ChatGPT as a learning Tool. BMC Med Educ 24 , 598 (2024). https://doi.org/10.1186/s12909-024-05595-9

Download citation

Received : 23 February 2024

Accepted : 23 May 2024

Published : 30 May 2024

DOI : https://doi.org/10.1186/s12909-024-05595-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • AI digital literacy
  • ChatGPT in education
  • Healthcare management education

BMC Medical Education

ISSN: 1472-6920

how to get literature review from chatgpt

More From Forbes

20 novel ways to improve your chatgpt prompts (according to science).

  • Share to Facebook
  • Share to Twitter
  • Share to Linkedin

20 novel ways to improve your ChatGPT prompts (according to science)

According to OpenAI cofounder Sam Altman , ChatGPT has 100 million weekly users . Many of these are founders using the friendly (and now all-knowing) chatbot to supercharge their personal brand , adopt a winner’s mindset , and outperform their competitors . But how do you know you’re using the tool as effectively as possible? You’re probably not. These unconventional pointers will ensure you’re not missing out on that top tier of results.

Researchers at Mohamed bin Zayed University of AI came up with a comprehensive list of principles for best practice in prompting, in a paper called Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4 . Entrepreneurs and business leaders can use them to take their ChatGPT usage to the next level. If you’re using the tool, you might as well do it right.

Improve your ChatGPT prompts with these simple pointers

Forget politeness.

You don’t need to be polite when prompting ChatGPT. It’s a robot, not a person. Forget please and thank you, it doesn’t make a difference. Save the characters for more useful instructions such as examples, more detail, or clarification on any ambiguous terms. For best results, use the phrases “Your task is” and “You must.” Write clear prompts, give clear instructions, and save the fluff for humans.

Include the audience

Reference the intended audience in the prompt, so ChatGPT knows who the output is for. It will keep them in mind when generating your articles , social media posts or web copy, for results that resonate better with your customers.

NSA Warns iPhone And Android Users To Turn It Off And On Again

‘godzilla minus one’ is coming to netflix this weekend, but there’s a catch, sudden u s dollar collapse fear predicted to trigger a 15 7 trillion etf bitcoin price gold flip as countries go dual currency, use sequences.

If you break down a complex task into logical steps, ChatGPT should better understand what’s required. Instead of a big block of text, give instructions one prompt at a time. After each one, check understanding and signal that more are on their way. If adding the sequence within one prompt, use line breaks to avoid confusion and ensure you get the answers you’re after.

Use positive commands

Tell ChatGPT what to do, instead of what not to do. For example, instruct it to “use only red and green” instead of “don’t use pink and purple.” This provides a greater degree of clarity, increasing the likelihood of a valuable response.

Ask for further clarification

If ChatGPT produces something that doesn’t make sense, add these phrases to request more information. “Explain [insert specific topic] in simple terms,” “Explain to me like I'm 11 years old,” “Explain to me as if I'm a beginner in [field],” According to the study, you can even add "I'm going to tip $xxx for a better solution!"

Include examples

Implement example-driven prompting when formatting. That way, ChatGPT knows the kind of response you’re looking for, from which to base its predictions. Format examples properly so they work within the prompt. Use either “### example ###” or “[Example]”. Don’t stop formatting there. Use line breaks to separate instructions, examples, questions, context and data. This helps the tool understand which part of your prompt is which.

Threaten punishment

You wouldn’t threaten your human team members, but you can threaten ChatGPT. Researchers found that using the phrase “You will be penalized if…” produced better results.

Ask it to be more human

ChatGPT has giveaway signs of AI-generated content , and some are so signature they are comical. You can request that it become more human by including this line in your prompts: “Answer in a natural, human-like manner," and request that it leave specific words out. Skip the ChatGPTisms for better responses.

Tell ChatGPT how to think

Be direct about how you want the tool to process your information, for better output every time. Use leading words like writing "think step by step" to provoke chain-of-thought responses, so you catch mistakes early on.

Avoid stereotypes

ChatGPT was trained on 300 billion words of content from the internet, many of which contain stereotypes and biases. Make it aware of its own bias by adding, “Ensure that your answer is unbiased and does not rely on stereotypes."

Ask it to ask you

You don’t know what you don’t know. Rather than predicting what you should have mentioned in the prompt, ask ChatGPT to tell you the gaps. Include the instruction, "Ask me questions to get the information you need" in your prompt, and emphasize that it should do this before providing answers.

Assign a role

Want a marketing manager? Say, “act as a marketing expert.” The same for legal expert, accountancy expert, and business analyst. Doing this brings better results. Tell ChatGPT whose wisdom it should channel in its response to make sure it aligns with your goals.

Use delimiters

Delimiters specify the boundary between separate, independent regions in streams of text. They include brackets, commas, angled brackets and square brackets. Use delimiters in your prompts to separate information to stand the best chance of it computing in ChatGPT.

Frequency matters

If something in your request is important, repeat it. The primacy-recency effect is in play when prompting ChatGPT. Repeat a specific word or phrase multiple times within a prompt, especially at the start and end of your command. Hammer home the requirement with ChatGPT.

Combine techniques

Don’t rely on adding one best practice method. Combine them. For example, asking ChatGPT to provide answers step by step, combined with giving examples, as well as assigning a role, will maximise your prompt further.

Prompt the response

If you know how you want the response to start, tell ChatGPT. Imagine you’re asking it to write a LinkedIn post but you know the hook. End your prompt with the start of the desired response to guide the conversation to the right answer.

Don’t change what works

If you ask for a re-write, you’ll get all sorts of synonyms. Sometimes you just want a gentle edit. Use this request when that’s the case: "Revise each paragraph to improve grammar and vocabulary while keeping the original writing style." The paper suggested you add, “You should only improve the user’s grammar and vocabulary and make sure it sounds natural. You should not change the writing style, such as making a formal paragraph casual”

Finish your sentences

If you’ve written an entire article or social media post but you need it wrapping up in a compelling way, share the start and ask for the end. “Your task is to complete this [song, post, blog, etc] in a [describe the style, for example compelling, persuasive, empowering way], by [include other requirements] and keeping the flow. Here’s the beginning: [Paste work]"

Provide sample copy

If you have the text you want to emulate, give it to ChatGPT. Trying to prompt a specific writing style is incredibly challenging without providing an example, so make sure you include one. Include the instruction, “Use the same language style as the provided [describe the text]: [paste the sample]."

Always be clear

While this might sound obvious, it’s always worth double checking. Before you hit send, read your prompt through. Check for anything that could be misinterpreted. Compare your prompt to how you’d ask a real person the same thing, and think about what questions they would have next. Your requirements should include all relevant keywords, rules, hints, or instructions to set ChatGPT up for success.

How to write better prompts in ChatGPT (according to science)

Prompting ChatGPT is a skill that you can improve like any other. Study best practice, experiment, iterate your words and go again. Learn what works well so you can get the best results from effortless inputs. Access the benefits of more work in less time when you master this art.

Jodie Cook

  • Editorial Standards
  • Reprints & Permissions

Join The Conversation

One Community. Many Voices. Create a free account to share your thoughts. 

Forbes Community Guidelines

Our community is about connecting people through open and thoughtful conversations. We want our readers to share their views and exchange ideas and facts in a safe space.

In order to do so, please follow the posting rules in our site's  Terms of Service.   We've summarized some of those key rules below. Simply put, keep it civil.

Your post will be rejected if we notice that it seems to contain:

  • False or intentionally out-of-context or misleading information
  • Insults, profanity, incoherent, obscene or inflammatory language or threats of any kind
  • Attacks on the identity of other commenters or the article's author
  • Content that otherwise violates our site's  terms.

User accounts will be blocked if we notice or believe that users are engaged in:

  • Continuous attempts to re-post comments that have been previously moderated/rejected
  • Racist, sexist, homophobic or other discriminatory comments
  • Attempts or tactics that put the site security at risk
  • Actions that otherwise violate our site's  terms.

So, how can you be a power user?

  • Stay on topic and share your insights
  • Feel free to be clear and thoughtful to get your point across
  • ‘Like’ or ‘Dislike’ to show your point of view.
  • Protect your community.
  • Use the report tool to alert us when someone breaks the rules.

Thanks for reading our community guidelines. Please read the full list of posting rules found in our site's  Terms of Service.

IMAGES

  1. Research paper and Literature review writing using CHAT GPT

    how to get literature review from chatgpt

  2. How to Use ChatGPT to Write Literature Review (Easy Tutorial) 2024

    how to get literature review from chatgpt

  3. How to Write Literature Review with ChatGPT? Using ChatGPT for

    how to get literature review from chatgpt

  4. Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review

    how to get literature review from chatgpt

  5. Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review

    how to get literature review from chatgpt

  6. ChatGPT for Literature and Research

    how to get literature review from chatgpt

VIDEO

  1. Automate Literature Review Using ChatGPT

  2. GCSE English Literature Revision using ChatGPT-4o voice mode! #genkienglish

  3. How to Generate Literature Survey using ChatGpt

  4. How to use/read link on chatgpt

  5. #ChatGPT does literature review! #ScholarAI

  6. How to use ChatGPT for your PhD literature review

COMMENTS

  1. How To Use ChatGPT To Write A Literature Review: Prompts & References

    Summarizing relevant literature to ensure the review is comprehensive and up-to-date. Get ChatGPT To Help You During Research, Using The Right Prompts. The key to effectively using ChatGPT in this process lies in crafting the right prompts, guiding the AI to generate relevant and useful content. When initiating a literature review, the prompt ...

  2. ChatGPT for Research and Publication: A Step-by-Step Guide

    Yes, ChatGPT can help generate a literature review, but it is important to note that it may not have access to the most up-to-date research articles and studies due to copyrights and limited access to some journals. Additionally, a literature review typically requires a comprehensive analysis of multiple sources, so the generated response may ...

  3. Application ChatGPT in conducting systematic reviews and meta ...

    ChatGPT is a Large Language Model (LLM) developed by OpenAI (OpenAI, L.L.C., San Francisco, CA, USA) which has tremendous potential to revolutionise the healthcare industry. ChatGPT has been ...

  4. How To Use ChatGPT For Literature Review (Pro Tips!)

    ChatGPT can suggest ways to organize your literature review, such as categorizing studies by theme, methodology, or chronological order. 7. Highlighting Important Studies. It can point out seminal papers and influential studies that are essential for your review. 8.

  5. Research Guides: Literature Reviews: ChatGPT [beta]

    ChatGPT — Conversational Large Language Model by OpenAI — Potential applications for teaching, learning and doing literature reviews. https://chat.openai.com. The knowledge cutoff for the ChatGPT 3.5 is September 2021 and it has no access to the Internet. Academic users may consider alternatives such as Semantic Scholar, Elicit, Consensus ...

  6. How to Use ChatGPT to Write a Literature Review With Prompts

    A Step-by-Step Guide: How to Use ChatGPT for Writing a Literature Review. Step 1: Defining Your Research Objective Before diving into the literature review process, it is crucial to define your research objective. Clearly articulate the topic, research question, or hypothesis you aim to address through your literature review. This step will ...

  7. ChatGPT

    Generate high-quality literature reviews fast, Summarize papers, identify key themes, and synthesize conclusions

  8. Using ChatGPT

    ChatGPT is a generative large language model which has gained popularity since late 2021. The name stands for Chat Generative Pre-trained Transformer. GPT models are programmed to mimic the look and feel of engaging in a realistic conversation with another human being; however, bias and inaccuracy remain a considerable risk ( Kocoń, J., 2023).

  9. Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review

    Clearly articulate the topic, research question, or hypothesis you aim to address through your literature review. This step will help you maintain focus and guide your search for relevant sources. Step 2: Identifying Keywords and Search Terms To effectively use ChatGPT to assist in your literature review, you need to identify relevant keywords ...

  10. Step-by-Step Guide: How to Use ChatGPT to Write a Literature Review

    A Step-by-Step Guide: How to Use ChatGPT for Writing a Literature Review. Step 1: Defining Your Research Objective Before diving into the literature review process, it is crucial to define your research objective. Clearly articulate the topic, research question, or hypothesis you aim to address through your literature review. This step will ...

  11. Using ChatGPT to conduct a literature review

    Using ChatGPT to conduct a literature review Account Res. 2023 Mar 6:1-3. doi: 10.1080/08989621.2023.2185514. Online ahead of print. Authors Michael Haman 1 , Milan Školník 1 Affiliation 1 Department of Humanities, Czech University of Life ...

  12. How to Write Literature Review with ChatGPT? Using ChatGPT for

    In this comprehensive guide, you will learn how to write a powerful literature review step by step. A literature review is an essential part of academic rese...

  13. ChatGPT

    Engaging, friendly guide for academic literature reviews using research question or topic

  14. How to write Literature review using Chat GPT

    In this captivating video tutorial, join us as we delve into the art of crafting a compelling literature review using ChatGPT. Discover step-by-step guidance...

  15. 9 Ways To Use ChatGPT To Write A Literature Review (WITHOUT ...

    Schedule a free 1-1 strategy session with me to see how I can help you achieve your research goals: https://academicenglishnow.com/schedule?utm_source=YouTub...

  16. 80+ ChatGPT Prompts for Literature Review

    Here are some example prompts that can be used to guide ChatGPT in assisting with literature reviews: Example Prompts: Provide an overview of the literature on [specific topic]. Summarize the methodologies used in the studies on [specific topic]. Identify common themes in the literature on [specific topic].

  17. How to use ChatGPT to read and analyze PDF files

    By leveraging ChatGPT's ability to analyze research papers, you can streamline your literature review process, identify important insights, and synthesize information more efficiently. Using ...

  18. How to Use ChatGPT to Write a Literature Review With Prompts

    Note: The literature review that you would get is plagiarism-free. This is another benefit of using chatgpt to write literature review. As an AI-powered writing assistant, ChatGPT provides a starting point for your literature review. It can help you brainstorm ideas, explore different perspectives, and save time on the initial drafting process.

  19. Crafting Effective ChatGPT Prompts for Literature Reviews

    Creating effective prompts for ChatGPT can significantly enhance the efficiency of your literature review process. By incorporating clear language, specific details, and thoughtful questions, you ...

  20. Using ChatGPT to conduct a literature review

    Article PDFs can be downloaded. Article PDFs can be printed. USD 461.00 Add to cart. * Local tax will be added as applicable. Dear Accountability in Research Editors,In this letter, we consider the ethical and practical implications of using ChatGPT in the research process. The ethics of using ChatGPT have been debated in...

  21. A systematic literature review of empirical research on ChatGPT in

    Over the last four decades, studies have investigated the incorporation of Artificial Intelligence (AI) into education. A recent prominent AI-powered technology that has impacted the education sector is ChatGPT. This article provides a systematic review of 14 empirical studies incorporating ChatGPT into various educational settings, published in 2022 and before the 10th of April 2023—the ...

  22. A Systematic Literature Review of Empirical Research on ChatGPT in

    Abstract and Figures. This article provides a systematic review of 14 empirical studies incorporating ChatGPT into various educational settings, published in 2022 and before the 10th of April 2023 ...

  23. (PDF) Literature Review on Pros and Cons of ChatGPT ...

    Objectives: (a) To conceptualise what is ChatGPT and how it. impacts our learning culture. (b) To review from various literature the pros and cons of. using ChatGPT. (c) To analyse the facts from ...

  24. 5 Things To Know About ChatGPT

    ChatGPT is a type of artificial intelligence model trained to generate coherent, human-like pieces of writing on a given topic. "ChatGPT was optimized for dialogue," (1) which means users interact with a chatbot in a conversational context, and the chatbot will compose text based upon the user's prompts. The bot is capable of generating ...

  25. Article: Chatbots and ChatGPT: a bibliometric analysis and systematic

    The research consists of two study phases: 1) an analysis of chatbot literature; 2) a comprehensive review of scientific documents on ChatGPT. In the first phase, a bibliometric analysis is conducted on all the published literature from both Scopus (5,839) and WoS (2,531) databases covering the period from 1998 to 2023.

  26. ChatGPT can extract data from clinical notes: Newsroom

    Much of the research in the Xie Lab focuses on developing and using data science and AI tools to improve biomedical research and health care. She and her colleagues wondered whether ChatGPT might speed the process of analyzing clinical notes - the memos physicians write to document patients' visits, diagnoses, and statuses as part of their medical record - to find relevant data for ...

  27. Academic integrity and artificial intelligence: is ChatGPT hype, hero

    There was little discussion of ChatGPT (just 5 articles in Medline in 2022) yet an explosion of literature since ChatGPT was publicly released on November 30, 2022 (163 articles in Medline in the first quarter of 2023 and 273 articles by 20 April 2023). ... Indeed, A systematic review of ChatGPT articles, at the time of writing, ...

  28. Enhancing AI competence in health management: students' experiences

    This study proposes a novel pedagogical framework that integrates problem-based learning with the use of ChatGPT for undergraduate healthcare management students, while qualitatively exploring the students' experiences with this technology through a thematic analysis of the reflective journals of 65 students. ... Literature review AI tools in ...

  29. 20 Novel Ways To Improve Your ChatGPT Prompts (According To ...

    Prompting ChatGPT is a skill that you can improve like any other. Study best practice, experiment, iterate your words and go again. Learn what works well so you can get the best results from ...

  30. How To Build a Professional Outline of Literature Review With #ChatGPT

    Check out Dr Rizwana Mustafa's video.