technologies in education

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• My Account Login
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Review Article
• Open access
• Published: 12 February 2024

Education reform and change driven by digital technology: a bibliometric study from a global perspective

• Chengliang Wang 1 ,
• Xiaojiao Chen 1 ,
• Teng Yu   ORCID: orcid.org/0000-0001-5198-7261 2 , 3 ,
• Yidan Liu 1 , 4 &
• Yuhui Jing 1  

Humanities and Social Sciences Communications volume  11 , Article number:  256 ( 2024 ) Cite this article

4744 Accesses

1 Citations

1 Altmetric

Metrics details

• Development studies
• Science, technology and society

Amidst the global digital transformation of educational institutions, digital technology has emerged as a significant area of interest among scholars. Such technologies have played an instrumental role in enhancing learner performance and improving the effectiveness of teaching and learning. These digital technologies also ensure the sustainability and stability of education during the epidemic. Despite this, a dearth of systematic reviews exists regarding the current state of digital technology application in education. To address this gap, this study utilized the Web of Science Core Collection as a data source (specifically selecting the high-quality SSCI and SCIE) and implemented a topic search by setting keywords, yielding 1849 initial publications. Furthermore, following the PRISMA guidelines, we refined the selection to 588 high-quality articles. Using software tools such as CiteSpace, VOSviewer, and Charticulator, we reviewed these 588 publications to identify core authors (such as Selwyn, Henderson, Edwards), highly productive countries/regions (England, Australia, USA), key institutions (Monash University, Australian Catholic University), and crucial journals in the field ( Education and Information Technologies , Computers & Education , British Journal of Educational Technology ). Evolutionary analysis reveals four developmental periods in the research field of digital technology education application: the embryonic period, the preliminary development period, the key exploration, and the acceleration period of change. The study highlights the dual influence of technological factors and historical context on the research topic. Technology is a key factor in enabling education to transform and upgrade, and the context of the times is an important driving force in promoting the adoption of new technologies in the education system and the transformation and upgrading of education. Additionally, the study identifies three frontier hotspots in the field: physical education, digital transformation, and professional development under the promotion of digital technology. This study presents a clear framework for digital technology application in education, which can serve as a valuable reference for researchers and educational practitioners concerned with digital technology education application in theory and practice.

Similar content being viewed by others

A bibliometric analysis of knowledge mapping in Chinese education digitalization research from 2012 to 2022

Digital transformation and digital literacy in the context of complexity within higher education institutions: a systematic literature review

Education big data and learning analytics: a bibliometric analysis

Introduction.

Digital technology has become an essential component of modern education, facilitating the extension of temporal and spatial boundaries and enriching the pedagogical contexts (Selwyn and Facer, 2014 ). The advent of mobile communication technology has enabled learning through social media platforms (Szeto et al. 2015 ; Pires et al. 2022 ), while the advancement of augmented reality technology has disrupted traditional conceptions of learning environments and spaces (Perez-Sanagustin et al., 2014 ; Kyza and Georgiou, 2018 ). A wide range of digital technologies has enabled learning to become a norm in various settings, including the workplace (Sjöberg and Holmgren, 2021 ), home (Nazare et al. 2022 ), and online communities (Tang and Lam, 2014 ). Education is no longer limited to fixed locations and schedules, but has permeated all aspects of life, allowing learning to continue at any time and any place (Camilleri and Camilleri, 2016 ; Selwyn and Facer, 2014 ).

The advent of digital technology has led to the creation of several informal learning environments (Greenhow and Lewin, 2015 ) that exhibit divergent form, function, features, and patterns in comparison to conventional learning environments (Nygren et al. 2019 ). Consequently, the associated teaching and learning processes, as well as the strategies for the creation, dissemination, and acquisition of learning resources, have undergone a complete overhaul. The ensuing transformations have posed a myriad of novel issues, such as the optimal structuring of teaching methods by instructors and the adoption of appropriate learning strategies by students in the new digital technology environment. Consequently, an examination of the principles that underpin effective teaching and learning in this environment is a topic of significant interest to numerous scholars engaged in digital technology education research.

Over the course of the last two decades, digital technology has made significant strides in the field of education, notably in extending education time and space and creating novel educational contexts with sustainability. Despite research attempts to consolidate the application of digital technology in education, previous studies have only focused on specific aspects of digital technology, such as Pinto and Leite’s ( 2020 ) investigation into digital technology in higher education and Mustapha et al.’s ( 2021 ) examination of the role and value of digital technology in education during the pandemic. While these studies have provided valuable insights into the practical applications of digital technology in particular educational domains, they have not comprehensively explored the macro-mechanisms and internal logic of digital technology implementation in education. Additionally, these studies were conducted over a relatively brief period, making it challenging to gain a comprehensive understanding of the macro-dynamics and evolutionary process of digital technology in education. Some studies have provided an overview of digital education from an educational perspective but lack a precise understanding of technological advancement and change (Yang et al. 2022 ). Therefore, this study seeks to employ a systematic scientific approach to collate relevant research from 2000 to 2022, comprehend the internal logic and development trends of digital technology in education, and grasp the outstanding contribution of digital technology in promoting the sustainability of education in time and space. In summary, this study aims to address the following questions:

RQ1: Since the turn of the century, what is the productivity distribution of the field of digital technology education application research in terms of authorship, country/region, institutional and journal level?

RQ2: What is the development trend of research on the application of digital technology in education in the past two decades?

RQ3: What are the current frontiers of research on the application of digital technology in education?

Literature review

Although the term “digital technology” has become ubiquitous, a unified definition has yet to be agreed upon by scholars. Because the meaning of the word digital technology is closely related to the specific context. Within the educational research domain, Selwyn’s ( 2016 ) definition is widely favored by scholars (Pinto and Leite, 2020 ). Selwyn ( 2016 ) provides a comprehensive view of various concrete digital technologies and their applications in education through ten specific cases, such as immediate feedback in classes, orchestrating teaching, and community learning. Through these specific application scenarios, Selwyn ( 2016 ) argues that digital technology encompasses technologies associated with digital devices, including but not limited to tablets, smartphones, computers, and social media platforms (such as Facebook and YouTube). Furthermore, Further, the behavior of accessing the internet at any location through portable devices can be taken as an extension of the behavior of applying digital technology.

The evolving nature of digital technology has significant implications in the field of education. In the 1890s, the focus of digital technology in education was on comprehending the nuances of digital space, digital culture, and educational methodologies, with its connotations aligned more towards the idea of e-learning. The advent and subsequent widespread usage of mobile devices since the dawn of the new millennium have been instrumental in the rapid expansion of the concept of digital technology. Notably, mobile learning devices such as smartphones and tablets, along with social media platforms, have become integral components of digital technology (Conole and Alevizou, 2010 ; Batista et al. 2016 ). In recent times, the burgeoning application of AI technology in the education sector has played a vital role in enriching the digital technology lexicon (Banerjee et al. 2021 ). ChatGPT, for instance, is identified as a novel educational technology that has immense potential to revolutionize future education (Rospigliosi, 2023 ; Arif, Munaf and Ul-Haque, 2023 ).

Pinto and Leite ( 2020 ) conducted a comprehensive macroscopic survey of the use of digital technologies in the education sector and identified three distinct categories, namely technologies for assessment and feedback, mobile technologies, and Information Communication Technologies (ICT). This classification criterion is both macroscopic and highly condensed. In light of the established concept definitions of digital technology in the educational research literature, this study has adopted the characterizations of digital technology proposed by Selwyn ( 2016 ) and Pinto and Leite ( 2020 ) as crucial criteria for analysis and research inclusion. Specifically, this criterion encompasses several distinct types of digital technologies, including Information and Communication Technologies (ICT), Mobile tools, eXtended Reality (XR) Technologies, Assessment and Feedback systems, Learning Management Systems (LMS), Publish and Share tools, Collaborative systems, Social media, Interpersonal Communication tools, and Content Aggregation tools.

Methodology and materials

Research method: bibliometric.

The research on econometric properties has been present in various aspects of human production and life, yet systematic scientific theoretical guidance has been lacking, resulting in disorganization. In 1969, British scholar Pritchard ( 1969 ) proposed “bibliometrics,” which subsequently emerged as an independent discipline in scientific quantification research. Initially, Pritchard defined bibliometrics as “the application of mathematical and statistical methods to books and other media of communication,” however, the definition was not entirely rigorous. To remedy this, Hawkins ( 2001 ) expanded Pritchard’s definition to “the quantitative analysis of the bibliographic features of a body of literature.” De Bellis further clarified the objectives of bibliometrics, stating that it aims to analyze and identify patterns in literature, such as the most productive authors, institutions, countries, and journals in scientific disciplines, trends in literary production over time, and collaboration networks (De Bellis, 2009 ). According to Garfield ( 2006 ), bibliometric research enables the examination of the history and structure of a field, the flow of information within the field, the impact of journals, and the citation status of publications over a longer time scale. All of these definitions illustrate the unique role of bibliometrics as a research method for evaluating specific research fields.

This study uses CiteSpace, VOSviewer, and Charticulator to analyze data and create visualizations. Each of these three tools has its own strengths and can complement each other. CiteSpace and VOSviewer use set theory and probability theory to provide various visualization views in fields such as keywords, co-occurrence, and co-authors. They are easy to use and produce visually appealing graphics (Chen, 2006 ; van Eck and Waltman, 2009 ) and are currently the two most widely used bibliometric tools in the field of visualization (Pan et al. 2018 ). In this study, VOSviewer provided the data necessary for the Performance Analysis; Charticulator was then used to redraw using the tabular data exported from VOSviewer (for creating the chord diagram of country collaboration); this was to complement the mapping process, while CiteSpace was primarily utilized to generate keyword maps and conduct burst word analysis.

Data retrieval

This study selected documents from the Science Citation Index Expanded (SCIE) and Social Science Citation Index (SSCI) in the Web of Science Core Collection as the data source, for the following reasons:

(1) The Web of Science Core Collection, as a high-quality digital literature resource database, has been widely accepted by many researchers and is currently considered the most suitable database for bibliometric analysis (Jing et al. 2023a ). Compared to other databases, Web of Science provides more comprehensive data information (Chen et al. 2022a ), and also provides data formats suitable for analysis using VOSviewer and CiteSpace (Gaviria-Marin et al. 2019 ).

(2) The application of digital technology in the field of education is an interdisciplinary research topic, involving technical knowledge literature belonging to the natural sciences and education-related literature belonging to the social sciences. Therefore, it is necessary to select Science Citation Index Expanded (SCIE) and Social Science Citation Index (SSCI) as the sources of research data, ensuring the comprehensiveness of data while ensuring the reliability and persuasiveness of bibliometric research (Hwang and Tsai, 2011 ; Wang et al. 2022 ).

After establishing the source of research data, it is necessary to determine a retrieval strategy (Jing et al. 2023b ). The choice of a retrieval strategy should consider a balance between the breadth and precision of the search formula. That is to say, it should encompass all the literature pertaining to the research topic while excluding irrelevant documents as much as possible. In light of this, this study has set a retrieval strategy informed by multiple related papers (Mustapha et al. 2021 ; Luo et al. 2021 ). The research by Mustapha et al. ( 2021 ) guided us in selecting keywords (“digital” AND “technolog*”) to target digital technology, while Luo et al. ( 2021 ) informed the selection of terms (such as “instruct*,” “teach*,” and “education”) to establish links with the field of education. Then, based on the current application of digital technology in the educational domain and the scope of selection criteria, we constructed the final retrieval strategy. Following the general patterns of past research (Jing et al. 2023a , 2023b ), we conducted a specific screening using the topic search (Topics, TS) function in Web of Science. For the specific criteria used in the screening for this study, please refer to Table 1 .

Literature screening

Literature acquired through keyword searches may contain ostensibly related yet actually unrelated works. Therefore, to ensure the close relevance of literature included in the analysis to the research topic, it is often necessary to perform a manual screening process to identify the final literature to be analyzed, subsequent to completing the initial literature search.

The manual screening process consists of two steps. Initially, irrelevant literature is weeded out based on the title and abstract, with two members of the research team involved in this phase. This stage lasted about one week, resulting in 1106 articles being retained. Subsequently, a comprehensive review of the full text is conducted to accurately identify the literature required for the study. To carry out the second phase of manual screening effectively and scientifically, and to minimize the potential for researcher bias, the research team established the inclusion criteria presented in Table 2 . Three members were engaged in this phase, which took approximately 2 weeks, culminating in the retention of 588 articles after meticulous screening. The entire screening process is depicted in Fig. 1 , adhering to the PRISMA guidelines (Page et al. 2021 ).

The process of obtaining and filtering the necessary literature data for research.

Data standardization

Nguyen and Hallinger ( 2020 ) pointed out that raw data extracted from scientific databases often contains multiple expressions of the same term, and not addressing these synonymous expressions could affect research results in bibliometric analysis. For instance, in the original data, the author list may include “Tsai, C. C.” and “Tsai, C.-C.”, while the keyword list may include “professional-development” and “professional development,” which often require merging. Therefore, before analyzing the selected literature, a data disambiguation process is necessary to standardize the data (Strotmann and Zhao, 2012 ; Van Eck and Waltman, 2019 ). This study adopted the data standardization process proposed by Taskin and Al ( 2019 ), mainly including the following standardization operations:

Firstly, the author and source fields in the data are corrected and standardized to differentiate authors with similar names.

Secondly, the study checks whether the journals to which the literature belongs have been renamed in the past over 20 years, so as to avoid the influence of periodical name change on the analysis results.

Finally, the keyword field is standardized by unifying parts of speech and singular/plural forms of keywords, which can help eliminate redundant entries in the knowledge graph.

Performance analysis (RQ1)

This section offers a thorough and detailed analysis of the state of research in the field of digital technology education. By utilizing descriptive statistics and visual maps, it provides a comprehensive overview of the development trends, authors, countries, institutions, and journal distribution within the field. The insights presented in this section are of great significance in advancing our understanding of the current state of research in this field and identifying areas for further investigation. The use of visual aids to display inter-country cooperation and the evolution of the field adds to the clarity and coherence of the analysis.

Time trend of the publications

To understand a research field, it is first necessary to understand the most basic quantitative information, among which the change in the number of publications per year best reflects the development trend of a research field. Figure 2 shows the distribution of publication dates.

Time trend of the publications on application of digital technology in education.

From the Fig. 2 , it can be seen that the development of this field over the past over 20 years can be roughly divided into three stages. The first stage was from 2000 to 2007, during which the number of publications was relatively low. Due to various factors such as technological maturity, the academic community did not pay widespread attention to the role of digital technology in expanding the scope of teaching and learning. The second stage was from 2008 to 2019, during which the overall number of publications showed an upward trend, and the development of the field entered an accelerated period, attracting more and more scholars’ attention. The third stage was from 2020 to 2022, during which the number of publications stabilized at around 100. During this period, the impact of the pandemic led to a large number of scholars focusing on the role of digital technology in education during the pandemic, and research on the application of digital technology in education became a core topic in social science research.

Analysis of authors

An analysis of the author’s publication volume provides information about the representative scholars and core research strengths of a research area. Table 3 presents information on the core authors in adaptive learning research, including name, publication number, and average number of citations per article (based on the analysis and statistics from VOSviewer).

Variations in research foci among scholars abound. Within the field of digital technology education application research over the past two decades, Neil Selwyn stands as the most productive author, having published 15 papers garnering a total of 1027 citations, resulting in an average of 68.47 citations per paper. As a Professor at the Faculty of Education at Monash University, Selwyn concentrates on exploring the application of digital technology in higher education contexts (Selwyn et al. 2021 ), as well as related products in higher education such as Coursera, edX, and Udacity MOOC platforms (Bulfin et al. 2014 ). Selwyn’s contributions to the educational sociology perspective include extensive research on the impact of digital technology on education, highlighting the spatiotemporal extension of educational processes and practices through technological means as the greatest value of educational technology (Selwyn, 2012 ; Selwyn and Facer, 2014 ). In addition, he provides a blueprint for the development of future schools in 2030 based on the present impact of digital technology on education (Selwyn et al. 2019 ). The second most productive author in this field, Henderson, also offers significant contributions to the understanding of the important value of digital technology in education, specifically in the higher education setting, with a focus on the impact of the pandemic (Henderson et al. 2015 ; Cohen et al. 2022 ). In contrast, Edwards’ research interests focus on early childhood education, particularly the application of digital technology in this context (Edwards, 2013 ; Bird and Edwards, 2015 ). Additionally, on the technical level, Edwards also mainly prefers digital game technology, because it is a digital technology that children are relatively easy to accept (Edwards, 2015 ).

Analysis of countries/regions and organization

The present study aimed to ascertain the leading countries in digital technology education application research by analyzing 75 countries related to 558 works of literature. Table 4 depicts the top ten countries that have contributed significantly to this field in terms of publication count (based on the analysis and statistics from VOSviewer). Our analysis of Table 4 data shows that England emerged as the most influential country/region, with 92 published papers and 2401 citations. Australia and the United States secured the second and third ranks, respectively, with 90 papers (2187 citations) and 70 papers (1331 citations) published. Geographically, most of the countries featured in the top ten publication volumes are situated in Australia, North America, and Europe, with China being the only exception. Notably, all these countries, except China, belong to the group of developed nations, suggesting that economic strength is a prerequisite for fostering research in the digital technology education application field.

This study presents a visual representation of the publication output and cooperation relationships among different countries in the field of digital technology education application research. Specifically, a chord diagram is employed to display the top 30 countries in terms of publication output, as depicted in Fig. 3 . The chord diagram is composed of nodes and chords, where the nodes are positioned as scattered points along the circumference, and the length of each node corresponds to the publication output, with longer lengths indicating higher publication output. The chords, on the other hand, represent the cooperation relationships between any two countries, and are weighted based on the degree of closeness of the cooperation, with wider chords indicating closer cooperation. Through the analysis of the cooperation relationships, the findings suggest that the main publishing countries in this field are engaged in cooperative relationships with each other, indicating a relatively high level of international academic exchange and research internationalization.

In the diagram, nodes are scattered along the circumference of a circle, with the length of each node representing the volume of publications. The weighted arcs connecting any two points on the circle are known as chords, representing the collaborative relationship between the two, with the width of the arc indicating the closeness of the collaboration.

Further analyzing Fig. 3 , we can extract more valuable information, enabling a deeper understanding of the connections between countries in the research field of digital technology in educational applications. It is evident that certain countries, such as the United States, China, and England, display thicker connections, indicating robust collaborative relationships in terms of productivity. These thicker lines signify substantial mutual contributions and shared objectives in certain sectors or fields, highlighting the interconnectedness and global integration in these areas. By delving deeper, we can also explore potential future collaboration opportunities through the chord diagram, identifying possible partners to propel research and development in this field. In essence, the chord diagram successfully encapsulates and conveys the multi-dimensionality of global productivity and cooperation, allowing for a comprehensive understanding of the intricate inter-country relationships and networks in a global context, providing valuable guidance and insights for future research and collaborations.

An in-depth examination of the publishing institutions is provided in Table 5 , showcasing the foremost 10 institutions ranked by their publication volume. Notably, Monash University and Australian Catholic University, situated in Australia, have recorded the most prolific publications within the digital technology education application realm, with 22 and 10 publications respectively. Moreover, the University of Oslo from Norway is featured among the top 10 publishing institutions, with an impressive average citation count of 64 per publication. It is worth highlighting that six institutions based in the United Kingdom were also ranked within the top 10 publishing institutions, signifying their leading position in this area of research.

Analysis of journals

Journals are the main carriers for publishing high-quality papers. Some scholars point out that the two key factors to measure the influence of journals in the specified field are the number of articles published and the number of citations. The more papers published in a magazine and the more citations, the greater its influence (Dzikowski, 2018 ). Therefore, this study utilized VOSviewer to statistically analyze the top 10 journals with the most publications in the field of digital technology in education and calculated the average citations per article (see Table 6 ).

Based on Table 6 , it is apparent that the highest number of articles in the domain of digital technology in education research were published in Education and Information Technologies (47 articles), Computers & Education (34 articles), and British Journal of Educational Technology (32 articles), indicating a higher article output compared to other journals. This underscores the fact that these three journals concentrate more on the application of digital technology in education. Furthermore, several other journals, such as Technology Pedagogy and Education and Sustainability, have published more than 15 articles in this domain. Sustainability represents the open access movement, which has notably facilitated research progress in this field, indicating that the development of open access journals in recent years has had a significant impact. Although there is still considerable disagreement among scholars on the optimal approach to achieve open access, the notion that research outcomes should be accessible to all is widely recognized (Huang et al. 2020 ). On further analysis of the research fields to which these journals belong, except for Sustainability, it is evident that they all pertain to educational technology, thus providing a qualitative definition of the research area of digital technology education from the perspective of journals.

Temporal keyword analysis: thematic evolution (RQ2)

The evolution of research themes is a dynamic process, and previous studies have attempted to present the developmental trajectory of fields by drawing keyword networks in phases (Kumar et al. 2021 ; Chen et al. 2022b ). To understand the shifts in research topics across different periods, this study follows past research and, based on the significant changes in the research field and corresponding technological advancements during the outlined periods, divides the timeline into four stages (the first stage from January 2000 to December 2005, the second stage from January 2006 to December 2011, the third stage from January 2012 to December 2017; and the fourth stage from January 2018 to December 2022). The division into these four stages was determined through a combination of bibliometric analysis and literature review, which presented a clear trajectory of the field’s development. The research analyzes the keyword networks for each time period (as there are only three articles in the first stage, it was not possible to generate an appropriate keyword co-occurrence map, hence only the keyword co-occurrence maps from the second to the fourth stages are provided), to understand the evolutionary track of the digital technology education application research field over time.

2000.1–2005.12: germination period

From January 2000 to December 2005, digital technology education application research was in its infancy. Only three studies focused on digital technology, all of which were related to computers. Due to the popularity of computers, the home became a new learning environment, highlighting the important role of digital technology in expanding the scope of learning spaces (Sutherland et al. 2000 ). In specific disciplines and contexts, digital technology was first favored in medical clinical practice, becoming an important tool for supporting the learning of clinical knowledge and practice (Tegtmeyer et al. 2001 ; Durfee et al. 2003 ).

2006.1–2011.12: initial development period

Between January 2006 and December 2011, it was the initial development period of digital technology education research. Significant growth was observed in research related to digital technology, and discussions and theoretical analyses about “digital natives” emerged. During this phase, scholars focused on the debate about “how to use digital technology reasonably” and “whether current educational models and school curriculum design need to be adjusted on a large scale” (Bennett and Maton, 2010 ; Selwyn, 2009 ; Margaryan et al. 2011 ). These theoretical and speculative arguments provided a unique perspective on the impact of cognitive digital technology on education and teaching. As can be seen from the vocabulary such as “rethinking”, “disruptive pedagogy”, and “attitude” in Fig. 4 , many scholars joined the calm reflection and analysis under the trend of digital technology (Laurillard, 2008 ; Vratulis et al. 2011 ). During this phase, technology was still undergoing dramatic changes. The development of mobile technology had already caught the attention of many scholars (Wong et al. 2011 ), but digital technology represented by computers was still very active (Selwyn et al. 2011 ). The change in technological form would inevitably lead to educational transformation. Collins and Halverson ( 2010 ) summarized the prospects and challenges of using digital technology for learning and educational practices, believing that digital technology would bring a disruptive revolution to the education field and bring about a new educational system. In addition, the term “teacher education” in Fig. 4 reflects the impact of digital technology development on teachers. The rapid development of technology has widened the generation gap between teachers and students. To ensure smooth communication between teachers and students, teachers must keep up with the trend of technological development and establish a lifelong learning concept (Donnison, 2009 ).

In the diagram, each node represents a keyword, with the size of the node indicating the frequency of occurrence of the keyword. The connections represent the co-occurrence relationships between keywords, with a higher frequency of co-occurrence resulting in tighter connections.

2012.1–2017.12: critical exploration period

During the period spanning January 2012 to December 2017, the application of digital technology in education research underwent a significant exploration phase. As can be seen from Fig. 5 , different from the previous stage, the specific elements of specific digital technology have started to increase significantly, including the enrichment of technological contexts, the greater variety of research methods, and the diversification of learning modes. Moreover, the temporal and spatial dimensions of the learning environment were further de-emphasized, as noted in previous literature (Za et al. 2014 ). Given the rapidly accelerating pace of technological development, the education system in the digital era is in urgent need of collaborative evolution and reconstruction, as argued by Davis, Eickelmann, and Zaka ( 2013 ).

In the domain of digital technology, social media has garnered substantial scholarly attention as a promising avenue for learning, as noted by Pasquini and Evangelopoulos ( 2016 ). The implementation of social media in education presents several benefits, including the liberation of education from the restrictions of physical distance and time, as well as the erasure of conventional educational boundaries. The user-generated content (UGC) model in social media has emerged as a crucial source for knowledge creation and distribution, with the widespread adoption of mobile devices. Moreover, social networks have become an integral component of ubiquitous learning environments (Hwang et al. 2013 ). The utilization of social media allows individuals to function as both knowledge producers and recipients, which leads to a blurring of the conventional roles of learners and teachers. On mobile platforms, the roles of learners and teachers are not fixed, but instead interchangeable.

In terms of research methodology, the prevalence of empirical studies with survey designs in the field of educational technology during this period is evident from the vocabulary used, such as “achievement,” “acceptance,” “attitude,” and “ict.” in Fig. 5 . These studies aim to understand learners’ willingness to adopt and attitudes towards new technologies, and some seek to investigate the impact of digital technologies on learning outcomes through quasi-experimental designs (Domínguez et al. 2013 ). Among these empirical studies, mobile learning emerged as a hot topic, and this is not surprising. First, the advantages of mobile learning environments over traditional ones have been empirically demonstrated (Hwang et al. 2013 ). Second, learners born around the turn of the century have been heavily influenced by digital technologies and have developed their own learning styles that are more open to mobile devices as a means of learning. Consequently, analyzing mobile learning as a relatively novel mode of learning has become an important issue for scholars in the field of educational technology.

The intervention of technology has led to the emergence of several novel learning modes, with the blended learning model being the most representative one in the current phase. Blended learning, a novel concept introduced in the information age, emphasizes the integration of the benefits of traditional learning methods and online learning. This learning mode not only highlights the prominent role of teachers in guiding, inspiring, and monitoring the learning process but also underlines the importance of learners’ initiative, enthusiasm, and creativity in the learning process. Despite being an early conceptualization, blended learning’s meaning has been expanded by the widespread use of mobile technology and social media in education. The implementation of new technologies, particularly mobile devices, has resulted in the transformation of curriculum design and increased flexibility and autonomy in students’ learning processes (Trujillo Maza et al. 2016 ), rekindling scholarly attention to this learning mode. However, some scholars have raised concerns about the potential drawbacks of the blended learning model, such as its significant impact on the traditional teaching system, the lack of systematic coping strategies and relevant policies in several schools and regions (Moskal et al. 2013 ).

2018.1–2022.12: accelerated transformation period

The period spanning from January 2018 to December 2022 witnessed a rapid transformation in the application of digital technology in education research. The field of digital technology education research reached a peak period of publication, largely influenced by factors such as the COVID-19 pandemic (Yu et al. 2023 ). Research during this period was built upon the achievements, attitudes, and social media of the previous phase, and included more elements that reflect the characteristics of this research field, such as digital literacy, digital competence, and professional development, as depicted in Fig. 6 . Alongside this, scholars’ expectations for the value of digital technology have expanded, and the pursuit of improving learning efficiency and performance is no longer the sole focus. Some research now aims to cultivate learners’ motivation and enhance their self-efficacy by applying digital technology in a reasonable manner, as demonstrated by recent studies (Beardsley et al. 2021 ; Creely et al. 2021 ).

The COVID-19 pandemic has emerged as a crucial backdrop for the digital technology’s role in sustaining global education, as highlighted by recent scholarly research (Zhou et al. 2022 ; Pan and Zhang, 2020 ; Mo et al. 2022 ). The online learning environment, which is supported by digital technology, has become the primary battleground for global education (Yu, 2022 ). This social context has led to various studies being conducted, with some scholars positing that the pandemic has impacted the traditional teaching order while also expanding learning possibilities in terms of patterns and forms (Alabdulaziz, 2021 ). Furthermore, the pandemic has acted as a catalyst for teacher teaching and technological innovation, and this viewpoint has been empirically substantiated (Moorhouse and Wong, 2021 ). Additionally, some scholars believe that the pandemic’s push is a crucial driving force for the digital transformation of the education system, serving as an essential mechanism for overcoming the system’s inertia (Romero et al. 2021 ).

The rapid outbreak of the pandemic posed a challenge to the large-scale implementation of digital technologies, which was influenced by a complex interplay of subjective and objective factors. Objective constraints included the lack of infrastructure in some regions to support digital technologies, while subjective obstacles included psychological resistance among certain students and teachers (Moorhouse, 2021 ). These factors greatly impacted the progress of online learning during the pandemic. Additionally, Timotheou et al. ( 2023 ) conducted a comprehensive systematic review of existing research on digital technology use during the pandemic, highlighting the critical role played by various factors such as learners’ and teachers’ digital skills, teachers’ personal attributes and professional development, school leadership and management, and administration in facilitating the digitalization and transformation of schools.

The current stage of research is characterized by the pivotal term “digital literacy,” denoting a growing interest in learners’ attitudes and adoption of emerging technologies. Initially, the term “literacy” was restricted to fundamental abilities and knowledge associated with books and print materials (McMillan, 1996 ). However, with the swift advancement of computers and digital technology, there have been various attempts to broaden the scope of literacy beyond its traditional meaning, including game literacy (Buckingham and Burn, 2007 ), information literacy (Eisenberg, 2008 ), and media literacy (Turin and Friesem, 2020 ). Similarly, digital literacy has emerged as a crucial concept, and Gilster and Glister ( 1997 ) were the first to introduce this concept, referring to the proficiency in utilizing technology and processing digital information in academic, professional, and daily life settings. In practical educational settings, learners who possess higher digital literacy often exhibit an aptitude for quickly mastering digital devices and applying them intelligently to education and teaching (Yu, 2022 ).

The utilization of digital technology in education has undergone significant changes over the past two decades, and has been a crucial driver of educational reform with each new technological revolution. The impact of these changes on the underlying logic of digital technology education applications has been noticeable. From computer technology to more recent developments such as virtual reality (VR), augmented reality (AR), and artificial intelligence (AI), the acceleration in digital technology development has been ongoing. Educational reforms spurred by digital technology development continue to be dynamic, as each new digital innovation presents new possibilities and models for teaching practice. This is especially relevant in the post-pandemic era, where the importance of technological progress in supporting teaching cannot be overstated (Mughal et al. 2022 ). Existing digital technologies have already greatly expanded the dimensions of education in both time and space, while future digital technologies aim to expand learners’ perceptions. Researchers have highlighted the potential of integrated technology and immersive technology in the development of the educational metaverse, which is highly anticipated to create a new dimension for the teaching and learning environment, foster a new value system for the discipline of educational technology, and more effectively and efficiently achieve the grand educational blueprint of the United Nations’ Sustainable Development Goals (Zhang et al. 2022 ; Li and Yu, 2023 ).

Hotspot evolution analysis (RQ3)

The examination of keyword evolution reveals a consistent trend in the advancement of digital technology education application research. The emergence and transformation of keywords serve as indicators of the varying research interests in this field. Thus, the utilization of the burst detection function available in CiteSpace allowed for the identification of the top 10 burst words that exhibited a high level of burst strength. This outcome is illustrated in Table 7 .

According to the results presented in Table 7 , the explosive terminology within the realm of digital technology education research has exhibited a concentration mainly between the years 2018 and 2022. Prior to this time frame, the emerging keywords were limited to “information technology” and “computer”. Notably, among them, computer, as an emergent keyword, has always had a high explosive intensity from 2008 to 2018, which reflects the important position of computer in digital technology and is the main carrier of many digital technologies such as Learning Management Systems (LMS) and Assessment and Feedback systems (Barlovits et al. 2022 ).

Since 2018, an increasing number of research studies have focused on evaluating the capabilities of learners to accept, apply, and comprehend digital technologies. As indicated by the use of terms such as “digital literacy” and “digital skill,” the assessment of learners’ digital literacy has become a critical task. Scholarly efforts have been directed towards the development of literacy assessment tools and the implementation of empirical assessments. Furthermore, enhancing the digital literacy of both learners and educators has garnered significant attention. (Nagle, 2018 ; Yu, 2022 ). Simultaneously, given the widespread use of various digital technologies in different formal and informal learning settings, promoting learners’ digital skills has become a crucial objective for contemporary schools (Nygren et al. 2019 ; Forde and OBrien, 2022 ).

Since 2020, the field of applied research on digital technology education has witnessed the emergence of three new hotspots, all of which have been affected to some extent by the pandemic. Firstly, digital technology has been widely applied in physical education, which is one of the subjects that has been severely affected by the pandemic (Parris et al. 2022 ; Jiang and Ning, 2022 ). Secondly, digital transformation has become an important measure for most schools, especially higher education institutions, to cope with the impact of the pandemic globally (García-Morales et al. 2021 ). Although the concept of digital transformation was proposed earlier, the COVID-19 pandemic has greatly accelerated this transformation process. Educational institutions must carefully redesign their educational products to face this new situation, providing timely digital learning methods, environments, tools, and support systems that have far-reaching impacts on modern society (Krishnamurthy, 2020 ; Salas-Pilco et al. 2022 ). Moreover, the professional development of teachers has become a key mission of educational institutions in the post-pandemic era. Teachers need to have a certain level of digital literacy and be familiar with the tools and online teaching resources used in online teaching, which has become a research hotspot today. Organizing digital skills training for teachers to cope with the application of emerging technologies in education is an important issue for teacher professional development and lifelong learning (Garzón-Artacho et al. 2021 ). As the main organizers and practitioners of emergency remote teaching (ERT) during the pandemic, teachers must put cognitive effort into their professional development to ensure effective implementation of ERT (Romero-Hall and Jaramillo Cherrez, 2022 ).

The burst word “digital transformation” reveals that we are in the midst of an ongoing digital technology revolution. With the emergence of innovative digital technologies such as ChatGPT and Microsoft 365 Copilot, technology trends will continue to evolve, albeit unpredictably. While the impact of these advancements on school education remains uncertain, it is anticipated that the widespread integration of technology will significantly affect the current education system. Rejecting emerging technologies without careful consideration is unwise. Like any revolution, the technological revolution in the education field has both positive and negative aspects. Detractors argue that digital technology disrupts learning and memory (Baron, 2021 ) or causes learners to become addicted and distracted from learning (Selwyn and Aagaard, 2020 ). On the other hand, the prudent use of digital technology in education offers a glimpse of a golden age of open learning. Educational leaders and practitioners have the opportunity to leverage cutting-edge digital technologies to address current educational challenges and develop a rational path for the sustainable and healthy growth of education.

Discussion on performance analysis (RQ1)

The field of digital technology education application research has experienced substantial growth since the turn of the century, a phenomenon that is quantifiably apparent through an analysis of authorship, country/region contributions, and institutional engagement. This expansion reflects the increased integration of digital technologies in educational settings and the heightened scholarly interest in understanding and optimizing their use.

Discussion on authorship productivity in digital technology education research

The authorship distribution within digital technology education research is indicative of the field’s intellectual structure and depth. A primary figure in this domain is Neil Selwyn, whose substantial citation rate underscores the profound impact of his work. His focus on the implications of digital technology in higher education and educational sociology has proven to be seminal. Selwyn’s research trajectory, especially the exploration of spatiotemporal extensions of education through technology, provides valuable insights into the multifaceted role of digital tools in learning processes (Selwyn et al. 2019 ).

Other notable contributors, like Henderson and Edwards, present diversified research interests, such as the impact of digital technologies during the pandemic and their application in early childhood education, respectively. Their varied focuses highlight the breadth of digital technology education research, encompassing pedagogical innovation, technological adaptation, and policy development.

Discussion on country/region-level productivity and collaboration

At the country/region level, the United Kingdom, specifically England, emerges as a leading contributor with 92 published papers and a significant citation count. This is closely followed by Australia and the United States, indicating a strong English-speaking research axis. Such geographical concentration of scholarly output often correlates with investment in research and development, technological infrastructure, and the prevalence of higher education institutions engaging in cutting-edge research.

China’s notable inclusion as the only non-Western country among the top contributors to the field suggests a growing research capacity and interest in digital technology in education. However, the lower average citation per paper for China could reflect emerging engagement or different research focuses that may not yet have achieved the same international recognition as Western counterparts.

The chord diagram analysis furthers this understanding, revealing dense interconnections between countries like the United States, China, and England, which indicates robust collaborations. Such collaborations are fundamental in addressing global educational challenges and shaping international research agendas.

Discussion on institutional-level contributions to digital technology education

Institutional productivity in digital technology education research reveals a constellation of universities driving the field forward. Monash University and the Australian Catholic University have the highest publication output, signaling Australia’s significant role in advancing digital education research. The University of Oslo’s remarkable average citation count per publication indicates influential research contributions, potentially reflecting high-quality studies that resonate with the broader academic community.

The strong showing of UK institutions, including the University of London, The Open University, and the University of Cambridge, reinforces the UK’s prominence in this research field. Such institutions are often at the forefront of pedagogical innovation, benefiting from established research cultures and funding mechanisms that support sustained inquiry into digital education.

Discussion on journal publication analysis

An examination of journal outputs offers a lens into the communicative channels of the field’s knowledge base. Journals such as Education and Information Technologies , Computers & Education , and the British Journal of Educational Technology not only serve as the primary disseminators of research findings but also as indicators of research quality and relevance. The impact factor (IF) serves as a proxy for the quality and influence of these journals within the academic community.

The high citation counts for articles published in Computers & Education suggest that research disseminated through this medium has a wide-reaching impact and is of particular interest to the field. This is further evidenced by its significant IF of 11.182, indicating that the journal is a pivotal platform for seminal work in the application of digital technology in education.

The authorship, regional, and institutional productivity in the field of digital technology education application research collectively narrate the evolution of this domain since the turn of the century. The prominence of certain authors and countries underscores the importance of socioeconomic factors and existing academic infrastructure in fostering research productivity. Meanwhile, the centrality of specific journals as outlets for high-impact research emphasizes the role of academic publishing in shaping the research landscape.

As the field continues to grow, future research may benefit from leveraging the collaborative networks that have been elucidated through this analysis, perhaps focusing on underrepresented regions to broaden the scope and diversity of research. Furthermore, the stabilization of publication numbers in recent years invites a deeper exploration into potential plateaus in research trends or saturation in certain sub-fields, signaling an opportunity for novel inquiries and methodological innovations.

Discussion on the evolutionary trends (RQ2)

The evolution of the research field concerning the application of digital technology in education over the past two decades is a story of convergence, diversification, and transformation, shaped by rapid technological advancements and shifting educational paradigms.

At the turn of the century, the inception of digital technology in education was largely exploratory, with a focus on how emerging computer technologies could be harnessed to enhance traditional learning environments. Research from this early period was primarily descriptive, reflecting on the potential and challenges of incorporating digital tools into the educational setting. This phase was critical in establishing the fundamental discourse that would guide subsequent research, as it set the stage for understanding the scope and impact of digital technology in learning spaces (Wang et al. 2023 ).

As the first decade progressed, the narrative expanded to encompass the pedagogical implications of digital technologies. This was a period of conceptual debates, where terms like “digital natives” and “disruptive pedagogy” entered the academic lexicon, underscoring the growing acknowledgment of digital technology as a transformative force within education (Bennett and Maton, 2010 ). During this time, the research began to reflect a more nuanced understanding of the integration of technology, considering not only its potential to change where and how learning occurred but also its implications for educational equity and access.

In the second decade, with the maturation of internet connectivity and mobile technology, the focus of research shifted from theoretical speculations to empirical investigations. The proliferation of digital devices and the ubiquity of social media influenced how learners interacted with information and each other, prompting a surge in studies that sought to measure the impact of these tools on learning outcomes. The digital divide and issues related to digital literacy became central concerns, as scholars explored the varying capacities of students and educators to engage with technology effectively.

Throughout this period, there was an increasing emphasis on the individualization of learning experiences, facilitated by adaptive technologies that could cater to the unique needs and pacing of learners (Jing et al. 2023a ). This individualization was coupled with a growing recognition of the importance of collaborative learning, both online and offline, and the role of digital tools in supporting these processes. Blended learning models, which combined face-to-face instruction with online resources, emerged as a significant trend, advocating for a balance between traditional pedagogies and innovative digital strategies.

The later years, particularly marked by the COVID-19 pandemic, accelerated the necessity for digital technology in education, transforming it from a supplementary tool to an essential platform for delivering education globally (Mo et al. 2022 ; Mustapha et al. 2021 ). This era brought about an unprecedented focus on online learning environments, distance education, and virtual classrooms. Research became more granular, examining not just the pedagogical effectiveness of digital tools, but also their role in maintaining continuity of education during crises, their impact on teacher and student well-being, and their implications for the future of educational policy and infrastructure.

Across these two decades, the research field has seen a shift from examining digital technology as an external addition to the educational process, to viewing it as an integral component of curriculum design, instructional strategies, and even assessment methods. The emergent themes have broadened from a narrow focus on specific tools or platforms to include wider considerations such as data privacy, ethical use of technology, and the environmental impact of digital tools.

Moreover, the field has moved from considering the application of digital technology in education as a primarily cognitive endeavor to recognizing its role in facilitating socio-emotional learning, digital citizenship, and global competencies. Researchers have increasingly turned their attention to the ways in which technology can support collaborative skills, cultural understanding, and ethical reasoning within diverse student populations.

In summary, the past over twenty years in the research field of digital technology applications in education have been characterized by a progression from foundational inquiries to complex analyses of digital integration. This evolution has mirrored the trajectory of technology itself, from a facilitative tool to a pervasive ecosystem defining contemporary educational experiences. As we look to the future, the field is poised to delve into the implications of emerging technologies like AI, AR, and VR, and their potential to redefine the educational landscape even further. This ongoing metamorphosis suggests that the application of digital technology in education will continue to be a rich area of inquiry, demanding continual adaptation and forward-thinking from educators and researchers alike.

Discussion on the study of research hotspots (RQ3)

The analysis of keyword evolution in digital technology education application research elucidates the current frontiers in the field, reflecting a trajectory that is in tandem with the rapidly advancing digital age. This landscape is sculpted by emergent technological innovations and shaped by the demands of an increasingly digital society.

Interdisciplinary integration and pedagogical transformation

One of the frontiers identified from recent keyword bursts includes the integration of digital technology into diverse educational contexts, particularly noted with the keyword “physical education.” The digitalization of disciplines traditionally characterized by physical presence illustrates the pervasive reach of technology and signifies a push towards interdisciplinary integration where technology is not only a facilitator but also a transformative agent. This integration challenges educators to reconceptualize curriculum delivery to accommodate digital tools that can enhance or simulate the physical aspects of learning.

Digital literacy and skills acquisition

Another pivotal frontier is the focus on “digital literacy” and “digital skill”, which has intensified in recent years. This suggests a shift from mere access to technology towards a comprehensive understanding and utilization of digital tools. In this realm, the emphasis is not only on the ability to use technology but also on critical thinking, problem-solving, and the ethical use of digital resources (Yu, 2022 ). The acquisition of digital literacy is no longer an additive skill but a fundamental aspect of modern education, essential for navigating and contributing to the digital world.

Educational digital transformation

The keyword “digital transformation” marks a significant research frontier, emphasizing the systemic changes that education institutions must undergo to align with the digital era (Romero et al. 2021 ). This transformation includes the redesigning of learning environments, pedagogical strategies, and assessment methods to harness digital technology’s full potential. Research in this area explores the complexity of institutional change, addressing the infrastructural, cultural, and policy adjustments needed for a seamless digital transition.

Engagement and participation

Further exploration into “engagement” and “participation” underscores the importance of student-centered learning environments that are mediated by technology. The current frontiers examine how digital platforms can foster collaboration, inclusivity, and active learning, potentially leading to more meaningful and personalized educational experiences. Here, the use of technology seeks to support the emotional and cognitive aspects of learning, moving beyond the transactional view of education to one that is relational and interactive.

Professional development and teacher readiness

As the field evolves, “professional development” emerges as a crucial area, particularly in light of the pandemic which necessitated emergency remote teaching. The need for teacher readiness in a digital age is a pressing frontier, with research focusing on the competencies required for educators to effectively integrate technology into their teaching practices. This includes familiarity with digital tools, pedagogical innovation, and an ongoing commitment to personal and professional growth in the digital domain.

Pandemic as a catalyst

The recent pandemic has acted as a catalyst for accelerated research and application in this field, particularly in the domains of “digital transformation,” “professional development,” and “physical education.” This period has been a litmus test for the resilience and adaptability of educational systems to continue their operations in an emergency. Research has thus been directed at understanding how digital technologies can support not only continuity but also enhance the quality and reach of education in such contexts.

Ethical and societal considerations

The frontier of digital technology in education is also expanding to consider broader ethical and societal implications. This includes issues of digital equity, data privacy, and the sociocultural impact of technology on learning communities. The research explores how educational technology can be leveraged to address inequities and create more equitable learning opportunities for all students, regardless of their socioeconomic background.

Innovation and emerging technologies

Looking forward, the frontiers are set to be influenced by ongoing and future technological innovations, such as artificial intelligence (AI) (Wu and Yu, 2023 ; Chen et al. 2022a ). The exploration into how these technologies can be integrated into educational practices to create immersive and adaptive learning experiences represents a bold new chapter for the field.

In conclusion, the current frontiers of research on the application of digital technology in education are multifaceted and dynamic. They reflect an overarching movement towards deeper integration of technology in educational systems and pedagogical practices, where the goals are not only to facilitate learning but to redefine it. As these frontiers continue to expand and evolve, they will shape the educational landscape, requiring a concerted effort from researchers, educators, policymakers, and technologists to navigate the challenges and harness the opportunities presented by the digital revolution in education.

Conclusions and future research

Conclusions.

The utilization of digital technology in education is a research area that cuts across multiple technical and educational domains and continues to experience dynamic growth due to the continuous progress of technology. In this study, a systematic review of this field was conducted through bibliometric techniques to examine its development trajectory. The primary focus of the review was to investigate the leading contributors, productive national institutions, significant publications, and evolving development patterns. The study’s quantitative analysis resulted in several key conclusions that shed light on this research field’s current state and future prospects.

(1) The research field of digital technology education applications has entered a stage of rapid development, particularly in recent years due to the impact of the pandemic, resulting in a peak of publications. Within this field, several key authors (Selwyn, Henderson, Edwards, etc.) and countries/regions (England, Australia, USA, etc.) have emerged, who have made significant contributions. International exchanges in this field have become frequent, with a high degree of internationalization in academic research. Higher education institutions in the UK and Australia are the core productive forces in this field at the institutional level.

(2) Education and Information Technologies , Computers & Education , and the British Journal of Educational Technology are notable journals that publish research related to digital technology education applications. These journals are affiliated with the research field of educational technology and provide effective communication platforms for sharing digital technology education applications.

(3) Over the past two decades, research on digital technology education applications has progressed from its early stages of budding, initial development, and critical exploration to accelerated transformation, and it is currently approaching maturity. Technological progress and changes in the times have been key driving forces for educational transformation and innovation, and both have played important roles in promoting the continuous development of education.

(4) Influenced by the pandemic, three emerging frontiers have emerged in current research on digital technology education applications, which are physical education, digital transformation, and professional development under the promotion of digital technology. These frontier research hotspots reflect the core issues that the education system faces when encountering new technologies. The evolution of research hotspots shows that technology breakthroughs in education’s original boundaries of time and space create new challenges. The continuous self-renewal of education is achieved by solving one hotspot problem after another.

The present study offers significant practical implications for scholars and practitioners in the field of digital technology education applications. Firstly, it presents a well-defined framework of the existing research in this area, serving as a comprehensive guide for new entrants to the field and shedding light on the developmental trajectory of this research domain. Secondly, the study identifies several contemporary research hotspots, thus offering a valuable decision-making resource for scholars aiming to explore potential research directions. Thirdly, the study undertakes an exhaustive analysis of published literature to identify core journals in the field of digital technology education applications, with Sustainability being identified as a promising open access journal that publishes extensively on this topic. This finding can potentially facilitate scholars in selecting appropriate journals for their research outputs.

Limitation and future research

Influenced by some objective factors, this study also has some limitations. First of all, the bibliometrics analysis software has high standards for data. In order to ensure the quality and integrity of the collected data, the research only selects the periodical papers in SCIE and SSCI indexes, which are the core collection of Web of Science database, and excludes other databases, conference papers, editorials and other publications, which may ignore some scientific research and original opinions in the field of digital technology education and application research. In addition, although this study used professional software to carry out bibliometric analysis and obtained more objective quantitative data, the analysis and interpretation of data will inevitably have a certain subjective color, and the influence of subjectivity on data analysis cannot be completely avoided. As such, future research endeavors will broaden the scope of literature screening and proactively engage scholars in the field to gain objective and state-of-the-art insights, while minimizing the adverse impact of personal subjectivity on research analysis.

Data availability

The datasets analyzed during the current study are available in the Dataverse repository: https://doi.org/10.7910/DVN/F9QMHY

Alabdulaziz MS (2021) COVID-19 and the use of digital technology in mathematics education. Educ Inf Technol 26(6):7609–7633. https://doi.org/10.1007/s10639-021-10602-3

Arif TB, Munaf U, Ul-Haque I (2023) The future of medical education and research: is ChatGPT a blessing or blight in disguise? Med Educ Online 28. https://doi.org/10.1080/10872981.2023.2181052

Banerjee M, Chiew D, Patel KT, Johns I, Chappell D, Linton N, Cole GD, Francis DP, Szram J, Ross J, Zaman S (2021) The impact of artificial intelligence on clinical education: perceptions of postgraduate trainee doctors in London (UK) and recommendations for trainers. BMC Med Educ 21. https://doi.org/10.1186/s12909-021-02870-x

Barlovits S, Caldeira A, Fesakis G, Jablonski S, Koutsomanoli Filippaki D, Lázaro C, Ludwig M, Mammana MF, Moura A, Oehler DXK, Recio T, Taranto E, Volika S(2022) Adaptive, synchronous, and mobile online education: developing the ASYMPTOTE learning environment. Mathematics 10:1628. https://doi.org/10.3390/math10101628

Article   Google Scholar  

Baron NS(2021) Know what? How digital technologies undermine learning and remembering J Pragmat 175:27–37. https://doi.org/10.1016/j.pragma.2021.01.011

Batista J, Morais NS, Ramos F (2016) Researching the use of communication technologies in higher education institutions in Portugal. https://doi.org/10.4018/978-1-5225-0571-6.ch057

Beardsley M, Albó L, Aragón P, Hernández-Leo D (2021) Emergency education effects on teacher abilities and motivation to use digital technologies. Br J Educ Technol 52. https://doi.org/10.1111/bjet.13101

Bennett S, Maton K(2010) Beyond the “digital natives” debate: towards a more nuanced understanding of students’ technology experiences J Comput Assist Learn 26:321–331. https://doi.org/10.1111/j.1365-2729.2010.00360.x

Buckingham D, Burn A (2007) Game literacy in theory and practice 16:323–349

Google Scholar  

Bulfin S, Pangrazio L, Selwyn N (2014) Making “MOOCs”: the construction of a new digital higher education within news media discourse. In: The International Review of Research in Open and Distributed Learning 15. https://doi.org/10.19173/irrodl.v15i5.1856

Camilleri MA, Camilleri AC(2016) Digital learning resources and ubiquitous technologies in education Technol Knowl Learn 22:65–82. https://doi.org/10.1007/s10758-016-9287-7

Chen C(2006) CiteSpace II: detecting and visualizing emerging trends and transient patterns in scientific literature J Am Soc Inf Sci Technol 57:359–377. https://doi.org/10.1002/asi.20317

Chen J, Dai J, Zhu K, Xu L(2022) Effects of extended reality on language learning: a meta-analysis Front Psychol 13:1016519. https://doi.org/10.3389/fpsyg.2022.1016519

Article   PubMed   PubMed Central   Google Scholar  

Chen J, Wang CL, Tang Y (2022b) Knowledge mapping of volunteer motivation: a bibliometric analysis and cross-cultural comparative study. Front Psychol 13. https://doi.org/10.3389/fpsyg.2022.883150

Cohen A, Soffer T, Henderson M(2022) Students’ use of technology and their perceptions of its usefulness in higher education: International comparison J Comput Assist Learn 38(5):1321–1331. https://doi.org/10.1111/jcal.12678

Collins A, Halverson R(2010) The second educational revolution: rethinking education in the age of technology J Comput Assist Learn 26:18–27. https://doi.org/10.1111/j.1365-2729.2009.00339.x

Conole G, Alevizou P (2010) A literature review of the use of Web 2.0 tools in higher education. Walton Hall, Milton Keynes, UK: the Open University, retrieved 17 February

Creely E, Henriksen D, Crawford R, Henderson M(2021) Exploring creative risk-taking and productive failure in classroom practice. A case study of the perceived self-efficacy and agency of teachers at one school Think Ski Creat 42:100951. https://doi.org/10.1016/j.tsc.2021.100951

Davis N, Eickelmann B, Zaka P(2013) Restructuring of educational systems in the digital age from a co-evolutionary perspective J Comput Assist Learn 29:438–450. https://doi.org/10.1111/jcal.12032

De Belli N (2009) Bibliometrics and citation analysis: from the science citation index to cybermetrics, Scarecrow Press. https://doi.org/10.1111/jcal.12032

Domínguez A, Saenz-de-Navarrete J, de-Marcos L, Fernández-Sanz L, Pagés C, Martínez-Herráiz JJ(2013) Gamifying learning experiences: practical implications and outcomes Comput Educ 63:380–392. https://doi.org/10.1016/j.compedu.2012.12.020

Donnison S (2009) Discourses in conflict: the relationship between Gen Y pre-service teachers, digital technologies and lifelong learning. Australasian J Educ Technol 25. https://doi.org/10.14742/ajet.1138

Durfee SM, Jain S, Shaffer K (2003) Incorporating electronic media into medical student education. Acad Radiol 10:205–210. https://doi.org/10.1016/s1076-6332(03)80046-6

Dzikowski P(2018) A bibliometric analysis of born global firms J Bus Res 85:281–294. https://doi.org/10.1016/j.jbusres.2017.12.054

van Eck NJ, Waltman L(2009) Software survey: VOSviewer, a computer program for bibliometric mapping Scientometrics 84:523–538 https://doi.org/10.1007/s11192-009-0146-3

Edwards S(2013) Digital play in the early years: a contextual response to the problem of integrating technologies and play-based pedagogies in the early childhood curriculum Eur Early Child Educ Res J 21:199–212. https://doi.org/10.1080/1350293x.2013.789190

Edwards S(2015) New concepts of play and the problem of technology, digital media and popular-culture integration with play-based learning in early childhood education Technol Pedagogy Educ 25:513–532 https://doi.org/10.1080/1475939x.2015.1108929

Article   MathSciNet   Google Scholar  

Eisenberg MB(2008) Information literacy: essential skills for the information age DESIDOC J Libr Inf Technol 28:39–47. https://doi.org/10.14429/djlit.28.2.166

Forde C, OBrien A (2022) A literature review of barriers and opportunities presented by digitally enhanced practical skill teaching and learning in health science education. Med Educ Online 27. https://doi.org/10.1080/10872981.2022.2068210

García-Morales VJ, Garrido-Moreno A, Martín-Rojas R (2021) The transformation of higher education after the COVID disruption: emerging challenges in an online learning scenario. Front Psychol 12. https://doi.org/10.3389/fpsyg.2021.616059

Garfield E(2006) The history and meaning of the journal impact factor JAMA 295:90. https://doi.org/10.1001/jama.295.1.90

Article   PubMed   Google Scholar  

Garzón-Artacho E, Sola-Martínez T, Romero-Rodríguez JM, Gómez-García G(2021) Teachers’ perceptions of digital competence at the lifelong learning stage Heliyon 7:e07513. https://doi.org/10.1016/j.heliyon.2021.e07513

Gaviria-Marin M, Merigó JM, Baier-Fuentes H(2019) Knowledge management: a global examination based on bibliometric analysis Technol Forecast Soc Change 140:194–220. https://doi.org/10.1016/j.techfore.2018.07.006

Gilster P, Glister P (1997) Digital literacy. Wiley Computer Pub, New York

Greenhow C, Lewin C(2015) Social media and education: reconceptualizing the boundaries of formal and informal learning Learn Media Technol 41:6–30. https://doi.org/10.1080/17439884.2015.1064954

Hawkins DT(2001) Bibliometrics of electronic journals in information science Infor Res 7(1):7–1. http://informationr.net/ir/7-1/paper120.html

Henderson M, Selwyn N, Finger G, Aston R(2015) Students’ everyday engagement with digital technology in university: exploring patterns of use and “usefulness J High Educ Policy Manag 37:308–319 https://doi.org/10.1080/1360080x.2015.1034424

Huang CK, Neylon C, Hosking R, Montgomery L, Wilson KS, Ozaygen A, Brookes-Kenworthy C (2020) Evaluating the impact of open access policies on research institutions. eLife 9. https://doi.org/10.7554/elife.57067

Hwang GJ, Tsai CC(2011) Research trends in mobile and ubiquitous learning: a review of publications in selected journals from 2001 to 2010 Br J Educ Technol 42:E65–E70. https://doi.org/10.1111/j.1467-8535.2011.01183.x

Hwang GJ, Wu PH, Zhuang YY, Huang YM(2013) Effects of the inquiry-based mobile learning model on the cognitive load and learning achievement of students Interact Learn Environ 21:338–354. https://doi.org/10.1080/10494820.2011.575789

Jiang S, Ning CF (2022) Interactive communication in the process of physical education: are social media contributing to the improvement of physical training performance. Universal Access Inf Soc, 1–10. https://doi.org/10.1007/s10209-022-00911-w

Jing Y, Zhao L, Zhu KK, Wang H, Wang CL, Xia Q(2023) Research landscape of adaptive learning in education: a bibliometric study on research publications from 2000 to 2022 Sustainability 15:3115–3115. https://doi.org/10.3390/su15043115

Jing Y, Wang CL, Chen Y, Wang H, Yu T, Shadiev R (2023b) Bibliometric mapping techniques in educational technology research: a systematic literature review. Educ Inf Technol 1–29. https://doi.org/10.1007/s10639-023-12178-6

Krishnamurthy S (2020) The future of business education: a commentary in the shadow of the Covid-19 pandemic. J Bus Res. https://doi.org/10.1016/j.jbusres.2020.05.034

Kumar S, Lim WM, Pandey N, Christopher Westland J (2021) 20 years of electronic commerce research. Electron Commer Res 21:1–40

Kyza EA, Georgiou Y(2018) Scaffolding augmented reality inquiry learning: the design and investigation of the TraceReaders location-based, augmented reality platform Interact Learn Environ 27:211–225. https://doi.org/10.1080/10494820.2018.1458039

Laurillard D(2008) Technology enhanced learning as a tool for pedagogical innovation J Philos Educ 42:521–533. https://doi.org/10.1111/j.1467-9752.2008.00658.x

Li M, Yu Z (2023) A systematic review on the metaverse-based blended English learning. Front Psychol 13. https://doi.org/10.3389/fpsyg.2022.1087508

Luo H, Li G, Feng Q, Yang Y, Zuo M (2021) Virtual reality in K-12 and higher education: a systematic review of the literature from 2000 to 2019. J Comput Assist Learn. https://doi.org/10.1111/jcal.12538

Margaryan A, Littlejohn A, Vojt G(2011) Are digital natives a myth or reality? University students’ use of digital technologies Comput Educ 56:429–440. https://doi.org/10.1016/j.compedu.2010.09.004

McMillan S(1996) Literacy and computer literacy: definitions and comparisons Comput Educ 27:161–170. https://doi.org/10.1016/s0360-1315(96)00026-7

Mo CY, Wang CL, Dai J, Jin P (2022) Video playback speed influence on learning effect from the perspective of personalized adaptive learning: a study based on cognitive load theory. Front Psychology 13. https://doi.org/10.3389/fpsyg.2022.839982

Moorhouse BL (2021) Beginning teaching during COVID-19: newly qualified Hong Kong teachers’ preparedness for online teaching. Educ Stud 1–17. https://doi.org/10.1080/03055698.2021.1964939

Moorhouse BL, Wong KM (2021) The COVID-19 Pandemic as a catalyst for teacher pedagogical and technological innovation and development: teachers’ perspectives. Asia Pac J Educ 1–16. https://doi.org/10.1080/02188791.2021.1988511

Moskal P, Dziuban C, Hartman J (2013) Blended learning: a dangerous idea? Internet High Educ 18:15–23

Mughal MY, Andleeb N, Khurram AFA, Ali MY, Aslam MS, Saleem MN (2022) Perceptions of teaching-learning force about Metaverse for education: a qualitative study. J. Positive School Psychol 6:1738–1745

Mustapha I, Thuy Van N, Shahverdi M, Qureshi MI, Khan N (2021) Effectiveness of digital technology in education during COVID-19 pandemic. a bibliometric analysis. Int J Interact Mob Technol 15:136

Nagle J (2018) Twitter, cyber-violence, and the need for a critical social media literacy in teacher education: a review of the literature. Teach Teach Education 76:86–94

Nazare J, Woolf A, Sysoev I, Ballinger S, Saveski M, Walker M, Roy D (2022) Technology-assisted coaching can increase engagement with learning technology at home and caregivers’ awareness of it. Comput Educ 188:104565

Nguyen UP, Hallinger P (2020) Assessing the distinctive contributions of simulation & gaming to the literature, 1970-2019: a bibliometric review. Simul Gaming 104687812094156. https://doi.org/10.1177/1046878120941569

Nygren H, Nissinen K, Hämäläinen R, Wever B(2019) Lifelong learning: formal, non-formal and informal learning in the context of the use of problem-solving skills in technology-rich environments Br J Educ Technol 50:1759–1770. https://doi.org/10.1111/bjet.12807

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Moher D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg 88:105906

Pan SL, Zhang S(2020) From fighting COVID-19 pandemic to tackling sustainable development goals: an opportunity for responsible information systems research Int J Inf Manage 55:102196. https://doi.org/10.1016/j.ijinfomgt.2020.102196

Pan X, Yan E, Cui M, Hua W(2018) Examining the usage, citation, and diffusion patterns of bibliometric mapping software: a comparative study of three tools J Informetr 12:481–493. https://doi.org/10.1016/j.joi.2018.03.005

Parris Z, Cale L, Harris J, Casey A (2022) Physical activity for health, covid-19 and social media: what, where and why?. Movimento, 28. https://doi.org/10.22456/1982-8918.122533

Pasquini LA, Evangelopoulos N (2016) Sociotechnical stewardship in higher education: a field study of social media policy documents. J Comput High Educ 29:218–239

Pérez-Sanagustín M, Hernández-Leo D, Santos P, Delgado Kloos C, Blat J(2014) Augmenting reality and formality of informal and non-formal settings to enhance blended learning IEEE Trans Learn Technol 7:118–131. https://doi.org/10.1109/TLT.2014.2312719

Pinto M, Leite C (2020) Digital technologies in support of students learning in Higher Education: literature review. Digital Education Review 343–360. https://doi.org/10.1344/der.2020.37.343-360

Pires F, Masanet MJ, Tomasena JM, Scolari CA(2022) Learning with YouTube: beyond formal and informal through new actors, strategies and affordances Convergence 28(3):838–853. https://doi.org/10.1177/1354856521102054

Pritchard A (1969) Statistical bibliography or bibliometrics 25:348

Romero M, Romeu T, Guitert M, Baztán P (2021) Digital transformation in higher education: the UOC case. In ICERI2021 Proceedings (pp. 6695–6703). IATED https://doi.org/10.21125/iceri.2021.1512

Romero-Hall E, Jaramillo Cherrez N (2022) Teaching in times of disruption: faculty digital literacy in higher education during the COVID-19 pandemic. Innovations in Education and Teaching International 1–11. https://doi.org/10.1080/14703297.2022.2030782

Rospigliosi PA(2023) Artificial intelligence in teaching and learning: what questions should we ask of ChatGPT? Interactive Learning Environments 31:1–3. https://doi.org/10.1080/10494820.2023.2180191

Salas-Pilco SZ, Yang Y, Zhang Z(2022) Student engagement in online learning in Latin American higher education during the COVID-19 pandemic: a systematic review. Br J Educ Technol 53(3):593–619. https://doi.org/10.1111/bjet.13190

Selwyn N(2009) The digital native-myth and reality In Aslib proceedings 61(4):364–379. https://doi.org/10.1108/00012530910973776

Selwyn N(2012) Making sense of young people, education and digital technology: the role of sociological theory Oxford Review of Education 38:81–96. https://doi.org/10.1080/03054985.2011.577949

Selwyn N, Facer K(2014) The sociology of education and digital technology: past, present and future Oxford Rev Educ 40:482–496. https://doi.org/10.1080/03054985.2014.933005

Selwyn N, Banaji S, Hadjithoma-Garstka C, Clark W(2011) Providing a platform for parents? Exploring the nature of parental engagement with school Learning Platforms J Comput Assist Learn 27:314–323. https://doi.org/10.1111/j.1365-2729.2011.00428.x

Selwyn N, Aagaard J (2020) Banning mobile phones from classrooms-an opportunity to advance understandings of technology addiction, distraction and cyberbullying. Br J Educ Technol 52. https://doi.org/10.1111/bjet.12943

Selwyn N, O’Neill C, Smith G, Andrejevic M, Gu X (2021) A necessary evil? The rise of online exam proctoring in Australian universities. Media Int Austr 1329878X2110058. https://doi.org/10.1177/1329878x211005862

Selwyn N, Pangrazio L, Nemorin S, Perrotta C (2019) What might the school of 2030 be like? An exercise in social science fiction. Learn, Media Technol 1–17. https://doi.org/10.1080/17439884.2020.1694944

Selwyn, N (2016) What works and why?* Understanding successful technology enabled learning within institutional contexts 2016 Final report Appendices (Part B). Monash University Griffith University

Sjöberg D, Holmgren R (2021) Informal workplace learning in swedish police education-a teacher perspective. Vocations and Learning. https://doi.org/10.1007/s12186-021-09267-3

Strotmann A, Zhao D (2012) Author name disambiguation: what difference does it make in author-based citation analysis? J Am Soc Inf Sci Technol 63:1820–1833

Article   CAS   Google Scholar  

Sutherland R, Facer K, Furlong R, Furlong J(2000) A new environment for education? The computer in the home. Comput Educ 34:195–212. https://doi.org/10.1016/s0360-1315(99)00045-7

Szeto E, Cheng AY-N, Hong J-C(2015) Learning with social media: how do preservice teachers integrate YouTube and Social Media in teaching? Asia-Pac Educ Res 25:35–44. https://doi.org/10.1007/s40299-015-0230-9

Tang E, Lam C(2014) Building an effective online learning community (OLC) in blog-based teaching portfolios Int High Educ 20:79–85. https://doi.org/10.1016/j.iheduc.2012.12.002

Taskin Z, Al U(2019) Natural language processing applications in library and information science Online Inf Rev 43:676–690. https://doi.org/10.1108/oir-07-2018-0217

Tegtmeyer K, Ibsen L, Goldstein B(2001) Computer-assisted learning in critical care: from ENIAC to HAL Crit Care Med 29:N177–N182. https://doi.org/10.1097/00003246-200108001-00006

Article   CAS   PubMed   Google Scholar  

Timotheou S, Miliou O, Dimitriadis Y, Sobrino SV, Giannoutsou N, Cachia R, Moné AM, Ioannou A(2023) Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: a literature review. Educ Inf Technol 28(6):6695–6726. https://doi.org/10.1007/s10639-022-11431-8

Trujillo Maza EM, Gómez Lozano MT, Cardozo Alarcón AC, Moreno Zuluaga L, Gamba Fadul M (2016) Blended learning supported by digital technology and competency-based medical education: a case study of the social medicine course at the Universidad de los Andes, Colombia. Int J Educ Technol High Educ 13. https://doi.org/10.1186/s41239-016-0027-9

Turin O, Friesem Y(2020) Is that media literacy?: Israeli and US media scholars’ perceptions of the field J Media Lit Educ 12:132–144. https://doi.org/10.1007/s11192-009-0146-3

Van Eck NJ, Waltman L (2019) VOSviewer manual. Universiteit Leiden

Vratulis V, Clarke T, Hoban G, Erickson G(2011) Additive and disruptive pedagogies: the use of slowmation as an example of digital technology implementation Teach Teach Educ 27:1179–1188. https://doi.org/10.1016/j.tate.2011.06.004

Wang CL, Dai J, Xu LJ (2022) Big data and data mining in education: a bibliometrics study from 2010 to 2022. In 2022 7th International Conference on Cloud Computing and Big Data Analytics ( ICCCBDA ) (pp. 507-512). IEEE. https://doi.org/10.1109/icccbda55098.2022.9778874

Wang CL, Dai J, Zhu KK, Yu T, Gu XQ (2023) Understanding the continuance intention of college students toward new E-learning spaces based on an integrated model of the TAM and TTF. Int J Hum-Comput Int 1–14. https://doi.org/10.1080/10447318.2023.2291609

Wong L-H, Boticki I, Sun J, Looi C-K(2011) Improving the scaffolds of a mobile-assisted Chinese character forming game via a design-based research cycle Comput Hum Behav 27:1783–1793. https://doi.org/10.1016/j.chb.2011.03.005

Wu R, Yu Z (2023) Do AI chatbots improve students learning outcomes? Evidence from a meta-analysis. Br J Educ Technol. https://doi.org/10.1111/bjet.13334

Yang D, Zhou J, Shi D, Pan Q, Wang D, Chen X, Liu J (2022) Research status, hotspots, and evolutionary trends of global digital education via knowledge graph analysis. Sustainability 14:15157–15157. https://doi.org/10.3390/su142215157

Yu T, Dai J, Wang CL (2023) Adoption of blended learning: Chinese university students’ perspectives. Humanit Soc Sci Commun 10:390. https://doi.org/10.3390/su142215157

Yu Z (2022) Sustaining student roles, digital literacy, learning achievements, and motivation in online learning environments during the COVID-19 pandemic. Sustainability 14:4388. https://doi.org/10.3390/su14084388

Za S, Spagnoletti P, North-Samardzic A(2014) Organisational learning as an emerging process: the generative role of digital tools in informal learning practices Br J Educ Technol 45:1023–1035. https://doi.org/10.1111/bjet.12211

Zhang X, Chen Y, Hu L, Wang Y (2022) The metaverse in education: definition, framework, features, potential applications, challenges, and future research topics. Front Psychol 13:1016300. https://doi.org/10.3389/fpsyg.2022.1016300

Zhou M, Dzingirai C, Hove K, Chitata T, Mugandani R (2022) Adoption, use and enhancement of virtual learning during COVID-19. Education and Information Technologies. https://doi.org/10.1007/s10639-022-10985-x

Download references

Acknowledgements

This research was supported by the Zhejiang Provincial Social Science Planning Project, “Mechanisms and Pathways for Empowering Classroom Teaching through Learning Spaces under the Strategy of High-Quality Education Development”, the 2022 National Social Science Foundation Education Youth Project “Research on the Strategy of Creating Learning Space Value and Empowering Classroom Teaching under the background of ‘Double Reduction’” (Grant No. CCA220319) and the National College Student Innovation and Entrepreneurship Training Program of China (Grant No. 202310337023).

Author information

Authors and affiliations.

College of Educational Science and Technology, Zhejiang University of Technology, Zhejiang, China

Chengliang Wang, Xiaojiao Chen, Yidan Liu & Yuhui Jing

Graduate School of Business, Universiti Sains Malaysia, Minden, Malaysia

Department of Management, The Chinese University of Hong Kong, Hong Kong, China

College of Humanities and Social Sciences, Beihang University, Beijing, China

You can also search for this author in PubMed   Google Scholar

Contributions

Conceptualization: Y.J., C.W.; methodology, C.W.; software, C.W., Y.L.; writing-original draft preparation, C.W., Y.L.; writing-review and editing, T.Y., Y.L., C.W.; supervision, X.C., T.Y.; project administration, Y.J.; funding acquisition, X.C., Y.L. All authors read and approved the final manuscript. All authors have read and approved the re-submission of the manuscript.

Corresponding author

Correspondence to Yuhui Jing .

Ethics declarations

Ethical approval.

Ethical approval was not required as the study did not involve human participants.

Informed consent

Informed consent was not required as the study did not involve human participants.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Wang, C., Chen, X., Yu, T. et al. Education reform and change driven by digital technology: a bibliometric study from a global perspective. Humanit Soc Sci Commun 11 , 256 (2024). https://doi.org/10.1057/s41599-024-02717-y

Download citation

Received : 11 July 2023

Accepted : 17 January 2024

Published : 12 February 2024

DOI : https://doi.org/10.1057/s41599-024-02717-y

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Publication

Global education monitoring report summary, 2023: technology in education: a tool on whose terms? (hin)

The new 2023 GEM Report on  Technology in education: A tool on whose terms?  addresses the use of technology in education around the world through the lenses of relevance, equity, scalability and sustainability.

It argues that education systems should always ensure that learners’ interests are placed at the center and that digital technologies are used to support an education based on human interaction rather than aiming at substituting it. The report looks at ways in which technology can help reach disadvantaged learners but also ensure more knowledge reaches more learners in more engaging and cheaper formats. It focuses on how quality can be improved, both in teaching and learning basic skills, and in developing the digital skills needed in daily life. It recognizes the role of technology in system management with special reference to assessment data and other education management information.

Related items

• Guidelines and tools
• Policy Advice
• Country page: India
• Topics: Flagship report
• Region: Asia and the Pacific
• UNESCO Office in New Delhi
• See more add

More on this subject

Event Digital Platform Governance: Building a Global Forum of Networks 18 June 2024 - 19 June 2024

Other recent publications

How technology is reinventing education

Stanford Graduate School of Education Dean Dan Schwartz and other education scholars weigh in on what's next for some of the technology trends taking center stage in the classroom.

Image credit: Claire Scully

New advances in technology are upending education, from the recent debut of new artificial intelligence (AI) chatbots like ChatGPT to the growing accessibility of virtual-reality tools that expand the boundaries of the classroom. For educators, at the heart of it all is the hope that every learner gets an equal chance to develop the skills they need to succeed. But that promise is not without its pitfalls.

“Technology is a game-changer for education – it offers the prospect of universal access to high-quality learning experiences, and it creates fundamentally new ways of teaching,” said Dan Schwartz, dean of Stanford Graduate School of Education (GSE), who is also a professor of educational technology at the GSE and faculty director of the Stanford Accelerator for Learning . “But there are a lot of ways we teach that aren’t great, and a big fear with AI in particular is that we just get more efficient at teaching badly. This is a moment to pay attention, to do things differently.”

For K-12 schools, this year also marks the end of the Elementary and Secondary School Emergency Relief (ESSER) funding program, which has provided pandemic recovery funds that many districts used to invest in educational software and systems. With these funds running out in September 2024, schools are trying to determine their best use of technology as they face the prospect of diminishing resources.

Here, Schwartz and other Stanford education scholars weigh in on some of the technology trends taking center stage in the classroom this year.

AI in the classroom

In 2023, the big story in technology and education was generative AI, following the introduction of ChatGPT and other chatbots that produce text seemingly written by a human in response to a question or prompt. Educators immediately worried that students would use the chatbot to cheat by trying to pass its writing off as their own. As schools move to adopt policies around students’ use of the tool, many are also beginning to explore potential opportunities – for example, to generate reading assignments or coach students during the writing process.

AI can also help automate tasks like grading and lesson planning, freeing teachers to do the human work that drew them into the profession in the first place, said Victor Lee, an associate professor at the GSE and faculty lead for the AI + Education initiative at the Stanford Accelerator for Learning. “I’m heartened to see some movement toward creating AI tools that make teachers’ lives better – not to replace them, but to give them the time to do the work that only teachers are able to do,” he said. “I hope to see more on that front.”

He also emphasized the need to teach students now to begin questioning and critiquing the development and use of AI. “AI is not going away,” said Lee, who is also director of CRAFT (Classroom-Ready Resources about AI for Teaching), which provides free resources to help teach AI literacy to high school students across subject areas. “We need to teach students how to understand and think critically about this technology.”

Immersive environments

The use of immersive technologies like augmented reality, virtual reality, and mixed reality is also expected to surge in the classroom, especially as new high-profile devices integrating these realities hit the marketplace in 2024.

The educational possibilities now go beyond putting on a headset and experiencing life in a distant location. With new technologies, students can create their own local interactive 360-degree scenarios, using just a cell phone or inexpensive camera and simple online tools.

“This is an area that’s really going to explode over the next couple of years,” said Kristen Pilner Blair, director of research for the Digital Learning initiative at the Stanford Accelerator for Learning, which runs a program exploring the use of virtual field trips to promote learning. “Students can learn about the effects of climate change, say, by virtually experiencing the impact on a particular environment. But they can also become creators, documenting and sharing immersive media that shows the effects where they live.”

Integrating AI into virtual simulations could also soon take the experience to another level, Schwartz said. “If your VR experience brings me to a redwood tree, you could have a window pop up that allows me to ask questions about the tree, and AI can deliver the answers.”

Gamification

Another trend expected to intensify this year is the gamification of learning activities, often featuring dynamic videos with interactive elements to engage and hold students’ attention.

“Gamification is a good motivator, because one key aspect is reward, which is very powerful,” said Schwartz. The downside? Rewards are specific to the activity at hand, which may not extend to learning more generally. “If I get rewarded for doing math in a space-age video game, it doesn’t mean I’m going to be motivated to do math anywhere else.”

Gamification sometimes tries to make “chocolate-covered broccoli,” Schwartz said, by adding art and rewards to make speeded response tasks involving single-answer, factual questions more fun. He hopes to see more creative play patterns that give students points for rethinking an approach or adapting their strategy, rather than only rewarding them for quickly producing a correct response.

Data-gathering and analysis

The growing use of technology in schools is producing massive amounts of data on students’ activities in the classroom and online. “We’re now able to capture moment-to-moment data, every keystroke a kid makes,” said Schwartz – data that can reveal areas of struggle and different learning opportunities, from solving a math problem to approaching a writing assignment.

But outside of research settings, he said, that type of granular data – now owned by tech companies – is more likely used to refine the design of the software than to provide teachers with actionable information.

The promise of personalized learning is being able to generate content aligned with students’ interests and skill levels, and making lessons more accessible for multilingual learners and students with disabilities. Realizing that promise requires that educators can make sense of the data that’s being collected, said Schwartz – and while advances in AI are making it easier to identify patterns and findings, the data also needs to be in a system and form educators can access and analyze for decision-making. Developing a usable infrastructure for that data, Schwartz said, is an important next step.

With the accumulation of student data comes privacy concerns: How is the data being collected? Are there regulations or guidelines around its use in decision-making? What steps are being taken to prevent unauthorized access? In 2023 K-12 schools experienced a rise in cyberattacks, underscoring the need to implement strong systems to safeguard student data.

Technology is “requiring people to check their assumptions about education,” said Schwartz, noting that AI in particular is very efficient at replicating biases and automating the way things have been done in the past, including poor models of instruction. “But it’s also opening up new possibilities for students producing material, and for being able to identify children who are not average so we can customize toward them. It’s an opportunity to think of entirely new ways of teaching – this is the path I hope to see.”

REALIZING THE PROMISE:

Leading up to the 75th anniversary of the UN General Assembly, this “Realizing the promise: How can education technology improve learning for all?” publication kicks off the Center for Universal Education’s first playbook in a series to help improve education around the world.

It is intended as an evidence-based tool for ministries of education, particularly in low- and middle-income countries, to adopt and more successfully invest in education technology.

While there is no single education initiative that will achieve the same results everywhere—as school systems differ in learners and educators, as well as in the availability and quality of materials and technologies—an important first step is understanding how technology is used given specific local contexts and needs.

The surveys in this playbook are designed to be adapted to collect this information from educators, learners, and school leaders and guide decisionmakers in expanding the use of technology.  

Introduction

While technology has disrupted most sectors of the economy and changed how we communicate, access information, work, and even play, its impact on schools, teaching, and learning has been much more limited. We believe that this limited impact is primarily due to technology being been used to replace analog tools, without much consideration given to playing to technology’s comparative advantages. These comparative advantages, relative to traditional “chalk-and-talk” classroom instruction, include helping to scale up standardized instruction, facilitate differentiated instruction, expand opportunities for practice, and increase student engagement. When schools use technology to enhance the work of educators and to improve the quality and quantity of educational content, learners will thrive.

Further, COVID-19 has laid bare that, in today’s environment where pandemics and the effects of climate change are likely to occur, schools cannot always provide in-person education—making the case for investing in education technology.

Here we argue for a simple yet surprisingly rare approach to education technology that seeks to:

• Understand the needs, infrastructure, and capacity of a school system—the diagnosis;
• Survey the best available evidence on interventions that match those conditions—the evidence; and
• Closely monitor the results of innovations before they are scaled up—the prognosis.

RELATED CONTENT

Podcast: How education technology can improve learning for all students

To make ed tech work, set clear goals, review the evidence, and pilot before you scale

The framework.

Our approach builds on a simple yet intuitive theoretical framework created two decades ago by two of the most prominent education researchers in the United States, David K. Cohen and Deborah Loewenberg Ball. They argue that what matters most to improve learning is the interactions among educators and learners around educational materials. We believe that the failed school-improvement efforts in the U.S. that motivated Cohen and Ball’s framework resemble the ed-tech reforms in much of the developing world to date in the lack of clarity improving the interactions between educators, learners, and the educational material. We build on their framework by adding parents as key agents that mediate the relationships between learners and educators and the material (Figure 1).

Figure 1: The instructional core

Adapted from Cohen and Ball (1999)

As the figure above suggests, ed-tech interventions can affect the instructional core in a myriad of ways. Yet, just because technology can do something, it does not mean it should. School systems in developing countries differ along many dimensions and each system is likely to have different needs for ed-tech interventions, as well as different infrastructure and capacity to enact such interventions.

The diagnosis:

How can school systems assess their needs and preparedness.

A useful first step for any school system to determine whether it should invest in education technology is to diagnose its:

• Specific needs to improve student learning (e.g., raising the average level of achievement, remediating gaps among low performers, and challenging high performers to develop higher-order skills);
• Infrastructure to adopt technology-enabled solutions (e.g., electricity connection, availability of space and outlets, stock of computers, and Internet connectivity at school and at learners’ homes); and
• Capacity to integrate technology in the instructional process (e.g., learners’ and educators’ level of familiarity and comfort with hardware and software, their beliefs about the level of usefulness of technology for learning purposes, and their current uses of such technology).

Before engaging in any new data collection exercise, school systems should take full advantage of existing administrative data that could shed light on these three main questions. This could be in the form of internal evaluations but also international learner assessments, such as the Program for International Student Assessment (PISA), the Trends in International Mathematics and Science Study (TIMSS), and/or the Progress in International Literacy Study (PIRLS), and the Teaching and Learning International Study (TALIS). But if school systems lack information on their preparedness for ed-tech reforms or if they seek to complement existing data with a richer set of indicators, we developed a set of surveys for learners, educators, and school leaders. Download the full report to see how we map out the main aspects covered by these surveys, in hopes of highlighting how they could be used to inform decisions around the adoption of ed-tech interventions.

The evidence:

How can school systems identify promising ed-tech interventions.

There is no single “ed-tech” initiative that will achieve the same results everywhere, simply because school systems differ in learners and educators, as well as in the availability and quality of materials and technologies. Instead, to realize the potential of education technology to accelerate student learning, decisionmakers should focus on four potential uses of technology that play to its comparative advantages and complement the work of educators to accelerate student learning (Figure 2). These comparative advantages include:

• Scaling up quality instruction, such as through prerecorded quality lessons.
• Facilitating differentiated instruction, through, for example, computer-adaptive learning and live one-on-one tutoring.
• Expanding opportunities to practice.
• Increasing learner engagement through videos and games.

Figure 2: Comparative advantages of technology

Here we review the evidence on ed-tech interventions from 37 studies in 20 countries*, organizing them by comparative advantage. It’s important to note that ours is not the only way to classify these interventions (e.g., video tutorials could be considered as a strategy to scale up instruction or increase learner engagement), but we believe it may be useful to highlight the needs that they could address and why technology is well positioned to do so.

When discussing specific studies, we report the magnitude of the effects of interventions using standard deviations (SDs). SDs are a widely used metric in research to express the effect of a program or policy with respect to a business-as-usual condition (e.g., test scores). There are several ways to make sense of them. One is to categorize the magnitude of the effects based on the results of impact evaluations. In developing countries, effects below 0.1 SDs are considered to be small, effects between 0.1 and 0.2 SDs are medium, and those above 0.2 SDs are large (for reviews that estimate the average effect of groups of interventions, called “meta analyses,” see e.g., Conn, 2017; Kremer, Brannen, & Glennerster, 2013; McEwan, 2014; Snilstveit et al., 2015; Evans & Yuan, 2020.)

*In surveying the evidence, we began by compiling studies from prior general and ed-tech specific evidence reviews that some of us have written and from ed-tech reviews conducted by others. Then, we tracked the studies cited by the ones we had previously read and reviewed those, as well. In identifying studies for inclusion, we focused on experimental and quasi-experimental evaluations of education technology interventions from pre-school to secondary school in low- and middle-income countries that were released between 2000 and 2020. We only included interventions that sought to improve student learning directly (i.e., students’ interaction with the material), as opposed to interventions that have impacted achievement indirectly, by reducing teacher absence or increasing parental engagement. This process yielded 37 studies in 20 countries (see the full list of studies in Appendix B).

Scaling up standardized instruction

One of the ways in which technology may improve the quality of education is through its capacity to deliver standardized quality content at scale. This feature of technology may be particularly useful in three types of settings: (a) those in “hard-to-staff” schools (i.e., schools that struggle to recruit educators with the requisite training and experience—typically, in rural and/or remote areas) (see, e.g., Urquiola & Vegas, 2005); (b) those in which many educators are frequently absent from school (e.g., Chaudhury, Hammer, Kremer, Muralidharan, & Rogers, 2006; Muralidharan, Das, Holla, & Mohpal, 2017); and/or (c) those in which educators have low levels of pedagogical and subject matter expertise (e.g., Bietenbeck, Piopiunik, & Wiederhold, 2018; Bold et al., 2017; Metzler & Woessmann, 2012; Santibañez, 2006) and do not have opportunities to observe and receive feedback (e.g., Bruns, Costa, & Cunha, 2018; Cilliers, Fleisch, Prinsloo, & Taylor, 2018). Technology could address this problem by: (a) disseminating lessons delivered by qualified educators to a large number of learners (e.g., through prerecorded or live lessons); (b) enabling distance education (e.g., for learners in remote areas and/or during periods of school closures); and (c) distributing hardware preloaded with educational materials.

Prerecorded lessons

Technology seems to be well placed to amplify the impact of effective educators by disseminating their lessons. Evidence on the impact of prerecorded lessons is encouraging, but not conclusive. Some initiatives that have used short instructional videos to complement regular instruction, in conjunction with other learning materials, have raised student learning on independent assessments. For example, Beg et al. (2020) evaluated an initiative in Punjab, Pakistan in which grade 8 classrooms received an intervention that included short videos to substitute live instruction, quizzes for learners to practice the material from every lesson, tablets for educators to learn the material and follow the lesson, and LED screens to project the videos onto a classroom screen. After six months, the intervention improved the performance of learners on independent tests of math and science by 0.19 and 0.24 SDs, respectively but had no discernible effect on the math and science section of Punjab’s high-stakes exams.

One study suggests that approaches that are far less technologically sophisticated can also improve learning outcomes—especially, if the business-as-usual instruction is of low quality. For example, Naslund-Hadley, Parker, and Hernandez-Agramonte (2014) evaluated a preschool math program in Cordillera, Paraguay that used audio segments and written materials four days per week for an hour per day during the school day. After five months, the intervention improved math scores by 0.16 SDs, narrowing gaps between low- and high-achieving learners, and between those with and without educators with formal training in early childhood education.

Yet, the integration of prerecorded material into regular instruction has not always been successful. For example, de Barros (2020) evaluated an intervention that combined instructional videos for math and science with infrastructure upgrades (e.g., two “smart” classrooms, two TVs, and two tablets), printed workbooks for students, and in-service training for educators of learners in grades 9 and 10 in Haryana, India (all materials were mapped onto the official curriculum). After 11 months, the intervention negatively impacted math achievement (by 0.08 SDs) and had no effect on science (with respect to business as usual classes). It reduced the share of lesson time that educators devoted to instruction and negatively impacted an index of instructional quality. Likewise, Seo (2017) evaluated several combinations of infrastructure (solar lights and TVs) and prerecorded videos (in English and/or bilingual) for grade 11 students in northern Tanzania and found that none of the variants improved student learning, even when the videos were used. The study reports effects from the infrastructure component across variants, but as others have noted (Muralidharan, Romero, & Wüthrich, 2019), this approach to estimating impact is problematic.

A very similar intervention delivered after school hours, however, had sizeable effects on learners’ basic skills. Chiplunkar, Dhar, and Nagesh (2020) evaluated an initiative in Chennai (the capital city of the state of Tamil Nadu, India) delivered by the same organization as above that combined short videos that explained key concepts in math and science with worksheets, facilitator-led instruction, small groups for peer-to-peer learning, and occasional career counseling and guidance for grade 9 students. These lessons took place after school for one hour, five times a week. After 10 months, it had large effects on learners’ achievement as measured by tests of basic skills in math and reading, but no effect on a standardized high-stakes test in grade 10 or socio-emotional skills (e.g., teamwork, decisionmaking, and communication).

Drawing general lessons from this body of research is challenging for at least two reasons. First, all of the studies above have evaluated the impact of prerecorded lessons combined with several other components (e.g., hardware, print materials, or other activities). Therefore, it is possible that the effects found are due to these additional components, rather than to the recordings themselves, or to the interaction between the two (see Muralidharan, 2017 for a discussion of the challenges of interpreting “bundled” interventions). Second, while these studies evaluate some type of prerecorded lessons, none examines the content of such lessons. Thus, it seems entirely plausible that the direction and magnitude of the effects depends largely on the quality of the recordings (e.g., the expertise of the educator recording it, the amount of preparation that went into planning the recording, and its alignment with best teaching practices).

These studies also raise three important questions worth exploring in future research. One of them is why none of the interventions discussed above had effects on high-stakes exams, even if their materials are typically mapped onto the official curriculum. It is possible that the official curricula are simply too challenging for learners in these settings, who are several grade levels behind expectations and who often need to reinforce basic skills (see Pritchett & Beatty, 2015). Another question is whether these interventions have long-term effects on teaching practices. It seems plausible that, if these interventions are deployed in contexts with low teaching quality, educators may learn something from watching the videos or listening to the recordings with learners. Yet another question is whether these interventions make it easier for schools to deliver instruction to learners whose native language is other than the official medium of instruction.

Distance education

Technology can also allow learners living in remote areas to access education. The evidence on these initiatives is encouraging. For example, Johnston and Ksoll (2017) evaluated a program that broadcasted live instruction via satellite to rural primary school students in the Volta and Greater Accra regions of Ghana. For this purpose, the program also equipped classrooms with the technology needed to connect to a studio in Accra, including solar panels, a satellite modem, a projector, a webcam, microphones, and a computer with interactive software. After two years, the intervention improved the numeracy scores of students in grades 2 through 4, and some foundational literacy tasks, but it had no effect on attendance or classroom time devoted to instruction, as captured by school visits. The authors interpreted these results as suggesting that the gains in achievement may be due to improving the quality of instruction that children received (as opposed to increased instructional time). Naik, Chitre, Bhalla, and Rajan (2019) evaluated a similar program in the Indian state of Karnataka and also found positive effects on learning outcomes, but it is not clear whether those effects are due to the program or due to differences in the groups of students they compared to estimate the impact of the initiative.

In one context (Mexico), this type of distance education had positive long-term effects. Navarro-Sola (2019) took advantage of the staggered rollout of the telesecundarias (i.e., middle schools with lessons broadcasted through satellite TV) in 1968 to estimate its impact. The policy had short-term effects on students’ enrollment in school: For every telesecundaria per 50 children, 10 students enrolled in middle school and two pursued further education. It also had a long-term influence on the educational and employment trajectory of its graduates. Each additional year of education induced by the policy increased average income by nearly 18 percent. This effect was attributable to more graduates entering the labor force and shifting from agriculture and the informal sector. Similarly, Fabregas (2019) leveraged a later expansion of this policy in 1993 and found that each additional telesecundaria per 1,000 adolescents led to an average increase of 0.2 years of education, and a decline in fertility for women, but no conclusive evidence of long-term effects on labor market outcomes.

It is crucial to interpret these results keeping in mind the settings where the interventions were implemented. As we mention above, part of the reason why they have proven effective is that the “counterfactual” conditions for learning (i.e., what would have happened to learners in the absence of such programs) was either to not have access to schooling or to be exposed to low-quality instruction. School systems interested in taking up similar interventions should assess the extent to which their learners (or parts of their learner population) find themselves in similar conditions to the subjects of the studies above. This illustrates the importance of assessing the needs of a system before reviewing the evidence.

Preloaded hardware

Technology also seems well positioned to disseminate educational materials. Specifically, hardware (e.g., desktop computers, laptops, or tablets) could also help deliver educational software (e.g., word processing, reference texts, and/or games). In theory, these materials could not only undergo a quality assurance review (e.g., by curriculum specialists and educators), but also draw on the interactions with learners for adjustments (e.g., identifying areas needing reinforcement) and enable interactions between learners and educators.

In practice, however, most initiatives that have provided learners with free computers, laptops, and netbooks do not leverage any of the opportunities mentioned above. Instead, they install a standard set of educational materials and hope that learners find them helpful enough to take them up on their own. Students rarely do so, and instead use the laptops for recreational purposes—often, to the detriment of their learning (see, e.g., Malamud & Pop-Eleches, 2011). In fact, free netbook initiatives have not only consistently failed to improve academic achievement in math or language (e.g., Cristia et al., 2017), but they have had no impact on learners’ general computer skills (e.g., Beuermann et al., 2015). Some of these initiatives have had small impacts on cognitive skills, but the mechanisms through which those effects occurred remains unclear.

To our knowledge, the only successful deployment of a free laptop initiative was one in which a team of researchers equipped the computers with remedial software. Mo et al. (2013) evaluated a version of the One Laptop per Child (OLPC) program for grade 3 students in migrant schools in Beijing, China in which the laptops were loaded with a remedial software mapped onto the national curriculum for math (similar to the software products that we discuss under “practice exercises” below). After nine months, the program improved math achievement by 0.17 SDs and computer skills by 0.33 SDs. If a school system decides to invest in free laptops, this study suggests that the quality of the software on the laptops is crucial.

To date, however, the evidence suggests that children do not learn more from interacting with laptops than they do from textbooks. For example, Bando, Gallego, Gertler, and Romero (2016) compared the effect of free laptop and textbook provision in 271 elementary schools in disadvantaged areas of Honduras. After seven months, students in grades 3 and 6 who had received the laptops performed on par with those who had received the textbooks in math and language. Further, even if textbooks essentially become obsolete at the end of each school year, whereas laptops can be reloaded with new materials for each year, the costs of laptop provision (not just the hardware, but also the technical assistance, Internet, and training associated with it) are not yet low enough to make them a more cost-effective way of delivering content to learners.

Evidence on the provision of tablets equipped with software is encouraging but limited. For example, de Hoop et al. (2020) evaluated a composite intervention for first grade students in Zambia’s Eastern Province that combined infrastructure (electricity via solar power), hardware (projectors and tablets), and educational materials (lesson plans for educators and interactive lessons for learners, both loaded onto the tablets and mapped onto the official Zambian curriculum). After 14 months, the intervention had improved student early-grade reading by 0.4 SDs, oral vocabulary scores by 0.25 SDs, and early-grade math by 0.22 SDs. It also improved students’ achievement by 0.16 on a locally developed assessment. The multifaceted nature of the program, however, makes it challenging to identify the components that are driving the positive effects. Pitchford (2015) evaluated an intervention that provided tablets equipped with educational “apps,” to be used for 30 minutes per day for two months to develop early math skills among students in grades 1 through 3 in Lilongwe, Malawi. The evaluation found positive impacts in math achievement, but the main study limitation is that it was conducted in a single school.

Facilitating differentiated instruction

Another way in which technology may improve educational outcomes is by facilitating the delivery of differentiated or individualized instruction. Most developing countries massively expanded access to schooling in recent decades by building new schools and making education more affordable, both by defraying direct costs, as well as compensating for opportunity costs (Duflo, 2001; World Bank, 2018). These initiatives have not only rapidly increased the number of learners enrolled in school, but have also increased the variability in learner’ preparation for schooling. Consequently, a large number of learners perform well below grade-based curricular expectations (see, e.g., Duflo, Dupas, & Kremer, 2011; Pritchett & Beatty, 2015). These learners are unlikely to get much from “one-size-fits-all” instruction, in which a single educator delivers instruction deemed appropriate for the middle (or top) of the achievement distribution (Banerjee & Duflo, 2011). Technology could potentially help these learners by providing them with: (a) instruction and opportunities for practice that adjust to the level and pace of preparation of each individual (known as “computer-adaptive learning” (CAL)); or (b) live, one-on-one tutoring.

Computer-adaptive learning

One of the main comparative advantages of technology is its ability to diagnose students’ initial learning levels and assign students to instruction and exercises of appropriate difficulty. No individual educator—no matter how talented—can be expected to provide individualized instruction to all learners in his/her class simultaneously . In this respect, technology is uniquely positioned to complement traditional teaching. This use of technology could help learners master basic skills and help them get more out of schooling.

Although many software products evaluated in recent years have been categorized as CAL, many rely on a relatively coarse level of differentiation at an initial stage (e.g., a diagnostic test) without further differentiation. We discuss these initiatives under the category of “increasing opportunities for practice” below. CAL initiatives complement an initial diagnostic with dynamic adaptation (i.e., at each response or set of responses from learners) to adjust both the initial level of difficulty and rate at which it increases or decreases, depending on whether learners’ responses are correct or incorrect.

Existing evidence on this specific type of programs is highly promising. Most famously, Banerjee et al. (2007) evaluated CAL software in Vadodara, in the Indian state of Gujarat, in which grade 4 students were offered two hours of shared computer time per week before and after school, during which they played games that involved solving math problems. The level of difficulty of such problems adjusted based on students’ answers. This program improved math achievement by 0.35 and 0.47 SDs after one and two years of implementation, respectively. Consistent with the promise of personalized learning, the software improved achievement for all students. In fact, one year after the end of the program, students assigned to the program still performed 0.1 SDs better than those assigned to a business as usual condition. More recently, Muralidharan, et al. (2019) evaluated a “blended learning” initiative in which students in grades 4 through 9 in Delhi, India received 45 minutes of interaction with CAL software for math and language, and 45 minutes of small group instruction before or after going to school. After only 4.5 months, the program improved achievement by 0.37 SDs in math and 0.23 SDs in Hindi. While all learners benefited from the program in absolute terms, the lowest performing learners benefited the most in relative terms, since they were learning very little in school.

We see two important limitations from this body of research. First, to our knowledge, none of these initiatives has been evaluated when implemented during the school day. Therefore, it is not possible to distinguish the effect of the adaptive software from that of additional instructional time. Second, given that most of these programs were facilitated by local instructors, attempts to distinguish the effect of the software from that of the instructors has been mostly based on noncausal evidence. A frontier challenge in this body of research is to understand whether CAL software can increase the effectiveness of school-based instruction by substituting part of the regularly scheduled time for math and language instruction.

Live one-on-one tutoring

Recent improvements in the speed and quality of videoconferencing, as well as in the connectivity of remote areas, have enabled yet another way in which technology can help personalization: live (i.e., real-time) one-on-one tutoring. While the evidence on in-person tutoring is scarce in developing countries, existing studies suggest that this approach works best when it is used to personalize instruction (see, e.g., Banerjee et al., 2007; Banerji, Berry, & Shotland, 2015; Cabezas, Cuesta, & Gallego, 2011).

There are almost no studies on the impact of online tutoring—possibly, due to the lack of hardware and Internet connectivity in low- and middle-income countries. One exception is Chemin and Oledan (2020)’s recent evaluation of an online tutoring program for grade 6 students in Kianyaga, Kenya to learn English from volunteers from a Canadian university via Skype ( videoconferencing software) for one hour per week after school. After 10 months, program beneficiaries performed 0.22 SDs better in a test of oral comprehension, improved their comfort using technology for learning, and became more willing to engage in cross-cultural communication. Importantly, while the tutoring sessions used the official English textbooks and sought in part to help learners with their homework, tutors were trained on several strategies to teach to each learner’s individual level of preparation, focusing on basic skills if necessary. To our knowledge, similar initiatives within a country have not yet been rigorously evaluated.

Expanding opportunities for practice

A third way in which technology may improve the quality of education is by providing learners with additional opportunities for practice. In many developing countries, lesson time is primarily devoted to lectures, in which the educator explains the topic and the learners passively copy explanations from the blackboard. This setup leaves little time for in-class practice. Consequently, learners who did not understand the explanation of the material during lecture struggle when they have to solve homework assignments on their own. Technology could potentially address this problem by allowing learners to review topics at their own pace.

Practice exercises

Technology can help learners get more out of traditional instruction by providing them with opportunities to implement what they learn in class. This approach could, in theory, allow some learners to anchor their understanding of the material through trial and error (i.e., by realizing what they may not have understood correctly during lecture and by getting better acquainted with special cases not covered in-depth in class).

Existing evidence on practice exercises reflects both the promise and the limitations of this use of technology in developing countries. For example, Lai et al. (2013) evaluated a program in Shaanxi, China where students in grades 3 and 5 were required to attend two 40-minute remedial sessions per week in which they first watched videos that reviewed the material that had been introduced in their math lessons that week and then played games to practice the skills introduced in the video. After four months, the intervention improved math achievement by 0.12 SDs. Many other evaluations of comparable interventions have found similar small-to-moderate results (see, e.g., Lai, Luo, Zhang, Huang, & Rozelle, 2015; Lai et al., 2012; Mo et al., 2015; Pitchford, 2015). These effects, however, have been consistently smaller than those of initiatives that adjust the difficulty of the material based on students’ performance (e.g., Banerjee et al., 2007; Muralidharan, et al., 2019). We hypothesize that these programs do little for learners who perform several grade levels behind curricular expectations, and who would benefit more from a review of foundational concepts from earlier grades.

We see two important limitations from this research. First, most initiatives that have been evaluated thus far combine instructional videos with practice exercises, so it is hard to know whether their effects are driven by the former or the latter. In fact, the program in China described above allowed learners to ask their peers whenever they did not understand a difficult concept, so it potentially also captured the effect of peer-to-peer collaboration. To our knowledge, no studies have addressed this gap in the evidence.

Second, most of these programs are implemented before or after school, so we cannot distinguish the effect of additional instructional time from that of the actual opportunity for practice. The importance of this question was first highlighted by Linden (2008), who compared two delivery mechanisms for game-based remedial math software for students in grades 2 and 3 in a network of schools run by a nonprofit organization in Gujarat, India: one in which students interacted with the software during the school day and another one in which students interacted with the software before or after school (in both cases, for three hours per day). After a year, the first version of the program had negatively impacted students’ math achievement by 0.57 SDs and the second one had a null effect. This study suggested that computer-assisted learning is a poor substitute for regular instruction when it is of high quality, as was the case in this well-functioning private network of schools.

In recent years, several studies have sought to remedy this shortcoming. Mo et al. (2014) were among the first to evaluate practice exercises delivered during the school day. They evaluated an initiative in Shaanxi, China in which students in grades 3 and 5 were required to interact with the software similar to the one in Lai et al. (2013) for two 40-minute sessions per week. The main limitation of this study, however, is that the program was delivered during regularly scheduled computer lessons, so it could not determine the impact of substituting regular math instruction. Similarly, Mo et al. (2020) evaluated a self-paced and a teacher-directed version of a similar program for English for grade 5 students in Qinghai, China. Yet, the key shortcoming of this study is that the teacher-directed version added several components that may also influence achievement, such as increased opportunities for teachers to provide students with personalized assistance when they struggled with the material. Ma, Fairlie, Loyalka, and Rozelle (2020) compared the effectiveness of additional time-delivered remedial instruction for students in grades 4 to 6 in Shaanxi, China through either computer-assisted software or using workbooks. This study indicates whether additional instructional time is more effective when using technology, but it does not address the question of whether school systems may improve the productivity of instructional time during the school day by substituting educator-led with computer-assisted instruction.

Increasing learner engagement

Another way in which technology may improve education is by increasing learners’ engagement with the material. In many school systems, regular “chalk and talk” instruction prioritizes time for educators’ exposition over opportunities for learners to ask clarifying questions and/or contribute to class discussions. This, combined with the fact that many developing-country classrooms include a very large number of learners (see, e.g., Angrist & Lavy, 1999; Duflo, Dupas, & Kremer, 2015), may partially explain why the majority of those students are several grade levels behind curricular expectations (e.g., Muralidharan, et al., 2019; Muralidharan & Zieleniak, 2014; Pritchett & Beatty, 2015). Technology could potentially address these challenges by: (a) using video tutorials for self-paced learning and (b) presenting exercises as games and/or gamifying practice.

Video tutorials

Technology can potentially increase learner effort and understanding of the material by finding new and more engaging ways to deliver it. Video tutorials designed for self-paced learning—as opposed to videos for whole class instruction, which we discuss under the category of “prerecorded lessons” above—can increase learner effort in multiple ways, including: allowing learners to focus on topics with which they need more help, letting them correct errors and misconceptions on their own, and making the material appealing through visual aids. They can increase understanding by breaking the material into smaller units and tackling common misconceptions.

In spite of the popularity of instructional videos, there is relatively little evidence on their effectiveness. Yet, two recent evaluations of different versions of the Khan Academy portal, which mainly relies on instructional videos, offer some insight into their impact. First, Ferman, Finamor, and Lima (2019) evaluated an initiative in 157 public primary and middle schools in five cities in Brazil in which the teachers of students in grades 5 and 9 were taken to the computer lab to learn math from the platform for 50 minutes per week. The authors found that, while the intervention slightly improved learners’ attitudes toward math, these changes did not translate into better performance in this subject. The authors hypothesized that this could be due to the reduction of teacher-led math instruction.

More recently, Büchel, Jakob, Kühnhanss, Steffen, and Brunetti (2020) evaluated an after-school, offline delivery of the Khan Academy portal in grades 3 through 6 in 302 primary schools in Morazán, El Salvador. Students in this study received 90 minutes per week of additional math instruction (effectively nearly doubling total math instruction per week) through teacher-led regular lessons, teacher-assisted Khan Academy lessons, or similar lessons assisted by technical supervisors with no content expertise. (Importantly, the first group provided differentiated instruction, which is not the norm in Salvadorian schools). All three groups outperformed both schools without any additional lessons and classrooms without additional lessons in the same schools as the program. The teacher-assisted Khan Academy lessons performed 0.24 SDs better, the supervisor-led lessons 0.22 SDs better, and the teacher-led regular lessons 0.15 SDs better, but the authors could not determine whether the effects across versions were different.

Together, these studies suggest that instructional videos work best when provided as a complement to, rather than as a substitute for, regular instruction. Yet, the main limitation of these studies is the multifaceted nature of the Khan Academy portal, which also includes other components found to positively improve learner achievement, such as differentiated instruction by students’ learning levels. While the software does not provide the type of personalization discussed above, learners are asked to take a placement test and, based on their score, educators assign them different work. Therefore, it is not clear from these studies whether the effects from Khan Academy are driven by its instructional videos or to the software’s ability to provide differentiated activities when combined with placement tests.

Games and gamification

Technology can also increase learner engagement by presenting exercises as games and/or by encouraging learner to play and compete with others (e.g., using leaderboards and rewards)—an approach known as “gamification.” Both approaches can increase learner motivation and effort by presenting learners with entertaining opportunities for practice and by leveraging peers as commitment devices.

There are very few studies on the effects of games and gamification in low- and middle-income countries. Recently, Araya, Arias Ortiz, Bottan, and Cristia (2019) evaluated an initiative in which grade 4 students in Santiago, Chile were required to participate in two 90-minute sessions per week during the school day with instructional math software featuring individual and group competitions (e.g., tracking each learner’s standing in his/her class and tournaments between sections). After nine months, the program led to improvements of 0.27 SDs in the national student assessment in math (it had no spillover effects on reading). However, it had mixed effects on non-academic outcomes. Specifically, the program increased learners’ willingness to use computers to learn math, but, at the same time, increased their anxiety toward math and negatively impacted learners’ willingness to collaborate with peers. Finally, given that one of the weekly sessions replaced regular math instruction and the other one represented additional math instructional time, it is not clear whether the academic effects of the program are driven by the software or the additional time devoted to learning math.

The prognosis:

How can school systems adopt interventions that match their needs.

Here are five specific and sequential guidelines for decisionmakers to realize the potential of education technology to accelerate student learning.

1. Take stock of how your current schools, educators, and learners are engaging with technology .

Carry out a short in-school survey to understand the current practices and potential barriers to adoption of technology (we have included suggested survey instruments in the Appendices); use this information in your decisionmaking process. For example, we learned from conversations with current and former ministers of education from various developing regions that a common limitation to technology use is regulations that hold school leaders accountable for damages to or losses of devices. Another common barrier is lack of access to electricity and Internet, or even the availability of sufficient outlets for charging devices in classrooms. Understanding basic infrastructure and regulatory limitations to the use of education technology is a first necessary step. But addressing these limitations will not guarantee that introducing or expanding technology use will accelerate learning. The next steps are thus necessary.

“In Africa, the biggest limit is connectivity. Fiber is expensive, and we don’t have it everywhere. The continent is creating a digital divide between cities, where there is fiber, and the rural areas.  The [Ghanaian] administration put in schools offline/online technologies with books, assessment tools, and open source materials. In deploying this, we are finding that again, teachers are unfamiliar with it. And existing policies prohibit students to bring their own tablets or cell phones. The easiest way to do it would have been to let everyone bring their own device. But policies are against it.” H.E. Matthew Prempeh, Minister of Education of Ghana, on the need to understand the local context.

2. Consider how the introduction of technology may affect the interactions among learners, educators, and content .

Our review of the evidence indicates that technology may accelerate student learning when it is used to scale up access to quality content, facilitate differentiated instruction, increase opportunities for practice, or when it increases learner engagement. For example, will adding electronic whiteboards to classrooms facilitate access to more quality content or differentiated instruction? Or will these expensive boards be used in the same way as the old chalkboards? Will providing one device (laptop or tablet) to each learner facilitate access to more and better content, or offer students more opportunities to practice and learn? Solely introducing technology in classrooms without additional changes is unlikely to lead to improved learning and may be quite costly. If you cannot clearly identify how the interactions among the three key components of the instructional core (educators, learners, and content) may change after the introduction of technology, then it is probably not a good idea to make the investment. See Appendix A for guidance on the types of questions to ask.

3. Once decisionmakers have a clear idea of how education technology can help accelerate student learning in a specific context, it is important to define clear objectives and goals and establish ways to regularly assess progress and make course corrections in a timely manner .

For instance, is the education technology expected to ensure that learners in early grades excel in foundational skills—basic literacy and numeracy—by age 10? If so, will the technology provide quality reading and math materials, ample opportunities to practice, and engaging materials such as videos or games? Will educators be empowered to use these materials in new ways? And how will progress be measured and adjusted?

4. How this kind of reform is approached can matter immensely for its success.

It is easy to nod to issues of “implementation,” but that needs to be more than rhetorical. Keep in mind that good use of education technology requires thinking about how it will affect learners, educators, and parents. After all, giving learners digital devices will make no difference if they get broken, are stolen, or go unused. Classroom technologies only matter if educators feel comfortable putting them to work. Since good technology is generally about complementing or amplifying what educators and learners already do, it is almost always a mistake to mandate programs from on high. It is vital that technology be adopted with the input of educators and families and with attention to how it will be used. If technology goes unused or if educators use it ineffectually, the results will disappoint—no matter the virtuosity of the technology. Indeed, unused education technology can be an unnecessary expenditure for cash-strapped education systems. This is why surveying context, listening to voices in the field, examining how technology is used, and planning for course correction is essential.

5. It is essential to communicate with a range of stakeholders, including educators, school leaders, parents, and learners .

Technology can feel alien in schools, confuse parents and (especially) older educators, or become an alluring distraction. Good communication can help address all of these risks. Taking care to listen to educators and families can help ensure that programs are informed by their needs and concerns. At the same time, deliberately and consistently explaining what technology is and is not supposed to do, how it can be most effectively used, and the ways in which it can make it more likely that programs work as intended. For instance, if teachers fear that technology is intended to reduce the need for educators, they will tend to be hostile; if they believe that it is intended to assist them in their work, they will be more receptive. Absent effective communication, it is easy for programs to “fail” not because of the technology but because of how it was used. In short, past experience in rolling out education programs indicates that it is as important to have a strong intervention design as it is to have a solid plan to socialize it among stakeholders.

Beyond reopening: A leapfrog moment to transform education?

On September 14, the Center for Universal Education (CUE) will host a webinar to discuss strategies, including around the effective use of education technology, for ensuring resilient schools in the long term and to launch a new education technology playbook “Realizing the promise: How can education technology improve learning for all?”

file-pdf Full Playbook – Realizing the promise: How can education technology improve learning for all? file-pdf References file-pdf Appendix A – Instruments to assess availability and use of technology file-pdf Appendix B – List of reviewed studies file-pdf Appendix C – How may technology affect interactions among students, teachers, and content?

About the Authors

Alejandro j. ganimian, emiliana vegas, frederick m. hess.

• Media Relations
• Terms and Conditions
• Privacy Policy

New global data reveal education technology’s impact on learning

The promise of technology in the classroom is great: enabling personalized, mastery-based learning; saving teacher time; and equipping students with the digital skills they will need  for 21st-century careers. Indeed, controlled pilot studies have shown meaningful improvements in student outcomes through personalized blended learning. 1 John F. Pane et al., “How does personalized learning affect student achievement?,” RAND Corporation, 2017, rand.org. During this time of school shutdowns and remote learning , education technology has become a lifeline for the continuation of learning.

As school systems begin to prepare for a return to the classroom , many are asking whether education technology should play a greater role in student learning beyond the immediate crisis and what that might look like. To help inform the answer to that question, this article analyzes one important data set: the 2018 Programme for International Student Assessment (PISA), published in December 2019 by the Organisation for Economic Co-operation and Development (OECD).

Every three years, the OECD uses PISA to test 15-year-olds around the world on math, reading, and science. What makes these tests so powerful is that they go beyond the numbers, asking students, principals, teachers, and parents a series of questions about their attitudes, behaviors, and resources. An optional student survey on information and communications technology (ICT) asks specifically about technology use—in the classroom, for homework, and more broadly.

In 2018, more than 340,000 students in 51 countries took the ICT survey, providing a rich data set for analyzing key questions about technology use in schools. How much is technology being used in schools? Which technologies are having a positive impact on student outcomes? What is the optimal amount of time to spend using devices in the classroom and for homework? How does this vary across different countries and regions?

From other studies we know that how education technology is used, and how it is embedded in the learning experience, is critical to its effectiveness. This data is focused on extent and intensity of use, not the pedagogical context of each classroom. It cannot therefore answer questions on the eventual potential of education technology—but it can powerfully tell us the extent to which that potential is being realized today in classrooms around the world.

Five key findings from the latest results help answer these questions and suggest potential links between technology and student outcomes:

• The type of device matters—some are associated with worse student outcomes.
• Geography matters—technology is associated with higher student outcomes in the United States than in other regions.
• Who is using the technology matters—technology in the hands of teachers is associated with higher scores than technology in the hands of students.
• Intensity matters—students who use technology intensely or not at all perform better than those with moderate use.
• A school system’s current performance level matters—in lower-performing school systems, technology is associated with worse results.

This analysis covers only one source of data, and it should be interpreted with care alongside other relevant studies. Nonetheless, the 2018 PISA results suggest that systems aiming to improve student outcomes should take a more nuanced and cautious approach to deploying technology once students return to the classroom. It is not enough add devices to the classroom, check the box, and hope for the best.

What can we learn from the latest PISA results?

How will the use, and effectiveness, of technology change post-covid-19.

The PISA assessment was carried out in 2018 and published in December 2019. Since its publication, schools and students globally have been quite suddenly thrust into far greater reliance on technology. Use of online-learning websites and adaptive software has expanded dramatically. Khan Academy has experienced a 250 percent surge in traffic; smaller sites have seen traffic grow fivefold or more. Hundreds of thousands of teachers have been thrown into the deep end, learning to use new platforms, software, and systems. No one is arguing that the rapid cobbling together of remote learning under extreme time pressure represents best-practice use of education technology. Nonetheless, a vast experiment is underway, and innovations often emerge in times of crisis. At this point, it is unclear whether this represents the beginning of a new wave of more widespread and more effective technology use in the classroom or a temporary blip that will fade once students and teachers return to in-person instruction. It is possible that a combination of software improvements, teacher capability building, and student familiarity will fundamentally change the effectiveness of education technology in improving student outcomes. It is also possible that our findings will continue to hold true and technology in the classroom will continue to be a mixed blessing. It is therefore critical that ongoing research efforts track what is working and for whom and, just as important, what is not. These answers will inform the project of reimagining a better education for all students in the aftermath of COVID-19.

PISA data have their limitations. First, these data relate to high-school students, and findings may not be applicable in elementary schools or postsecondary institutions. Second, these are single-point observational data, not longitudinal experimental data, which means that any links between technology and results should be interpreted as correlation rather than causation. Third, the outcomes measured are math, science, and reading test results, so our analysis cannot assess important soft skills and nonacademic outcomes.

It is also worth noting that technology for learning has implications beyond direct student outcomes, both positive and negative. PISA cannot address these broader issues, and neither does this paper.

But PISA results, which we’ve broken down into five key findings, can still provide powerful insights. The assessment strives to measure the understanding and application of ideas, rather than the retention of facts derived from rote memorization, and the broad geographic coverage and sample size help elucidate the reality of what is happening on the ground.

Finding 1: The type of device matters

The evidence suggests that some devices have more impact than others on outcomes (Exhibit 1). Controlling for student socioeconomic status, school type, and location, 2 Specifically, we control for a composite indicator for economic, social, and cultural status (ESCS) derived from questions about general wealth, home possessions, parental education, and parental occupation; for school type “Is your school a public or a private school” (SC013); and for school location (SC001) where the options are a village, hamlet or rural area (fewer than 3,000 people), a small town (3,000 to about 15,000 people), a town (15,000 to about 100,000 people), a city (100,000 to about 1,000,000 people), and a large city (with more than 1,000,000 people). the use of data projectors 3 A projector is any device that projects computer output, slides, or other information onto a screen in the classroom. and internet-connected computers in the classroom is correlated with nearly a grade-level-better performance on the PISA assessment (assuming approximately 40 PISA points to every grade level). 4 Students were specifically asked (IC009), “Are any of these devices available for you to use at school?,” with the choices being “Yes, and I use it,” “Yes, but I don’t use it,” and “No.” We compared the results for students who have access to and use each device with those who do not have access. The full text for each device in our chart was as follows: Data projector, eg, for slide presentations; Internet-connected school computers; Desktop computer; Interactive whiteboard, eg, SmartBoard; Portable laptop or notebook; and Tablet computer, eg, iPad, BlackBerry PlayBook.

On the other hand, students who use laptops and tablets in the classroom have worse results than those who do not. For laptops, the impact of technology varies by subject; students who use laptops score five points lower on the PISA math assessment, but the impact on science and reading scores is not statistically significant. For tablets, the picture is clearer—in every subject, students who use tablets in the classroom perform a half-grade level worse than those who do not.

Some technologies are more neutral. At the global level, there is no statistically significant difference between students who use desktop computers and interactive whiteboards in the classroom and those who do not.

Finding 2: Geography matters

Looking more closely at the reading results, which were the focus of the 2018 assessment, 5 PISA rotates between focusing on reading, science, and math. The 2018 assessment focused on reading. This means that the total testing time was two hours for each student, of which one hour was reading focused. we can see that the relationship between technology and outcomes varies widely by country and region (Exhibit 2). For example, in all regions except the United States (representing North America), 6 The United States is the only country that took the ICT Familiarity Questionnaire survey in North America; thus, we are comparing it as a country with the other regions. students who use laptops in the classroom score between five and 12 PISA points lower than students who do not use laptops. In the United States, students who use laptops score 17 PISA points higher than those who do not. It seems that US students and teachers are doing something different with their laptops than those in other regions. Perhaps this difference is related to learning curves that develop as teachers and students learn how to get the most out of devices. A proxy to assess this learning curve could be penetration—71 percent of US students claim to be using laptops in the classroom, compared with an average of 37 percent globally. 7 The rate of use excludes nulls. The United States measures higher than any other region in laptop use by students in the classroom. US = 71 percent, Asia = 40 percent, EU = 35 percent, Latin America = 31 percent, MENA = 21 percent, Non-EU Europe = 41 percent. We observe a similar pattern with interactive whiteboards in non-EU Europe. In every other region, interactive whiteboards seem to be hurting results, but in non-EU Europe they are associated with a lift of 21 PISA points, a total that represents a half-year of learning. In this case, however, penetration is not significantly higher than in other developed regions.

Finding 3: It matters whether technology is in the hands of teachers or students

The survey asks students whether the teacher, student, or both were using technology. Globally, the best results in reading occur when only the teacher is using the device, with some benefit in science when both teacher and students use digital devices (Exhibit 3). Exclusive use of the device by students is associated with significantly lower outcomes everywhere. The pattern is similar for science and math.

Again, the regional differences are instructive. Looking again at reading, we note that US students are getting significant lift (three-quarters of a year of learning) from either just teachers or teachers and students using devices, while students alone using a device score significantly lower (half a year of learning) than students who do not use devices at all. Exclusive use of devices by the teacher is associated with better outcomes in Europe too, though the size of the effect is smaller.

Finding 4: Intensity of use matters

PISA also asked students about intensity of use—how much time they spend on devices, 8 PISA rotates between focusing on reading, science, and math. The 2018 assessment focused on reading. This means that the total testing time was two hours for each student, of which one hour was reading focused. both in the classroom and for homework. The results are stark: students who either shun technology altogether or use it intensely are doing better, with those in the middle flailing (Exhibit 4).

The regional data show a dramatic picture. In the classroom, the optimal amount of time to spend on devices is either “none at all” or “greater than 60 minutes” per subject per week in every region and every subject (this is the amount of time associated with the highest student outcomes, controlling for student socioeconomic status, school type, and location). In no region is a moderate amount of time (1–30 minutes or 31–60 minutes) associated with higher student outcomes. There are important differences across subjects and regions. In math, the optimal amount of time is “none at all” in every region. 9 The United States is the only country that took the ICT Familiarity Questionnaire survey in North America; thus, we are comparing it as a country with the other regions. In reading and science, however, the optimal amount of time is greater than 60 minutes for some regions: Asia and the United States for reading, and the United States and non-EU Europe for science.

The pattern for using devices for homework is slightly less clear cut. Students in Asia, the Middle East and North Africa (MENA), and non-EU Europe score highest when they spend “no time at all” on devices for their homework, while students spending a moderate amount of time (1–60 minutes) score best in Latin America and the European Union. Finally, students in the United States who spend greater than 60 minutes are getting the best outcomes.

One interpretation of these data is that students need to get a certain familiarity with technology before they can really start using it to learn. Think of typing an essay, for example. When students who mostly write by hand set out to type an essay, their attention will be focused on the typing rather than the essay content. A competent touch typist, however, will get significant productivity gains by typing rather than handwriting.

Would you like to learn more about our Social Sector Practice ?

Finding 5: the school systems’ overall performance level matters.

Diving deeper into the reading outcomes, which were the focus of the 2018 assessment, we can see the magnitude of the impact of device use in the classroom. In Asia, Latin America, and Europe, students who spend any time on devices in their literacy and language arts classrooms perform about a half-grade level below those who spend none at all. In MENA, they perform more than a full grade level lower. In the United States, by contrast, more than an hour of device use in the classroom is associated with a lift of 17 PISA points, almost a half-year of learning improvement (Exhibit 5).

At the country level, we see that those who are on what we would call the “poor-to-fair” stage of the school-system journey 10 Michael Barber, Chinezi Chijoke, and Mona Mourshed, “ How the world’s most improved school systems keep getting better ,” November 2010. have the worst relationships between technology use and outcomes. For every poor-to-fair system taking the survey, the amount of time on devices in the classroom associated with the highest student scores is zero minutes. Good and great systems are much more mixed. Students in some very highly performing systems (for example, Estonia and Chinese Taipei) perform highest with no device use, but students in other systems (for example, Japan, the United States, and Australia) are getting the best scores with over an hour of use per week in their literacy and language arts classrooms (Exhibit 6). These data suggest that multiple approaches are effective for good-to-great systems, but poor-to-fair systems—which are not well equipped to use devices in the classroom—may need to rethink whether technology is the best use of their resources.

What are the implications for students, teachers, and systems?

Looking across all these results, we can say that the relationship between technology and outcomes in classrooms today is mixed, with variation by device, how that device is used, and geography. Our data do not permit us to draw strong causal conclusions, but this section offers a few hypotheses, informed by existing literature and our own work with school systems, that could explain these results.

First, technology must be used correctly to be effective. Our experience in the field has taught us that it is not enough to “add technology” as if it were the missing, magic ingredient. The use of tech must start with learning goals, and software selection must be based on and integrated with the curriculum. Teachers need support to adapt lesson plans to optimize the use of technology, and teachers should be using the technology themselves or in partnership with students, rather than leaving students alone with devices. These lessons hold true regardless of geography. Another ICT survey question asked principals about schools’ capacity using digital devices. Globally, students performed better in schools where there were sufficient numbers of devices connected to fast internet service; where they had adequate software and online support platforms; and where teachers had the skills, professional development, and time to integrate digital devices in instruction. This was true even accounting for student socioeconomic status, school type, and location.

COVID-19 and student learning in the United States: The hurt could last a lifetime

Second, technology must be matched to the instructional environment and context. One of the most striking findings in the latest PISA assessment is the extent to which technology has had a different impact on student outcomes in different geographies. This corroborates the findings of our 2010 report, How the world’s most improved school systems keep getting better . Those findings demonstrated that different sets of interventions were needed at different stages of the school-system reform journey, from poor-to-fair to good-to-great to excellent. In poor-to-fair systems, limited resources and teacher capabilities as well as poor infrastructure and internet bandwidth are likely to limit the benefits of student-based technology. Our previous work suggests that more prescriptive, teacher-based approaches and technologies (notably data projectors) are more likely to be effective in this context. For example, social enterprise Bridge International Academies equips teachers across several African countries with scripted lesson plans using e-readers. In general, these systems would likely be better off investing in teacher coaching than in a laptop per child. For administrators in good-to-great systems, the decision is harder, as technology has quite different impacts across different high-performing systems.

Third, technology involves a learning curve at both the system and student levels. It is no accident that the systems in which the use of education technology is more mature are getting more positive impact from tech in the classroom. The United States stands out as the country with the most mature set of education-technology products, and its scale enables companies to create software that is integrated with curricula. 11 Common Core State Standards sought to establish consistent educational standards across the United States. While these have not been adopted in all states, they cover enough states to provide continuity and consistency for software and curriculum developers. A similar effect also appears to operate at the student level; those who dabble in tech may be spending their time learning the tech rather than using the tech to learn. This learning curve needs to be built into technology-reform programs.

Taken together, these results suggest that systems that take a comprehensive, data-informed approach may achieve learning gains from thoughtful use of technology in the classroom. The best results come when significant effort is put into ensuring that devices and infrastructure are fit for purpose (fast enough internet service, for example), that software is effective and integrated with curricula, that teachers are trained and given time to rethink lesson plans integrating technology, that students have enough interaction with tech to use it effectively, and that technology strategy is cognizant of the system’s position on the school-system reform journey. Online learning and education technology are currently providing an invaluable service by enabling continued learning over the course of the pandemic; this does not mean that they should be accepted uncritically as students return to the classroom.

Jake Bryant is an associate partner in McKinsey’s Washington, DC, office; Felipe Child is a partner in the Bogotá office; Emma Dorn is the global Education Practice manager in the Silicon Valley office; and Stephen Hall is an associate partner in the Dubai office.

The authors wish to thank Fernanda Alcala, Sujatha Duraikkannan, and Samuel Huang for their contributions to this article.

Explore a career with us

Related articles.

Safely back to school after coronavirus closures

How the world’s most improved school systems keep getting better

Global Education Monitoring Report

• 2023 GEM REPORT

Technology in education

• Recommendations
• 2023 Webpage
• Press Release
• RELATED PUBLICATIONS
• Background papers
• 2021/2 GEM Report
• 2020 Report
• 2019 Report
• 2017/8 Report
• 2016 Report

A tool on whose terms?

Ismael Martínez Sánchez/ProFuturo

• Monitoring SDG 4
• 2023 webpage

Major advances in technology, especially digital technology, are rapidly transforming the world. Information and communication technology (ICT) has been applied for 100 years in education, ever since the popularization of radio in the 1920s. But it is the use of digital technology over the past 40 years that has the most significant potential to transform education. An education technology industry has emerged and focused, in turn, on the development and distribution of education content, learning management systems, language applications, augmented and virtual reality, personalized tutoring, and testing. Most recently, breakthroughs in artificial intelligence (AI), methods have increased the power of education technology tools, leading to speculation that technology could even supplant human interaction in education.

In the past 20 years, learners, educators and institutions have widely adopted digital technology tools. The number of students in MOOCs increased from 0 in 2012 to at least 220 million in 2021. The language learning application Duolingo had 20 million daily active users in 2023, and Wikipedia had 244 million page views per day in 2021. The 2018 PISA found that 65% of 15-year-old students in OECD countries were in schools whose principals agreed that teachers had the technical and pedagogical skills to integrate digital devices in instruction and 54% in schools where an effective online learning support platform was available; these shares are believed to have increased during the COVID-19 pandemic. Globally, the percentage of internet users rose from 16% in 2005 to 66% in 2022. About 50% of the world’s lower secondary schools were connected to the internet for pedagogical purposes in 2022.

The adoption of digital technology has resulted in many changes in education and learning. The set of basic skills that young people are expected to learn in school, at least in richer countries, has expanded to include a broad range of new ones to navigate the digital world. In many classrooms, paper has been replaced by screens and pens by keyboards. COVID-19 can be seen as a natural experiment where learning switched online for entire education systems virtually overnight. Higher education is the subsector with the highest rate of digital technology adoption, with online management platforms replacing campuses. The use of data analytics has grown in education management. Technology has made a wide range of informal learning opportunities accessible.

Yet the extent to which technology has transformed education needs to be debated. Change resulting from the use of digital technology is incremental, uneven and bigger in some contexts than others. The application of digital technology varies by community and socioeconomic level, by teacher willingness and preparedness, by education level, and by country income. Except in the most technologically advanced countries, computers and devices are not used in classrooms on a large scale. Technology use is not universal and will not become so any time soon. Moreover, evidence is mixed on its impact: Some types of technology seem to be effective in improving some kinds of learning. The short- and long-term costs of using digital technology appear to be significantly underestimated. The most disadvantaged are typically denied the opportunity to benefit from this technology.

Too much attention on technology in education usually comes at a high cost. Resources spent on technology, rather than on classrooms, teachers and textbooks for all children in low- and lower-middle-income countries lacking access to these resources are likely to lead to the world being further away from achieving the global education goal, SDG 4. Some of the world’s richest countries ensured universal secondary schooling and minimum learning competencies before the advent of digital technology. Children can learn without it.

However, their education is unlikely to be as relevant without digital technology. The Universal Declaration of Human Rights defines the purpose of education as promoting the ‘full development of the human personality’, strengthening ‘respect for … fundamental freedoms’ and promoting ‘understanding, tolerance and friendship’. This notion needs to move with the times. An expanded definition of the right to education could include effective support by technology for all learners to fulfil their potential, regardless of context or circumstance.

Clear objectives and principles are needed to ensure that technology use is of benefit and avoids harm. The negative and harmful aspects in the use of digital technology in education and society include risk of distraction and lack of human contact. Unregulated technology even poses threats to democracy and human rights, for instance through invasion of privacy and stoking of hatred. Education systems need to be better prepared to teach about and through digital technology, a tool that must serve the best interests of all learners, teachers and administrators. Impartial evidence showing that technology is being used in some places to improve education, and good examples of such use, need to be shared more widely so that the optimal mode of delivery can be assured for each context.

CAN TECHNOLOGY HELP SOLVE THE MOST IMPORTANT CHALLENGES IN EDUCATION?

Discussions about education technology are focused on technology rather than education. The first question should be: What are the most important challenges in education? As a basis for discussion, consider the following three challenges:

• Equity and inclusion: Is fulfilment of the right to choose the education one wants and to realize one’s full potential through education compatible with the goal of equality? If not, how can education become the great equalizer?
• Quality: Do education’s content and delivery support societies in achieving sustainable development objectives? If not, how can education help learners to not only acquire knowledge but also be agents of change?
• Efficiency: Does the current institutional arrangement of teaching learners in classrooms support the achievement of equity and quality? If not, how can education balance individualized instruction and socialization needs?

How best can digital technology be included in a strategy to tackle these challenges, and under what conditions? Digital technology packages and transmits information on an unprecedented scale at high speed and low cost. Information storage has revolutionized the volume of accessible knowledge. Information processing enables learners to receive immediate feedback and, through interaction with machines, adapt their learning pace and trajectory: Learners can organize the sequence of what they learn to suit their background and characteristics. Information sharing lowers the cost of interaction and communication. But while such technology has tremendous potential, many tools have not been designed for application to education. Not enough attention has been given to how they are applied in education and even less to how they should be applied in different education contexts.

On the question of equity and inclusion , ICT – and digital technology in particular – helps lower the education access cost for some disadvantaged groups: Those who live in remote areas are displaced, face learning difficulties, lack time or have missed out on past education opportunities. But while access to digital technology has expanded rapidly, there are deep divides in access. Disadvantaged groups own fewer devices, are less connected to the internet (Figure 1) and have fewer resources at home. The cost of much technology is falling rapidly but is still too high for some. Households that are better off can buy technology earlier, giving them more advantages and compounding disparity. Inequality in access to technology exacerbates existing inequality in access to education, a weakness exposed during the COVID-19 school closures.

Figure 1: Internet connectivity is highly unequal

Percentage of 3- to 17-year-olds with internet connection at home, by wealth quintile, selected countries, 2017–19 Source: UNICEF database.

Education quality is a multifaceted concept. It encompasses adequate inputs (e.g. availability of technology infrastructure), prepared teachers (e.g. teacher standards for technology use in classrooms), relevant content (e.g. integration of digital literacy in the curriculum) and individual learning outcomes (e.g. minimum levels of proficiency in reading and mathematics). But education quality should also encompass social outcomes. It is not enough for students to be vessels receiving knowledge; they need to be able to use it to help achieve sustainable development in social, economic and environmental terms.

There are a variety of views on the extent to which digital technologies can enhance education quality. Some argue that, in principle, digital technology creates engaging learning environments, enlivens student experiences, simulates situations, facilitates collaboration and expands connections. But others say digital technology tends to support an individualized approach to education, reducing learners’ opportunities to socialize and learn by observing each other in real-life settings. Moreover, just as new technology overcomes some constraints, it brings its own problems. Increased screen time has been associated with adverse impact on physical and mental health. Insufficient regulation has led to unauthorized use of personal data for commercial purposes. Digital technology has also helped spread misinformation and hate speech, including through education.

Improvements to efficiency may be the most promising way for digital technology to make a difference in education. Technology is touted as being able to reduce the time students and teachers spend on menial tasks, time that can be used in other, educationally more meaningful activities. However, there are conflicting views on what is meaningful. The way that education technology is used is more complex than just a substitution of resources. Technology may be one-to-many, one-to-one or peer-to-peer technology. It may require students to learn alone or with others, online or offline, independently or networked. It delivers content, creates learner communities and connects teachers with students. It provides access to information. It may be used for formal or informal learning and can assess what has been learned. It is used as a tool for productivity, creativity, communication, collaboration, design and data management. It may be professionally produced or have user-generated content. It may be specific to schools and place-based or transcend time and place. As in any complex system, each technology tool involves distinct infrastructure, design, content and pedagogy, and each may promote different types of learning.

Technology is evolving too fast to permit evaluation that could inform decisions on legislation, policy and regulation. Research on technology in education is as complex as technology itself. Studies evaluate experiences of learners of various ages using various methodologies applied in contexts as different as self-study, classrooms and schools of diverse sizes and features, non-school settings, and at system level. Findings that apply in some contexts are not always replicable elsewhere. Some conclusions can be drawn from long-term studies as technologies mature but there is an endless stream of new products. Meanwhile, not all impact can be easily measured, given technology’s ubiquity, complexity, utility and heterogeneity. In brief, while there is much general research on education technology, the amount of research for specific applications and contexts is insufficient, making it difficult to prove that a particular technology enhances a particular kind of learning.

Why is there often the perception nevertheless that technology can address major education challenges? To understand the discourse around education technology, it is necessary to look behind the language being used to promote it, and the interests it serves. Who frames the problems technology should address? What are the consequences of such framing for education? Who promotes education technology as a precondition for education transformation? How credible are such claims? What criteria and standards need to be set to evaluate digital technology’s current and potential future contribution to education so as to separate hype from substance? Can evaluation go beyond short-term assessments of impact on learning and capture potential far-reaching consequences of the generalized use of digital technology in education?

Exaggerated claims about technology go hand in hand with exaggerated estimates of its global market size. In 2022, business intelligence providers’ estimates ranged from USD 123 billion to USD 300 billion. These accounts are almost always projected forward, predicting optimistic expansion, yet they fail to give historic trends and verify whether past projections proved true. Such reporting routinely characterizes education technology as essential and technology companies as enablers and disruptors. If optimistic projections are not fulfilled, responsibility is implicitly placed on governments as a way of maintaining indirect pressure on them to increase procurement. Education is criticized as being slow to change, stuck in the past and a laggard when it comes to innovation. Such coverage plays on users’ fascination with novelty but also their fear of being left behind.

The sections below further explore the three challenges this report addresses: equity and inclusion (in terms of access to education for disadvantaged groups and access to content), quality (in terms of teaching through and about digital technology) and efficiency (in terms of education management). After identifying technology’s potential to tackle these challenges, it discusses three conditions that need to be met for that potential to be fulfilled: equitable access, appropriate governance and regulation, and sufficient teacher capacity.

EQUITY AND INCLUSION: ACCESS FOR DISADVANTAGED GROUPS

A wide range of technology brings education to hard-to-reach learners. Technology has historically opened up education to learners facing significant obstacles in access to schools or well-trained teachers. Interactive radio instruction is used in nearly 40 countries. In Nigeria, radio instruction combined with print and audiovisual materials has been used since the 1990s, reaching nearly 80% of nomads and increasing their literacy, numeracy and life skills. Television has helped educate marginalized groups, notably in Latin America and the Caribbean. The Telesecundaria programme in Mexico, combining televised lessons with in-class support and extensive teacher training, increased secondary school enrolment by 21%. Mobile learning devices, often the only type of device accessible to disadvantaged learners, have been used in hard-to-reach areas and emergencies to share educational materials; complement in-person or remote channels; and foster interactions between students, teachers and parents, notably during COVID-19. Adults have been the main target of online distance learning, with open universities having increased participation for both working and disadvantaged adults.

Inclusive technology supports accessibility and personalization for learners with disabilities. Assistive technology removes learning and communication barriers, with numerous studies reporting a significant positive impact on academic engagement, social participation and the well-being of learners with disabilities. However, such devices remain inaccessible and unaffordable in many countries, and teachers often lack specialized training to use them effectively in learning environments. While people with disabilities used to rely exclusively on specialized devices to gain access to education, technology platforms and devices are increasingly incorporating accessibility features, which support inclusive, personalized learning for all students.

Technology supports learning continuity in emergencies. Mapping of 101 distance education projects in crisis contexts in 2020 showed that 70% used radio, television and basic mobile phones. During the Boko Haram crisis in Nigeria, the Technology Enhanced Learning for All programme used mobile phones and radios to support the learning continuity of 22,000 disadvantaged children, with recorded improvement in literacy and numeracy skills. However, there are significant gaps in terms of rigorous evaluation of education technology in emergencies, despite some limited recorded impact. Meanwhile, most projects are led by non-state actors as short-term crisis responses, raising sustainability concerns; education ministries implemented only 12% of the 101 projects.

Technology supported learning during COVID-19, but millions were left out. During school closures, 95% of education ministries carried out some form of distance learning, potentially reaching over 1 billion students globally. Many of the resources used during the pandemic were first developed in response to previous emergencies or rural education, with some countries building on decades of experience with remote learning. Sierra Leone revived the Radio Teaching Programme, developed during the Ebola crisis, one week after schools closed. Mexico expanded content from its Telesecundaria programme to all levels of education. However, at least half a billion, or 31% of students worldwide – mostly the poorest (72%) and those in rural areas (70%) – could not be reached by remote learning. Although 91% of countries used online learning platforms to deliver distance learning during school closures, the platforms only reached a quarter of students globally. For the rest, low-tech interventions such as radio and television were largely used, in combination with paper-based materials and mobile phones for increased interactivity.

Some countries are expanding existing platforms to reach marginalized groups. Less than half of all countries developed long-term strategies for increasing their resilience and the sustainability of interventions as part of their COVID-19 response plans. Many have abandoned distance learning platforms developed during COVID-19, while others are repurposing them to reach marginalized learners. The digital platform set up in Ukraine during the pandemic was expanded once the war broke out in 2022, allowing 85% of schools to complete the academic year.

EQUITY AND INCLUSION: ACCESS TO CONTENT

Technology facilitates content creation and adaptation. Open educational resources (OERs) encourage the reuse and repurposing of materials to cut development time, avoid duplication of work and make materials more context-specific or relevant to learners. They also significantly reduce the cost of access to content. In the US state of North Dakota, an initial investment of USD 110,000 to shift to OERs led to savings of over USD 1 million in student costs. Social media increases access to user-generated content. YouTube, a major player in both formal and informal learning, is used by about 80% of the world’s top 113 universities. Moreover, collaborative digital tools can improve the diversity and quality of content creation. In South Africa, the Siyavule initiative supported tutor collaboration on the creation of primary and secondary education textbooks.

Digitization of educational content simplifies access and distribution. Many countries, including Bhutan and Rwanda, have created static digital versions of traditional textbooks to increase availability. Others, including India and Sweden, have produced digital textbooks that encourage interactivity and multimodal learning. Digital libraries and educational content repositories such as the National Academic Digital Library of Ethiopia, National Digital Library of India and Teachers Portal in Bangladesh help teachers and learners find relevant materials. Learning management platforms, which have become a key part of the contemporary learning environment, help organize content by integrating digital resources into course structures.

Open access resources help overcome barriers. Open universities and MOOCs can eliminate time, location and cost barriers to access. In Indonesia, where low participation in tertiary education is largely attributed to geographical challenges, MOOCs play an important role in expanding access to post-secondary learning. During COVID-19, MOOC enrolment surged, with the top three providers adding as many users in April 2020 as in all of 2019. Technology can also remove language barriers. Translation tools help connect teachers and learners from various countries and increase the accessibility of courses by non-native students.

Ensuring and assessing the quality of digital content is difficult. The sheer quantity of content and its decentralized production pose logistical challenges for evaluation. Several strategies have been implemented to address this. China established specific quality criteria for MOOCs to be nationally recognized. The European Union developed its OpenupED quality label. India strengthened the link between non-formal and formal education. Micro-credentials are increasingly used to ensure that institution and learner both meet minimum standards. Some platforms aim to improve quality by recentralizing content production. YouTube, for example, has been funnelling financing and resources to a few trusted providers and partnering with well-established education institutions.

Technology may reinforce existing inequality in both access to and production of content. Privileged groups still produce most content. A study of higher-education repositories with OER collections found that nearly 90% were created in Europe or North America; 92% of the material in the OER Commons global library is in English. This influences who has access to digital content. MOOCs, for example, mainly benefit educated learners – studies have shown around 80% of participants on major platforms already have a tertiary degree – and those from richer countries. The disparity is due to divides in digital skills, internet access, language and course design. Regional MOOCs cater to local needs and languages but can also worsen inequality.

TEACHING AND LEARNING

Technology has been used to support teaching and learning in multiple ways. Digital technology offers two broad types of opportunities. First, it can improve instruction by addressing quality gaps, increasing opportunities to practise, increasing available time and personalizing instruction. Second, it can engage learners by varying how content is represented, stimulating interaction and prompting collaboration. Systematic reviews over the past two decades on technology’s impact on learning find small to medium-sized positive effects compared to traditional instruction. However, evaluations do not always isolate technology’s impact in an intervention, making it difficult to attribute positive effects to technology alone rather than to other factors, such as added instruction time, resources or teacher support. Technology companies can have disproportionate influence on evidence production. For example, Pearson funded studies contesting independent analysis that showed its products had no impact.

The prevalence of ICT use in classrooms is not high, even in the world’s richest countries. The 2018 PISA found that only about 10% of 15-year-old students in over 50 participating education systems used digital devices for more than an hour a week in mathematics and science lessons, on average (Figure 2) . The 2018 International Computer and Information Literacy Study (ICILS) showed that in the 12 participating education systems, simulation and modelling software in classrooms was available to just over one third of students, with country levels ranging from 8% in Italy to 91% in Finland.

Figure 2: Even in upper-middle- and high-income countries, technology use in mathematics and science classrooms is limited

Percentage of 15-year-old students who used digital devices for at least one hour per week in mathematics or science classroom lessons, selected upper-middle- and high-income countries, 2018 Source: 2018 PISA database.

Recorded lessons can address teacher quality gaps and improve teacher time allocation. In China, lesson recordings from high-quality urban teachers were delivered to 100 million rural students. An impact evaluation showed improvements in Chinese skills by 32% and a 38% long-term reduction in the rural–urban earning gap. However, just delivering materials without contextualizing and providing support is insufficient. In Peru, the One Laptop Per Child programme distributed over 1 million laptops loaded with content, but no positive impact on learning resulted, partly due to the focus on provision of devices instead of the quality of pedagogical integration.

Enhancing technology-aided instruction with personalization can improve some types of learning. Personalized adaptive software generates analytics that can help teachers track student progress, identify error patterns, provide differentiated feedback and reduce workload on routine tasks. Evaluations of the use of a personalized adaptive software in India documented learning gains in after-school settings and for low-performing students. However, not all widely used software interventions have strong evidence of positive effects compared to teacher-led instruction. A meta-analysis of studies on an AI learning and assessment system that has been used by over 25 million students in the United States found it was no better than traditional classroom teaching in improving outcomes.

Varied interaction and visual representation can enhance student engagement. A meta-analysis of 43 studies published from 2008 to 2019 found that digital games improved cognitive and behavioural outcomes in mathematics. Interactive whiteboards can support teaching and learning if well integrated in pedagogy; but in the United Kingdom, despite large-scale adoption, they were mostly used to replace blackboards. Augmented, mixed or virtual reality used as an experiential learning tool for repeated practice in life-like conditions in technical, vocational and scientific subjects is not always as effective as real-life training but may be superior to other digital methods, such as video demonstrations.

Technology offers teachers low-cost and convenient ways to communicate with parents. The Colombian Institute of Family Welfare’s distance education initiative, which targeted 1.7 million disadvantaged children, relied on social media platforms to relay guidance to caregivers on pedagogical activities at home. However, uptake and effectiveness of behavioural interventions targeting caregivers are limited by parental education levels, as well as lack of time and material resources.

Student use of technology in classrooms and at home can be distracting, disrupting learning. A meta-analysis of research on student mobile phone use and its impact on education outcomes, covering students from pre-primary to higher education in 14 countries, found a small negative effect, and a larger one at the university level. Studies using PISA data indicate a negative association between ICT use and student performance beyond a threshold of moderate use. Teachers perceive tablet and phone use as hampering classroom management. More than one in three teachers in seven countries participating in the 2018 ICILS agreed that ICT use in classrooms distracted students. Online learning relies on student ability to self-regulate and may put low-performing and younger learners at increased risk of disengagement.

DIGITAL SKILLS

The definition of digital skills has been evolving along with digital technology. An analysis for this report shows that 54% of countries have identified digital skills standards for learners. The Digital Competence Framework for Citizens (DigComp), developed on behalf of the European Commission, has five competence areas: information and data literacy, communication and collaboration, digital content creation, safety, and problem-solving. Some countries have adopted digital skills frameworks developed by non-state, mostly commercial, actors. The International Computer Driving Licence (ICDL) has been promoted as a ‘digital skills standard’ but is associated mainly with Microsoft applications. Kenya and Thailand have endorsed the ICDL as the digital literacy standard for use in schools.

Digital skills are unequally distributed. In the 27 European Union (EU) countries, 54% of adults had at least basic digital skills in 2021. In Brazil, 31% of adults had at least basic skills, but the level was twice as high in urban as in rural areas, three times as high among those in the labour force as among those outside it, and nine times as high in the top socioeconomic group as in the two bottom groups. The overall gender gap in digital skills is small, but wider in specific skills. In 50 countries, 6.5% of males and 3.2% of females could write a computer program. In Belgium, Hungary and Switzerland, no more than 2 women for every 10 men could program; in Albania, Malaysia and Palestine, 9 women for every 10 men could do so. According to the 2018 PISA, 5% of 15-year-olds with the strongest reading skills but 24% of those with the weakest ones were at risk of being misled by a typical phishing email.

Formal skills training may not be the main way of acquiring digital skills. About one quarter of adults in EU countries, ranging from 16% in Italy to 40% in Sweden, had acquired skills through a ‘formalised educational institution’. Informal learning, such as self-study and informal assistance from colleagues, relatives and friends, was used by twice as many. Still, formal education is important: In 2018, those with tertiary education in Europe were twice as likely (18%) as those with upper secondary education (9%) to engage in free online training or self-study to improve their computer, software or application use. Solid mastery of literacy and numeracy skills is positively associated with mastery of at least some digital skills.

A curriculum content mapping of 16 education systems showed that Greece and Portugal dedicated less than 10% of the curriculum to data and media literacy while Estonia and the Republic of Korea embedded both in half their curricula. In some countries, media literacy in curricula is explicitly connected to critical thinking in subject disciplines, as under Georgia’s New School Model. Asia is characterized by a protectionist approach to media literacy that prioritizes information control over education. But in the Philippines, the Association for Media and Information Literacy successfully advocated for incorporation of media and information literacy in the curriculum, and it is now a core subject in grades 11 and 12.

Digital skills in communication and collaboration matter in hybrid learning arrangements. Argentina promoted teamwork skills as part of a platform for programming and robotics competitions in primary and secondary education. Mexico offers teachers and students digital education resources and tools for remote collaboration, peer learning and knowledge sharing. Ethical digital behaviour includes rules, conventions and standards to be learned, understood and practised by digital users when using digital spaces. Digital communication’s anonymity, invisibility, asynchronicity and minimization of authority can make it difficult for individuals to understand its complexities.

Competences in digital content creation include selecting appropriate delivery formats and creating copy, audio, video and visual assets; integrating digital content; and respecting copyright and licences. The ubiquitous use of social media has turned content creation into a skill with direct application in electronic commerce. In Indonesia, the Siberkreasi platform counts collaborative engagement among its core activities. The Kenya Copyright Board collaborates closely with universities to provide copyright education and conducts frequent training sessions for students in the visual arts and ICT.

Education systems need to strengthen preventive measures and respond to many safety challenges, from passwords to permissions, helping learners understand the implications of their online presence and digital footprint. In Brazil, 29% of schools have conducted debates or lectures on privacy and data protection. In New Zealand, the Te Mana Tūhono (Power of Connectivity) programme delivers digital protection and security services to almost 2,500 state and state-integrated schools. A systematic review of interventions in Australia, Italy, Spain and the United States estimated that the average programme had a 76% chance of reducing cyberbullying perpetration. In Wales, United Kingdom, the government has advised schools how to prepare for and respond to harmful viral online content and hoaxes.

The definition of problem-solving skills varies widely among education systems. Many countries perceive them in terms of coding and programming and as part of a computer science curriculum that includes computational thinking, algorithm use and automation. A global review estimated that 43% of students in high-income countries, 62% in upper-middle-income, 5% in lower-middle-income but no students in low-income countries take computer science as compulsory in primary and/or secondary education. Only 20% of education systems require schools to offer computer science as an elective or core course. Non-state actors often support coding and programming skills. In Chile, Code.org has partnered with the government to provide educational resources in computer science.

EDUCATION MANAGEMENT

Education management information systems focus on efficiency and effectiveness. Education reforms have been characterized by increased school autonomy, target setting and results-based performance, all of which require more data. By one measure, since the 1990s, the number of policies making reference to data, statistics and information has increased by 13 times in high-income, 9 times in upper-middle-income, and 5 times in low- and lower-middle-income countries. But only 54% of countries globally – and as low as 22% in sub-Saharan Africa – have unique student identification mechanisms.

Geospatial data can support education management. Geographical information systems help address equity and efficiency in infrastructure and resource distribution in education systems. School mapping has been used to foster diversity and reduce inequality of opportunity. Ireland links three databases to decide in which of its 314 planning areas to build new schools. Geospatial data can identify areas where children live too far from the nearest school. For instance, it has been estimated that 5% of the population in Guatemala and 41% in the United Republic of Tanzania live more than 3 kilometres away from the nearest primary school.

Education management information systems struggle with data integration. In 2017, Malaysia introduced the Education Data Repository as part of its 2019–23 ICT Transformation Plan to progressively integrate its 350 education data systems and applications scattered across institutions. By 2019, it had integrated 12 of its main data systems, aiming for full integration through a single data platform by the end of 2023. In New Zealand, schools had been procuring student management systems independently and lack of interoperability between them was preventing authorities from tracking student progress. In 2019, the government began setting up the National Learner Repository and Data Exchange to be hosted in cloud data centres, but deployment was paused in 2021 due to cybersecurity concerns. European countries have been addressing interoperability concerns collectively to facilitate data sharing between countries and across multiple applications used in higher-education management through the EMREX project.

Computer-based assessments and computer adaptive testing have been replacing many paper-based assessments. They reduce test administration costs, improve measurement quality and provide rapid scoring. As more examinations shift online, the need for online cheating detection and proctoring tools has also increased. While these can reduce cheating, their effectiveness should be weighed against fairness and psychological effects. Evidence on the quality and usefulness of technology-based assessments has started to emerge, but much less is known about cost efficiency. Among 34 papers on technology-based assessments reviewed for this report, transparent data on cost were lacking.

Learning analytics can increase formative feedback and enable early detection systems. In China, learning analytics has been used to identify learners’ difficulties, predict learning trajectories and manage teacher resources. In the United States, Course Signals is a system used to flag the likelihood of a student not passing a course; educators can then target them for additional support. However, learning analytics requires all actors to have sufficient data literacy. Successful education systems typically have absorptive capacity, including strong school leaders and confident teachers willing to innovate. Yet often seemingly trivial issues, such as maintenance and repair, are ignored or underestimated.

ACCESS TO TECHNOLOGY: EQUITY, EFFICIENCY AND SUSTAINABILITY

Access to electricity and devices is highly unequal between and within countries. In 2021, almost 9% of the global population – and more than 70% of people in rural sub-Saharan Africa – lacked access to electricity. Globally, one in four primary schools do not have electricity. A 2018 study in Cambodia, Ethiopia, Kenya, Myanmar, Nepal and Niger found that 31% of public schools were on grid and 9% were off grid, with only 16% enjoying uninterrupted power supply. Globally, 46% of households had a computer at home in 2020; the share of schools with computers for pedagogical purposes was 47% in primary, 62% in lower secondary and 76% in upper secondary education. There were at most 10 computers per 100 students in Brazil and Morocco but 160 computers per 100 students in Luxembourg, according to the 2018 PISA.

Internet access, a vital enabler of economic, social and cultural rights, is also unequal. In 2022, two in three people globally used the internet. In late 2021, 55% of the world’s population had mobile broadband access. In low- and middle-income countries, 16% less women than men used mobile internet in 2021. An estimated 3.2 billion people do not use mobile internet services despite being covered by a mobile broadband network. Globally, 40% of primary, 50% of lower secondary and 65% of upper secondary schools are connected to the internet. In India, 53% of private unaided and 44% of private aided schools are connected, compared with only 14% of government schools.

Various policies are used to improve access to devices. Some one in five countries have policies granting subsidies or deductions to buy devices. One-to-one technology programmes were established in 30% of countries at one time; currently only 15% of countries pursue such programmes. A number of upper-middle- and high-income countries are shifting from providing devices to allowing students to use their own devices in school. Jamaica adopted a Bring Your Own Device policy framework in 2020 to aim for sustainability.

Some countries champion free and open source software. Education institutions with complex ICT infrastructure, such as universities, can benefit from open source software to add new solutions or functionalities. By contrast, proprietary software does not permit sharing and has vendor locks that hinder interoperability, exchange and updates. In India, the National e-Governance Plan makes it mandatory for all software applications and services used in government to be built on open source software to achieve efficiency, transparency, reliability and affordability.

Countries are committed to universal internet provision at home and in school. About 85% of countries have policies to improve school or learner connectivity and 38% have laws on universal internet provision. A review of 72 low- and middle-income countries found that 29 had used universal service funds to reduce costs for underserved groups. In Kyrgyzstan, renegotiated contracts helped cut prices by nearly half and almost doubled internet speed. In Costa Rica, the Hogares Conectados (Connected Households) programme, which provided an internet cost subsidy to the poorest 60% of households with school-age children, helped reduce the share of unconnected households from 41% in 2016 to 13% in 2019. Zero-rating, or providing free internet access for education or other purposes, has been used, especially during COVID-19, but is not without problems, as it violates the net neutrality principle.

Education technology is often underutilized. In the United States, an average of 67% of education software licences were unused and 98% were not used intensively. According to the EdTech Genome Project, 85% of some 7,000 pedagogical tools, which cost USD 13 billion, were ‘either a poor fit or implemented incorrectly’. Less than one in five of the top 100 education technology tools used in classrooms met the requirements of the US Every Student Succeeds Act. Research had been published for 39% of these tools but the research was aligned with the act in only 26% of cases.

Evidence needs to drive education technology decisions. A review in the United Kingdom found that only 7% of education technology companies had conducted randomized controlled trials, 12% had used third-party certification and 18% had engaged in academic studies. An online survey of teachers and administrators in 17 US states showed that only 11% requested peer-reviewed evidence prior to adopting education technology. Recommendations influence purchase decisions, yet ratings can be manipulated through fake reviews disseminated on social media. Few governments try to fill the evidence gap, so demand has grown for independent reviews. Edtech Tulna, a partnership between a private think tank and a public university in India, offers quality standards, an evaluation toolkit and publicly available expert reviews.

Education technology procurement decisions need to take economic, social and environmental sustainability into account. With respect to economic considerations, it is estimated that initial investment in education technology accounts for just 25% or less of the eventual total cost. Regarding social concerns, procurement processes need to address equity, accessibility, local ownership and appropriation. In France, the Territoires Numériques Educatifs (Digital Educational Territories) initiative was criticized because not all subsidized equipment met local needs, and local governments were left out of the decisions on which equipment to purchase. Both issues have since been addressed. Concerning environmental considerations, it has been estimated that extending the lifespan of all laptops in the European Union by a year would save the equivalent of taking almost 1 million cars off the road in terms of CO2 emissions.

Regulation needs to address risks in education technology procurement. Public procurement is vulnerable to collusion and corruption. In 2019, Brazil’s Comptroller General of the Union found irregularities in the electronic bidding process for the purchase of 1.3 million computers, laptops and notebooks for state and municipal public schools. Decentralizing public procurement to local governments is one way to balance some of the risks. Indonesia has used its SIPLah e-commerce platform to support school-level procurement processes. However, decentralization is vulnerable to weak organizational capacity. A survey of administrators in 54 US school districts found that they had rarely carried out needs assessments.

GOVERNANCE AND REGULATION

Governance of the education technology system is fragmented. A department or an agency responsible for education technology has been identified in 82% of countries. Placing education ministries in charge of education technology strategies and plans could help ensure that decisions are primarily based on pedagogical principles. However, this is the case in just 58% of countries. In Kenya, the 2019 National Information, Communications and Technology Policy led the Ministry of Information, Communications and Technology to integrate ICT at all levels of education.

Participation is often limited in the development of education technology strategies and plans. Nepal established a Steering and a Coordination Committee under the 2013–17 ICT in Education Master Plan for intersectoral and inter-agency coordination and cooperation in its implementation. Including administrators, teachers and students can help bridge the knowledge gap with decision makers to ensure that education technology choices are appropriate. In 2022, only 41% of US education sector leaders agreed that they were regularly included in planning and strategic conversations about technology.

The private sector’s commercial interests can clash with government equity, quality and efficiency goals. In India, the government alerted families about the hidden costs of free online content. Other risks relate to data use and protection, privacy, interoperability and lock-in effects, whereby students and teachers are compelled to use specific software or platforms. Google, Apple and Microsoft produce education platforms tied to particular hardware and operating systems.

Privacy risks to children make their learning environment unsafe. One analysis found that 89% of 163 education technology products recommended for children’s learning during the COVID-19 pandemic could or did watch children outside school hours or education settings. In addition, 39 of 42 governments providing online education during the pandemic fostered uses that ‘risked or infringed’ upon children’s rights. Data used for predictive algorithms can bias predictions and decisions and lead to discrimination, privacy violations and exclusion of disadvantaged groups. The Cyberspace Administration of China and the Ministry of Education introduced regulations in 2019 requiring parental consent before devices powered by AI, such as cameras and headbands, could be used with students in schools and required data to be encrypted.

Children’s exposure to screen time has increased. A survey of screen time of parents of 3- to 8-year-olds in Australia, China, Italy, Sweden and the United States found that their children’s screen exposure increased by 50 minutes during the pandemic for both education and leisure. Extended screen time can negatively affect self-control and emotional stability, increasing anxiety and depression. Few countries have strict regulations on screen time. In China, the Ministry of Education limited the use of digital devices as teaching tools to 30% of overall teaching time. Less than one in four countries are banning the use of smartphones in schools. Italy and the United States have banned the use of specific tools or social media from schools. Cyberbullying and online abuse are rarely defined as offences but can fall under existing laws, such as stalking laws as in Australia and harassment laws in Indonesia.

Monitoring of data protection law implementation is needed. Only 16% of countries explicitly guarantee data privacy in education by law and 29% have a relevant policy, mainly in Europe and Northern America. The number of cyberattacks in education is rising. Such attacks increase exposure to theft of identity and other personal data, but capacity and funds to address the issue are often insufficient. Globally, 5% of all ransomware attacks targeted the education sector in 2022, accounting for more than 30% of cybersecurity breaches. Regulations on sharing children’s personal information are rare but are starting to emerge under the EU’s General Data Protection Regulation. China and Japan have binding instruments on protecting children’s data and information.

Technology has an impact on the teaching profession. Technology allows teachers to choose, modify and generate educational materials. Personalized learning platforms offer teachers customized learning paths and insights based on student data. During the COVID-19 pandemic, France facilitated access to 17 online teaching resource banks mapped against the national curriculum. The Republic of Korea temporarily eased copyright restrictions for teachers. Online teacher-student collaboration platforms provide access to support services, facilitate work team creation, allow participation in virtual sessions and promote sharing of learning materials.

Obstacles to integrating technology in education prevent teachers from fully embracing it. Inadequate digital infrastructure and lack of devices hinder teachers’ ability to integrate technology in their practice. A survey in 165 countries during the pandemic found that two in five teachers used their own devices, and almost one third of schools had only one device for education use. Some teachers lack training to use digital devices effectively. Older teachers may struggle to keep up with rapidly changing technology. The 2018 Teaching and Learning International Survey (TALIS) found that older teachers in 48 education systems had weaker skills and lower self-efficacy in using ICT. Some teachers may lack confidence. Only 43% of lower secondary school teachers in the 2018 TALIS said they felt prepared to use technology for teaching after training, and 78% of teachers in the 2018 ICILS were not confident in using technology for assessment.

Education systems support teachers in developing technology-related professional competencies. About half of education systems worldwide have ICT standards for teachers in a competency framework, teacher training framework, development plan or strategy. Education systems set up annual digital education days for teachers, promote OER, support the exchange of experiences and resources between teachers, and offer training. One quarter of education systems have legislation to ensure teachers are trained in technology, either through initial or in-service training. Some 84% of education systems have strategies for in-service teacher professional development, compared with 72% for pre-service teacher education in technology. Teachers can identify their development needs using digital self-assessment tools such as that provided by the Centre for Innovation in Brazilian Education.

Technology is changing teacher training. Technology is used to create flexible learning environments, engage teachers in collaborative learning, support coaching and mentoring, increase reflective practice, and improve subject or pedagogical knowledge. Distance education programmes have promoted teacher learning in South Africa and even equalled the impact of in-person training in Ghana. Virtual communities have emerged, primarily through social networks, for communication and resource sharing. About 80% of teachers surveyed in the Caribbean belonged to professional WhatsApp groups and 44% used instant messaging to collaborate at least once a week. In Senegal, the Reading for All programme used in-person and online coaching. Teachers considered face-to-face coaching more useful, but online coaching cost 83% less and still achieved a significant, albeit small, improvement in how teachers guided students’ reading practice. In Flanders, Belgium, KlasCement, a teacher community network created by a non-profit and now run by the Ministry of Education, expanded access to digital education and provided a platform for discussions on distance education during the pandemic.

Many actors support teacher professional development in ICT. Universities, teacher training institutions and research institutes provide specialized training, research opportunities and partnerships with schools for professional development in ICT. In Rwanda, universities collaborated with teachers and the government to develop the ICT Essentials for Teachers course. Teacher unions also advocate for policies that support teachers. The Confederation of Education Workers of the Argentine Republic established the right of teachers to disconnect. Civil society organizations, including the Carey Institute for Global Good, offer support through initiatives such as providing OER and online courses for refugee teachers in Chad, Kenya, Lebanon and Niger.

Digital Technologies in Education

The use of information and communication technologies in education can play a crucial role in providing new and innovative forms of support to teachers, students, and the learning process more broadly.

The World Bank Group is the largest financier of education in the developing world, working on education programs in more than 80 countries to provide quality education and lifelong learning opportunities for all.

The WBG works in partnership with governments and organizations worldwide to support innovative projects, timely research, and knowledge sharing activities about the effective and appropriate use of information and communication technologies (ICTs) in education systems -- "EdTech" -- to strengthen learning and contribute to poverty reduction around the world, as part of its larger work related to education .

The World Bank estimated the levels of “Learning Poverty” across the globe by measuring the number of 10-year old children who cannot read and understand a simple story by the end of primary school. In low- and middle-income countries “learning poverty” stands at 53%, while for the poorest countries, this is 80% on average.  With the spread of the Coronavirus disease (COVID-19), 180+ countries mandated temporary school closures, leaving ~1.6 billion children and youth out of school at its height and affecting approximately 85% of children world-wide. While most countries are working towards re-opening schools, there are still intermittent closures and use of hybrid learning. 

Reflecting on COVID Response and Remote Learning

Technology played and continues to play an essential role to deliver education to the students outside of school. Commendably, all countries were able to deploy remote learning technologies using a combination of TV, Radio, Online and Mobile Platforms. However, many children in low income countries did not participate in remote learning with about a third of low income countries reporting that 50% of children had not been reached in a joint UNESCO-UNICEF-World Bank survey . The pandemic has also led to significant losses in learning. School closures and limited access to remote learning means that Learning Poverty is likely to worsen from 53% to 63% especially in low-income countries if no remediation interventions are taken.  

The crisis has starkly highlighted the inequalities in digital access and that ‘business as usual’ will not work for delivery of education to all children. To close the digital divides in Education and leverage the power of technology to accelerate learning, reduce learning poverty, and support skills development a focus must be placed in bridging the gaps in: i) digital infrastructure (connectivity, devices and software); ii) human infrastructure (teacher capacity, student skills and parental support); and iii) logistical and administrative systems to deploy and maintain tech architecture.

Education systems must adapt. It is against this backdrop that the EdTech team at the World Bank has identified five key questions to address in the short to medium term. These questions touch on the need to re-imagine education, to provide an equitable, engaging and fun learning experience for all children.

How can countries leverage EdTech investments to develop resilient hybrid learning systems?   This question requires both reflecting on the lessons from implementation of remote learning during COVID and addressing the new digital infrastructure access divide.  The World Bank is working with countries to identify how to address issues of affordable connectivity, device procurement, cloud solutions and multi-modal delivery of education.  Moreover, the investments that countries have made in remote learning could be leveraged address existing challenges in education. Many countries are now thinking about a dual role for remote learning: as an insurance policy against future calamites especially in a world experiencing climate change as well as a way to reach out of school children and provide a lifelong education to all citizens.  

How can countries recover learning loss, more effectively harness data and personalize learning with technology? The World Bank is deepening its work on adaptive learning systems, remote assessment and how education systems can more effectively use learning analytics to personalize education.  A major part of this work will be developing a new strategy for Education Management Information Systems (EMIS 2.0) to support more effective use of data.  

What are the changing roles and new skills for teachers in hybrid learning systems and how can additional human connections be leveraged through technology? The World Bank is exploring teacher competency frameworks, teacher networks, and communities of innovative teachers to support countries to empower teachers.  Teachers are still central to learning even, or rather, especially in an environment rich with technology. Evidence is growing that bypassing Teachers and not engaging them with technology does not lead to student learning improvement.

How can countries leverage open technology ecosystems to expand access to quality content and learning experiences? The World Bank will collaborate with partners developing open global public goods and strategies to engage the large ecosystem of innovators in client countries to support the design and development of new educational content and curriculum.  The team will develop communities of practice around EdTech innovation hubs and creative talent to develop new open educational libraries.  A key content area of focus will be climate change.

How can technology support the development, measurement and accreditation of future skills? The World Bank will support countries to define 21st century competencies in students and teachers; explore ways to more effectively measure these skills and accredit these skills in collaboration with external partners sharing knowledge and experience in communities of practice on hard to measure skills and blockchain for education.  

Education technology by itself is not a panacea

Though investment in EdTech has been increasing, learning and outcomes as a result have not changed considerably in many countries. An OECD report found that, when it comes to impact of computer usage in schools as measured through PISA, “impact on student performance is mixed, at best."  COVID however has changed the debate on EdTech from a question of if to a question of how.  Experience to date highlights that teaching and learning remotely is not the same as face-to-face pedagogy.  Many teachers with access to e-content, for instance, use it like any another textbook to read from in class.  Some adjustments include shorter and more modular content, more engaging content such as edutainment, continuous feedback, smaller group on-line discussions on more open-ended questions. Education at its heart is about human connections and relationships.  While we can never replace the magic that happens between great teachers and students in an in-person environment, we should focus on the social aspects of technology to enhance connections from a distance. Much more attention must be directed on how technology will enhance teaching and learning in a blended learning environment reaching students, both in school and at home.

World Bank EdTech Strategy

As education systems invest in EdTech, the World Bank advocates these five principles for how to design and implement technology to re-imagine education:

1. ASK WHY:   EdTech policies need to be developed with a clear purpose, strategy and vision of the intended education change to address the learning crisis.

If technology is the answer, what is the question? Education technology should be focused on the “education” and not just on the “technology”. Before investing in and deploying EdTech, policymakers must ask what education challenges need to be addressed and what resulting change is desired.  Policies must be holistic to account for teacher capacity and incentives, appropriate digital learning resources linked to the curriculum, and formative assessments that capture learning.  Education at its core is a human-centered socially intensive endeavor. Technology is a means to these goals.

2. DESIGN FOR SCALE: EdTech design should be flexible and user-centered with equity and inclusion at its heart in order to realize scale and sustainability for all.

Design for scale begins with proactive engagement and empathy for all possible end-users -- students, teachers, administrators, parents, etc. Engagement with different users will reveal different needs. Understanding these needs will lead to inclusive and flexible designs that will be equitable and hence scalable.  Today, the use of EdTech has demonstrated and is exacerbating inequities in education systems.  This need not be the case.  Beginning the design process with how technology can be utilized for all will lead to initiatives that are equitable and adaptable to specific contexts and thereby sustainable at scale.

3. EMPOWER TEACHERS: Technology should enhance teacher engagement with students through access to content, data and networks allowing them to focus on personalized student learning.EdTech cannot replace teachers, it can only augment teaching.

Evidence from around the world shows that, over time, the role of teachers become more central, and not peripheral, as the result of the effective use of EdTech.  Technology will replace some of what teachers currently do, while at the same time supporting teachers as they take on new, often more sophisticated duties and responsibilities as a result of technological change. Teachers can be facilitators of learning, part of a learning team, a collaborator with outside expert mentors, a team leader on a project-based learning activity, etc. At the same time, in those circumstances where there is a scarcity of teachers or low-capacity teachers, technology can play an important role in assisting learners to, in part, overcome this absence. Where teachers lack content or pedagogical knowledge, technology can support structured lesson plans or text-based nudges to build this capacity. Teachers’ use of technology will empower them to leverage an array of resources to provide more focused, personalized learning to students.

4. ENGAGE THE ECOSYSTEM: Education systems should take a whole of government and multi-stakeholder approach to engage and incorporate the most innovative ideas to support student learning.Ministries of Education should leverage all stakeholders in the education system when developing and implementing EdTech programs and policies. The best content, software, applications, algorithms and edutainment will be spread across many innovators in the country and around the world.

Ministries of Education should actively identify ways to find, incentive, integrate and sustain the creators in their country. This content can be delivered over the most appropriate channel – radio, TV, mobile, web – and bundled with data on learning and feedback to support continuous learning.  This ecosystem includes key stakeholders such as students, teachers, school leaders, parents, NGOs, donors and the private sector including app developers, publishers, equipment manufacturers, telecommunication companies and cloud service providers. Clearly, EdTech requires that all these actors work in concert to a common goal taking a “whole of government approach.” Successful EdTech policies and deployments requires that Ministries of Education leverage all stakeholders – inside and outside the education system.

5. DATA DRIVEN: Transparent standards and interoperable data architecture supports evidence-based decision making and a culture of learning and experimentation.

Technology can and should be used to easily collect data from educational institutions, analyze this data and support decision making. Technology is currently available to measure outcomes, track student performance, manage student retention, track book distribution, manage teacher recruitment, track education system spending, etc. Without these, countries will not be as efficient in supporting schools, students and teachers. This data however is diffused through various systems in Ministries of Education and other parts of government. Countries must have flexible, scalable systems that avoid data silos that don’t talk to one another and vendor-lock in (where future decisions on the use of EdTech are constrained by technology choices made in the past). To operationalize this principle, Ministries of Education should promote transparent standards that facilitate interoperability of systems, data and content and remove barriers to competition in order to promote a data-driven decision-making culture.  Many times, learnings from this data is not fed back into the system.  A culture of gathering rigorous data about the ‘impact of EdTech’ must be priority. With the pace of technological change, evidence quickly becomes stale. Hence, constant learning through iteration, controlled experimentation, and nimble evaluations is critical to separate ‘hope’ from 'hype' surrounding different technologies and informing all further EdTech decisions. The culture of data-driven decision making must be strengthened.

In order to operationalize these principles, the World Bank focuses on the discovery, diffusion and deployment of new technologies.  

Discover, document, generate and analyze evidence-based technology solutions in education attuned to developing countries. 

The World Bank supports the EdTech community across countries to discover new innovations, build the evidence base and facilitate the transformation of ministries of education into learning organizations. In some sense, policy makers are supported to think like a system, but act like entrepreneurs. This is achieved through institutional support for Monitoring and Evaluation (M&E) into projects that use EdTech; the inclusion of partnerships with like-minded organizations and the development of global public goods that can be used across multiple countries.

Diffuse this knowledge widely across policy makers in our client countries and support capacity development to better use this new knowledge. The World Bank promotes multi-stakeholder approaches, including partnerships beyond the traditional education sector, to support the effective, appropriate and impactful use of EdTech.

The World Bank works in partnership with governments, academic institutions, non-governmental organizations, private companies, civil society and communities worldwide to support innovative projects, timely research, and knowledge-sharing about EdTech with the ultimate goal of improving teaching and learning. To do this, it invests in the capabilities of its staff to identify and lead partnerships, drawing on relevant experience and expertise. The World Bank also recognizes the role played by the private sector and seeks to harness its innovation and ingenuity to strengthen efficiencies in the public sector.  This approach of networking expertise is critical to ensure that EdTech experiences are effectively shared across regions and that last-mile support to educational institutions supports implementation of government programs.

Deploy solutions, at the pilot level and at scale, tackling adoption barriers (including in procurement) and in ways informed by evidence, and which allow for efficient course correction. The World Bank supports countries as they seek to strengthen and expand existing educational practices and approaches through the use of new technologies, as well as to transform them. The World Bank works with partners to develop digital global public goods that adhere to its 5 EdTech principles. These digital global public goods are digitized knowledge and ideas that countries can build upon and adapt to their contexts.

To execute this strategy the World Bank will provide support to countries through lending operations, partnership networks, and development of digital global public goods in support of the overall World Bank education approach.

Reimagining Human Connections: Technology and Innovation in Education at the World Bank

Current and Past Projects

Notable recent projects include:

• In Burundi, the Burundi Skills for Jobs: Women and Youth aims at supporting job creation for women and youth, with a focus on digital skills and support the creation of a new Institute of Computer Science/Computer Engineering and Digital Transformation, anchored at the University of Burundi in partnership with world class universities.
• In Nigeria, the Edo Basic Education Sector and Skills Transformation Operation leverages technology to improve  teaching  and  learning  processes  in  basic  education  and has institutionalized remote learning EdoBEST@Home program to provide access to all students outside school.
• In Pakistan, the Higher Education Development Project  includes support to equip Students and Higher Education Institutions with Modern Technology and to leverage technology to improve the teaching, learning and research environment in Pakistan including upgrading Pakistan’s National Research and Education Network (NREN)).
• In Morocco, the pandemic created an electroshock on the education system that motivated the country to come up with a new system that prepares the schools for the new realities and for the future of education. Classrooms are kept smaller and new methods of teaching have been developed to enable teachers to animate classes in a way that students understand better. In addition, the schools are more connected than ever. System of evaluation of the new way of teaching and learning is being developed. Complementing, but not replacing in-person teaching by online classes. Developing pedagogical models that support the return to school and provide different learning formats for different situations/students. Morocco is introducing a hybrid-model for families to choose.
• In Turkey, an COVID emergency response Project – Safe Schooling and Distance Education Project aims to build future resilience in the education system by creating a new hybrid learning model to support access to digital resources, improve connectivity and access to education data. The Project will also build out the national ecosystem of innovators to support the development of new learning resources and build capacity of teachers to effectively use these digital resources to support hybrid learning.  
• EVOKE, an online alternate reality game supporting social innovation among young people around the world including a latest iteration on use of Blockchain for conditional cash transfer in Colombia. Also support for FabLabs in higher education institutions in countries like Bangladesh, research into the use of e-readers in schools in Lagos, and pilots of the Khan Academy in Nigeria and Guyana.
• Join Upcoming Events (Twitter Announcements)
• Learn about Past Events (Events Archive)

Resources 

We release a number of publications each year on specific projects and themes related to technology and innovation in education.  See attached a sample of some of these resources linked to the critical questions we will address in the coming year:

1. How can countries leverage EdTech investments to develop resilient hybrid learning systems?  

• What is Hybrid Learning?
• Exploring the potential of Digital Infrastructure
• Understanding the perceived effectiveness of remote learning – lessons from 18 countries
• How can countries implement low tech remote learning?
• Remote Learning During COVID-19 – how to implement multi-channel delivery

2. How can countries recover learning loss, more effectively harness data and personalize learning with technology? 

• Mitigating learning losses and accelerating learning through Adaptive Learning
• Considering an adaptive learning system – a roadmap for policy makers
• Remote Assessment – Potential of phone-based formative assessments to support learning continuity

3. What are the changing roles and new skills for teachers in hybrid learning systems and how can additional human connections be leveraged through technology?  

• Supporting teachers in the age of the pandemic
• The Changing Role of Teachers and Technologies amidst the COVID-19 pandemic  
• Transforming how teachers use technology
• How to use technology to help teacher be better

4. How can countries leverage open technology ecosystems to expand access to quality content and learning experiences?  

• Open Learning Management Systems – How to select and evaluate
• Open Educational Resources are free but you still need to invest to use them

5. How can technology support the development, measurement and accreditation of future skills?   

• Reimagining Youth Skills
• Leveraging Blockchain
• Digital Learning and Skills part I

Comprehensive list of past publications (Archive)

Download Knowledge Packs

Knowledge Packs are resources developed by the World Bank’s EdTech team to serve as short, practical guides on individual topics within education technology. 

• Virtual and XR Laboratories for Workforce Development (pdf, last version September 2023)
• Education TV Knowledge Pack  – (pdf, last version June 2020)
• EdTech Knowledge Pack on Remote Learning response to COVID-19 (pdf, last draft 8 April 2020). 
• EduRadio knowledge pack
• Mobile Distance & Hybrid Education Solutions knowledge pack
• More COVID-19-specific resources

Founded in 2019, the EdTech Hub was established to accelerate progress toward ending the global learning crisis by increasing the use of evidence to inform decision-making about education technology. Technology has the potential to help address the global learning crisis. But that potential is not yet being realised. Some reasons for this include:

• incomplete understanding of what works and what does not
• many under-researched issues
• intervention designs are often not evidence-based
• policy decisions are often not evidence-based
• stakeholders are disconnected
• the evidence that does exist is not easily accessible

The EdTech Hub aims to address these gaps. The EdTech Hub will synthesize existing evidence, conduct new research, support innovations to scale, and provide advisory support to governments and other country partners.

The EdTech Hub is collaboratively run by a partnership of organisations: Overseas Development Institute, Faculty of Education at the University of Cambridge, Results for Development, Open Development and Education, Brink, Jigsaw Consult, BRAC, Afrilabs and eLearning Africa. The EdTech Hub is funded by the UK Department for International Development, the World Bank and the Bill & Melinda Gates Foundation.

Education Continuity Partnership under COVID-19 with OECD, Harvard & HundrED

In the wake of COVID-19, the Harvard Global Education Innovation Initiative , HundrED , the OECD Directorate for Education and Skills and the World Bank Group Education Global Practice is gathering information from around the world on the education response to the crisis. This includes a series of webinar conversations and a series of education stories.

Strategic Impact Evaluation Fund ( SIEF )

The World Bank’s Strategic Impact Evaluation Fund (SIEF) supports scientifically rigorous research that measures the impact of programs and policies to improve education, health, access to quality water and sanitation, and early childhood development in low and middle income countries. The majority of the evaluations are randomized control trials (RCTs) and they were chosen through a competitive process open to researchers worldwide.

On July 29, 2020, SIEF announced six evaluation teams that will receive funding through SIEF’s COVID-19 emergency window . These evaluations will rapidly generate evidence on how to keep students engaged with learning and remote education at home and how to prepare them for the return to school. Each evaluation will also collect detailed cost data that can help shed light on the resources required for scale and sustained implementation. Teams include: Bangladesh, Ecuador, Ghana, Guatemala, Pakistan, Sierra Leone.

Global EdTech Readiness Index Partnership

The Global Edtech Readiness Index is part of the Global Education Policy Dashboard (GEPD) funded by a partnership between the World Bank, Bill & Melinda Gates Foundation, U.K.'s Department for International Development and government of Japan.

The World Bank, with support from Imaginable Futures has created the EdTech Readiness Index (ETRI). The tool will enable countries to: (a) identify good practices and areas where EdTech policies can be strengthened, and (b) monitor progress as countries take action. 

The ETRI goes beyond measuring the availability of devices and the level of connectivity to capture key elements of the larger education-technology ecosystem in a country, guiding efforts to increase learning opportunities and reduce inequalities. ETRI is organized around 6 pillars: School Management, Teachers, Students, Devices, Connectivity, and Digital Resources. For each pillar, the ETRI reports on a practice indicator (to capture the practices at the school level), a de jure policy indicator (to capture whether there is a policy to inform each practice), and a de facto policy indicator (to measure the extent to which the policy is implemented)

Continuity and Acceleration of Learning

The Continuous and Accelerated Learning (CAL) program aims to support multi-modal continuous learning by supporting the development, dissemination and delivery at scale of new and existing global public goods and regional learning continuity approaches, in the short term to offset the impacts of school closures, and in the medium to long term to ensure continuity and accelerate learning after schools re-open while building resilience into the education system. Support will be focused on improving foundational learning and lowering learning poverty by adapting to students’, teachers’ and parents’ needs, anywhere, anytime in a more inclusive, equitable, effective and resilient way than pre-COVID-19.

As part of the Continuous and Accelerated Learning (CAL) program “Teachers for a Changing World: Transforming Teacher Professional Development Spotlight” (T4T) in partnership with HundrED a created a global contest to identify and promote scalable and impactful solutions for teacher professional development using technology.

The CAL work is supported by GPE and other donors and involves partnerships with UNESCO and UNICEF.

Reimagine Education: Digital Learning for Every Child Everywhere with UNICEF

UNICEF and the World Bank are joining forces to support countries to use technology as an accelerator to address key global education challenges related to equitable access to quality and relevant learning.  This partnership will build on, extend, and complement existing global joint initiatives partnerships and programs that use digital technology to address the learning crisis. It also supports the improvement of teachers’ effectiveness in the classroom; student development of skills needed to succeed in school, work, and life; connecting all schools to the Internet; and research on technological innovations for education. This partnership is unique, representing the convergence and alignment of the World Bank and UNICEF’s global and country-level expertise, reach and ability to support implementation at scale. 

mEducation Alliance

The mEducation Alliance is a non-governmental organization focused on the evidence-driven and sustainable role of technology in education to  advance quality educational outcomes. Formed in 2010, the mEducation Alliance is a  unique, multi-stakeholder convening platform for government and donor policymakers, other investors, researchers, and practitioners to work together, particularly in lower-resource, developing country contexts.

The mEducation Alliance is dedicated to strengthening formal and non-formal educational systems by:

• Convening: connecting EdTech investors, policymakers, and practitioners;
• Communicating: sharing good practices within the global EdTech community; and,
• Catalyzing: accelerating EdTech investments and the scaling of promising interventions and initiatives.

Key mEducation Alliance Key Activities and Product Highlights

• Ecosystem building for and acceleration of EdTech interventions
• Dissemination of good practices via a variety of multimedia channels
• Annual Symposia and other networking events (virtual and in person)
• EdTech research profiles and research roundtables
• Landscape and literature reviews
• Investment consultations for donors and EdTech service providers
• Catalyzing education grand challenges and competition calls
• Working groups for donors and policymakers
• Launch and support of a range of signature EdTech initiatives (e.g, Math Attacks!, Young Digital Champions, EdTech Academy)

The World Bank is an alliance member, along with the British Council, EdTech Hub, GIZ, Gesci, Global Partnership for Education, GSMA, IAmLearn, IDRC CRDI, ISTE, ITU, KERIS, Norad, OAS, Peace Corps, SPRIDER, US State Department, UNHCR, UNICEF, UNESCO, DFID, USAID, World Vision, World Wide Web Foundation, Brookings, and ADEA.

Publications

Flyer: EDUCATION TECHNOLOGY OR ‘EDTECH’ – April 2022

Blog:  EdTech hope or hype? Insights from East Asia Pacific

EduTech Blog Series

STAY CONNECTED

This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser. To learn more about cookies, click here .

• News Releases

Revolutionizing Classrooms: How AI Is Reshaping Global Education

World Economic Forum, [email protected]

• New report shows how AI could transform education by enhancing personalization, boosting digital skills and empowering teachers with advanced capacity-improving tools
• With education systems under strain, the report highlights nine examples of innovative approaches for leveraging AI to enhance education systems globally
• The report calls for a responsible integration of AI to foster a more inclusive, adaptable and forward-looking educational landscape
• Read the report here . Watch livestreamed sessions from the Special Meeting on Global Collaboration, Growth and Energy for Development here and join the conversation on social media using hashtag #SpecialMeeting24

Riyadh, Saudi Arabia, 28 April 2024 – A new World Economic Forum report explores how artificial intelligence could revolutionize education systems and improve the experiences of educators and students alike. The new research outlines AI’s wide-ranging potential – from personalizing learning experiences, to streamlining administrative tasks, integrating AI into educational curricula and more – and finds that a responsible application of emerging technologies could herald a new era in education worldwide.

The new report, Shaping the Future of Learning: The Role of AI in Education 4.0 , indicates how emerging technology can help educational systems meet the increased demands for digital literacy and personalized learning environments. Through a series of case studies, it shows how innovative AI applications are already transforming education by improving learning outcomes, empowering educators and equipping students with the skills of the future.

“AI is rapidly reshaping the global education landscape,” said Saadia Zahidi, Managing Director, World Economic Forum. “If deployed safely and strategically, AI can help adapt learning to the needs of each student, enabling an innovative, scalable personalized learning experience that is vital for both student engagement and the effectiveness of educators.”

The report analyses the varied opportunities AI introduces to the education sector, emphasizing the refinement of assessment processes for more timely and holistic evaluations and insights into student progress. It also details how AI can optimize educator roles by automating and augmenting up to 20% of educator clerical tasks, reducing administrative burdens and enabling more time for teachers to focus on personalization, improving pedagogy and supporting students’ social-emotional needs. AI’s integration into educational curricula also equips students with essential future skills and knowledge, while personalized learning content and experiences provide tailored educational pathways to meet diverse student needs.

Several innovative examples of how AI is already revolutionizing education systems are outlined in the report:

• UNICEF's Accessible Digital Textbooks initiative is employing AI to develop digital tools that support diverse learning needs, particularly benefiting students with disabilities by providing customizable, inclusive, educational resources
• In Brazil, the Letrus programme uses AI-driven feedback mechanisms to significantly improve literacy skills across socioeconomic statuses in hundreds of schools
• Kabakoo Academies in West Africa harness AI-enabled virtual mentors to provide personalized learning experiences and mentorship, preparing young people for self-employment in informal economies
• The Republic of Korea’s Ministry of Education develops AI-powered digital textbooks tailored for diverse student proficiency levels, aiming to enhance personalized learning and reduce the reliance on private education
• The UAE Ministry of Education, co-develops an AI-powered virtual tutor to enhance personalized learning, aiming to improve academic performance and promote educational equity across diverse student populations

AI’s potential to dramatically improve educational outcomes necessitates a proactive approach to harness these technologies while carefully addressing the challenges they pose. These include ensuring equitable access to technology, addressing concerns of data privacy and bias, and navigating the potential displacement of traditional teaching roles.

The report calls on policy-makers and educational leaders to integrate AI responsibly into their education systems by ensuring the protection of sensitive information through the implementation of robust data privacy and security protocols. The paper also provides a call to action for stronger collaboration between AI developers and educators to ensure that new AI tools promote better student outcomes.

About the Special Meeting 2024 The World Economic Forum Special Meeting on Global Collaboration, Growth and Energy for Development convenes key global stakeholders in Riyadh, Saudi Arabia, to enable comprehensive dialogue on global cooperation, sustainable growth and promoting a global energy transition that underpins sustainable development. For further information, click here

Notes to editors Read the Forum Agenda also in Spanish | Mandarin | Japanese Learn about the Forum’s impact Check out the Forum’s Strategic Intelligence Platform and Transformation Maps Follow the Forum on social media: @wef | Instagram | LinkedIn | Facebook | TikTok | Weibo | Threads | WhatsApp Watch Forum videos at wef.ch/videos | YouTube Get Forum podcasts at wef.ch/podcasts | YouTube Subscribe to Forum news releases