The effectiveness of technology‐supported personalised learning in low‐ and middle‐income countries: A meta‐analysis
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Digital technology offers the potential to address educational challenges in resource‐poor settings. This meta‐analysis examines the impact of students' use of technology that personalises and adapts to learning level in low‐ and middle‐income countries. Following a systematic search for research between 2007 and 2020, 16 randomised controlled trials were identified in five countries. Studies involved 53,029 learners aged 6–15 years. Coding examined learning domain (mathematics and literacy); personalisation level and delivery; technology use; and intervention duration and intensity. Overall, technology‐supported personalised learning was found to have a statistically significant—if moderate—positive effect size of 0.18 on learning ( p = 0.001). Meta‐regression reveals how more personalised approaches which adapt or adjust to learners' level led to significantly greater impact (an effect size of 0.35) than those only linking to learners' interests or providing personalised feedback, support, and/or assessment. Avenues for future research include investigating cost implications, optimum programme length, and teachers' role in making personalised learning with technology effective. Practitioner notes: What is already known about this topic? Promoting personalised learning is an established aim of educators. Using technology to support personalised learning in low‐ and middle‐income countries (LMICs) could play an important role in ensuring more inclusive and equitable access to education, particularly in the aftermath of COVID‐19. There is currently no rigorous overview of evidence on the effectiveness of using technology to enable personalised learning in LMICs. What this paper adds? The meta‐analysis is the first to evaluate the effectiveness of technology‐supported personalised learning in improving learning outcomes for school‐aged children in LMICs. Technology‐supported personalised learning has a statistically significant, positive effect on learning outcomes. Interventions are similarly effective for mathematics and literacy and whether or not teachers also have an active role in the personalisation. Personalised approaches that adapt or adjust to the learner led to significantly greater impact, although whether these warrant the additional investment likely necessary for implementation at scale needs to be investigated. Personalised technology implementation of moderate duration and intensity had similar positive effects to that of stronger duration and intensity, although further research is needed to confirm this. Implications for practice and/or policy: The inclusion of more adaptive personalisation features in technology‐assisted learning environments can lead to greater learning gains. Personalised technology approaches featuring moderate personalisation may also yield learning rewards. While it is not known whether personalised technology can be scaled in a cost‐effective and contextually appropriate way, there are indications that this is possible. The appropriateness of teachers integrating personalised approaches in their practice should be explored given ‘supplementary’ uses of personalised technology (ie, additional sessions involving technology outside of regular instruction) are common.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 1×
“…test, the trim- and-fill method, was conducted to identify and correct for funnel plot asymmetry arising from publication bias by providing an estimate of the number of missing studies and an adjusted intervention effect from including the filled studies (Duval & Tweedie, 2000; Shi & Lin, 2019).”
MethodThe Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737
Remedying Education: Evidence from Two Randomized Experiments in India
Banerjee, A. V., Cole, S., Duflo, E., & Linden, L. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1235 · Cited by 1,398 · cited 3×
“A seminal study by Banerjee et al. (2007) 3 reported a randomised evaluation of a computer-assisted programme involving over 11,000 children.”
InfluentialEmpirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950 · cited 1×
“Instead, there is consensus that effect sizes should reflect the nature of the intervention being evaluated, its target population and the outcome measure(s) used (Hill et al., 2008; Pigott & Polanin, 2020).”
BackgroundShi, L., & Lin, L. (2019) · Medicine · doi:10.1097/md.0000000000015987 · Cited by 818
Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.08.010 · Cited by 730
Xie, H., Chu, H.-C., Hwang, G.-J., & Wang, C.-C. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103599 · Cited by 713
Methodological guidance paper: High-quality meta- analysis in a systematic review
Pigott, T. D., & Polanin, J. R. (2020) · Review of Educational Research · doi:10.3102/0034654319877153 · Cited by 568
Slavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560
Goldemberg, D., Azevedo, J. P., Iqbal, S. A., Hasan, A., & Geven, K. (2020) · doi:10.1596/1813-9450-9284 · Cited by 476
Using learning analytics to scale the provision of personalised feedback
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12592 · Cited by 425 · cited 1×
“In addition to improving learning outcomes, there are also indications that the impact of such approaches may increase as learner socio-economic level decreases (Perera & Aboal, 2019), including when used at home (Tang et al., 2020).”
BackgroundDisrupting education? Experimental evidence on technology-aided instruction in India
Muralidharan, K., Singh, A., & Ganimian, A. J. (2019) · American Economic Review · doi:10.1257/aer.20171112 · Cited by 415
Education Technology: An Evidence-Based Review
Escueta, M., Quan, V., Nickow, A. J., & Oreopoulos, P. (2017) · doi:10.3386/w23744 · Cited by 389 · cited 1×
“Escueta et al., (2017) similarly synthesised experimental evidence, reporting that computer-assisted learning (CAL) may be more effective in LMICs given tight capacity constraints.”
BackgroundContinued Progress: Promising Evidence on Personalized Learning
Pane, J., Steiner, E., Baird, M., & Hamilton, L. (2015) · doi:10.7249/rr1365 · Cited by 360
How features of educational technology applications affect student reading outcomes: A meta-analysis
Cheung, A. C. K., & Slavin, R. E. (2012) · Educational Research Review · doi:10.1016/j.edurev.2012.05.002 · Cited by 307 · cited 1×
“Slavin's (2012) intensity criteria were followed using a cut off of 75 min per week.”
MethodBeyond small, medium, or large: points of consideration when interpreting effect sizes
Bakker, A., Cai, J., English, L., Kaiser, G., Mesa, V., & Van Dooren, W. (2019) · Educational Studies in Mathematics · doi:10.1007/s10649-019-09908-4 · Cited by 302 · cited 3×
“…to benchmarks provided by Cohen (0.2 is ‘small’, around 0.5 is ‘medium’ and above 0.8 is ‘large’; 1988) and others (eg, Acock, 2014), there is no universal guideline for assessing the practical importance of stand-ardised effect size estimates for educational interventions (Bakker et al., 2019).”
BackgroundInfluentialArroyo, I., Woolf, B. P., Burelson, W., Muldner, K., Rai, D., & Tai, M. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0023-y · Cited by 263 · cited 1×
“Research suggests that personalisation can contribute to improving learning outcomes through enhancing motivation and attitudes (Jones et al., 2013) and supporting the development of metacognitive skills and self-reflection (Arroyo et al., 2014; Kim, Olfman, et al., 2014).”
BackgroundEducation in Africa: What Are We Learning?
Evans, D. K., & Mendez Acosta, A. (2021) · Journal of African Economies · doi:10.1093/jae/ejaa009 · Cited by 212
FitzGerald, E., Kucirkova, N., Jones, A., Cross, S., Ferguson, R., Herodotou, C., Hillaire, G., & Scanlon, E. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12534 · Cited by 104 · cited 6×
“It can also facilitate different kinds of content (to reflect learners' preferences and cultural context; Kucirkova, 2018) and automatically capture and respond to students' learning patterns (du Boulay et al., 2018).”
BackgroundMethodInfluential
Cited by
AI‐driven adaptive learning for sustainable educational transformation
Strielkowski, W., Grebennikova, V., Lisovskiy, A., Rakhimova, G., & Vasileva, T. (2025) · Sustainable Development · doi:10.1002/sd.3221 · Cited by 581
Almeqdad, Q. I., Alodat, A. M., Alquraan, M. F., Mohaidat, M. A., & Al-Makhzoomy, A. K. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2218191 · Cited by 444
“The findings seemed to indicate a potential publication bias of publishing studies that were statistically significant only, a bias that was regularly highlighted in previous literature (e.g., Major et al., 2021).”
Hennessy, S., D'Angelo, S., McIntyre, N., Koomar, S., Kreimeia, A., Cao, L., Brugha, M., & Zubairi, A. (2022) · Computers and Education Open · doi:10.1016/j.caeo.2022.100080 · Cited by 327
Sanders, T., Noetel, M., Parker, P., Del Pozo Cruz, B., Biddle, S., Ronto, R., Hulteen, R., Parker, R., Thomas, G., De Cocker, K., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01712-8 · Cited by 148
Exploring the Role of Generative AI in Enhancing Language Learning: Opportunities and Challenges
Creely, E. (2024) · International Journal of Changes in Education · doi:10.47852/bonviewijce42022495 · Cited by 113
“Thispropensityforcustomizationenablesstudentstobemorethan passive recipients of information but active and agential participants in their own learning journey, such that it is a device or technology for opening out rather than disguising the process of learning (Major et al., 2021).”
Background
Metadata
- Authors
- Major, L., Francis, G. A., & Tsapali, M.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2021-05-24
- Volume
- 52
- Issue
- 5
- Pages
- 1935-1964
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W3165716705
- Cited by
- 240
- References
- 20
- FWCI
- 9.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.