The DOI matches its Crossref record; 71 of the 72 references it cites were found in a registry or an index.
What Forty Years of Research Says About the Impact of Technology on Learning: A Second-Order Meta-Analysis and Validation Study
Abstract
This research study employs a second-order meta-analysis procedure to summarize 40 years of research activity addressing the question, does computer technology use affect student achievement in formal face-to-face classrooms as compared to classrooms that do not use technology? A study-level meta-analytic validation was also conducted for purposes of comparison. An extensive literature search and a systematic review process resulted in the inclusion of 25 meta-analyses with minimal overlap in primary literature, encompassing 1,055 primary studies. The random effects mean effect size of 0.35 was significantly different from zero. The distribution was heterogeneous under the fixed effects model. To validate the second-order meta-analysis, 574 individual independent effect sizes were extracted from 13 out of the 25 meta-analyses. The mean effect size was 0.33 under the random effects model, and the distribution was heterogeneous. Insights about the state of the field, implications for technology use, and prospects for future research are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, Tamim et al. (2011) reported small to moderate positive effects between the use of computer technology (CAI, ICT, simulations, computer-based instruction, digital and hypermedia) and student achievement in formal face-to-face classrooms compared to classrooms that did not use technology.”
From Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: A literature review (2023) · cites this paper as Tamim et al. (2011)
In the citing paper
“Several other researchers suggested that a number of variables play a significant role in the impact of ICTs on students’ learning that could be attributed to the school context, teaching practices and professional development, the curriculum, and learners’ characteristics (Underwood, 2009; Tamim et al., 2011; Higgins et al., 2012; Archer et al., 2014; Sung et al., 2016; Haßler et al., 2016; Chau”
From Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: A literature review (2023) · cites this paper as Tamim et al., 2011
In the citing paper
“Based on these findings, several authors have suggested that the impact of technology on education depends on several variables and not on the technology per se (Tamim et al., 2011; Higgins et al., 2012; Archer et al., 2014; Sung et al., 2016; Haßler et al., 2016; Chauhan, 2017; Lee et al., 2020; Lei et al., 2022a).”
From Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: A literature review (2023) · cites this paper as Tamim et al., 2011
In the citing paper
“Tamim, Bernard, Borokhovski, Abrami, and Schmid’s (2011) second-order meta-analysis finding only a small to moderate impact on student achievement across 40 years.”
From Mapping research in student engagement and educational technology in higher education: a systematic evidence map (2020) · cites this paper as Tamim et al., 2011
In the citing paper
“The effect of scaffolding across all assessment levels is also higher than the effect size (ES = 0.33) found in a synthesis of 25 meta-analyses on the effect of computer-assisted instruction on cognitive outcomes (Tamim, Bernard, Borokhovski, Abrami, & Schmid, 2011).”
From Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education (2017) · cites this paper as Tamim et al., 2011
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
(2000) · Cited by 9,198
(2008) · Cited by 6,939
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Visible learning: a synthesis of over 800 meta‐analyses relating to achievement
Carter, M. (2009) · Educational Psychology · doi:10.1080/01443410903415150 · Cited by 4,581
Research works printed but not linked: 8
- 10.1322/174426410X524866 · doi:10.1322/174426410x524866
- Bernard R. M., 1990, Canadian Journal of Educational Communication, 19, 171
- Borenstein M., 2005, Comprehensive Meta-Analysis (Version 2) [Computer software]
- *Goldberg A., 2003, Journal of Technology, Learning, and Assessment, 2, 3
- *Hsu Y. C. (2003). The effectiveness of computer-assisted instruction in statistics education: A meta-analysis (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3089963)
- Hunter J. E., 1982, Meta-analysis
- *Liao Y. -I., Paper presented at the World Conference on Educational Multimedia, Hypermedia and Telecommunications
- *Yaakub M. N. (1998). Meta-analysis of the effectiveness of computer-assisted instruction in the technical education and training (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3040293)
Cited by
ESG and financial performance: aggregated evidence from more than 2000 empirical studies
Friede, G., Busch, T., & Bassen, A. (2015) · Journal of Sustainable Finance & Investment · doi:10.1080/20430795.2015.1118917 · Cited by 4,631
“(Richard, Bond, and Stokes-Zoota 2003; Tamim et al. 2011; Lipsey et al. 2012) and, notably, might have relatively high relevance for competitive global securities markets.”
BackgroundInfluentialAbeysekera, L., & Dawson, P. (2015) · Higher Education Research & Development · doi:10.1080/07294360.2014.934336 · Cited by 1,847
“Verylittle research has been undertaken into fl ipped classroom approaches; this is not unusual, as Tamim, Bernard, Borokhovski, Abrami, and Schmid ’ s (2011) second-order meta-analysis found high-level, detailed research evaluating the ef fi cacy of speci fi c approaches of blended learning to be…”
MethodThe validity of the multi-informant approach to assessing child and adolescent mental health.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015) · Psychological Bulletin · doi:10.1037/a0038498 · Cited by 1,666
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960
Sung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.008 · Cited by 1,574
Metadata
- Authors
- Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F.
- Affiliations
- Hamdan Bin Mohammed Smart University (AE)
- Concordia University (CA)
- Venue
- Review of Educational Research
- Published
- 2011-03
- Volume
- 81
- Issue
- 1
- Pages
- 4-28
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2109070640
- Cited by
- 1,029
- References
- 72
- Citations by year
- 2026: 72 · 2025: 60 · 2024: 57 · 2023: 59 · 2022: 76 · 2021: 69 · 2020: 77 · 2019: 76 · 2018: 68 · 2017: 67 · 2016: 77 · 2015: 106 · 2014: 67 · 2013: 57 · 2012: 30
- FWCI
- 251.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Topics
- Social Sciences › Education › Education and Technology Integration
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Educational Technology in Learning
- Keywords
- educational technology, academic performance, technology-enhanced learning, effect size, face-to-face teaching, technology use in schools
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What Forty Years of Research Says About the Impact of Technology on Learning: A Second-Order Meta-Analysis and Validation Study. https://app.cochat.ai/papers/10.3102/0034654310393361
- The paper
- Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011). What Forty Years of Research Says About the Impact of Technology on Learning: A Second-Order Meta-Analysis and Validation Study. Review of Educational Research. https://doi.org/10.3102/0034654310393361
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.