CoChat

Second language (L2) gains through digital game-based language learning (DGBLL): A meta-analysis

Open access
Dixon, Daniel H., Dixon, Tülay, Jordan, Eric · 2022 · Language Learning & Technology

The DOI matches its Crossref record; 43 of the 57 references it cites were found in a registry or an index; 4 of the 29 sources its claims cite were checked for support.

Abstract

Studies on digital game-based language learning (DGBLL) have increased in numbers, creating a pool of studies that can be meta-analyzed to measure the overall effect of digital gaming on second language (L2) development. The current meta-analysis targets digital games that were available to the public at the time of data collection, January of 2020, aggregating their effects on L2 development overall and across a number of moderator variables. Results indicate that DGBLL has had a small to medium positive effect (Cohen’s dweighted = 0.50) for between-groups designs and a medium effect (dweighted = 0.95) for within-group designs. Games designed for entertainment were found to be more effective than those designed for L2 education.

Overview

CoChat Summary

TL;DR

This meta-analysis of 26 eligible studies found that digital game-based language learning (DGBLL) produced a small-to-medium positive immediate effect for between-groups designs (dweighted = 0.50) and a medium effect for within-group designs (dweighted = 0.95). Games designed for entertainment tended to outperform educational games, though confidence intervals overlapped, and teacher-mediated supplementary material was associated with roughly twice the gains.

Key findings

  • Overall immediate effects: between-groups designs had k = 21, dweighted = 0.50, unweighted d = 0.65, 95% CI [0.19, 1.11]; within-group designs had k = 29, dweighted = 0.95, unweighted d = 1.18, 95% CI [0.85, 1.52].
  • Entertainment vs. education: between-groups entertainment games had dweighted = 0.66 vs. education dweighted = 0.45; within-group entertainment games had dweighted = 2.03 vs. education dweighted = 1.13, but the paper notes overlapping 95% CIs and that more data are needed. Removing the deHaan et al. (2010) outlier raised the between-groups entertainment dweighted from 0.66 to 1.19.
  • Teacher-mediated supplementary material: gains were about twice as great with supplementary material; between-groups yes dweighted = 0.91 vs. no dweighted = 0.40; within-group yes dweighted = 2.09 vs. no dweighted = 1.05, again with overlapping CIs.
  • Retention and moderators: delayed treatment vs. control had dweighted = 0.09, 95% CI [-0.62, 1.03]; treatment delayed vs. pretest had dweighted = 1.36; delayed vs. immediate had dweighted = -0.69, 95% CI [-0.73, 0.25]. Player interaction was mixed: between-groups multiplayer dweighted = 0.87 vs. single player 0.55; within-group single player dweighted = 1.45 vs. MMO 0.59.

Methods

  • Meta-analysis of quantitative pretest-posttest studies, both within-group and between-groups, using publicly available digital games as of January 2020; searches covered 11 databases plus Google, Google Scholar, and reference/citation checks, yielding 98 studies and 26 eligible studies, with 29 within-group samples and 21 between-groups samples.
  • Studies were coded for game purpose, player interaction, input/output modes, outcome measures, teacher mediation, study design, and results; double-coding achieved 92.68% agreement and Cohen’s kappa = 0.95.
  • Analyses used Cohen’s d, sample-size-weighted and unweighted effect sizes, random-effects models, and Plonsky and Oswald’s (2014) L2-specific benchmarks; within-group and between-groups designs were analyzed separately.

Limitations

  • Stated in the paper: deciding whether software qualified as a digital game required some subjectivity; only English-published studies were included, so relevant studies were likely missed; inconsistent treatment-length reporting prevented coding treatment length as a moderator; many studies lacked game titles, reliability reporting, statistical assumption discussion, or effect-size interpretation; publication bias remains possible despite five unpublished studies.
  • Evident from the text: many moderator analyses were constrained by small numbers of samples—e.g., only four between-groups multiplayer samples, insufficient between-groups MMO samples, and insufficient within-group multiplayer samples—and vocabulary dominated dependent variables, limiting conclusions about other L2 skills.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.64152/10125/73464

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 0 Not valid · 23 Not checked · 94 Own results and interpretations

62 more claims

Create a free account to see all 121 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 36
  • It may state two separate claims as one. 33

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Research works printed but not linked: 8

  1. *Alfadil, M. M. (2017). Virtual reality game classroom implementation: Teacher perspectives and student learning outcomes [Doctoral dissertation, University of Northern Colorado]. Scholarship & Creative Works @ Digital UNC. https://digscholarship.unco.edu/cgi/viewcontent.cgi?article=1406&context=dissertations
  2. *Altınbaş, M. E. (2018). The use of multiplayer online computer games in developing EFL skills [Master's thesis, Middle East Technical University]. OpenMETU. https://open.metu.edu.tr/handle/11511/27368
  3. *Hung, K. H. (2011). The design and development of an education-designed massively multiplayer online role-playing game (EdD MMORPG) for young Taiwanese Mandarin-speaking learners learning English vocabulary words [Doctoral dissertation, Teachers College, Columbia University]. ProQuest Dissertations Publishing. https://www.learntechlib.org/p/123523/
  4. *Rankin, Y. A. (2008 ). Design and evaluation of massive multiplayer online role playing games that facilitate second language acquisition [Doctoral dissertation, Northwestern University]. https://www.proquest.com/openview/9f48d15795ac033f86ef9312ee7b0f14/1?pqorigsite=gscholar&cbl=18750
  5. *Rogers, S. A. (2017). A MMORPG with language learning strategic activities to improve English grammar, listening, reading, and vocabulary (UMI No. 10265484) [Doctoral dissertation]. ProQuest Dissertations and Theses. https://www.academia.edu/35805995/A\_Massively\_Multiplayer\_Online\_Role\_playing\_Game\_with\_ Language\_Learning\_Strategic\_Activities\_to\_Improve\_English\_Grammar\_Listening\_Reading\_and\_V ocabulary
  6. Sundqvist, P. (2013). The SSI model: Categorization of digital games in EFL studies. European Journal of Applied Linguistics and TEFL , 2 (1), 89-104.
  7. *Vahdat, S., & Behbahani, A. R. (2013). The effect of video games on Iranian EFL learners' vocabulary learning. The Reading Matrix , 13 (1), 61-71. https://www.researchgate.net/publication/301340668\_The\_effect\_of\_video\_games\_on\_Iranian\_EFL\_ learners'\_vocabulary\_learning
  8. Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

Cited by

See all 88

Metadata

Authors
Dixon, D. H., Dixon, T., & Jordan, E.
Affiliations
  • University of Arizona (US)
  • Northern Arizona University (US)
Venue
Language Learning & Technology
Published
2022-02-28
Volume
26
Issue
1
Pages
1-25
ISSN
1094-3501 (ISSN-L)
OpenAlex
W4413183472
Cited by
88
References
57
Citations by year
2026: 11 · 2025: 30 · 2024: 32 · 2023: 8 · 2022: 7
FWCI
3.94
Type
journal article
Language
en
Open access
Locations
  • Language learning & technology (publishedVersion, cc-by-nc-nd)
  • Digital Archive @ GSU (submittedVersion, cc-by-nc-nd)
  • ScholarSpace (University of Hawaii at Manoa) (submittedVersion, cc-by-nc-nd)
  • Counseling And Psychological Services Dissertations (Georgia State University) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
Keywords
digital game-based language learning, second language acquisition, game-based learning, entertainment games, game elements, multiplayer games, massively multiplayer online games, vocabulary acquisition, language proficiency, player interaction, effect size

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.