CoChat

Commercial-off-the-shelf games in the digital wild and L2 learner vocabulary

Open access
Sundqvist, Pia · 2019 · Language Learning & Technology

The DOI matches its Crossref record; 44 of the 56 references it cites were found in a registry or an index; 1 of the 20 sources its claims cite were checked for support.

Abstract

The purposes of this study are to examine the relation between playing commercial-off-the-shelf (COTS) games in the wild and L2 English vocabulary and to offer comparisons with non-gamers’ vocabulary. Results showed a significant positive correlation between time played and test scores. Gamers scored higher at all vocabulary frequency levels, and for particularly difficult words.

Overview

CoChat Summary

TL;DR

This study examines how playing commercial-off-the-shelf (COTS) games in the digital wild relates to Swedish teenage L2 English learners’ vocabulary, with emphasis on productive vocabulary. It finds that time spent gaming predicts vocabulary test scores, while game type appears mainly mediated by time, and that gamers outperform non-gamers on productive vocabulary, especially difficult words.

Key findings

  • Time spent playing COTS games correlated significantly with vocabulary test scores: VLT \(r_s = .31\), PLT \(r_s = .28\), both \(p < .000\). Frequent gamers scored highest on the PLT (\(M = 24.42\)) and VLT (\(M = 70.34\)), compared with non-gamers (\(M = 16.88\) and \(57.25\), respectively).
  • Type-of-game-preference groups differed significantly: MP scored highest, followed by MMO, SP, and non-gamers. For the PLT, Kruskal-Wallis results were significant (\(p < .001\), \(\eta^2 = .20\)); for the VLT, ANOVA was significant, \(F(3, 818) = 25.43\), \(p < .001\), \(\eta^2 = .085\).
  • In multiple regression, Type of Game became non-significant when Time was entered (PLT: beta = -.09, \(p = .205\); VLT: beta = -.07, \(p = .328\)), while Time remained significant (PLT: beta = .39, \(p < .001\); VLT: beta = .38, \(p < .001\)). Students scored on average 3.1 points higher on the PLT per level of the Time variable (unstandardized beta = 3.14).
  • Gamers had significantly higher productive vocabulary scores at all tested levels: K2 \(10.01\) vs. \(8.43\), K3 \(6.09\) vs. \(4.53\), K5 \(3.05\) vs. \(2.09\), and academic words \(1.78\) vs. \(1.49\) (all significant; academic \(p = .002\)). For particularly difficult words, gamers’ solution rates were double or more than non-gamers’ at K2, K3, K5, and academic levels.

Methods

  • Quantitative-dominant mixed-methods design (QUAN+qual). Sample A was 1,069 Year 9 students (ages 15–16) in Sweden; Sample B was a convenience sample of 16 Year 9 students at one school.
  • Data included questionnaires, English grades, productive levels test (PLT; 45 items across K2, K3, K5, and academic words), vocabulary levels test (VLT; 90 items across K2, K3, K5), national test essays, scoring profiles, school leaving certificates, and semi-structured interviews.
  • Analyses used chi-squared and Cramér’s V, independent-samples t-tests, one-way ANOVAs, Kruskal-Wallis tests, Spearman correlations, and multiple regression with Time Played and Types of Games as predictors and L2 vocabulary as outcome.

Limitations

  • Stated in the paper: it is difficult to specify the association between L2 outcomes and game titles or genres; relatively few questionnaire items were included due to ethical and instructional-time constraints; the principle of highest order for classifying students may have misclassified some; and other English-mediated activities besides gaming may have influenced findings.
  • Evident from the text: Sample B is small and a convenience sample, limiting generalizability of the qualitative findings; Sample A was not randomly sampled, though described as a near representation of typical Year 9 students in Sweden; missing data caused totals to vary across analyses.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.64152/10125/44674

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

1 Valid · 4 Not valid · 17 Not checked · 90 Own results and interpretations

43 more claims

Create a free account to see all 112 claims and every source verdict.

See all claims — free account
  • The quote only partly states this claim. 2
  • It may state two separate claims as one. 40
  • Probably not a substantial claim. 37

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • ConsistentF(3, 818) = 25.43reported p < .001 · recomputed p < .001

    “F (3, 818) = 25.43, p < .001”

1 of 1

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Research works printed but not linked: 7

  1. Aron, A., Aron, E. N., & Coups, E. J. (2005). Statistics for the behavioral and social sciences: A brief course (3rd ed.). London, UK: Prentice Hall International.
  2. Block, D. (2003). The social turn in second language acquisition . Washington, DC: Georgetown University Press.
  3. Cheung, A., & Harrison, C. (1992). Microcomputer adventure games and second language acquisition: A study of Hong Kong tertiary students. In M. C. Pennington & V. Stevens (Eds.), Computers in Applied Linguistics (pp. 155-178). Clevedon, UK: Multilingual Matters.
  4. Sauro, S., & Zourou, K. (2017). Call for papers for CALL in the digital wilds special issue. Language Learning & Technology , 21(1), 186.
  5. Sundqvist, P. (2009). Extramural English matters: Out-of-school English and its impact on Swedish ninth graders' oral proficiency and vocabulary (Doctoral dissertation). Karlstad University, Karlstad, Sweden.
  6. Sundqvist, P. (2013). The SSI model: Categorization of digital games in EFL studies. European Journal of Applied Linguistics and TEFL , 2 (1), 89-104.
  7. Xue, G.-y., & Nation, I. S. P. (1984). A university word list. Language Learning and Communication , 3 (2), 215-229.

Cited by

See all 156

Metadata

Authors
Sundqvist, P.
Affiliations
University of Oslo (NO)
Corresponding author
Sundqvist, Pia
Venue
Language Learning & Technology
Published
2019-02-01
Volume
23
Issue
1
Pages
87-113
ISSN
1094-3501 (ISSN-L)
OpenAlex
W2913330477
Cited by
154
References
56
Citations by year
2026: 25 · 2025: 32 · 2024: 23 · 2023: 17 · 2022: 17 · 2021: 19 · 2020: 15 · 2019: 6
FWCI
25.88
Type
journal article
Language
en
Open access
Locations
  • Language learning & technology (publishedVersion, cc-by-nc-nd)
  • ScholarSpace (University of Hawaii at Manoa) (submittedVersion)
  • Digitala vetenskapliga arkivet (Diva) (Karlstad University) (submittedVersion, other-oa)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
  • Language learning & technology (cc-by-nc-nd)
Funders
Karlstads universitet
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
  • Social Sciences › Sociology and Political Science › Digital Games and Media
Keywords
commercial off-the-shelf games, video games, second language acquisition, vocabulary acquisition, word frequency, expressive vocabulary, receptive vocabulary, gaming time, adolescent students

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.