The DOI matches its Crossref record; 84 of the 88 references it cites were found in a registry or an index, and 4 are not checked yet; none of the 51 sources its claims cite is checked for support yet.
A Meta‐Analysis and Meta‐Regression of Incidental Second Language Word Learning from Spoken Input
Open accessAbstract
We meta‐analyzed the effectiveness of incidental second language word learning from spoken input. Our sample contained 105 effect sizes from 32 primary studies employing meaning‐focused word‐learning activities with 1,964 participants with typical cognitive functioning. The random‐effects meta‐analysis yielded a mean effect size of g = 1.05, reflecting generally large vocabulary gains from spoken input in meaning‐focused activities. A meta‐regression with three substantive and two methodological predictors also revealed that adult participants outperformed children in terms of word learning and that interactive learning tasks were more effective than noninteractive ones. Furthermore, learning scores were higher when measured with recognition than with recall tests. Methodologically, the use of a no‐input control group seemed to protect against an overestimation of learning effects, evidenced by smaller effect sizes. Finally, whether a pretest–posttest design was used did not influence effect sizes. All data and the analysis script are publicly available. Open Practices: This article has been awarded an Open Data badge. All data and the analysis script are publicly accessible via the Open Science Framework at https://osf.io/92vfw . Learn more about the Open Practices badges from the Center for Open Science: https://osf.io/tvyxz/wiki .
Checked 2026-11-19 · 4 references not checked yet
Overview
CoChat Summary
TL;DR
This meta-analysis finds that meaning-focused exposure to spoken second language input yields large vocabulary gains, with a mean effect size of Hedges’ g = 1.05. Meta-regression shows advantages for university over younger learners, interactive over noninteractive tasks, recognition over recall tests, and smaller effects when a true no-input control group is used.
Key findings
- Across 105 effect sizes from 32 primary studies and 1,964 participants, the random-effects meta-analysis yielded a mean effect size of g = 1.05, 95% CI [0.81, 1.28], SE = 0.12, z = 8.77, p < .0001, described as a large effect.
- University participants outperformed kindergarten/elementary school participants by 0.92 standard deviation units; the high school versus kindergarten/elementary difference was nonsignificant, β = 0.18, 95% CI [−0.78, 1.13], p = .72.
- Task/+interaction treatments were more effective than task/−interaction treatments, β = 0.63, 95% CI [0.26, 1.00], SE = 0.19, z = 3.37, p < .001; all other treatment contrasts were nonsignificant (all ps > .11).
- Recognition tests produced effect sizes 0.42 standard deviation units higher than recall tests, and studies with a true control group produced effect sizes 0.47 standard deviation units lower than studies without one; gain scores showed no significant effect.
Methods
- Meta-analysis and meta-regression of 32 primary studies (from 30 sources; 24 peer reviewed) with 44 independent treatment groups, eight true control groups, 105 effect sizes, and 1,964 participants; studies were located through four electronic databases searched through August 2017 plus manual reference and journal searches.
- Included studies had to involve spoken-only target word input embedded in a meaning-focused activity, typical cognitive functioning, controlled preexisting knowledge, and sufficient data to calculate standardized effect sizes.
- Hedges’ g was used as the effect-size measure; random-effects models included random intercepts at study and sample levels, and a mixed-effects meta-regression tested five predictors: age group, treatment type, mode of testing, use of gain scores, and use of a true control group. Three influential cases with Cook’s distance > 0.85 were excluded from the final meta-regression.
Limitations
- Stated: the authors depended on primary-study reporting; some relevant studies could not be included because means or standard deviations were missing, and correlations between repeated tests were often not reported. They also could not include exposure frequency, retention interval, or proficiency as predictors, and the age effect is confounded with education type, L2 experience/proficiency, motivation, and possible IQ differences.
- Stated: the study originally aimed to examine incidental learning but often could not determine whether participants expected a posttest, so it analyzed meaning-focused learning instead; only about a quarter of studies included a true control group.
- Evident from the text: meta-regression cannot establish causal effects of the predictors, and several treatment and age contrasts had small samples or were not directly manipulated within studies, limiting precision and generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 35 Not checked · 94 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The primary studies in our sample for the most part did not aim at answering the same research questions as we did in this study.”
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Characteristics of the Sample
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A meta-regression with three substantive and two methodological predictors also revealed that adult participants outperformed children in terms of word learning”
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Abstract
plainstates an associationn = 1,964- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Methodologically, the use of a no-input control group seemed to protect against an overestimation of learning effects, evidenced by smaller effect sizes.”
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Abstract
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and that interactive learning tasks were more effective than noninteractive ones.”
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, learning scores were higher when measured with recognition than with recall tests.”
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
65 more claims
Create a free account to see all 130 claims and to verify the 32 references still open.
- It may state two separate claims as one. 31
- Probably not a substantial claim. 41
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous meta-analyses found age influenced L2 learning, with Kurokawa et al. (2024) reporting the greatest gains with primary students, while de Vos et al. (2018) found university students made the most gains.”
From The effects of audiovisual input on second language learning: A meta-analysis (2026) · cites this paper as de Vos et al. (2018)
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = 0.36reported p = .72 · recomputed p = .719
“z = 0.36, p = .72”
- Consistentz = 3.37reported p < .001 · recomputed p < .001
“z = 3.37, p < .001”
- Consistentχ²(1) = 461.74reported p < .0001 · recomputed p < .001
“X 2 (1) = 461.74,p < .0001”
- Consistentχ²(1) = 536.03reported p < .0001 · recomputed p < .001
“X 2 (1) = 536.03,p < .0001”
- Consistentz = 8.77reported p < .0001 · recomputed p < .001
“z = 8.77, p < .0001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Characteristics of the Sample
“The included 30 sources contained relevant data from 32 studies (of which 24 were peer reviewed), with a total of 44 independent treatment groups that were of interest to us and eight true control groups.The total number of participants over all included groups was 1,964.”
§ A Meta-Analysis and Meta-Regression of Incidental Second Language Word Learning from Spoken Input > Characteristics of the Sample
“The mean number of participants in the independent treatment groups was 36 (SD = 39, range = 8-187), and in the control groups it was 41 (SD = 25, range = 11-82).”
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Discovering Statistics Using SPSS
Field, A. P., & Miles, J. N. V. (2000) · Medical Entomology and Zoology · Cited by 28,288
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Levels of processing: A framework for memory research
Craik, F. I. M., & Lockhart, R. S. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80001-x · Cited by 9,566
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Learning Vocabulary in Another Language
Nation, I. S. P. (2001) · Cambridge University Press · doi:10.1017/cbo9781139524759 · Cited by 6,608
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Depth of Processing and the Retention of Words in Episodic Memory
Craik, F. I. M., & Tulving, E. (1975) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.104.3.268 · Cited by 4,121
Research works printed but not linked: 2
- *Donkaewbua S., 2009, Vocabulary learning through listening in another language
- *Toya M., 1993, Occasional Paper #23
Cited by
Research Methods in Applied Linguistics
(2021) · Research methods in applied linguistics · doi:10.1075/rmal · Cited by 2,793
Uchihara, T., Webb, S., & Yanagisawa, A. (2019) · Language Learning · doi:10.1111/lang.12343 · Cited by 300
How effective is second language incidental vocabulary learning? A meta-analysis
Webb, S., Uchihara, T., & Yanagisawa, A. (2023) · Language Teaching · doi:10.1017/s0261444822000507 · Cited by 200
Fernández-Castilla, B., Jamshidi, L., Declercq, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01373-9 · Cited by 181
Incidental vocabulary learning through viewing television
Rodgers, M., & Webb, S. (2019) · ITL Review of Applied Linguistics · doi:10.1075/itl.18034.rod · Cited by 163
Metadata
- Authors
- de Vos, J. F., Schriefers, H., Nivard, M. G., & Lemhöfer, K.
- Affiliations
- Radboud University Nijmegen (NL)
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- de Vos, Johanna F.
- Venue
- Language Learning
- Publisher
- Wiley
- Published
- 2018-06-11
- Volume
- 68
- Issue
- 4
- Pages
- 906-941
- ISSN
- 0023-8333 (ISSN-L)
- 1467-9922
- OpenAlex
- W2807788276
- Cited by
- 110
- References
- 85
- Citations by year
- 2026: 7 · 2025: 5 · 2024: 12 · 2023: 11 · 2022: 49 · 2021: 11 · 2020: 8 · 2019: 7
- FWCI
- 8.68
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Language Learning (publishedVersion, cc-by)
- VU Research Portal (publishedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (276-89-004)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
- Keywords
- incidental vocabulary learning, second language acquisition, vocabulary acquisition, interactive learning activities, recall versus recognition, age differences, pretest-posttest design, effect size overestimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.