CoChat

The DOI matches its Crossref record; 59 of the 63 references it cites were found in a registry or an index, and 4 are not checked yet; none of the 22 sources its claims cite is checked for support yet.

Noticing vocabulary holes aids incidental second language word learning: An experimental study

Open access
DE VOS, JOHANNA F., SCHRIEFERS, HERBERT, LEMHÖFER, KRISTIN · 2019 · Bilingualism: Language and Cognition

Abstract

Noticing the hole (NTH) occurs when speakers want to say something, but realise they do not know the right word(s). Such awareness of lacking knowledge supposedly facilitates the acquisition of the unknown word(s) from later input (Swain, 1993). We tested this claim by experimentally inducing NTH in a second language (L2) for some participants (experimental), but not others (control). Then, in a price comparison game, all participants were exposed to spoken L2 input containing the to-be-learned words. They were unaware of taking part in an L2 study. Post-tests showed that participants who had noticed holes in their vocabulary had indeed learned more words compared to participants who had not. This held both for the experimental group as well as those participants in the control group who later reported to have noticed holes. Thus, when we become aware of vocabulary holes, the first step to improve our vocabulary is already taken.

Checked 2026-11-19 · 4 references not checked yet

Overview

CoChat Summary

TL;DR

In an incidental L2 word-learning experiment with German learners of Dutch, participants who noticed vocabulary holes (NTH) before hearing the target words later produced more correct phonemes than those who did not. NTH facilitated learning whether it was experimentally induced by required vocal output or self-generated subvocally, with no significant difference between the two NTH groups.

Key findings

  • Participants who noticed holes outperformed those who did not: [+O, +NTH] vs. [-O, -NTH] at immediate testing (p < .001, odds ratio = 4.57) and after 15 minutes (p < .001, odds ratio = 4.14); [-O, +NTH] vs. [-O, -NTH] at immediate testing (p = .002, odds ratio = 3.06) and delayed testing (p = .009, odds ratio = 2.59). At immediate testing, [+O, +NTH] produced 70% more correct phonemes than [-O, -NTH], and after 15 minutes still 58% more; [-O, +NTH] produced 59% more immediately and 40% more after 15 minutes.
  • There was no significant difference between the two NTH groups, [+O, +NTH] and [-O, +NTH], at immediate testing (p = .45) or delayed testing (p = .33).
  • No significant decay occurred over the 15-minute delay (p = .64), and the Condition × Testing moment interaction was not significant for any contrast (all uncorrected p > .22).
  • Pre-existing passive knowledge interacted with condition: it had a negative effect for [-O, -NTH] (p = .047, odds ratio = 0.71), but positive effects for [+O, +NTH] (p < .001, odds ratio = 2.67) and [-O, +NTH] (p < .001, odds ratio = 1.93).

Methods

  • The study initially recruited 70 German students in Nijmegen; the final sample was 65 (51 females), mean age 22, learning Dutch as an L2. It was advertised as a price-judgment experiment, with a hidden language filter, and none of the final sample guessed the Dutch word-learning purpose. Participants were randomly assigned to experimental and control conditions; the control condition was later split by post-experiment interview into [-O, +NTH] and [-O, -NTH], while the experimental condition was [+O, +NTH]. In the NTH manipulation, experimental participants named objects in Dutch and failed, whereas control participants inspected the same objects silently.
  • After the manipulation, all participants received spoken Dutch input in a price-comparison task containing 16 low-frequency non-cognate target words and 44 fillers, across four blocks of 40 trials. They then completed an unannounced immediate picture-naming post-test and a delayed post-test about 15 minutes later.
  • Data were analyzed with generalized two-level mixed-effects models of the binomial family. The dependent variable was the vector of correct and incorrect phonemes per target-word utterance; fixed effects were Condition, Testing moment, their interaction, and Passive knowledge; random intercepts were included for Participant (N = 65) and Word (N = 16). Productions were scored at the phoneme level using Levenshtein alignment.

Limitations

  • The paper states that it assumed not trying to name pictures automatically meant no NTH took place, and now considers this a limitation because it would have been better to check this assumption explicitly. It also states that control participants were not explicitly asked whether their subvocal naming attempts resulted in NTH.
  • The paper notes that the immediate post-test would generate NTH in all groups, including [-O, -NTH], which confounds retest performance; the authors do not consider this a problem because their explanation concerns processing input after noticing holes and no input was offered between the two vocabulary tests. The paper also states that it cannot yet draw conclusions about the cognitive mechanisms underlying NTH, and that it remains unknown what caused some control participants, but not others, to notice holes.
  • Evident from the text: the [-O, +NTH] versus [-O, -NTH] comparison relies on retrospective self-report and non-random reassignment, so learner-generated NTH is not experimentally isolated; retention was tested only after 15 minutes; and the study did not directly measure curiosity or attention during input exposure.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1017/s1366728918000019

Cites

59 of 63 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

0 Valid · 1 Not valid · 15 Not checked · 96 Own results and interpretations

39 more claims

Create a free account to see all 112 claims and to verify the 13 references still open.

See all claims — free account
  • Probably not a substantial claim. 55
  • It may state two separate claims as one. 23
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • ConsistentF(2, 62) = 0.88reported p = .42 · recomputed p = .420

    “F(2,62) = 0.88, p = .42”

  • ConsistentF(2, 62) = 0.91reported p = .41 · recomputed p = .408

    “F(2,62) = 0.91, p = .41”

  • ConsistentF(2, 62) = 0.27reported p = .77 · recomputed p = .764

    “F(2,62) = 0.27, p = .77”

  • ConsistentF(2, 62) = 1.8reported p = .17 · recomputed p = .174

    “F(2,62) = 1.80, p = .17”

  • ConsistentF(2, 62) = 0.03reported p = .97 · recomputed p = .970

    “F(2,62) = 0.03, p = .97”

5 of 11 · the rest aren’t loaded

6 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 59 references

Research works printed but not linked: 4

  1. Kwon, S. H. (2006). Roles of output and task design on second language vocabulary acquisition. Ph.D. dissertation, University of Florida.
  2. Park, 2007, Learner-Generated Noticing of L2 Input: An Exploratory Study
  3. Leow, R. P. (1999). The role of attention in second/foreign language classroom research: Methodological issues. In Papers from the 2nd Hispanic Linguistics Symposium, pp. 60–71.
  4. Swain, 1998, Focus on Form in Classroom Second Language Acquisition, 64

Cited by

See all 56

Metadata

Authors
DE VOS, J. F., SCHRIEFERS, H., & LEMHÖFER, K.
Affiliations
Radboud University Nijmegen (NL)
Corresponding author
DE VOS, JOHANNA F.
Venue
Bilingualism: Language and Cognition
Published
2018-05-31
Volume
22
Issue
3
Pages
500-515
ISSN
  • 1366-7289 (ISSN-L)
  • 1469-1841
OpenAlex
W2805278314
Cited by
56
References
59
Citations by year
2026: 1 · 2025: 4 · 2024: 5 · 2023: 2 · 2022: 27 · 2021: 10 · 2020: 1 · 2019: 5 · 2018: 1
FWCI
5.55
Type
journal article
Language
en
Open access
Locations
  • Bilingualism Language and Cognition (publishedVersion, cc-by)
  • MPG.PuRe (Max Planck Society) (submittedVersion, cc-by)
  • Radboud Repository (Radboud University) (submittedVersion)
Funders
Nederlandse Organisatie voor Wetenschappelijk Onderzoek (276-89-004)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
Keywords
incidental vocabulary learning, second language vocabulary acquisition, vocabulary gap

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Noticing vocabulary holes aids incidental second language word learning: An experimental study. https://app.cochat.ai/papers/10.1017/s1366728918000019
The paper
DE VOS, J. F., SCHRIEFERS, H., & LEMHÖFER, K. (2019). Noticing vocabulary holes aids incidental second language word learning: An experimental study. Bilingualism: Language and Cognition. https://doi.org/10.1017/s1366728918000019

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.