The DOI matches its Crossref record; 59 of the 63 references it cites were found in a registry or an index, and 4 are not checked yet; none of the 22 sources its claims cite is checked for support yet.
Noticing vocabulary holes aids incidental second language word learning: An experimental study
Open accessAbstract
Noticing the hole (NTH) occurs when speakers want to say something, but realise they do not know the right word(s). Such awareness of lacking knowledge supposedly facilitates the acquisition of the unknown word(s) from later input (Swain, 1993). We tested this claim by experimentally inducing NTH in a second language (L2) for some participants (experimental), but not others (control). Then, in a price comparison game, all participants were exposed to spoken L2 input containing the to-be-learned words. They were unaware of taking part in an L2 study. Post-tests showed that participants who had noticed holes in their vocabulary had indeed learned more words compared to participants who had not. This held both for the experimental group as well as those participants in the control group who later reported to have noticed holes. Thus, when we become aware of vocabulary holes, the first step to improve our vocabulary is already taken.
Checked 2026-11-19 · 4 references not checked yet
Overview
CoChat Summary
TL;DR
In an incidental L2 word-learning experiment with German learners of Dutch, participants who noticed vocabulary holes (NTH) before hearing the target words later produced more correct phonemes than those who did not. NTH facilitated learning whether it was experimentally induced by required vocal output or self-generated subvocally, with no significant difference between the two NTH groups.
Key findings
- Participants who noticed holes outperformed those who did not: [+O, +NTH] vs. [-O, -NTH] at immediate testing (p < .001, odds ratio = 4.57) and after 15 minutes (p < .001, odds ratio = 4.14); [-O, +NTH] vs. [-O, -NTH] at immediate testing (p = .002, odds ratio = 3.06) and delayed testing (p = .009, odds ratio = 2.59). At immediate testing, [+O, +NTH] produced 70% more correct phonemes than [-O, -NTH], and after 15 minutes still 58% more; [-O, +NTH] produced 59% more immediately and 40% more after 15 minutes.
- There was no significant difference between the two NTH groups, [+O, +NTH] and [-O, +NTH], at immediate testing (p = .45) or delayed testing (p = .33).
- No significant decay occurred over the 15-minute delay (p = .64), and the Condition × Testing moment interaction was not significant for any contrast (all uncorrected p > .22).
- Pre-existing passive knowledge interacted with condition: it had a negative effect for [-O, -NTH] (p = .047, odds ratio = 0.71), but positive effects for [+O, +NTH] (p < .001, odds ratio = 2.67) and [-O, +NTH] (p < .001, odds ratio = 1.93).
Methods
- The study initially recruited 70 German students in Nijmegen; the final sample was 65 (51 females), mean age 22, learning Dutch as an L2. It was advertised as a price-judgment experiment, with a hidden language filter, and none of the final sample guessed the Dutch word-learning purpose. Participants were randomly assigned to experimental and control conditions; the control condition was later split by post-experiment interview into [-O, +NTH] and [-O, -NTH], while the experimental condition was [+O, +NTH]. In the NTH manipulation, experimental participants named objects in Dutch and failed, whereas control participants inspected the same objects silently.
- After the manipulation, all participants received spoken Dutch input in a price-comparison task containing 16 low-frequency non-cognate target words and 44 fillers, across four blocks of 40 trials. They then completed an unannounced immediate picture-naming post-test and a delayed post-test about 15 minutes later.
- Data were analyzed with generalized two-level mixed-effects models of the binomial family. The dependent variable was the vector of correct and incorrect phonemes per target-word utterance; fixed effects were Condition, Testing moment, their interaction, and Passive knowledge; random intercepts were included for Participant (N = 65) and Word (N = 16). Productions were scored at the phoneme level using Levenshtein alignment.
Limitations
- The paper states that it assumed not trying to name pictures automatically meant no NTH took place, and now considers this a limitation because it would have been better to check this assumption explicitly. It also states that control participants were not explicitly asked whether their subvocal naming attempts resulted in NTH.
- The paper notes that the immediate post-test would generate NTH in all groups, including [-O, -NTH], which confounds retest performance; the authors do not consider this a problem because their explanation concerns processing input after noticing holes and no input was offered between the two vocabulary tests. The paper also states that it cannot yet draw conclusions about the cognitive mechanisms underlying NTH, and that it remains unknown what caused some control participants, but not others, to notice holes.
- Evident from the text: the [-O, +NTH] versus [-O, -NTH] comparison relies on retrospective self-report and non-random reassignment, so learner-generated NTH is not experimentally isolated; retention was tested only after 15 minutes; and the study did not directly measure curiosity or attention during input exposure.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 15 Not checked · 96 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This held both for the experimental group as well as those participants in the control group who later reported to have noticed holes.”
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In fact, it was found that about half of the participants in the control condition had noticed holes after all.”
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > The present study: NTH in incidental L2 word learning
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Post-tests showed that participants who had noticed holes in their vocabulary had indeed learned more words compared to participants who had not.”
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Post-experiment interviews showed that this expectation was correct.”
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > The present study: NTH in incidental L2 word learning
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, the differences between the conditions that were observed at immediate testing persisted 15 minutes later.”
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > Effect of testing moment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
39 more claims
Create a free account to see all 112 claims and to verify the 13 references still open.
- Probably not a substantial claim. 55
- It may state two separate claims as one. 23
- The quote only partly states this claim. 2
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(2, 62) = 0.88reported p = .42 · recomputed p = .420
“F(2,62) = 0.88, p = .42”
- ConsistentF(2, 62) = 0.91reported p = .41 · recomputed p = .408
“F(2,62) = 0.91, p = .41”
- ConsistentF(2, 62) = 0.27reported p = .77 · recomputed p = .764
“F(2,62) = 0.27, p = .77”
- ConsistentF(2, 62) = 1.8reported p = .17 · recomputed p = .174
“F(2,62) = 1.80, p = .17”
- ConsistentF(2, 62) = 0.03reported p = .97 · recomputed p = .970
“F(2,62) = 0.03, p = .97”
6 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > From two to three conditions
“Although we did not explicitly ask them whether these subvocal naming attempts had resulted in the experience of NTH (which we consider a limitation of the current study)”
§ Noticing vocabulary holes aids incidental second language word learning: An experimental study * > Debriefing and measures
“"If in Dutch, did you notice you were not able to produce some names?"”
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
A Theory of Cognitive Dissonance
(2017) · Macat Library eBooks · doi:10.4324/9781912282432 · Cited by 18,122
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 14,804
Levels of processing: A framework for memory research
Craik, F. I. M., & Lockhart, R. S. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80001-x · Cited by 9,566
The attention system of the human brain
Posner, M. I., & Petersen, S. E. (1990) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.13.030190.000325 · Cited by 8,070 · cited 1×
“Perhaps NTH functions as a type of ORIENTING, which is one of three major attentional systems proposed by Posner & Petersen (1990).”
BackgroundMacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
The Role of Consciousness in Second Language Learning1
SCHMIDT, R. W. (1990) · Applied Linguistics · doi:10.1093/applin/11.2.129 · Cited by 5,435 · cited 1×
“Swain’s use of the term NOTICING differs from how it was originally used by Schmidt (1990) in his Noticing Hypothesis, which states that noticing would be a necessary condition for language learning.”
Method
Research works printed but not linked: 4
- Kwon, S. H. (2006). Roles of output and task design on second language vocabulary acquisition. Ph.D. dissertation, University of Florida.
- Park, 2007, Learner-Generated Noticing of L2 Input: An Exploratory Study
- Leow, R. P. (1999). The role of attention in second/foreign language classroom research: Methodological issues. In Papers from the 2nd Hispanic Linguistics Symposium, pp. 60–71.
- Swain, 1998, Focus on Form in Classroom Second Language Acquisition, 64
Cited by
Research Methods in Applied Linguistics
(2021) · Research methods in applied linguistics · doi:10.1075/rmal · Cited by 2,793
A Meta‐Analysis and Meta‐Regression of Incidental Second Language Word Learning from Spoken Input
de Vos, J. F., Schriefers, H., Nivard, M. G., & Lemhöfer, K. (2018) · Language Learning · doi:10.1111/lang.12296 · Cited by 110
Self-citationOptimal input for language learning: Genuine, simplified, elaborated, or modified elaborated?
Long, M. H. (2019) · Language Teaching · doi:10.1017/s0261444819000466 · Cited by 103
Research Methods in Vocabulary Studies
Durrant, P., Siyanova‐Chanturia, A., Kremmel, B., & Sonbul, S. (2022) · Research methods in applied linguistics · doi:10.1075/rmal.2 · Cited by 44
Between-language competition as a driving force in foreign language attrition
Mickan, A., McQueen, J. M., & Lemhöfer, K. (2020) · Cognition · doi:10.1016/j.cognition.2020.104218 · Cited by 43
Self-citation
Metadata
- Authors
- DE VOS, J. F., SCHRIEFERS, H., & LEMHÖFER, K.
- Affiliations
- Radboud University Nijmegen (NL)
- Corresponding author
- DE VOS, JOHANNA F.
- ORCID
- LEMHÖFER, KRISTIN
- Venue
- Bilingualism: Language and Cognition
- Publisher
- Cambridge University Press (CUP)
- Published
- 2018-05-31
- Volume
- 22
- Issue
- 3
- Pages
- 500-515
- ISSN
- 1366-7289 (ISSN-L)
- 1469-1841
- OpenAlex
- W2805278314
- Semantic Scholar
- 51526b11a03a1cf6bb2c1ab6c858fd3cc17f735c
- Cited by
- 56
- References
- 59
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 5 · 2023: 2 · 2022: 27 · 2021: 10 · 2020: 1 · 2019: 5 · 2018: 1
- FWCI
- 5.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Bilingualism Language and Cognition (publishedVersion, cc-by)
- MPG.PuRe (Max Planck Society) (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (276-89-004)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- incidental vocabulary learning, second language vocabulary acquisition, vocabulary gap
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Noticing vocabulary holes aids incidental second language word learning: An experimental study. https://app.cochat.ai/papers/10.1017/s1366728918000019
- The paper
- DE VOS, J. F., SCHRIEFERS, H., & LEMHÖFER, K. (2019). Noticing vocabulary holes aids incidental second language word learning: An experimental study. Bilingualism: Language and Cognition. https://doi.org/10.1017/s1366728918000019
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.