Readers, Players, and Watchers: EFL Students’ Vocabulary Acquisition through Digital Video Games
Open accessThe DOI matches its Crossref record; 53 of the 56 references it cites were found in a registry or an index; 1 of the 33 sources its claims cite were checked for support.
Abstract
The present study investigated vocabulary acquisition through a commercial digital video game compared to a traditional pencil-and-paper treatment among 241 male high school students. Players and Watchers outperformed Readers in vocabulary acquisition.
Overview
CoChat Summary
TL;DR
In a five-week study with 241 male Iranian high school EFL students, those who played a commercial digital video game (Players) or watched classmates play (Watchers) scored higher on weekly vocabulary posttests than those who learned through intensive reading (Readers). The study concludes commercial DVGs can be beneficial complementary vocabulary activities, with playing and watching both viable.
Key findings
- A mixed between-within subjects ANOVA on five immediate vocabulary posttests found a significant group difference, p = .000, partial eta squared = .371. Post-hoc Tukey HSD showed Readers scored significantly lower than Players (mean difference = -1.0297, p = .000) and Watchers (mean difference = -.8944, p = .000); Players vs. Watchers was not significant (mean difference = .1352, p = .470).
- Pretest homogeneity: one-way ANOVA found no significant group difference (p = .058); pretest means were Readers 6.27 (SD 3.98), Players 5.44 (SD 4.65), Watchers 4.61 (SD 3.71) out of 21.
- Players and Watchers had higher mean scores than Readers on all five immediate posttests; for example, posttest 5 means were Readers 1.48, Players 2.39, Watchers 1.94 (3 items).
- The conclusion states DVGs should not replace course books but serve as complementary or supplemental activities, and both playing and watching treatments seem viable for promoting vocabulary acquisition.
Methods
- Cluster-sampled 241 male Iranian junior and senior high school students (age 12–18); 25 were removed for playing the game at home, cheating, or missing more than one session. Final analyses included Readers N = 70, Players N = 64, Watchers N = 71. Senior classes were randomly assigned to all three treatments; junior high was limited to Players or Watchers because it did not meet the Readers’ requirement of more than 250 hours of language learning experience.
- Five-week treatment, one session per week, under 50 minutes each; 21 target noun phrases were drawn from the commercial DVG *Warcraft III: The Frozen Throne* (Defense of the Ancients map). A vocabulary pretest was given two weeks before treatment, followed by weekly immediate multiple-choice posttests (9–12 total items, including 5–8 non-vocabulary questions; only vocabulary items were analyzed). Readers did intensive reading, translation, and retelling; Players played the game; Watchers watched two classmates play.
- Data were analyzed with SPSS v. 21 using a mixed between-within subjects ANOVA with alpha set at .01, followed by post-hoc Tukey HSD tests; field notes were used for data triangulation.
Limitations
- Stated: students were not equal in computer knowledge; a certain ANOVA assumption could not be met, limiting generalization; immediate vocabulary posttests included only 3–6 target items, a small number for measuring group differences; and students had out-of-class interactions about the classroom experience that might have affected outcomes.
- Stated: cooperative learning/group work violated the ANOVA assumption of independent observations, which the authors tried to lessen by setting alpha at .01.
- Evident: the sample was all male, Iranian high school students age 12–18; the study used a single commercial DVG over five weeks and measured only immediate posttests, with no delayed retention measure reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
1 Valid · 2 Not valid · 23 Not checked · 33 Own results and interpretations
In the paper
“Based on a Headway placement test published by Oxford University Press in 2012, 87.9 % of the participants were classified as level A1.”
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 3.1 Participants
What the sources say
- Not matchedcites Headway placement test published by Oxford University Press in 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As suggested by the mean values, the majority of students were not familiar with the target vocabulary items.”
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 4.2 Results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was no significant difference between Players and Watchers (p = .470)which answers the second question that asked if there were any differences between the Players and Watchers in terms of vocabulary acquisition.”
- Also stated in: § 4.3 Discussions · plain
“Specifically on account of the second question, there was no statistically significant difference between Players and Watchers.”
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 4.2 Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.3 Discussions · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Game-learners identified the DVG as an effective facilitator of vocabulary acquisition since it allowed for close examination and utilization of the vocabulary items.”
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 4.3 Discussions
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown, Readers performed significantly lower than both Players and Watchers (p = .000).”
- Also stated in: § 4.3 Discussions · hedged
“The findings seem elt.ccsenet.orgto indicate that DVG-learners significantly outperformed the Readers (p = .000,Cohen's d = .371).”
- Also stated in: § 5. Conclusion · plain
“We found Players and Watchers to outperform Readers.”
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 4.2 Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.3 Discussions · hedged
15 more claims
Create a free account to see all 59 claims and every source verdict.
- It may state two separate claims as one. 19
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
- Probably not a substantial claim. 26
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 3.1 Participants
“Initially, 241 male, Iranian, junior and senior high school, students (age 12-18) chosen through cluster sampling participated in the study.Twenty five students were removed from final analyses”
§ Readers, Players, and Watchers: EFL Students' Vocabulary Acquisition through Digital Video Games > 3.1 Participants
“The study included one junior (N = 61) and two senior (N = 153) high schools.”
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
What Video Games Have to Teach Us about Learning and Literacy
(2004) · Education + Training · doi:10.1108/et.2004.00446dae.002 · Cited by 6,674
Learning Vocabulary in Another Language
Nation, I. S. P. (2001) · Cambridge University Press · doi:10.1017/cbo9781139524759 · Cited by 6,608
What video games have to teach us about learning and literacy
Gee, J. P. (2003) · Computers in Entertainment · doi:10.1145/950566.950595 · Cited by 5,735 · cited 5×
“In line with Gee (2003) and Van Eck (2009), thus, we suggest that DVGs be included in high school classrooms.”
BackgroundMethodInfluentialApplied multivariate statistics for the social sciences
Stevens, J. P., & Stevens, J. P. (2001) · doi:10.4324/9781410604491 · Cited by 4,993
Principles and Practice in Second Language Acquisition
Krahnke, K. J., & Krashen, S. D. (1983) · TESOL Quarterly · doi:10.2307/3586656 · Cited by 4,453
Scripts, Plans, Goals, and Understanding: An Inquiry into Human Knowledge Structures
Kronenfeld, D. B., Schank, R. C., & Abelson, R. P. (1978) · Language · doi:10.2307/412850 · Cited by 3,054 · cited 1×
“…skill in other similar situations to guess the meaning of unfamiliar vocabulary could also be attributed to learning since similar situations activate scripts—concepts learned and rehearsed through an understanding of goals, causation, and plans of action (Abelson, 1981; Schank & Abelson, 1977).”
Background(1985) · Medical Entomology and Zoology · Cited by 3,037
Scripts, Plans, Goals, and Understanding: An Inquiry into Human Knowledge Structures
Hunt, E., Schank, R., & Abelson, R. (1979) · The American Journal of Psychology · doi:10.2307/1421499 · Cited by 2,944
(2002) · Cited by 2,645
Research works printed but not linked: 3
- [3]3. Anderson, N. (2003). Reading. In D. Nunan (Ed.), Practical English language teaching (pp. 67-86). New York, NY: McGraw-Hill.
- [21]21. Laufer, B. (1997). What's in a word that makes it hard or easy: Some intralexical factors that affect the leaming of words. In N. Schmitt, & M. McCarthy (Eds.), Vocabulary: Descripfion, acquisition and pedagogy (pp. 140-155). Cambridge, UK: Cambridge University Press.
- [33]33. Nation, I. S. P., & Waring, R. (1997). Vocabulary size, text coverage, and word lists. In N. Schmitt & M. McCarthy (Eds.), Vocabulary: Description, acquisition, and pedagogy (pp. 6-19). Cambridge: Cambridge University Press.
Cited by
Acquah, E. O., & Katz, H. T. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103667 · Cited by 280
Fu, Q.-K., Lin, C.-J., Hwang, G.-J., & Zhang, L. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.04.005 · Cited by 187
A Scoping Review of Digital Game-Based Technology on English Language Learning
Xu, Z., Chen, Z., Eutsler, L., Geng, Z., & Kogut, A. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-019-09702-2 · Cited by 162
“…Jalali and Dousti 2012; Lucht and Heidig 2013), more studies reported that DGBLL was effective for English language learning in vocabulary (e.g., Ebrahimzadeh 2017; Jensen 2017), pragmatics (e.g., Peterson 2012; Shirazi et al. 2016), grammar (Cornillie et al. 2017; Mehrpour and Ghayour 2017),…”
BackgroundEntertainment Video Games for Academic Learning: A Systematic Review
Martinez, L., Gimenes, M., & Lambert, E. G. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331211053848 · Cited by 221
“With Warcraft, Ebrahimzadeh and Alavi (2016) and Ebrahimzadeh (2017) found no differences between players and watchers on vocabulary acquisition, but deHaan et al. (2010) found that Japanese students who played a rhythm game were outperformed by those who only watched the game.”
BackgroundResultInfluentialLin, C.-J., Hwang, G., Fu, Q.-K., & Cao, Y.-H. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103876 · Cited by 144
Lee, J. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10391-1 · Cited by 148
“Indeed, a variety of studies provided empirical evidence favoring digital game-based L2 learning over paper-based traditional teaching (Ebrahimzadeh 2017; Hwang et al. 2016, 2017; Mazaji and Tabatabaei 2016; Utku and Dolgunsöz 2018; Young and Wang 2014).”
BackgroundThompson, C. G., & von Gillern, S. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100332 · Cited by 89
Differences in serious game-aided and traditional English vocabulary acquisition
Zhonggen, Y. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.07.014 · Cited by 83
Talan, T., Doğan, Y., & Batdı, V. (2020) · Journal of Research on Technology in Education · doi:10.1080/15391523.2020.1743798 · Cited by 134
Exploring the potential of digital game-based vocabulary learning: a systematic review
Vnucko, G., & Klimova, B. (2023) · Systems · doi:10.3390/systems11020057 · Cited by 59
“DGBVL proved to be an effective teaching method in the past [30,32–45], and was confirmed as such within this systematic review.”
BackgroundMethodInfluentialTHE EFFECT OF DIGITAL VIDEO GAMES ON EFL STUDENTS’ LANGUAGE LEARNING MOTIVATION
Ebrahimzadeh, M., & Alavi, S. (2017) · Teaching English With Technology · Cited by 116
Self-citationSecond language (L2) gains through digital game-based language learning (DGBLL): A meta-analysis
Dixon, D. H., Dixon, T., & Jordan, E. (2022) · Language Learning & Technology · doi:10.64152/10125/73464 · Cited by 88
“Bubbles, Bilingual Child Terantino (2016) Tom Clancy’s Ghost Recon: Future Soldier Urun et al. (2017) Warcraft III: The Frozen Throne Ebrahimzadeh (2017) Word Coach Cobb & Horst (2011)”
BackgroundA scoping review of video games and learning in secondary classrooms
Cole, C., Parada, R. H., & Mackenzie, E. (2023) · Journal of Research on Technology in Education · doi:10.1080/15391523.2023.2186546 · Cited by 57
Ongoro, C. A., & Fanjiang, Y. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3268282 · Cited by 68
“Integrating DGBL into the school curriculum is crucial for addressing the challenges of boredom and demotivation in the context of language learning [17], [18], [19].”
MethodLearning Outcomes, Motivation, and Satisfaction in Gamified English Vocabulary Learning
Yu, Z. (2023) · SAGE Open · doi:10.1177/21582440231158332 · Cited by 88
“Serious game players could facilitate vocabulary learning by using learning strategies, including repetitions of vocabulary, contextual inferences, convenient communication, and animated visualization in authentic situations (Ebrahimzadeh, 2017).”
BackgroundLiu, L., & Hwang, G. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13400 · Cited by 56
An artificial vocabulary learning assistant
Polyzi, P., & Moussiades, L. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11810-9 · Cited by 45
“In (Ebrahimzadeh, 2017), 241 boys aged 12–18 were divided into three groups: Readers who practised vocabulary through reading, players who studied through playing the commercial digital video game "Warcraft III: The Frozen Throne", and watchers who watched those playing.”
BackgroundA review of the effects of media on foreign language vocabulary acquisition
Nguyen, N. T. T. (2021) · International Journal of TESOL & Education · Cited by 24
Kassem, M. A. M. (2018) · Journal of Language Teaching and Research · doi:10.17507/jltr.0902.05 · Cited by 28
“Similar conclusions were asserted by Ebrahimzadeh (2017) who reported the effectiveness of DVGs in fostering students' vocabulary acquisition.”
ResultExploring the Potential of Generative AI in English Language Teaching
Ironsi, C. S. (2023) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-0487-7.ch007 · Cited by 30
Video games and disability—a risk and benefit analysis
Kuo, H. J., Yeomans, M., Ruiz, D., & Lin, C.-C. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1343057 · Cited by 20
Muñoz–Basols, J., Gutiérrez, M. F., & Cerezo, L. (2023) · Routledge eBooks · doi:10.4324/9781003146391 · Cited by 33
The effects of a game-enhanced learning intervention on foreign language learning
Aydın, S. M., & Çakır, N. A. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10141-9 · Cited by 21
“In particular, COTS games were found to positively contribute to vocabulary retainment and acquisition (Calvo-Ferrer et al., 2021; Chen et al., 2012; Chen & Yang, 2013; deHaan, 2005; Ebrahimzadeh, 2017; Ebrahimzadeh & Alavi, 2016; Miller & Hegelheimer, 2006; Hitosugi et al., 2014; Lu & Chang, 2016; Miller & Peterson,…”
Sadan, M., Lipka, O., & Katzir, T. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2024.2382452 · Cited by 20
“The gamified environment likely provided scaffolded learning experiences that boosted confidence and motivation, critical for students at risk of disengagement (Ebrahimzadeh, 2017).”
Wang, C.-C., Chen, H.-C., & Hung, J. C.-S. (2024) · Interactive Technology and Smart Education · doi:10.1108/itse-01-2024-0015 · Cited by 12
Becker, D. (2022) · Anglistik · doi:10.33675/angl/2022/1/8 · Cited by 9
“Yet, so far, there is hardly any empirical evidence to either support or deny this assumption: While there Ebrahimzadeh 2017; Casan-Pitarch The present study addresses this research gap by empirically exploring the actual use of commercial video games by language educators .”
Zainuddin, G., Ramlan, S. R., Masrop, N. A. M., Sahrir, M. S., & bin Abdullah, E. (2021) · International Conference on Sustainable Innovation – Social, Humanity, and Education (ICoSIHESS) · doi:10.2991/assehr.k.210120.157 · Cited by 13
Applying Gamification to Enhance the Universal Design for Learning Framework
Majdoub, M. (2022) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-7998-9561-9.ch013 · Cited by 6
A Systematic Review of Research Questions in Mixed Methods Studies in Instructional Design
Merchant, Z., Sadaf, A., Olesova, L. A., & Wu, T. (2021) · Pedagogical Research · doi:10.29333/pr/11282 · Cited by 5
Yu, Z. (2018) · International Journal of Gaming and Computer-Mediated Simulations · doi:10.4018/ijgcms.2018040101 · Cited by 8
A systematic review on the effectiveness of blended learning on learners’ EFL vocabulary performance
Chuane, Q., Shukor, S. S., Kaur Swaran Singh, C., Wang, G., Xiaofen, Z., & Yuehong, T. (2022) · Pegem Journal of Education and Instruction · doi:10.47750/pegegog.12.04.21 · Cited by 11
Zengin, M., & Yılmaz, N. P. (2021) · European Journal of English Language Teaching · doi:10.46827/ejel.v6i6.4011 · Cited by 4
“…and learning (Aghlara & Tamjid, 2011; Alsharafat, Alrashdan, & Younes, 2017; Ashraf, Motlagh, & Salami, 2014; Ceylaner & Yanpar Yelken, 2017; Ebrahimzadeh, 2017; Jensen, 2017; Kocaman & Kızılkaya Cumaoğlu, 2014; Letchumanan, Tan, Paramasivam, Sabariah, & Muthusamy, 2015; Liu & Chu, 2010;…”
Guedes, S. D. C., Nobre, J. N. P., Morais, R. L. D. S., Mascarenhas, R. D. O., Santos, L. R., Martins-Reis, V. D. O., Oliveira, V. C., & Santos, J. N. (2020) · Motriz Revista de Educação Física · doi:10.1590/s1980-65742020000400095 · Cited by 6
Hesami, E., Bakhshani, N., Arabpour, M., & Zaheri, Y. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e41036 · Cited by 5
A descriptive analysis of digital game-based foreign language education
Kazu, İ. Y. (2023) · Focus on ELT Journal · doi:10.14744/felt.2023.5.1.4 · Cited by 7
Nitisakunwut, P., Hwang, G., & Chanyoo, N. (2022) · International Journal of Online Pedagogy and Course Design · doi:10.4018/ijopcd.311437 · Cited by 5
Baturay, M. H., YASTIBAŞ, A. E., Ekşi, G. Y., & Çinar, C. A. (2021) · Advances in game-based learning book series · doi:10.4018/978-1-7998-7271-9.ch027 · Cited by 2
Using Cartoon Discussions for Vocabulary Acquisition in English Language Teaching
ÖZKURKUDİS, M. J., & Bümen, N. T. (2021) · Journal of Education and Future · doi:10.30786/jef.656206 · Cited by 4
“This can be possible through motivating content such as videos, cartoons, and fun material (AlShajiji, 2015; Arıkan & Taraf, 2010; Averianova, 2015; Calvo-Ferrer, 2017; Ebrahimzadeh, 2017; Karaaslan et. al., 2018Kim & Gilman, 2008; Prosic-Santovac, 2017; Cardoso, et. al, 2017; Yip & Kwan, 2006; Zabidin, 2015).”
BackgroundMethodInfluentialAhmed, D. A. E. (2018) · مجلة البحث العلمى فى التربية · doi:10.21608/jsre.2018.7958 · Cited by 3
Uribe-Gómez, L., López-Granda, N., Grajales-Peláez, J., Ocampo-Arroyave, F., Moreno-Valencia, E., & Abad, J. V. (2026) · PROFILE Issues in Teachers Professional Development · doi:10.15446/profile.v28n2.122751
Poole, F. J., & Dixon, D. H. (2026) · Research methods in applied linguistics · doi:10.1075/rmal.15.07poo
Reading Interventions in the Modern Era: Reconceptualizing the Utility of Video Games
Mehmedovic, S. (2025) · Digital Commons - DU (University of Denver) · doi:10.56902/etdcrp.2025.143
Humaira Mariyam, B., & Karthika, V. K. (2024) · Educational Philosophy and Theory · doi:10.1080/00131857.2024.2440475
“The study also confirms the considerable improvement in vocabulary and speaking skills similar to the studies concerning games and language learning (Ansteeg, 2015; Bytheway, 2014; Ebrahimzadeh, 2017; Reinders & Wattana, 2015).”
Kiên, T. T. (2024) · Journal of Science and Technology · doi:10.55401/c1kpm641
Abdulaal, M. A. A.-D., & Al-Johani, H. M. (2024) · World Journal of English Language · doi:10.5430/wjel.v14n3p87
Metadata
- Authors
- Ebrahimzadeh, M.
- Affiliations
- Shiraz University (IR)
- Corresponding author
- Ebrahimzadeh, Mohsen
- Venue
- English Language Teaching
- Published
- 2017-01-04
- Volume
- 10
- Issue
- 2
- Pages
- 1
- ISSN
- 1916-4742 (ISSN-L)
- 1916-4750
- OpenAlex
- W2570374697
- Cited by
- 45
- References
- 56
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 7 · 2023: 9 · 2022: 6 · 2021: 6 · 2020: 5 · 2019: 3 · 2018: 4 · 2017: 1
- FWCI
- 7.17
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- English Language Teaching (publishedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Keywords
- vocabulary acquisition, EFL learners, high school students, intensive reading, game-based learning, vocabulary training, English as a foreign language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

