The DOI matches its Crossref record; 91 of the 93 references it cites were found in a registry or an index.
Not New, but Nearly Forgotten: the Testing Effect Decreases or even Disappears as the Complexity of Learning Materials Increases
Open accessAbstract
The testing effect is a finding from cognitive psychology with relevance for education. It shows that after an initial study period, taking a practice test improves long-term retention compared to not taking a test and—more interestingly—compared to restudying the learning material. Boundary conditions of the effect that have received attention include the test format, retrieval success on the initial test, the retention interval, or the spacing of tests. Another potential boundary condition concerns the complexity of learning materials, that is, the number of interacting information elements a learning task contains. This insight is not new, as research from a century ago already had indicated that the testing effect decreases as the complexity of learning materials increases, but that finding seems to have been nearly forgotten. Studies presented in this special issue suggest that the effect may even disappear when the complexity of learning material is very high. Since many learning tasks in schools are high in element interactivity, a failure to find the effect under these conditions is relevant for education. Therefore, this special issue hopes to put this potential boundary condition back on the radar and provide a starting point for discussion and future research on this topic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, the generation effect is reduced in novice learners, as there are no previous schemas to work with (Leahy et al., 2015; van Gog & Sweller, 2015).”
From Does difficulty moderate learning? A comparative analysis of the desirable difficulties framework and cognitive load theory (2025) · cites this paper as van Gog & Sweller, 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · Elsevier eBooks · doi:10.1007/978-1-4419-1428-6_446 · Cited by 6,172
Self-citationThe Psychology of Learning and Motivation
(2021) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(21)x0002-3 · Cited by 5,082
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328
Acquisition of cognitive skill
Anderson, J. R. (1982) · Psychological Review · doi:10.1037/0033-295x.89.4.369 · Cited by 3,663
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load
Sweller, J. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9128-5 · Cited by 2,020
Self-citationThe Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 2×
“According to a Google Scholar search (December 2014), his work has only been cited in nine other publications.”
Karpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745
Metacognition and affect: What can metacognitive experiences tell us about the learning process?
Efklides, A. (2006) · Educational Research Review · doi:10.1016/j.edurev.2005.11.001 · Cited by 724
Repeated retrieval during learning is the key to long-term retention☆
Karpicke, J. D., & ROEDIGERIII, H. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 647
Exploring the Assistance Dilemma in Experiments with Cognitive Tutors
Koedinger, K. R., & Aleven, V. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9049-0 · Cited by 632
Testing the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563
Pyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551
Effects of pairs of problems and examples on task performance and different types of cognitive load
Leppink, J., Paas, F., van Gog, T., van der Vleuten, C. P. M., & van Merriënboer, J. J. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.12.001 · Cited by 520
Test format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval.
Carpenter, S. K. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017021 · Cited by 503
Ten Benefits of Testing and Their Applications to Educational Practice
Roediger, H. L., III, Putnam, A. L., & Smith, M. A. (2011) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 496
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492 · cited 1×
“…transfer (e.g., recalling a word in a sentence that differed from the word that had to be recalled from that same sentence on an initial test) or contained cues that were also present in the original text (i.e., corresponding words or terms) that would invite the correct answer (e.g., Butler 2010).”
Unsuccessful retrieval attempts enhance subsequent learning.
Kornell, N., Hays, M. J., & Bjork, R. A. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015729 · Cited by 484
When Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434
Test-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., III, Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology Applied · doi:10.1037/a0026252 · Cited by 416
The "testing" phenomenon: Not gone but nearly forgotten.
Glover, J. A. (1989) · Journal of Educational Psychology · doi:10.1037/0022-0663.81.3.392 · Cited by 392 · cited 2×
“Interestingly, this insight is not new, although, as was once true of the testing effect itself (Glover 1989), it seems to have been nearly forgotten.”
BackgroundLearning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · doi:10.1017/cbo9781107707085 · Cited by 388
Carpenter, S. K., & Delosh, E. L. (2006) · Memory & Cognition · doi:10.3758/bf03193405 · Cited by 386
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03518.x · Cited by 383
Why Testing Improves Memory: Mediator Effectiveness Hypothesis
Pyc, M. A., & Rawson, K. A. (2010) · Science · doi:10.1126/science.1191465 · Cited by 371
Examining the testing effect with open‐ and closed‐book tests
Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., III, & McDermott, K. B. (2007) · Applied Cognitive Psychology · doi:10.1002/acp.1391 · Cited by 368
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360 · cited 1×
“…condition, because even though the term testing effect is also used to refer to beneficial effects of testing as an additional activity (e.g., McDaniel et al. 2011; Smith and Karpicke 2014), any beneficial effects of testing as an additional activity could be due to increased time on task…”
Roediger, H. L., III, & Pyc, M. A. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2012.09.002 · Cited by 310
Recitation As a Factor in Memorizing
Gates, A. I. (2010) · Medical Entomology and Zoology · Cited by 310
Spitzer, H. F. (1939) · Journal of Educational Psychology · doi:10.1037/h0063404 · Cited by 306
The pretesting effect: do unsuccessful retrieval attempts enhance learning?
Richland, L. E., Kornell, N., & Kao, L. S. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0016496 · Cited by 302
Effects of worked examples, example-problem, and problem-example pairs on novices’ learning
van Gog, T., Kester, L., & Paas, F. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2010.10.004 · Cited by 283
The effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281
Retrieval-Based Learning: An Episodic Context Account
Karpicke, J. D., Lehman, M. S., & Aue, W. R. (2012) · Current Directions in Psychological Science · Cited by 276
Using tests to enhance 8th grade students' retention of U.S. history facts
Carpenter, S. K., Pashler, H., & Cepeda, N. J. (2009) · Applied Cognitive Psychology · doi:10.1002/acp.1507 · Cited by 254
A testing effect with multimedia learning.
Johnson, C. I., & Mayer, R. E. (2009) · Journal of Educational Psychology · doi:10.1037/a0015183 · Cited by 251
Subjective organization and effects of repetition in multi-trial free-recall learning
Tulving, E. (1966) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(66)80016-6 · Cited by 249
Different rates of forgetting following study versus test trials
Wheeler, M., Ewers, M., & Buonanno, J. F. (2003) · Memory · doi:10.1080/09658210244000414 · Cited by 249
Retrieval-Based Learning: A Perspective for Enhancing Meaningful Learning
Karpicke, J. D., & Grimaldi, P. J. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9202-2 · Cited by 245
Testing Enhances the Transfer of Learning
Carpenter, S. K. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412452728 · Cited by 230
Test-potentiated learning: Distinguishing between direct and indirect effects of tests.
Arnold, K. M., & McDermott, K. B. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0029199 · Cited by 227
McDermott, K. B., Agarwal, P. K., D'Antonio, L., Roediger, H. L., III, & McDaniel, M. A. (2013) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000004 · Cited by 214
The testing effect in free recall is associated with enhanced organizational processes
Zaromb, F. M., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.995 · Cited by 206
Learners’ choices and beliefs about self-testing
Kornell, N., & Son, L. K. (2009) · Memory · doi:10.1080/09658210902832915 · Cited by 190
The dynamics of learning and allocation of study time to a region of proximal learning
Metcalfe, J., & Kornell, N. (2003) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.132.4.530 · Cited by 186
Karpicke, J. D., Lehman, M., & Aue, W. R. (2014) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-800283-4.00007-1 · Cited by 185
McDaniel, M. A., Wildman, K. M., & Anderson, J. L. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2011.10.001 · Cited by 177
What types of learning are enhanced by a cued recall test?
Carpenter, S. K., Pashler, H., & Vul, E. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03194004 · Cited by 172
Learning with retrieval-based concept mapping.
Blunt, J. R., & Karpicke, J. D. (2014) · Journal of Educational Psychology · doi:10.1037/a0035934 · Cited by 171
The Testing Effect and the Retention Interval: Questions and Answers
Toppino, T. C., & Cohen, M. S. (2009) · Experimental Psychology · doi:10.1027/1618-3169.56.4.252 · Cited by 160
Retrieval practice with short-answer, multiple-choice, and hybrid tests
Smith, M. A., & Karpicke, J. D. (2013) · Memory · doi:10.1080/09658211.2013.831454 · Cited by 151
Agarwal, P. K., Bain, P. M., & Chamberlain, R. W. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9210-2 · Cited by 132
Covert retrieval practice benefits retention as much as overt retrieval practice.
Smith, M. A., Roediger, H. L., III, & Karpicke, J. D. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0033569 · Cited by 132
Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · Cited by 109
Why is test–restudy practice beneficial for memory? An evaluation of the mediator shift hypothesis.
Pyc, M. A., & Rawson, K. A. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0026166 · Cited by 107
A Test of the Testing Effect: Acquiring Problem‐Solving Skills From Worked Examples
van Gog, T., & Kester, L. (2012) · Cognitive Science · doi:10.1111/cogs.12002 · Cited by 107
Retrieval attempts enhance learning, but retrieval success (versus failure) does not matter.
Kornell, N., Klein, P. J., & Rawson, K. A. (2014) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0037850 · Cited by 100
Material-appropriate processing: A contextualist approach to reading and studying strategies
McDaniel, M. A., & Einstein, G. O. (1989) · Educational Psychology Review · doi:10.1007/bf01326639 · Cited by 95
THE PSYCHOLOGY OF LEARNING AND MOTIVATION: Cognition in Education
(2011) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-387691-1.00011-9 · Cited by 91
Enhancing visuospatial learning: The benefit of retrieval practice
Kang, S. H. K. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.1009 · Cited by 89
Retrieval-based learning: The need for guided retrieval in elementary school children
Karpicke, J. D., Blunt, J. R., Smith, M. A., & Karpicke, S. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.07.008 · Cited by 89
Does response mode affect amount recalled or the magnitude of the testing effect?
Putnam, A. L., & Roediger, H. L. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0245-x · Cited by 86
Weinstein, Y., McDermott, K. B., & Roediger, H. L., III (2010) · Journal of Experimental Psychology Applied · doi:10.1037/a0020992 · Cited by 83
The Effect of Retrieval Practice in Primary School Vocabulary Learning
Goossens, N. A. M. C., Camp, G., Verkoeijen, P. P. J. L., & Tabbers, H. K. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2956 · Cited by 82
Tse, C.-S., Balota, D. A., & Roediger, H. L. (2010) · Psychology and Aging · doi:10.1037/a0019933 · Cited by 80
Cranney, J., Ahn, M., McKinnon, R., Morris, S., & Watts, K. (2009) · European Journal of Cognitive Psychology · doi:10.1080/09541440802413505 · Cited by 80
Bouwmeester, S., & Verkoeijen, P. P. J. L. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2011.02.005 · Cited by 77
Tests enhance retention and transfer of spatial learning
Carpenter, S. K., & Kelly, J. W. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0221-2 · Cited by 77
Leahy, W., Hanham, J., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9296-4 · Cited by 77
Self-citationvan Gog, T., Kester, L., Dirkx, K., Hoogerheide, V., Boerboom, J., & Verkoeijen, P. P. J. L. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9297-3 · Cited by 75
Benefits of testing memory: Best practices and boundary conditions
Roediger, H. L., III (2009) · Psychology Press eBooks · doi:10.4324/9780203869611-10 · Cited by 65
Free recall enhances subsequent learning
Arnold, K. M., & McDermott, K. B. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0370-3 · Cited by 59
Learning Adinkra symbols: The effect of testing
Coppens, L. C., Verkoeijen, P. P. J. L., & Rikers, R. M. J. P. (2011) · Journal of Cognitive Psychology · doi:10.1080/20445911.2011.507188 · Cited by 58
Effects of testing on learning of functions
Kang, S. H. K., McDaniel, M. A., & Pashler, H. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0113-x · Cited by 57
Retrieval practice and elaborative encoding benefit memory in younger and older adults.
Coane, J. H. (2013) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2013.04.001 · Cited by 56
Guided retrieval practice of educational materials using automated scoring.
Grimaldi, P. J., & Karpicke, J. D. (2013) · Journal of Educational Psychology · doi:10.1037/a0033208 · Cited by 52
Is the benefit of retrieval practice modulated by motivation?
Kang, S. H. K., & Pashler, H. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.05.006 · Cited by 50
Jang, Y., Wixted, J. T., Pecher, D., Zeelenberg, R., & Huber, D. E. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2011.638079 · Cited by 46
Retrieval practice: the lack of transfer to deductive inferences
Tran, R., Rohrer, D., & Pashler, H. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0646-x · Cited by 40
The role of organizational processes in long-term retention.
Masson, M. E. J., & McDaniel, M. A. (1981) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037/0278-7393.7.2.100 · Cited by 34
Carpenter, S. K., Sachs, R. E., Martin, B., Schmidt, K., & Looft, R. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0185-7 · Cited by 28
A Short-Term Testing Effect in Cross-Language Recognition
Verkoeijen, P. P. J. L., Bouwmeester, S., & Camp, G. (2012) · Psychological Science · doi:10.1177/0956797611435132 · Cited by 25
The Effect of Testing on the Retention of Coherent and Incoherent Text Material
de Jonge, M., Tabbers, H. K., & Rikers, R. M. J. P. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9300-z · Cited by 23
Is recitation an effective tool for adult learners?
McDermott, K. B., & Naaz, F. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.06.006 · Cited by 10
Applying cognitive psychology to education: Complexities and prospects.
Roediger, H. L., III, & Pyc, M. A. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2012.10.006 · Cited by 9
The Relative Benefits of Studying and Testing on Long-Term Retention
Roediger, H. L., III, & Nestojko, J. F. (2015) · doi:10.4324/9781315885582-12 · Cited by 9
Organizational Processes Contribute to the Testing Effect in Free Recall
Zaromb, F. M. (2010) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7vh5kzn · Cited by 6
Cited by
Sorted by citations
Eight Ways to Promote Generative Learning
Fiorella, L., & Mayer, R. E. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9348-9 · Cited by 832
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286
Teaching the science of learning
Weinstein, Y., Madan, C. R., & Sumeracki, M. A. (2018) · Cognitive Research Principles and Implications · doi:10.1186/s41235-017-0087-y · Cited by 288
Retrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223
The science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184
Metadata
- Authors
- van Gog, T., & Sweller, J.
- Affiliations
- Utrecht University (NL)
- UNSW Sydney (AU)
- Corresponding author
- van Gog, Tamara
- Venue
- Educational Psychology Review
- Published
- 2015-05-16
- Volume
- 27
- Issue
- 2
- Pages
- 247-264
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W2128915986
- Cited by
- 164
- References
- 93
- Citations by year
- 2026: 11 · 2025: 18 · 2024: 22 · 2023: 21 · 2022: 10 · 2021: 16 · 2020: 13 · 2019: 15 · 2018: 17 · 2017: 7 · 2016: 10 · 2015: 4
- FWCI
- 7.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Educational Psychology Review (publishedVersion, cc-by)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
- RePub (Erasmus University Rotterdam) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (452‐11‐006)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- testing effect, learning complexity, element interactivity, long-term retention, practice tests, restudying, boundary conditions, retrieval practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
