Resumption strategies for interrupted programming tasks
Abstract
Interruptions are a daily reality for professional programmers. Unfortunately, the strategies programmers use to recover lost knowledge and resume work have not yet been well studied. In this paper, we perform exploratory analysis on 10,000 recorded programming sessions of 85 programmers to understand the variety of strategies used by programmers for resuming programming tasks. In our study, we find that only 10% of the programming sessions have coding activity start in less than a minute, only 7% of the programming sessions involve no navigation to other locations prior to editing, and find evidence of programmers seeking other sources of task context during task resumption. Based on the analysis, we suggest how task resumption might be better supported in future development tools.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
According to Parnin and Rugaber, a major challenge of task resumption is to rebuild the interrupted task's context.
“According to Parnin and Rugaber, a major challenge of task resumption is to rebuild the interrupted task's context [73].”
From Detecting Developers' Task Switches and Types (2022) · cites this paper as [73]
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,469 · see citing works
Human Memory: A Proposed System and its Control Processes
Atkinson, R. C., & Shiffrin, R. M. (1968) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60422-3 · Cited by 7,216 · see citing works
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779 · see citing works
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035 · see citing works
Encoding specificity and retrieval processes in episodic memory.
Tulving, E., & Thomson, D. M. (1973) · Psychological Review · doi:10.1037/h0020071 · Cited by 4,540 · see citing works
Chase, W. G., & Simon, H. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90004-2 · Cited by 4,479 · see citing works
Ericsson, K. A., & Kintsch, W. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.211 · Cited by 3,498 · see citing works
An Integrated Theory of the Mind.
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C. J., & Qin, Y. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1036 · Cited by 3,048 · see citing works
Memory systems of the brain: A brief history and current perspective
Squire, L. R. (2004) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2004.06.005 · Cited by 2,269 · see citing works
Practical aspects of memory : current research and issues
Gruneberg, M. M., Morris, P. E., & Sykes, R. N. (1988) · Wiley eBooks · Cited by 1,038 · see citing works
A diary study of task switching and interruptions
Czerwinski, M., Horvitz, E., & Wilhite, S. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985715 · Cited by 830 · see citing works
Memory for goals: an activation-based model
Altmann, E. M., & Trafton, J. G. (2002) · Cognitive Science · doi:10.1016/s0364-0213(01)00058-1 · Cited by 796 · see citing works
Memory for goals: an activation‐based model
Altmann, E. M., & Trafton, J. G. (2002) · Cognitive Science · doi:10.1207/s15516709cog2601_2 · Cited by 795 · see citing works
Maintaining mental models: a study of developer work habits
LaToza, T. D., Venolia, G., & DeLine, R. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134355 · Cited by 628 · see citing works
If not now, when?: the effects of interruption at different moments within task execution
Adamczyk, P. D., & Bailey, B. P. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985727 · Cited by 531 · see citing works
No task left behind?: examining the nature of fragmented work
Mark, G., Gonzalez, V. M., & Harris, J. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055017 · Cited by 503 · see citing works
Information Needs in Collocated Software Development Teams
Ko, A. J., DeLine, R., & Venolia, G. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.45 · Cited by 499 · see citing works
Studying Software Engineers: Data Collection Techniques for Software Field Studies
Lethbridge, T. C., Sim, S. E., & Singer, J. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-1290-x · Cited by 491 · see citing works
What makes interruptions disruptive? A study of length, similarity, and complexity
Gillie, T., & Broadbent, D. (1989) · Psychological Research · doi:10.1007/bf00309260 · Cited by 490 · see citing works
Trafton, J. G., Altmann, E. M., Brock, D. P., & Mintz, F. E. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00023-5 · Cited by 457 · see citing works
Using task context to improve programmer productivity
Kersten, M., & Murphy, G. C. (2006) · Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1181775.1181777 · Cited by 452 · see citing works
Temporal factors in mental work: Effects of interrupted activities
Zijlstra, F. R. H., Roe, R. A., Leonora, A. B., & Krediet, I. (1999) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317999166581 · Cited by 429 · see citing works
How are Java software developers using the Eclipse IDE?
Murphy, G. C., Kersten, M., & Findlater, L. (2006) · IEEE Software · doi:10.1109/ms.2006.105 · Cited by 413 · see citing works
Morris, R. G. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04888.x · Cited by 398 · see citing works
McFarlane, D. C. (2002) · Human–Computer Interaction · doi:10.1207/s15327051hci1701_2 · Cited by 378 · see citing works
Anderson, J. R., Farrell, R., & Sauers, R. (1984) · Cognitive Science · doi:10.1016/s0364-0213(84)80013-0 · Cited by 377 · see citing works
Morris, R., & Frey, U. (1997) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1997.0136 · Cited by 366 · see citing works
Frontal-lobe contribution to recency judgements
Milner, B. A., Corsi, P. M., & Leonard, G. T. (1991) · Neuropsychologia · doi:10.1016/0028-3932(91)90013-x · Cited by 352 · see citing works
Untersuchungen zur Handlungs- und Affektpsychologie
Lewin, K. (1927) · Psychological Research · doi:10.1007/bf02409755 · Cited by 344 · see citing works
(2001) · Cited by 341 · see citing works
The effect of interruption duration and demand on resuming suspended goals.
Monk, C. A., Trafton, J. G., & Boehm-Davis, D. A. (2008) · Journal of Experimental Psychology: Applied · doi:10.1037/a0014402 · Cited by 296 · see citing works
O’Conaill, B., & Frohlich, D. M. (1995) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/223355.223665 · Cited by 291 · see citing works
Anderson, J. R., Farrell, R., & Sauers, R. (1984) · Cognitive Science · doi:10.1207/s15516709cog0802_1 · Cited by 282 · see citing works
Cherubini, M., Venolia, G. D., DeLine, R., & Ko, A. J. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240714 · Cited by 262 · see citing works
Salvucci, D. D., Taatgen, N. A., & Borst, J. P. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518981 · Cited by 251 · see citing works
Psychological Issues in Support of Multiple Activities
MIYATA, Y., & NORMAN, D. A. (1986) · User Centered System Design · doi:10.1201/b15703-13 · Cited by 245 · see citing works
Das Behalten erledigter und unerledigter Handlungen
Zeigarnik, B. (1927) · Springer eBooks · Cited by 223 · see citing works
Bellotti, V. M. E., Dalal, B., Good, N. S., Flynn, P., Bobrow, D. G., & Ducheneaut, N. (2004) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985785 · Cited by 217 · see citing works
Iqbal, S. T., & Bailey, B. P. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056948 · Cited by 203 · see citing works
Timecourse of recovery from task interruption: Data and a model
Altmann, E. M., & Trafton, J. G. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03193094 · Cited by 191 · see citing works
Eliciting design requirements for maintenance-oriented IDEs
Ko, A. J., Aung, H. H., & Myers, B. A. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1062455.1062492 · Cited by 182 · see citing works
(2004) · eScholarship (California Digital Library) · Cited by 160 · see citing works
Error Detection Processes in Statistical Problem Solving
Allwood, C. M. (1984) · Cognitive Science · doi:10.1207/s15516709cog0804_5 · Cited by 154 · see citing works
Hippocampal contributions to recollection in retrograde and anterograde amnesia
Gilboa, A., Winocur, G., Rosenbaum, R. S., Poreh, A., Gao, F., Black, S. E., Westmacott, R., & Moscovitch, M. (2006) · Hippocampus · doi:10.1002/hipo.20226 · Cited by 129 · see citing works
Easing Program Comprehension by Sharing Navigation Data
DeLine, R. A., Czerwinski, M. P., & Robertson, G. G. (2005) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2005.32 · Cited by 125 · see citing works
Storey, M., Ryall, J., Bull, R. I., Myers, D., & Singer, J. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1368088.1368123 · Cited by 120 · see citing works
NavTracks: supporting navigation in software maintenance
Singer, J., Elves, R., & Storey, M.-A. (2005) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2005.66 · Cited by 119 · see citing works
Contextual cues aid recovery from interruption: the role of associative activation
Hodgetts, H. M., & Jones, D. M. (2006) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.32.5.1120 · Cited by 116 · see citing works
Evaluation and analysis of users' activity organization
Bannon, L. J., Cypher, A., Greenspan, S. L., & Monty, M. L. (1983) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/800045.801580 · Cited by 115 · see citing works
Examining task engagement in sensor-based statistical models of human interruptibility
Fogarty, J., Ko, A. J., Aung, H. H., Golden, E., Tang, K. P., & Hudson, S. E. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055018 · Cited by 111 · see citing works
Interrupts: just a minute never is
van Solingen, R., Berghout, E., & van Latum, F. (1998) · IEEE Software · doi:10.1109/52.714843 · Cited by 104 · see citing works
Towards understanding programs through wear-based filtering
DeLine, R., Khella, A., Czerwinski, M., & Robertson, G. (2005) · Proceedings of the 2005 ACM symposium on Software visualization · doi:10.1145/1056018.1056044 · Cited by 91 · see citing works
Building Usage Contexts During Program Comprehension
Parnin, C., & Görg, C. (2006) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2006.14 · Cited by 77 · see citing works
Self-citationHuh, what was I Doing? How People Use Environmental Cues after an Interruption
Trafton, J. G., Altmann, E. M., & Brock, D. (2005) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120504900354 · Cited by 76 · see citing works
Pennington, N., & Grabowski, B. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-350772-3.50008-2 · Cited by 65 · see citing works
Spatial memory guides task resumption
Ratwani, R. M., & Trafton, J. G. (2008) · Visual Cognition · doi:10.1080/13506280802025791 · Cited by 62 · see citing works
Code Thumbnails: Using Spatial Memory to Navigate Source Code
DeLine, R. A., Czerwinski, M. P., Meyers, B. R., Venolia, G. D., Drucker, S. M., & Robertson, G. G. (2006) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2006.14 · Cited by 61 · see citing works
Evaluating Cues for Resuming Interrupted Programming Tasks
Parnin, C., & DeLine, R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753342 · Cited by 60 · see citing works
Self-citationStorey, M., Best, C., Michaud, J., Rayside, D., Litoiu, M., & Musen, M. A. (2002) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/506443.506459 · Cited by 55 · see citing works
The Effect of Frequent versus Infrequent Interruptions on Primary Task Resumption
Monk, C. A. (2004) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120404800304 · Cited by 52 · see citing works
Characterizing and Understanding Development Sessions
Robbes, R., & Lanza, M. (2007) · 15th IEEE International Conference on Program Comprehension (ICPC '07) · doi:10.1109/icpc.2007.12 · Cited by 51 · see citing works
Relo: Helping Users Manage Context during Interactive Exploratory Visualization of Large Codebases
Sinha, V., Karger, D. R., & Miller, R. C. (2006) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2006.40 · Cited by 33 · see citing works
Comparing episodic and semantic interfaces for task boundary identification
Safer, I., & Murphy, G. C. (2007) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1145/1321211.1321235 · Cited by 27 · see citing works
Hypothesis-driven understanding processes during corrective maintenance of large scale software
von Mayrhauser, A., & Vans, A. M. (1997) · International Conference on Software Maintenance · doi:10.1109/icsm.1997.624226 · Cited by 26 · see citing works
The Costs of Multitasking in Threaded Cognition
Borst, J. P., & Taatgen, N. (2007) · Cited by 24 · see citing works
Understanding memory triggers for task tracking
Brush, A. J. B., Meyers, B. R., Tan, D. S., & Czerwinski, M. P. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240768 · Cited by 21 · see citing works
An Industrial Case Study of Program Artifacts Viewed During Maintenance Tasks
Zou, L., & Godfrey, M. W. (2006) · 2006 13th Working Conference on Reverse Engineering · doi:10.1109/wcre.2006.12 · Cited by 20 · see citing works
Making sense of low-level usage data to understand user activities
Renaud, K., & Gray, P. (2004) · doi:10.5555/1035053.1035067 · Cited by 19 · see citing works
Modelling the Information-Seeking Behaviour of Programmers - An Empirical Approach
O’Brien, M. P., & Buckley, J. (2005) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/wpc.2005.24 · Cited by 14 · see citing works
Storey, M., Best, C., Michaud, J., Rayside, D., Litoiu, M., & Musen, M. A. (2002) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/506444.506459 · Cited by 11 · see citing works
Studies in the retention of interrupted learning activities.
McKinney, F. W. (1935) · Journal of comparative psychology · doi:10.1037/h0056005 · Cited by 10 · see citing works
Designing a prosthetic memory to support software developers
Dekel, U. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1370175.1370225 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
On the Comprehension of Program Comprehension
Maalej, W., Tiarks, R., Roehm, T., & Koschke, R. (2014) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2622669 · Cited by 180 · see citing works
Supporting Workplace Detachment and Reattachment with Conversational Intelligence
Williams, A. C., Kaur, H., Mark, G. J., Thompson, A. L., Iqbal, S. T., & Teevan, J. B. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173662 · Cited by 83 · see citing works
Can development work describe itself?
Maalej, W., & Happel, H.-J. (2010) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2010.5463344 · Cited by 81 · see citing works
Capturing and analyzing low-level events from the code editor
Yoon, Y., & Myers, B. A. (2011) · doi:10.1145/2089155.2089163 · Cited by 74 · see citing works
Cohesive and Isolated Development with Branches
Barr, E. T., Bird, C., Rigby, P. C., Hindle, A., Germán, D. M., & Dévanbu, P. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-28872-2_22 · Cited by 66 · see citing works
Evaluating Cues for Resuming Interrupted Programming Tasks
Parnin, C., & DeLine, R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753342 · Cited by 60 · see citing works
Self-citationCollecting and Processing Interaction Data for Recommendation Systems
Maalej, W., Fritz, T., & Robbes, R. (2013) · Springer eBooks · doi:10.1007/978-3-642-45135-5_7 · Cited by 37 · see citing works
Debugger Canvas: Industrial experience with the code bubbles paradigm
DeLine, R. A., Bragdon, A. C., Rowan, K., Jacobsen, J., & Reiss, S. P. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227113 · Cited by 36 · see citing works
A context model for IDE-based recommendation systems
Gašparič, M., Murphy, G. C., & Ricci⋆, F. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2016.09.012 · Cited by 32 · see citing works
The Influence of the Task on Programmer Behaviour
Ying, A. T. T., & Robillard, M. P. (2011) · 2011 IEEE 19th International Conference on Program Comprehension · doi:10.1109/icpc.2011.35 · Cited by 41 · see citing works
An immersive future for software engineering
Sharma, V. S., Mehra, R., Kaulgud, V., & Podder, S. (2018) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3183399.3183414 · Cited by 23 · see citing works
Software assistants in software engineering: A systematic mapping study
Savary-Leblanc, M., Burgueño, L., Cabot, J., Pallec, X. L., & Gérard, S. (2022) · Software, Practice & Experience · doi:10.1002/spe.3170 · Cited by 25 · see citing works
An Empirical Study of the Effect of File Editing Patterns on Software Quality
Zhang, F., Khomh, F., Zou, Y., & Hassan, A. E. (2012) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2012.55 · Cited by 21 · see citing works
ScreenTrack: Using a Visual History of a Computer Screen to Retrieve Documents and Web Pages
Hu, D., & Lee, S. W. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376753 · Cited by 21 · see citing works
Daily Stand-Up Meetings: Start Breaking the Rules!
Stray, V. G., Moe, N. B., & Sjøberg, D. (2020) · NORA - Norwegian Open Research Archives · Cited by 17 · see citing works
An exploratory study of productivity perceptions in software teams
Ruvimova, A., Lill, A., Gugler, J., Howe, L. C., Huang, E. M., Murphy, G. C., & Fritz, T. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510081 · Cited by 16 · see citing works
Detecting Developers' Task Switches and Types
Meyer, A. N., Satterfield, C., Zuger, M., Kevic, K., Murphy, G. C., Zimmermann, T., & Fritz, T. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2984086 · Cited by 14 · see citing works
Exploring the Effectiveness of Time-lapse Screen Recording for Self-Reflection in Work Context
Hu, D., & Lee, S. W. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642469 · Cited by 11 · see citing works
An empirical study of the effect of file editing patterns on software quality
Zhang, F., Khomh, F., Zou, Y., & Hassan, A. E. (2014) · Journal of Software Evolution and Process · doi:10.1002/smr.1659 · Cited by 10 · see citing works
A Smart Advisor for Software Delivery - A Bot Framework for Awareness, Alerts and Advice
Sharma, V. S., Mehra, R., Kaulgud, V., & Podder, S. (2019) · IEEE/ACM International Workshop on Bots in Software Engineering (BotSE) · doi:10.1109/botse.2019.00014 · Cited by 7 · see citing works
Unpacking Task Management Tools, Values, and Worker Dynamics
Hu, D., Bhuiyan, M. M., Lim, S. I., Wiese, J., & Lee, S. W. (2024) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3663384.3663402 · Cited by 6 · see citing works
Parnin, C. (2013) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2013.6645270 · Cited by 1 · see citing works
Self-citationConsensus task interaction trace recommender to guide developers’ software navigation
Etaiwi, L., Sager, P., Guéhéneuc, Y., & Hamel, S. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10528-7
Augmenting software engineers with modeling assistants
Savary‐Leblanc, M. (2021) · doi:10.70675/dfc895bez7656z4fbbzb428zb7fe5569d910
- Authors
- Parnin, C., & Rugaber, S.
- Affiliations
- Georgia Institute of Technology (US)
- ORCID
- Parnin, Chris
- Venue
- 2009 IEEE 17th International Conference on Program Comprehension
- Publisher
- IEEE
- Published
- 2009-05
- Pages
- 80-89
- OpenAlex
- W2142791893
- Cited by
- 24
- References
- 71
- Citations by year
- 2024: 3 · 2022: 2 · 2021: 1 · 2020: 3 · 2019: 1 · 2018: 2 · 2016: 1 · 2014: 2 · 2013: 2 · 2012: 3
- FWCI
- 1.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Program Comprehension (ICPC) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- task resumption, interruptions, programmer behavior, source code navigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
