Trust in deliberation: The consequences of deliberative decision strategies for medical decisions.
Abstract
OBJECTIVE: Decision aids (DAs) play an increasingly critical role in supporting patients in making preference-sensitive treatment decisions. One largely untested assumption of DA design is that patients should be encouraged to deliberate carefully about their options after being informed of those options. The purpose of the present research is to test the impact of deliberative versus intuitive decision strategies in medical decision contexts. METHOD: In 3 experiments, participants were randomly assigned to make a hypothetical medical decision either intuitively, or using various deliberative strategies. In Study 1, we predicted that deliberation would improve decision confidence while not changing decisions. In Study 2, our aim was to establish whether the observed increase in confidence was due to decision-making effort, confirmation bias, or both. In Study 3, it was predicted that deliberation would cause participants to become more confident in suboptimal decisions. RESULTS: Across 3 studies, participants who deliberated felt better about their decisions and decision process, even when the decision was the same as what would have been chosen intuitively (Studies 1 and 2), and even when the decision was normatively bad (Study 3). Study 2 additionally indicated that participants' confidence was driven by confirmation bias rather than effort justification. CONCLUSIONS: Deliberative tasks may often fail to be an effective debiasing tool, and components of patient decision aids that ask patients to deliberate may serve to improve how patients feel without improving the quality of their decisions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Surrogates may have considered the decision aid content but used it to confirm an existing decision when integrating it with other informational sources and optimistic bias.
“surrogates may have considered the decision aid content but used it to confirm an existing decision when integrating it with other informational sources and optimistic bias (37).”
From Effects of a Personalized Web-Based Decision Aid for Surrogate Decision Makers of Patients With Prolonged Mechanical Ventilation (2019) · cites this paper as [37]
Cites
(2011) · Cited by 14,317 · see citing works
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996 · see citing works
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267 · see citing works
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Lewis, K., Barry, M. J., Bennett, C. L., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub5 · Cited by 6,685 · see citing works
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540 · see citing works
Dual-Process Theories of Higher Cognition: Advancing the Debate
Evans, J. S. B. T., & Stanovich, K. E. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691612460685 · Cited by 4,271 · see citing works
Individual differences in reasoning: Implications for the rationality debate?
Stanovich, K. E., & West, R. F. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003435 · Cited by 4,255 · see citing works
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T. D., Griffin, D., & Kahneman, D. J. (2004) · Academy of Management Review · doi:10.2307/20159081 · Cited by 3,579 · see citing works
Elwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824 · see citing works
Thinking too much: Introspection can reduce the quality of preferences and decisions.
Wilson, T. D., & Schooler, J. W. (1991) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.60.2.181 · Cited by 1,397 · see citing works
The effect of severity of initiation on liking for a group.
Aronson, E., & Mills, J. (1959) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0047195 · Cited by 1,297 · see citing works
How numeracy influences risk comprehension and medical decision making.
Reyna, V. F., Nelson, W. L., Han, P. K. J., & Dieckmann, N. F. (2009) · Psychological Bulletin · doi:10.1037/a0017327 · Cited by 1,172 · see citing works
Mental contamination and mental correction: Unwanted influences on judgments and evaluations.
Wilson, T. D., & Brekke, N. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.1.117 · Cited by 1,157 · see citing works
Feelings-as-Information Theory
Schwarz, N. (2012) · SAGE Publications Ltd eBooks · doi:10.4135/9781446249215.n15 · Cited by 927 · see citing works
Decision aids for patients facing health treatment or screening decisions: systematic review
O'Connor, A. M. C., Rostom, A., Fiset, V., Tetroe, J., Entwistle, V. A., Llewellyn-Thomas, H. A., Holmes-Rovner, M. M., Barry, M. J., & Jones, J. A. (1999) · BMJ · doi:10.1136/bmj.319.7212.731 · Cited by 862 · see citing works
On the relative independence of thinking biases and cognitive ability
Stanovich, K. E., & West, R. F. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.4.672 · Cited by 840 · see citing works
Costs and benefits of judgment errors: Implications for debiasing.
Arkes, H. R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.3.486 · Cited by 764 · see citing works
Connolly, T., & Zeelenberg, M. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00203 · Cited by 667 · see citing works
How People Make Decisions That Involve Risk
Reyna, V. F. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.00275.x · Cited by 639 · see citing works
Kruger, J., Wirtz, D., Leaf Van Boven, A., & Altermatt, T. W. (2003) · Journal of Experimental Social Psychology · doi:10.1016/s0022-1031(03)00065-9 · Cited by 445 · see citing works
Medical Decision Making in Situations That Offer Multiple Alternatives
Redelmeier, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03520280048038 · Cited by 417 · see citing works
Lilienfeld, S. O., Ammirati, R. J., & Landfield, K. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01144.x · Cited by 352 · see citing works
Clarifying values: an updated review
Fagerlin, A., Pignone, M. P., Abhyankar, P., Col, N. F., Feldman‐Stewart, D., Gavaruzzi, T., Kryworuchko, J., Levin, C. A., Pieterse, A. H., Reyna, V. F., et al. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-s2-s8 · Cited by 246 · see citing works
Self-citationDeliberation before determination: the definition and evaluation of good decision making
Elwyn, G. J., & Miron‐Shatz, T. (2009) · Health Expectations · doi:10.1111/j.1369-7625.2009.00572.x · Cited by 222 · see citing works
Regret in cancer-related decisions.
Connolly, T., & Reb, J. M. (2005) · Health Psychology · doi:10.1037/0278-6133.24.4.s29 · Cited by 201 · see citing works
AN EMPIRICAL ASSESSMENT OF COMPUTER‐ASSISTED DECISION ANALYSIS*
Aldag, R. J., & Power, D. (1986) · Decision Sciences · doi:10.1111/j.1540-5915.1986.tb00243.x · Cited by 198 · see citing works
An approach to measuring the quality of breast cancer decisions
Sepucha, K., Ozanne, E. M., Silvia, K. A., Partridge, A. H., & Mulley, A. G. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2006.08.007 · Cited by 148 · see citing works
Feldman‐Stewart, D., Tong, C., Siemens, R., Alibhai, S. M. H., Pickles, T., Robinson, J. W., & Brundage, M. (2012) · Medical Decision Making · doi:10.1177/0272989x11434601 · Cited by 112 · see citing works
Dual-Process Theories of Deductive Reasoning: Facts and Fallacies
Evans, J. S. B. T. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199734689.013.0008 · Cited by 108 · see citing works
The metacognitive advantage of deliberative thinkers: A dual-process perspective on overconfidence.
Mata, A., Ferreira, M. B., & Sherman, S. J. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0033640 · Cited by 96 · see citing works
O'Connor, A. M. C., Wells, G. A., Tugwell, P., Laupacis, A., Elmslie, T., & Drake, E. R. (1999) · Health Expectations · doi:10.1046/j.1369-6513.1999.00027.x · Cited by 86 · see citing works
Cure Me Even If It Kills Me: Preferences for Invasive Cancer Treatment
Fagerlin, A., Zikmund‐Fisher, B. J., & Ubel, P. A. (2005) · Medical Decision Making · doi:10.1177/0272989x05282639 · Cited by 75 · see citing works
Self-citationCombining deliberation and intuition in patient decision support.
de Vries, M., Fagerlin, A., Witteman, H., & Scherer, L. D. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2012.11.016 · Cited by 72 · see citing works
Self-citationPieterse, A. H., de Vries, M., Kunneman, M., Stiggelbout, A. M., & Feldman‐Stewart, D. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.11.020 · Cited by 68 · see citing works
Plessner, H., Betsch, C., & Betsch, T. (2008) · doi:10.4324/9780203838099-22 · Cited by 68 · see citing works
Anchoring-and-Adjustment Bias in Communication of Disease Risk
Şenay, İ., & Kaphingst, K. A. (2008) · Medical Decision Making · doi:10.1177/0272989x08327395 · Cited by 67 · see citing works
Fraenkel, L., Street, R. L., Towle, V. R., O’Leary, J. R., Iannone, L. P., Ness, P. H. V., & Fried, T. R. (2012) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2012.04080.x · Cited by 45 · see citing works
Pignone, M. P., Howard, K., Brenner, A. T., Crutchfield, T. M., Hawley, S. T., Lewis, C. L., & Sheridan, S. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.2651 · Cited by 41 · see citing works
Wong, J., D’Alimonte, L., Angus, J., Paszat, L., Metcalfe, K. A., Whelan, T. J., Llewellyn‐Thomas, H. A., Warner, E. A., Franssen, E., & Szumacher, E. (2012) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2011.11.028 · Cited by 41 · see citing works
Can avoidance of complications lead to biased healthcare decisions?
Amsterlaw, J., Zikmund‐Fisher, B. J., Fagerlin, A., & Ubel, P. A. (2006) · Judgment and Decision Making · doi:10.1017/s1930297500000358 · Cited by 34 · see citing works
Self-citationKmett, C. M., Arkes, H. R., & Jones, S. K. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299258010 · Cited by 22 · see citing works
Garvelink, M. M., ter Kuile, M. M., Stiggelbout, A. M., & de Vries, M. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-68 · Cited by 21 · see citing works
Davis, E., McCaffery, K. J., Mullan, B. A., & Juraskova, I. (2014) · Health Expectations · doi:10.1111/hex.12248 · Cited by 7 · see citing works
Chapter 20. Beyond Comprehension
Ubel, P. A. (2013) · Princeton University Press eBooks · doi:10.1515/9781400845347-024 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
A systematic review of algorithm aversion in augmented decision making
Burton, J. W., Stein, M., & Jensen, T. B. (2020) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2155 · Cited by 814 · see citing works
Cognitive bias in clinical medicine
O'Sullivan, E., & Schofield, S. (2018) · Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2018.306 · Cited by 334 · see citing works
Debiasing Health-Related Judgments and Decision Making: A Systematic Review
Ludolph, R. A., & Schulz, P. J. (2017) · Medical Decision Making · doi:10.1177/0272989x17716672 · Cited by 158 · see citing works
Cox, C. E., White, D. B., Hough, C. L., Jones, D. M., Kahn, J. M., Olsen, M. K., Lewis, C. L., Hanson, L. C., & Carson, S. S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-2335 · Cited by 152 · see citing works
“In addition, surrogates may have considered the decision aid content but used it to confirm an existing decision when integrating it with other informational sources and optimistic bias (37).”
Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies
Bauer, K., & Gill, A. (2023) · Information Systems Research · doi:10.1287/isre.2023.1217 · Cited by 66 · see citing works
Effects of Design Features of Explicit Values Clarification Methods
Witteman, H. O., Gavaruzzi, T., Scherer, L. D., Pieterse, A. H., Fuhrel-Forbis, A., Dansokho, S. C., Exe, N. L., Kahn, V. C., Feldman‐Stewart, D., Col, N. F., et al. (2016) · Medical Decision Making · doi:10.1177/0272989x16634085 · Cited by 55 · see citing works
Self-citationWhat is a good medical decision? A research agenda guided by perspectives from multiple stakeholders
Hamilton, J. G., Lillie, S. E., Alden, D. L., Scherer, L. D., Oser, M. L., Rini, C. K., Tanaka, M., Baleix, J., Brewster, M., Lee, S. J. C., et al. (2016) · Journal of Behavioral Medicine · doi:10.1007/s10865-016-9785-z · Cited by 53 · see citing works
Self-citationLet me decide: Increasing user autonomy increases recommendation acceptance
Fink, L., Newman, L., & Haran, U. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108244 · Cited by 51 · see citing works
Individual differences in reliance on intuition predict harsher moral judgments.
Ward, S. J., & King, L. A. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000153 · Cited by 42 · see citing works
What Helps People Make Values-Congruent Medical Decisions? Eleven Strategies Tested across 6 Studies
Witteman, H. O., Julien, A., Ndjaboué, R., Exe, N. L., Kahn, V. C., Fagerlin, A., & Zikmund‐Fisher, B. J. (2020) · Medical Decision Making · doi:10.1177/0272989x20904955 · Cited by 34 · see citing works
Self-citationThe AI‐augmented crowd: How human crowdvoters adopt AI (or not)
Freisinger, E., Unfried, M., & Schneider, S. (2023) · Journal of Product Innovation Management · doi:10.1111/jpim.12708 · Cited by 30 · see citing works
Scherer, L. D., Yates, J. F., Baker, S., & Valentine, K. D. (2017) · Personality and Social Psychology Bulletin · doi:10.1177/0146167217700607 · Cited by 28 · see citing works
Self-citationDecision Aid for Nutrition Support in Pediatric Oncology: A Pilot Study
Sajeev, M. F., Cohen, J. E., Wakefield, C. E., Fardell, J. E., & Cohn, R. J. (2016) · Journal of Parenteral and Enteral Nutrition · doi:10.1177/0148607116661840 · Cited by 23 · see citing works
Veenstra, C. M., Wallner, L. P., Abrahamse, P. H., Janz, N. K., Katz, S. J., & Hawley, S. T. (2019) · Cancer · doi:10.1002/cncr.31956 · Cited by 22 · see citing works
Preventing algorithm aversion: People are willing to use algorithms with a learning label
Chacon, A., Kausel, E. E., Reyes, T. H., & Trautmann, S. T. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2024.115032 · Cited by 21 · see citing works
Cuypers, M., Lamers, R. E. D., Kil, P. J. M., The, R., Karssen, K., van de Poll-Franse, L. V., & de Vries, M. (2017) · Health Informatics Journal · doi:10.1177/1460458217720393 · Cited by 20 · see citing works
Beeber, A., Kistler, C. E., Zimmerman, S. I., Dictus, C., Ward, K., Farel, C. E., Chrzan, K., Wretman, C. J., Boyton-Hansen, M., Pignone, M. P., et al. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2020.06.053 · Cited by 20 · see citing works
Intuitive vs Deliberative Approaches to Making Decisions About Life Support
Rubin, E. B., Buehler, A. E., Cooney, E. L., Gabler, N. B., Mante, A. A., & Halpern, S. D. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.7851 · Cited by 20 · see citing works
Lacey, H. P., Lacey, S. C., Scherer, L. D., & Zikmund‐Fisher, B. J. (2020) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2194 · Cited by 12 · see citing works
Self-citationTill Tech Do Us Part: Betrayal Aversion and Its Role in Algorithm Use
Kormylo, C., Adjerid, I., Ball, S. B., & Dogan, C. (2025) · Management Science · doi:10.1287/mnsc.2022.03510 · Cited by 10 · see citing works
An overview of the effects of algorithm use on judgmental biases affecting forecasting
Chacon, A., & Kaufmann, E. (2024) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2024.09.007 · Cited by 11 · see citing works
Beyond Algorithm Aversion in Human-Machine Decision-Making
Burton, J. W., Stein, M., & Jensen, T. B. (2023) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-3-031-30085-1_1 · Cited by 9 · see citing works
The Political Psychology of Deliberation
Karpowitz, C. F., & Mendelberg, T. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198747369.013.36 · Cited by 8 · see citing works
Izadi, S. R., Pachur, T., Wheeler, C. S., McGuire, J., & Waters, E. A. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.05.029 · Cited by 7 · see citing works
Cognitive Bias in Medical Decision Making
Sareen, R. (2022) · Journal of Pathology Research Reviews & Reports · doi:10.47363/jpr/2022(4)142 · Cited by 5 · see citing works
Mitigative Strategies for Recovering From Large Language Model Trust Violations
Martell, M. J., Baweja, J. A., & Dreslin, B. D. (2024) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434241303577 · Cited by 5 · see citing works
Voices of experience: what Dutch parents teach us about values and intuition in periviable decisions
de Boer, A., Proost, L. D., de Vries, M., Hogeveen, M., de Vries, M. C., Verweij, E. J. T., & Geurtzen, R. (2024) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/archdischild-2024-327400 · Cited by 5 · see citing works
de Bruin, W. B., Okan, Y., Krishnamurti, T., & Huffman, M. D. (2023) · Medical Decision Making · doi:10.1177/0272989x221148196 · Cited by 5 · see citing works
Halpern, S. D. (2016) · The American Journal of Bioethics · doi:10.1080/15265161.2016.1159766 · Cited by 5 · see citing works
Keswani, V., Conitzer, V., Sinnott-Armstrong, W. P., Nguyen, B. K., Heidari, H., & Borg, J. S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714167 · Cited by 4 · see citing works
Ársælsson, K. M., & Gastil, J. (2025) · Sociological Science · doi:10.15195/v12.a17 · Cited by 3 · see citing works
The effect of faith in intuition on moral judgment: The mediating role of perceived harm
Jiang, S., Ding, S., & Ding, D.-Q. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1084907 · Cited by 2 · see citing works
Cognitive biases in pediatric cardiac care
Padovani, P., Roy, A., Guerra, A. B., Cadeau, O., Ly, M., Vasile, C. M., Pass, R. H., & Baruteau, A. (2024) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2024.1423680 · Cited by 4 · see citing works
Witteman, H. O., Julien, A., Ndjaboué, R., Exe, N. L., Kahn, V. C., Fagerlin, A., & Zikmund‐Fisher, B. J. (2018) · doi:10.31219/osf.io/4nhzg · Cited by 2 · see citing works
Self-citationCognitive Task Analysis to Evaluate Resident Physician Decision Making in the Intensive Care Unit
Mansoori, J. N., Gravitz, S., Reed, K. D., Taylor, J. K., Havranek, E. P., Holtrop, J. S., & Douglas, I. S. (2025) · ATS Scholar · doi:10.34197/ats-scholar.2025-0009oc · Cited by 1 · see citing works
The Dependency Dilemma: How Machine Learning Decision Aids can Undermine Skill Growth
Bauer, K., Nofer, M., Henrich, B., Drachsler, H., & Hinz, O. (2026) · Business & Information Systems Engineering · doi:10.1007/s12599-026-01014-z · Cited by 1 · see citing works
Incorporating Patient Perspectives and Priorities into Clinical Trial Design
Bradford, A. M., & Shinn, E. H. (2016) · Gynecologic Oncology · doi:10.1016/j.ygyno.2016.01.014 · Cited by 1 · see citing works
Collaborative group reasoning in ward rounds: A critical realist case study
Perversi, P. (2019) · Deakin Research Online (Deakin University) · Cited by 1 · see citing works
Overcoming AI applications challenges in health: Decision system DINAR2
Goldberg, S. I., & Евгеньевич, П. М. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-824521-7.00006-5
Deliberativna komunikacija u zdravstvenoj skrbi
Jakšetić, D. (2022) · Journal of Applied Health Sciences · doi:10.24141/1/8/2/10
Guo, C., Liu, H., & Guo, J. (2025) · Journal of Psychology in Africa · doi:10.32604/jpa.2025.065763
- Authors
- Scherer, L. D., de Vries, M., Zikmund-Fisher, B. J., Witteman, H. O., & Fagerlin, A.
- Affiliations
- University of Missouri (US)
- Université Laval (CA)
- University of Michigan (US)
- Venue
- Health Psychology
- Published
- 2015-11
- Volume
- 34
- Issue
- 11
- Pages
- 1090-1099
- ISSN
- 0278-6133 (ISSN-L)
- 1930-7810
- OpenAlex
- W2095628489
- Cited by
- 41
- References
- 45
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 6 · 2023: 4 · 2022: 4 · 2020: 3 · 2019: 5 · 2018: 3 · 2017: 5 · 2016: 5
- FWCI
- 3.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Health Psychology (publishedVersion)
- Research portal (Tilburg University) (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Foundation for Informed Medical Decisions
- European Association of Social Psychology
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- decision aids, intuitive decision making, clinical decision-making, decision confidence, confirmation bias, effort justification, bias mitigation, patient decision-making
- MeSH terms
- Decision Making, Decision Support Techniques, Female, Humans, Male
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review