The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
"When Two Wrongs Don't Make a Right" - Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology
Open accessAbstract
Artificial intelligence (AI)-based decision support systems hold promise for enhancing diagnostic accuracy and efficiency in computational pathology. However, human-AI collaboration can introduce and amplify cognitive biases, such as confirmation bias caused by false confirmation when erroneous human opinions are reinforced by inaccurate AI output. This bias may worsen when time pressure, ubiquitously present in routine pathology, strains practitioners' cognitive resources. We quantified confirmation bias triggered by AI-induced false confirmation and examined the role of time constraints in a web-based experiment, where trained pathology experts (n=28) estimated tumor cell percentages. Our results suggest that AI integration may fuel confirmation bias, evidenced by a statistically significant positive linear-mixed-effects model coefficient linking AI recommendations mirroring flawed human judgment and alignment with system advice. Conversely, time pressure appeared to weaken this relationship. These findings highlight potential risks of AI use in healthcare and aim to support the safe integration of clinical decision support systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Prior studies using traditional AI models have documented the effects of cognitive biases,22-27 with inaccurate predictions impairing radiologist performance and erroneous suggestions prompting pathology experts to overturn correct diagnoses in 7% of cases.22, 23”
From Automation Bias in Large Language Model Assisted Diagnostic Reasoning Among AI-Trained Physicians (2025) · cites this paper as [23]
Citations
Cites
FCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
Conditions for intuitive expertise: A failure to disagree.
Kahneman, D., & Klein, G. (2009) · American Psychologist · doi:10.1037/a0016755 · Cited by 2,443
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Diagnostic error in internal medicine
Graber, M. L., Franklin, N., & Gordon, R. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.13.1493 · Cited by 1,549
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Explainable artificial intelligence: an analytical review
Angelov, P. P., Soares, E. A., Jiang, R., Arnold, N. I., & Atkinson, P. M. (2021) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1424 · Cited by 843
Dellermann, D., Ebel, P., Söllner, M., & Leimeister, J. M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00595-2 · Cited by 826
Replication and Analysis of Ebbinghaus’ Forgetting Curve
Murre, J. M. J., & Dros, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0120644 · Cited by 777
Do as AI say: susceptibility in deployment of clinical decision-aids
Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00385-9 · Cited by 543
Research works printed but not linked: 5
- Jerome S. Bruner, Jacqueline J. Goodnow, and George A. Austin. 1956. A study of thinking. Wiley.
- Jean-Paul Caverni, Jean-Marc Fabre, and Michel Gonzalez. 1990. Cognitive biases. North Holland/Elsevier, 7–9.
- Hermann Ebbinghaus. 1885. Über das Gedächtnis: Untersuchungen zur experimentellen Psychologie. Duncker & Humblot, Leipzig. https://www.deutschestextarchiv.de/book/show/ebbinghaus_gedaechtnis_1885
- Rüdiger Pohl. 2004. Cognitive illusions: A handbook on fallacies and biases in thinking, judgement and memory. Psychology press.
- Max Schemmer Niklas Kühl Carina Benz and Gerhard Satzger. 2022. On the Influence of Explainable AI on Automation Bias. arxiv:https://arXiv.org/abs/2204.08859 [cs.HC] https://arxiv.org/abs/2204.08859 · arXiv
Cited by
Cognitive bias in clinical large language models
Mahajan, A., Obermeyer, Z., Daneshjou, R., Lester, J., & Powell, D. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01790-0 · Cited by 53
Qazi, I. A., Ali, A., Khawaja, A. U., Akhtar, M. J., Sheikh, A. Z., & Alizai, M. H. (2026) · NEJM AI · doi:10.1056/aioa2501001 · Cited by 68
Automation Bias in Large Language Model Assisted Diagnostic Reasoning Among AI-Trained Physicians
Qazi, I. A., Ali, A., Khawaja, A. U., Akhtar, M. J., Sheikh, A. Z., & Alizai, M. H. (2025) · medRxiv · doi:10.1101/2025.08.23.25334280 · Cited by 16
Bertram, C., Schutten, M. M., Ressel, L., Breininger, K., Webster, J. D., & Aubreville, M. (2025) · Veterinary Pathology-Supplement · doi:10.1177/03009858251344320 · Cited by 11
Self-citationShahin, M., Maghanaki, M., & Chen, F. F. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131606 · Cited by 12
Metadata
- Authors
- Rosbach, E., Ammeling, J., Krügel, S., Kießig, A., Fritz, A., Ganz, J., Puget, C., Donovan, T., Klang, A., Köller, M. C., Bolfa, P., Tecilla, M., Denk, D., Kiupel, M., Paraschou, G., Kok, M. K., Haake, A. F. H., de Krijger, R. R., Sonnen, A. F.-P., Kasantikul, T., Dorrestein, G. M., Smedley, R. C., Stathonikos, N., Uhl, M., Bertram, C. A., Riener, A., & Aubreville, M.
- Affiliations
- Technische Hochschule Ingolstadt (DE)
- University of Hohenheim (DE)
- Catholic University of Eichstätt-Ingolstadt (DE)
- University of Freiburg (DE)
- Freie Universität Berlin (DE)
- The Schwarzman Animal Medical Center (US)
- University of Veterinary Medicine Vienna (AT)
- Medical University of Vienna, Vienna, Germany
- Ross University School of Veterinary Medicine, Basseterre, St. Kitts and Nevis
- University of Milan (IT)
- Ludwig-Maximilians-Universität München (DE)
- Michigan State University (US)
- Ross University School of Veterinary Medicine (KN)
- Universiti Putra Malaysia (MY)
- UMC Utrecht, Utrecht, Netherlands and Princess Maxima Center for Pediatric Oncology, Utrecht, Netherlands
- University Medical Center Utrecht (NL)
- NOIVBD, Vessem, Netherlands
- Flensburg University of Applied Sciences (DE)
- ORCID
- Rosbach, Emely
- Ammeling, Jonas
- Krügel, Sebastian
- Kießig, Angelika
- Fritz, Alexis
- Ganz, Jonathan
- Puget, Chloé
- Donovan, Taryn
- Klang, Andrea
- Köller, Maximilian C.
- Bolfa, Pompei
- Tecilla, Marco
- Denk, Daniela
- Kiupel, Matti
- Paraschou, Georgios
- Kok, Mun Keong
- Haake, Alexander F. H.
- de Krijger, Ronald R.
- Sonnen, Andreas F.-P.
- Kasantikul, Tanit
- Dorrestein, Gerry M.
- Smedley, Rebecca C.
- Stathonikos, Nikolas
- Uhl, Matthias
- Bertram, Christof A.
- Riener, Andreas
- Aubreville, Marc
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-18
- OpenAlex
- W4409747300
- Cited by
- 18
- References
- 77
- Citations by year
- 2026: 13 · 2025: 5
- FWCI
- 17.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by-nc-sa)
- arXiv (Cornell University) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- bidt
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- confirmation bias, time pressure, human-AI collaboration, computational pathology, radiology, diagnostic decision-making, AI-assisted diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: "When Two Wrongs Don't Make a Right" - Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology. https://app.cochat.ai/papers/10.1145/3706598.3713319
- The paper
- Rosbach, E., Ammeling, J., Krügel, S., Kießig, A., Fritz, A., Ganz, J., Puget, C., Donovan, T., Klang, A., Köller, M. C., Bolfa, P., Tecilla, M., Denk, D., Kiupel, M., Paraschou, G., Kok, M. K., Haake, A. F. H., de Krijger, R. R., Sonnen, A. F.-P., . . . Aubreville, M. (2025). "When Two Wrongs Don't Make a Right" - Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3706598.3713319
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.