CoChat
Sign Up
PreprintCited by 10Artificial Intelligence in Healthcare and EducationExplainable Artificial Intelligence (XAI)Ethics and Social Impacts of AI

Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in Radiology

Open access
Thieme, Anja, Rajamohan, Abhijith, Cooper, Benjamin, Groombridge, Heather, Simister, Robert, Wong, Barney, Woznitza, Nicholas, Pinnock, Mark Ames +17 more·2024·arXiv
DOI 10.48550/arxiv.2405.05299arXiv 2405.05299
Open this paper in CoChat — free accountOpen PDF

Abstract

Nasogastric tubes (NGTs) are feeding tubes that are inserted through the nose into the stomach to deliver nutrition or medication. If not placed correctly, they can cause serious harm, even death to patients. Recent AI developments demonstrate the feasibility of robustly detecting NGT placement from Chest X-ray images to reduce risks of sub-optimally or critically placed NGTs being missed or delayed in their detection, but gaps remain in clinical practice integration. In this study, we present a human-centered approach to the problem and describe insights derived following contextual inquiry and in-depth interviews with 15 clinical stakeholders. The interviews helped understand challenges in existing workflows, and how best to align technical capabilities with user needs and expectations. We discovered the trade-offs and complexities that need consideration when choosing suitable workflow stages, target users, and design configurations for different AI proposals. We explored how to balance AI benefits and risks for healthcare staff and patients within broader organizational and medical-legal constraints. We also identified data issues related to edge cases and data biases that affect model training and evaluation; how data documentation practices influence data preparation and labelling; and how to measure relevant AI outcomes reliably in future evaluations. We discuss how our work informs design and development of AI applications that are clinically useful, ethical, and acceptable in real-world healthcare services.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2405.05299

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 152

  1. Anne Adams and Martina Angela Sasse. 1999. Users are not the enemy. Commun. ACM 42, 12 (1999), 40-46.
  2. Muhammad Aurangzeb Ahmad, Arpit Patel, Carly Eckert, Vikas Kumar, and Ankur Teredesai. 2020. Fairness in machine learning for healthcare. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining. 3529-3530.
  3. Julia Amann, Alessandro Blasimme, Effy Vayena, Dietmar Frey, Vince I Madai, and Precise4Q Consortium. 2020. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC medical informatics and decision making 20 (2020), 1-9.
  4. Milan Aryal and Nasim Yahyasoltani. 2021. Identifying Catheter and Line Position in Chest X-Rays Using GANs. In 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA). IEEE, 122-127.
  5. Matan Atad, Vitalii Dmytrenko, Yitong Li, Xinyue Zhang, Matthias Keicher, Jan Kirschke, Bene Wiestler, Ashkan Khakzar, and Nassir Navab. 2022. Chexplaining in style: Counterfactual explanations for chest x-rays using stylegan. arXiv preprint arXiv:2207.07553 (2022). · arXiv
  6. Amid Ayobi, Jacob Hughes, Christopher J Duckworth, Jakub J Dylag, Sam James, Paul Marshall, Matthew Guy, Anitha Kumaran, Adriane Chapman, Michael Boniface, et al. 2023. Computational Notebooks as Co-Design Tools: Engaging Young Adults Living with Diabetes, Family Carers, and Clinicians with Machine Learning Models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-20.
  7. Anne Kathrine Petersen Bach, Trine Munch Nørgaard, Jens Christian Brok, and Niels van Berkel. 2023. "If I Had All the Time in the World": Ophthalmologists' Perceptions of Anchoring Bias Mitigation in Clinical AI Support. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-14.
  8. Ivo Baltruschat, Leonhard Steinmeister, Hannes Nickisch, Axel Saalbach, Michael Grass, Gerhard Adam, Tobias Knopp, and Harald Ittrich. 2021. Smart chest X-ray worklist prioritization using artificial intelligence: a clinical workflow simulation. European radiology 31 (2021), 3837-3845.
  9. Shruthi Bannur, Kenza Bouzid, Daniel C Castro, Anton Schwaighofer, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, et al. 2024. MAIRA-2: Grounded Radiology Report Generation. arXiv preprint arXiv:2406.04449 (2024). · arXiv
  10. Shruthi Bannur, Stephanie Hyland, Qianchu Liu, Fernando Perez-Garcia, Maximilian Ilse, Daniel C Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, et al. 2023. Learning to exploit temporal structure for biomedical vision-language processing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 15016-15027.
  11. Amie J Barda, Christopher M Horvat, and Harry Hochheiser. 2020. A qualitative research framework for the design of user-centered displays of explanations for machine learning model predictions in healthcare. BMC medical informatics and decision making 20, 1 (2020), 1-16.
  12. Sally L Baxter, Jeremy S Bass, and Amy M Sitapati. 2020. Barriers to implementing an artificial intelligence model for unplanned readmissions. ACI open 4, 02 (2020), e108-e113.
  13. Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Paisan Ruamviboonsuk, and Laura M Vardoulakis. 2020. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1-12.
  14. Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. 610-623.
  15. Marc Berg, Jos Aarts, and Johan van der Lei. 2003. ICT in health care: sociotechnical approaches. Methods of information in medicine 42, 04 (2003), 297-301.
  16. Hannah Bleher and Matthias Braun. 2022. Diffused responsibility: attributions of responsibility in the use of AI-driven clinical decision support systems. AI and Ethics 2, 4 (2022), 747-761.
  17. Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel C Castro, Anton Schwaighofer, Stephanie Hyland, Maria Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, et al. 2022. Making the most of text semantics to improve biomedical vision- language processing. In European conference on computer vision. Springer, 1-21. ACM Trans. Comput.-Hum. Interact.
  18. Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021). · arXiv
  19. Thuvanan Borvornvitchotikarn and Thongchai Yooyativong. 2022. Pre-Activation-Spatial Attention Module for Multiple Catheters and Tubes Classification. In 2022 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON). IEEE, 238-241.
  20. Robert Bowman, Camille Nadal, Kellie Morrissey, Anja Thieme, and Gavin Doherty. 2023. Using thematic analysis in healthcare HCI at CHI: A scoping review. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-18.
  21. Virginia Braun and Victoria Clarke. 2019. Reflecting on reflexive thematic analysis. Qualitative research in sport, exercise and health 11, 4 (2019), 589-597.
  22. Virginia Braun and Victoria Clarke. 2021. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qualitative research in psychology 18, 3 (2021), 328-352.
  23. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877-1901.
  24. Eleanor R Burgess, Ivana Jankovic, Melissa Austin, Nancy Cai, Adela Kapuścińska, Suzanne Currie, J Marc Overhage, Erika S Poole, and Jofish Kaye. 2023. Healthcare AI Treatment Decision Support: Design Principles to Enhance Clinician Adoption and Trust. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-19.
  25. Aurelia Bustos, Antonio Pertusa, Jose-Maria Salinas, and Maria De La Iglesia-Vaya. 2020. Padchest: A large chest x-ray image dataset with multi-label annotated reports. Medical image analysis 66 (2020), 101797.
  26. David Byrne. 2022. A worked example of Braun and Clarke's approach to reflexive thematic analysis. Quality & quantity 56, 3 (2022), 1391-1412.
  27. Carrie J Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S Corrado, Martin C Stumpe, et al. 2019. Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the 2019 chi conference on human factors in computing systems. 1-14.
  28. Carrie J Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. " Hello AI": uncovering the onboarding needs of medical practitioners for human-AI collaborative decision-making. Proceedings of the ACM on Human-computer Interaction 3, CSCW (2019), 1-24.
  29. Carrie J Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2021. Onboarding Materials as Cross-functional Boundary Objects for Developing AI Assistants. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1-7.
  30. Francisco Maria Calisto, João Fernandes, Margarida Morais, Carlos Santiago, João Maria Abrantes, Nuno Nunes, and Jacinto C Nascimento. 2023. Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-20.
  31. Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, and Jacinto C Nascimento. 2021. Introduction of human-centric AI assistant to aid radiologists for multimodal breast image classification. International Journal of Human-Computer Studies 150 (2021), 102607.
  32. Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, and Jacinto C Nascimento. 2022. BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions. Artificial Intelligence in Medicine 127 (2022), 102285.
  33. Winnie Chen, Kirsten Howard, Gillian Gorham, Claire Maree O'Bryan, Patrick Coffey, Bhavya Balasubramanya, Asanga Abeyaratne, and Alan Cass. 2022. Design, effectiveness, and economic outcomes of contemporary chronic disease clinical decision support systems: a systematic review and meta-analysis. Journal of the American Medical Informatics Association 29, 10 (2022), 1757-1772.
  34. Isabel Chien, Nina Deliu, Richard Turner, Adrian Weller, Sofia Villar, and Niki Kilbertus. 2022. Multi-disciplinary fairness considerations in machine learning for clinical trials. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 906-924.
  35. Enrico Coiera. 2019. The last mile: where artificial intelligence meets reality. Journal of medical Internet research 21, 11 (2019), e16323.
  36. James Dawson. 2007. Nasogastric tube incidents and the use of the'whoosh test'. Critical Care 11 (2007), 1-1.
  37. Alex J DeGrave, Joseph D Janizek, and Su-In Lee. 2021. AI for radiographic COVID-19 detection selects shortcuts over signal. Nature Machine Intelligence 3, 7 (2021), 610-619.
  38. Dina Demner-Fushman, Marc D Kohli, Marc B Rosenman, Sonya E Shooshan, Laritza Rodriguez, Sameer Antani, George R Thoma, and Clement J McDonald. 2016. Preparing a collection of radiology examinations for distribution and retrieval. Journal of the American Medical Informatics Association 23, 2 (2016), 304-310.
  39. The Medical Education Directorate. [n. d.]. What happens when I submit a Datix? https://www.med.scot.nhs.uk/trainee- doctors/learning-from-datixes/what-happens-when-i-submit-a-datix#:~:text=What%20is%20DATIX%3F,identify%20learning%20and% 20implement%20improvement. ACM Trans. Comput.-Hum. Interact.
  40. Ignat Drozdov, Rachael Dixon, Benjamin Szubert, Jessica Dunn, Darren Green, Nicola Hall, Arman Shirandami, Sofia Rosas, Ryan Grech, Srikanth Puttagunta, et al. 2023. An Artificial Neural Network for Nasogastric Tube Position Decision Support. Radiology: Artificial Intelligence 5, 2 (2023), e220165.
  41. Abdelfettah Elaanba, Mohammed Ridouani, and Larbi Hassouni. 2021. Automatic detection using deep convolutional neural networks for 11 abnormal positioning of tubes and catheters in chest X-ray Images. In 2021 IEEE World AI IoT Congress (AIIoT). IEEE, 0007-0012.
  42. Geraldine Fitzpatrick and Gunnar Ellingsen. 2013. A review of 25 years of CSCW research in healthcare: contributions, challenges and future agendas. Computer Supported Cooperative Work (CSCW) 22 (2013), 609-665.
  43. Maayan Frid-Adar, Rula Amer, and Hayit Greenspan. 2019. Endotracheal tube detection and segmentation in chest radiographs using synthetic data. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 784-792.
  44. Astrid Galsgaard, Tom Doorschodt, Ann-Louise Holten, Felix Christoph Müller, Mikael Ploug Boesen, and Mario Maas. 2022. Artificial intelligence and multidisciplinary team meetings; a communication challenge for radiologists' sense of agency and position as spider in a web? European Journal of Radiology 155 (2022), 110231.
  45. Fernanda Raphael Escobar Gimenes, Marta Cristiane Alves Pereira, Patricia Rezende do Prado, Rhanna Emanuela Fontenele Lima de Carvalho, Janine Koepp, Ligia Menezes de Freitas, Thalyta Cardoso Alux Teixeira, and Adriana Inocenti Miasso. 2019. Nasogastric/Na- soenteric tube-related incidents in hospitalised patients: a study protocol of a multicentre prospective cohort study. BMJ open 9, 7 (2019), e027967.
  46. Jennifer C Ginestra, Heather M Giannini, William D Schweickert, Laurie Meadows, Michael J Lynch, Kimberly Pavan, Corey J Chivers, Michael Draugelis, Patrick J Donnelly, Barry D Fuchs, et al. 2019. Clinician perception of a machine learning-based early warning system designed to predict severe sepsis and septic shock. Critical care medicine 47, 11 (2019), 1477.
  47. Yu Gordienko, Peng Gang, Jiang Hui, Wei Zeng, Yu Kochura, Oleg Alienin, Oleksandr Rokovyi, and Sergii Stirenko. 2019. Deep learning with lung segmentation and bone shadow exclusion techniques for chest X-ray analysis of lung cancer. In Advances in Computer Science for Engineering and Education 13. Springer, 638-647.
  48. L Gorospe-Sarasúa, JM Muñoz-Olmedo, F Sendra-Portero, and R de Luis-García. 2022. Challenges of Radiology education in the era of artificial intelligence. Radiología (English Edition) 64, 1 (2022), 54-59.
  49. Hongyan Gu, Yuan Liang, Yifan Xu, Christopher Kazu Williams, Shino Magaki, Negar Khanlou, Harry Vinters, Zesheng Chen, Shuo Ni, Chunxu Yang, et al. 2023. Improving workflow integration with XPath: Design and evaluation of a human-AI diagnosis system in pathology. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1-37.
  50. Hongyan Gu, Chunxu Yang, Mohammad Haeri, Jing Wang, Shirley Tang, Wenzhong Yan, Shujin He, Christopher Kazu Williams, Shino Magaki, and Xiang'Anthony' Chen. 2023. Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-19.
  51. K Harrison, H Pullen, C Welsh, O Oktay, J Alvarez-Valle, and R Jena. 2022. Machine learning for auto-segmentation in radiotherapy planning. Clinical Oncology 34, 2 (2022), 74-88.
  52. Tianxing He, Shengcheng Yu, Ziyuan Wang, Jieqiong Li, and Zhenyu Chen. 2019. From data quality to model quality: An exploratory study on deep learning. In Proceedings of the 11th Asia-Pacific Symposium on Internetware. 1-6.
  53. Robert DE Henderson, Xin Yi, Scott J Adams, and Paul Babyn. 2021. Automatic detection and classification of multiple catheters in neonatal radiographs with deep learning. Journal of digital imaging 34, 4 (2021), 888-897.
  54. Tad Hirsch, Kritzia Merced, Shrikanth Narayanan, Zac E Imel, and David C Atkins. 2017. Designing contestability: Interaction design, machine learning, and mental health. In Proceedings of the 2017 Conference on Designing Interactive Systems. 95-99.
  55. Tad Hirsch, Christina Soma, Kritzia Merced, Patty Kuo, Aaron Dembe, Derek D Caperton, David C Atkins, and Zac E Imel. 2018. " It's hard to argue with a computer" Investigating Psychotherapists' Attitudes towards Automated Evaluation. In Proceedings of the 2018 Designing Interactive Systems Conference. 559-571.
  56. Jonathan Huang, Luke Neill, Matthew Wittbrodt, David Melnick, Matthew Klug, Michael Thompson, John Bailitz, Timothy Loftus, Sanjeev Malik, Amit Phull, et al. 2023. Generative Artificial Intelligence for Chest Radiograph Interpretation in the Emergency Department. JAMA network open 6, 10 (2023), e2336100-e2336100.
  57. Shigao Huang, Jie Yang, Na Shen, Qingsong Xu, and Qi Zhao. 2023. Artificial intelligence in lung cancer diagnosis and prognosis: Current application and future perspective. In Seminars in Cancer Biology. Elsevier.
  58. Brian Hurt, Andrew Yen, Seth Kligerman, and Albert Hsiao. 2020. Augmenting interpretation of chest radiographs with deep learning probability maps. Journal of thoracic imaging 35, 5 (2020), 285.
  59. Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel C Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, et al. 2023. MAIRA-1: A specialised large multimodal model for radiology report generation. arXiv preprint arXiv: 2311.13668 (2023). · arXiv
  60. Jeremy Irvin, Pranav Rajpurkar, Michael Ko, Yifan Yu, Silviana Ciurea-Ilcus, Chris Chute, Henrik Marklund, Behzad Haghgoo, Robyn Ball, Katie Shpanskaya, et al. 2019. Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 590-597.
  61. Azra Ismail, Naveena Karusala, and Neha Kumar. 2018. Bridging disconnected knowledges for community health. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1-27.
  62. Maia Jacobs, Jeffrey He, Melanie F. Pradier, Barbara Lam, Andrew C Ahn, Thomas H McCoy, Roy H Perlis, Finale Doshi-Velez, and Krzysztof Z Gajos. 2021. Designing AI for trust and collaboration in time-constrained medical decisions: a sociotechnical lens. In Proceedings of the 2021 chi conference on human factors in computing systems. 1-14.
  63. Sowon Jang, Hwayoung Song, Yoon Joo Shin, Junghoon Kim, Jihang Kim, Kyung Won Lee, Sung Soo Lee, Woojoo Lee, Seungjae Lee, and Kyung Hee Lee. 2020. Deep learning-based automatic detection algorithm for reducing overlooked lung cancers on chest radiographs. Radiology 296, 3 (2020), 652-661.
  64. Stefanie Jauk, Diether Kramer, Alexander Avian, Andrea Berghold, Werner Leodolter, and Stefan Schulz. 2021. Technology acceptance of a machine learning algorithm predicting delirium in a clinical setting: a mixed-methods study. Journal of medical systems 45, 4 (2021), 48.
  65. Katharina Jeblick, Balthasar Schachtner, Jakob Dexl, Andreas Mittermeier, Anna Theresa Stüber, Johanna Topalis, Tobias Weber, Philipp Wesp, Bastian Sabel, Jens Ricke, et al. 2022. Chatgpt makes medicine easy to swallow: An exploratory case study on simplified radiology reports. arXiv preprint arXiv:2212.14882 (2022). · arXiv
  66. Bonnie E John, Len Bass, Rick Kazman, and Eugene Chen. 2004. Identifying gaps between HCI, software engineering, and design, and boundary objects to bridge them. In CHI'04 extended abstracts on Human factors in computing systems. 1723-1724.
  67. Alistair EW Johnson, Tom J Pollard, Seth J Berkowitz, Nathaniel R Greenbaum, Matthew P Lungren, Chih-ying Deng, Roger G Mark, and Steven Horng. 2019. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Scientific data 6, 1 (2019), 317.
  68. Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, et al. 2022. Language models (mostly) know what they know. arXiv preprint arXiv:2207.05221 (2022). · arXiv
  69. E-Fong Kao, Twei-Shiun Jaw, Chun-Wei Li, Ming-Chung Chou, and Gin-Chung Liu. 2015. Automated detection of endotracheal tubes in paediatric chest radiographs. Computer methods and programs in biomedicine 118, 1 (2015), 1-10.
  70. Christopher J Kelly, Alan Karthikesalingam, Mustafa Suleyman, Greg Corrado, and Dominic King. 2019. Key challenges for delivering clinical impact with artificial intelligence. BMC medicine 17 (2019), 1-9.
  71. Abdul Baseer Mohammed Khan and Syed Mahboob Abrar Ali. 2021. Early detection of malpositioned catheters and lines on chest X-rays using deep learning. In 2021 International Conference on Artificial Intelligence and Computer Science Technology (ICAICST). IEEE, 51-55.
  72. Elin Kjelle and Catherine Chilanga. 2022. The assessment of image quality and diagnostic value in X-ray images: a survey on radiographers' reasons for rejecting images. Insights into Imaging 13, 1 (2022), 1-6.
  73. Matthew C Koopmann, Kenneth A Kudsk, Molly J Szotkowski, and Susan M Rees. 2011. A team-based protocol and electromagnetic technology eliminate feeding tube placement complications. Annals of surgery 253, 2 (2011), 297-302.
  74. Kundan Krishna, Sopan Khosla, Jeffrey P Bigham, and Zachary C Lipton. 2020. Generating SOAP notes from doctor-patient conversations using modular summarization techniques. arXiv preprint arXiv:2005.01795 (2020). · arXiv
  75. Sean Kross and Philip Guo. 2021. Orienting, framing, bridging, magic, and counseling: How data scientists navigate the outer loop of client collaborations in industry and academia. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1-28.
  76. Charlotte P Lee. 2007. Boundary negotiating artifacts: Unbinding the routine of boundary objects and embracing chaos in collaborative work. Computer Supported Cooperative Work (CSCW) 16 (2007), 307-339.
  77. Hyunkwang Lee, Mohammad Mansouri, Shahein Tajmir, Michael H Lev, and Synho Do. 2018. A deep-learning system for fully- automated peripherally inserted central catheter (PICC) tip detection. Journal of digital imaging 31 (2018), 393-402. ACM Trans. Comput.-Hum. Interact.
  78. Peter Lee, Sebastien Bubeck, and Joseph Petro. 2023. Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine. New England Journal of Medicine 388, 13 (2023), 1233-1239.
  79. Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, et al. 2022. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110 (2022). · arXiv
  80. Q Vera Liao, Yunfeng Zhang, Ronny Luss, et al. 2022. Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 10. 147-159.
  81. Christopher J Lindsell, William W Stead, and Kevin B Johnson. 2020. Action-informed artificial intelligence-matching the algorithm to the problem. Jama 323, 21 (2020), 2141-2142.
  82. Martin Lindvall, Claes Lundström, and Jonas Löwgren. 2021. Rapid assisted visual search: Supporting digital pathologists with imperfect AI. In 26th International Conference on Intelligent User Interfaces. 504-513.
  83. Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel C Castro, Maria Teodora Wetscherek, Robert Tinn, Harshita Sharma, Fernando Pérez-García, Anton Schwaighofer, et al. 2023. Exploring the Boundaries of GPT-4 in Radiology. arXiv preprint arXiv:2310.14573 (2023). · arXiv
  84. Stina Matthiesen, Søren Zöga Diederichsen, Mikkel Klitzing Hartmann Hansen, Christina Villumsen, Mats Christian Højbjerg Lassen, Peter Karl Jacobsen, Niels Risum, Bo Gregers Winkel, Berit T Philbert, Jesper Hastrup Svendsen, et al. 2021. Clinician preimplementation perspectives of a decision-support tool for the prediction of cardiac arrhythmia based on machine learning: near-live feasibility and qualitative study. JMIR human factors 8, 4 (2021), e26964.
  85. Tim Miller, Piers Howe, and Liz Sonenberg. 2017. Explainable AI: Beware of inmates running the asylum or: How I learnt to stop worrying and love the social and behavioural sciences. arXiv preprint arXiv:1712.00547 (2017). · arXiv
  86. Yasuhide Miura, Yuhao Zhang, Emily Bao Tsai, Curtis P Langlotz, and Dan Jurafsky. 2020. Improving factual completeness and consistency of image-to-text radiology report generation. arXiv preprint arXiv:2010.10042 (2020). · arXiv
  87. Michael Moor, Oishi Banerjee, Zahra Shakeri Hossein Abad, Harlan M Krumholz, Jure Leskovec, Eric J Topol, and Pranav Rajpurkar. 2023. Foundation models for generalist medical artificial intelligence. Nature 616, 7956 (2023), 259-265.
  88. Caroline M Moore, Elena Frangou, Neil McCartan, Aida Santaolalla, Douglas Kopcke, Giorgio Brembilla, Joanna Hadley, Francesco Giganti, Teresa Marsden, Mieke Van Hemelrijck, et al. 2023. Prevalence of MRI lesions in men responding to a GP-led invitation for a prostate health check: a prospective cohort study. BMJ Oncology 2, 1 (2023).
  89. Harsha Nori, Nicholas King, Scott Mayer McKinney, Dean Carignan, and Eric Horvitz. 2023. Capabilities of gpt-4 on medical challenge problems. arXiv preprint arXiv:2303.13375 (2023). · arXiv
  90. Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (2019), 447-453.
  91. Francis O'Connell, Justin Ong, Crystal Donelan, and Ali Pourmand. 2021. Emergency department approach to gastric tube complications and review of the literature. The American Journal of Emergency Medicine 39 (2021), 259-e5.
  92. Nazmun Nisat Ontika, Sheree May Sassmannshausen, Aparecido Fabiano Pinatti De Carvalho, and Volkmar Pipek. 2023. PAIRADS: Hybrid Interaction Between Humans and AI in Radiology. In HHAI 2023: Augmenting Human Intellect. IOS Press, 395-397.
  93. Tariq Osman Andersen, Francisco Nunes, Lauren Wilcox, Elizabeth Kaziunas, Stina Matthiesen, and Farah Magrabi. 2021. Realizing AI in healthcare: challenges appearing in the wild. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1-5.
  94. Bhavik N Patel, Louis Rosenberg, Gregg Willcox, David Baltaxe, Mimi Lyons, Jeremy Irvin, Pranav Rajpurkar, Timothy Amrhein, Rajan Gupta, Safwan Halabi, et al. 2019. Human-machine partnership with artificial intelligence for chest radiograph diagnosis. NPJ digital medicine 2, 1 (2019), 111.
  95. Fernando Pérez-García, Sam Bond-Taylor, Pedro P Sanchez, Boris van Breugel, Daniel C Castro, Harshita Sharma, Valentina Salvatelli, Maria TA Wetscherek, Hannah Richardson, Matthew P Lungren, et al. 2023. RadEdit: stress-testing biomedical vision models via diffusion image editing. arXiv preprint arXiv:2312.12865 (2023). · arXiv
  96. Eike Petersen, Yannik Potdevin, Esfandiar Mohammadi, Stephan Zidowitz, Sabrina Breyer, Dirk Nowotka, Sandra Henn, Ludwig Pechmann, Martin Leucker, Philipp Rostalski, et al. 2022. Responsible and regulatory conform machine learning for medicine: a survey of challenges and solutions. IEEE Access 10 (2022), 58375-58418.
  97. Cécile Petitgand, Aude Motulsky, Jean-Louis Denis, and Catherine Régis. 2020. Investigating the barriers to physician adoption of an artificial intelligence-based decision support system in emergency care: an interpretative qualitative study. In Digital Personalized Health and Medicine. IOS Press, 1001-1005.
  98. Thomas Ploug and Søren Holm. 2020. The four dimensions of contestable AI diagnostics-A patient-centric approach to explainable AI. Artificial Intelligence in Medicine 107 (2020), 101901.
  99. Sam Preston, Mu Wei, Rajesh Rao, Robert Tinn, Naoto Usuyama, Michael Lucas, Yu Gu, Roshanthi Weerasinghe, Soohee Lee, Brian Piening, et al. 2023. Toward structuring real-world data: Deep learning for extracting oncology information from clinical text with patient-level supervision. Patterns 4, 4 (2023).
  100. Rob Procter, Peter Tolmie, and Mark Rouncefield. 2023. Holding AI to account: Challenges for the delivery of trustworthy AI in healthcare. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1-34.
  101. Nigel Rees, Kelly Holding, and Mark Sujan. 2023. Information governance as a socio-technical process in the development of trustworthy healthcare AI. Frontiers in Computer Science 5 (2023), 1134818.
  102. Cynthia Rudin. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature machine intelligence 1, 5 (2019), 206-215.
  103. Ankit Rungta. 2021. Detection of the Malpositioned Catheters and Endotracheal Tubes on Radiographs using Deep Learning Methods. Ph. D. Dissertation. Dublin, National College of Ireland.
  104. Jarrel CY Seah, Cyril HM Tang, Quinlan D Buchlak, Xavier G Holt, Jeffrey B Wardman, Anuar Aimoldin, Nazanin Esmaili, Hassan Ahmad, Hung Pham, John F Lambert, et al. 2021. Effect of a comprehensive deep-learning model on the accuracy of chest x-ray interpretation by radiologists: a retrospective, multireader multicase study. The Lancet Digital Health 3, 8 (2021), e496-e506.
  105. Teik Choon See, Mark Callaway, Raman Uberoi, Amanda Martin, Alexandra Lipton, Sue Johnson, Alastair Henderson, Katherine Henderson, James France, Richard Roope, et al. 2023. Alerts and notification of imaging reports recommendations. Clinical Radiology 78, 3 (2023), e227-e236.
  106. Mark Sendak, Madeleine Clare Elish, Michael Gao, Joseph Futoma, William Ratliff, Marshall Nichols, Armando Bedoya, Suresh Balu, and Cara O'Brien. 2020. " The human body is a black box" supporting clinical decision-making with deep learning. In Proceedings of the 2020 conference on fairness, accountability, and transparency. 99-109.
  107. Mark P Sendak, William Ratliff, Dina Sarro, Elizabeth Alderton, Joseph Futoma, Michael Gao, Marshall Nichols, Mike Revoir, Faraz Yashar, Corinne Miller, et al. 2020. Real-world integration of a sepsis deep learning technology into routine clinical care: implementation study. JMIR medical informatics 8, 7 (2020), e15182.
  108. Manan Shah, Derek Shu, VB Surya Prasath, Yizhao Ni, Andrew H Schapiro, and Kevin R Dufendach. 2021. Machine learning for detection of correct peripherally inserted central catheter tip position from radiology reports in infants. Applied Clinical Informatics 12, 04 (2021), 856-863.
  109. Murray Shanahan. 2022. Talking About Large Language Models. arXiv preprint arXiv:2212.03551 (2022). · arXiv
  110. Varun Singh, Varun Danda, Richard Gorniak, Adam Flanders, and Paras Lakhani. 2019. Assessment of critical feeding tube malpositions on radiographs using deep learning. Journal of digital imaging 32 (2019), 651-655.
  111. Karan Singhal, Tao Tu, Juraj Gottweis, Rory Sayres, Ellery Wulczyn, Le Hou, Kevin Clark, Stephen Pfohl, Heather Cole-Lewis, Darlene Neal, et al. 2023. Towards expert-level medical question answering with large language models. arXiv preprint arXiv:2305.09617 (2023). · arXiv
  112. Ilyas Sirazitdinov, Matthias Lenga, Ivo M Baltruschat, Dmitry V Dylov, and Axel Saalbach. 2021. Landmark constellation models for central venous catheter malposition detection. In 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI). IEEE, 1132-1136.
  113. Venkatesh Sivaraman, Leigh A Bukowski, Joel Levin, Jeremy M Kahn, and Adam Perer. 2023. Ignore, trust, or negotiate: understanding clinician acceptance of AI-based treatment recommendations in health care. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-18.
  114. Ruchika Sreedhar, Jeena Thomas, and Ebin Deni Raj. 2021. Detection Of Chest Catheters Using Mask R-CNN. In 2021 International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON). IEEE, 1-6. ACM Trans. Comput.-Hum. Interact.
  115. Lea Strohm, Charisma Hehakaya, Erik R Ranschaert, Wouter PC Boon, and Ellen HM Moors. 2020. Implementation of artificial intelligence (AI) applications in radiology: hindering and facilitating factors. European radiology 30 (2020), 5525-5532.
  116. Vaishnavi Subramanian, Hongzhi Wang, Joy T Wu, Ken CL Wong, Arjun Sharma, and Tanveer Syeda-Mahmood. 2019. Automated detection and type classification of central venous catheters in chest x-rays. In Medical Image Computing and Computer Assisted Intervention-MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13-17, 2019, Proceedings, Part VI 22. Springer, 522-530.
  117. Jennifer SN Tang, Jarrel CY Seah, Adil Zia, Jay Gajera, Richard N Schlegel, Aaron JN Wong, Dayu Gai, Shu Su, Tony Bose, Marcus L Kok, et al. 2021. CLiP, catheter and line position dataset. Scientific Data 8, 1 (2021), 285.
  118. P Temblett and S George. 2013. pH testing to confirm nasogastric tube position on the ICU: are we wasting our time? Critical Care 17, Suppl 2 (2013), P245.
  119. Anja Thieme, Danielle Belgrave, and Gavin Doherty. 2020. Machine learning in mental health: A systematic review of the HCI literature to support the development of effective and implementable ML systems. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 5 (2020), 1-53.
  120. Anja Thieme, Ed Cutrell, Cecily Morrison, Alex Taylor, and Abigail Sellen. 2020. Interpretability as a dynamic of human-AI interaction. Interactions 27, 5 (2020), 40-45.
  121. Anja Thieme, Maryann Hanratty, Maria Lyons, Jorge Palacios, Rita Faia Marques, Cecily Morrison, and Gavin Doherty. 2023. Designing human-centered AI for mental health: Developing clinically relevant applications for online CBT treatment. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1-50.
  122. Anja Thieme, Aditya Nori, Marzyeh Ghassemi, Rishi Bommasani, Tariq Osman Andersen, and Ewa Luger. 2023. Foundation Models in Healthcare: Opportunities, Risks & Strategies Forward. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1-4.
  123. Tim Torsy, Renée Saman, Kurt Boeykens, Ivo Duysburgh, Mats Eriksson, Sofie Verhaeghe, and Dimitri Beeckman. 2020. Accuracy of the corrected nose-earlobe-xiphoid distance formula for determining nasogastric feeding tube insertion length in intensive care unit patients: A prospective observational study. International Journal of Nursing Studies 110 (2020), 103614.
  124. Tao Tu, Shekoofeh Azizi, Danny Driess, Mike Schaekermann, Mohamed Amin, Pi-Chuan Chang, Andrew Carroll, Chuck Lau, Ryutaro Tanno, Ira Ktena, et al. 2023. Towards generalist biomedical ai. arXiv preprint arXiv:2307.14334 (2023). · arXiv
  125. Stephanie Tulk Jesso, Aisling Kelliher, Harsh Sanghavi, Thomas Martin, and Sarah Henrickson Parker. 2022. Inclusion of clinicians in the development and evaluation of clinical artificial intelligence tools: a systematic literature review. Frontiers in Psychology 13 (2022), 830345.
  126. Daiju Ueda, Taichi Kakinuma, Shohei Fujita, Koji Kamagata, Yasutaka Fushimi, Rintaro Ito, Yusuke Matsui, Taiki Nozaki, Takeshi Nakaura, Noriyuki Fujima, et al. 2023. Fairness of artificial intelligence in healthcare: review and recommendations. Japanese Journal of Radiology (2023), 1-13.
  127. Stephanie Valencia, Richard Cave, Krystal Kallarackal, Katie Seaver, Michael Terry, and Shaun K Kane. 2023. "The less I type, the better": How AI Language Models can Enhance or Impede Communication for AAC Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-14.
  128. Himanshu Verma, Jakub Mlynar, Roger Schaer, Julien Reichenbach, Mario Jreige, John Prior, Florian Evéquoz, and Adrien Depeursinge. 2023. Rethinking the role of AI with physicians in oncology: revealing perspectives from clinical and research workflows. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-19.
  129. Himanshu Verma, Roger Schaer, Julien Reichenbach, Mario Jreige, John O Prior, Florian Evéquoz, and Adrien Depeursinge. 2021. On improving physicians' trust in AI: Qualitative inquiry with imaging experts in the oncological domain. BMC Medical Imaging, in review (2021).
  130. Dakuo Wang, Liuping Wang, Zhan Zhang, Ding Wang, Haiyi Zhu, Yvonne Gao, Xiangmin Fan, and Feng Tian. 2021. "Brilliant AI doctor" in rural clinics: Challenges in AI-powered clinical decision support system deployment. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1-18.
  131. Jiangkun Wang, Miyuka Nakamura, and Abderazek Ben Abdallah. 2022. Efficient AI-enabled pneumonia detection in chest X-ray images. In 2022 IEEE 4th Global Conference on Life Sciences and Technologies (LifeTech). IEEE, 470-474.
  132. Liuping Wang, Zhan Zhang, Dakuo Wang, Weidan Cao, Xiaomu Zhou, Ping Zhang, Jianxing Liu, Xiangmin Fan, and Feng Tian. 2023. Human-centered design and evaluation of AI-empowered clinical decision support systems: a systematic review. Frontiers in Computer Science 5 (2023), 1187299.
  133. Xiaosong Wang, Yifan Peng, Le Lu, Zhiyong Lu, Mohammadhadi Bagheri, and Ronald M Summers. 2017. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2097-2106.
  134. Siyuan Wei, Youngwon Choi, M Wasil Wahi-Anwar, Liza Shrestha, Koon-Pong Wong, and Matthew S Brown. 2023. Catheter segmentation in chest x-ray: improving imbalanced segmentation with a class frequency weighted loss function. In Medical Imaging 2023: Computer-Aided Diagnosis, Vol. 12465. SPIE, 433-439.
  135. Malwina Anna Wójcik. 2022. Foundation Models in Healthcare: Opportunities, Biases and Regulatory Prospects in Europe. In International Conference on Electronic Government and the Information Systems Perspective. Springer, 32-46.
  136. Yao Xie, Melody Chen, David Kao, Ge Gao, and Xiang'Anthony' Chen. 2020. CheXplain: enabling physicians to explore and understand data-driven, AI-enabled medical imaging analysis. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1-13.
  137. Shawn Xu, Lin Yang, Christopher Kelly, Marcin Sieniek, Timo Kohlberger, Martin Ma, Wei-Hung Weng, Attila Kiraly, Sahar Kazemzadeh, Zakkai Melamed, et al. 2023. ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoders. arXiv preprint arXiv:2308.01317 (2023). · arXiv
  138. Qian Yang, Yuexing Hao, Kexin Quan, Stephen Yang, Yiran Zhao, Volodymyr Kuleshov, and Fei Wang. 2023. Harnessing biomedical literature to calibrate clinicians' trust in AI decision support systems. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-14.
  139. Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 chi conference on human factors in computing systems. 1-13.
  140. Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fitting intelligent decision support into critical, clinical decision-making processes. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1-11.
  141. Qian Yang, John Zimmerman, Aaron Steinfeld, Lisa Carey, and James F Antaki. 2016. Investigating the heart pump implant decision process: opportunities for decision support tools to help. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4477-4488.
  142. Xin Yi, Scott J Adams, Robert DE Henderson, and Paul Babyn. 2020. Computer-aided assessment of catheters and tubes on radiographs: How good is artificial intelligence for assessment? Radiology: Artificial Intelligence 2, 1 (2020), e190082.
  143. Nur Yildirim, Changhoon Oh, Deniz Sayar, Kayla Brand, Supritha Challa, Violet Turri, Nina Crosby Walton, Anna Elise Wong, Jodi Forlizzi, James McCann, et al. 2023. Creating Design Resources to Scaffold the Ideation of AI Concepts. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 2326-2346.
  144. Nur Yildirim, Mahima Pushkarna, Nitesh Goyal, Martin Wattenberg, and Fernanda Viégas. 2023. Investigating how practitioners use human-ai guidelines: A case study on the people+ ai guidebook. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-13.
  145. Nur Yildirim, Hannah Richardson, Maria Teodora Wetscherek, Junaid Bajwa, Joseph Jacob, Mark Ames Pinnock, Stephen Harris, Daniel Coelho De Castro, Shruthi Bannur, Stephanie Hyland, et al. 2024. Multimodal healthcare AI: identifying and designing clinically relevant vision-language applications for radiology. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1-22.
  146. Dong Whi Yoo, Hayoung Woo, Sachin R Pendse, Nathaniel Young Lu, Michael L Birnbaum, Gregory D Abowd, and Munmun De Choudhury. 2024. Missed Opportunities for Human-Centered AI Research: Understanding Stakeholder Collaboration in Mental Health AI Research. Proceedings of the ACM on Human-Computer Interaction 8, CSCW1 (2024), 1-24.
  147. Dingding Yu, Kaijie Zhang, Lingyan Huang, Bonan Zhao, Xiaoshan Zhang, Xin Guo, Miaomiao Li, Zheng Gu, Guosheng Fu, Minchun Hu, et al. 2020. Detection of peripherally inserted central catheter (PICC) in chest X-ray images: A multi-task deep learning model. Computer Methods and Programs in Biomedicine 197 (2020), 105674.
  148. Feiyang Yu, Mark Endo, Rayan Krishnan, Ian Pan, Andy Tsai, Eduardo Pontes Reis, Eduardo Kaiser Ururahy Nunes Fonseca, Henrique Min Ho Lee, Zahra Shakeri Hossein Abad, Andrew Y. Ng, Curtis P. Langlotz, Vasantha Kumar Venugopal, and Pranav Rajpurkar. 2023. Evaluating progress in automatic chest X-ray radiology report generation. Patterns 4, 9 (2023). https://doi.org/10.1016/j.patter.2023. 100802 · DOI · Paper page
  149. Kun-Hsing Yu, Andrew L Beam, and Isaac S Kohane. 2018. Artificial intelligence in healthcare. Nature biomedical engineering 2, 10 (2018), 719-731.
  150. Travis Zack, Eric Lehman, Mirac Suzgun, Jorge A Rodriguez, Leo Anthony Celi, Judy Gichoya, Dan Jurafsky, Peter Szolovits, David W Bates, Raja-Elie E Abdulnour, et al. 2023. Coding Inequity: Assessing GPT-4's Potential for Perpetuating Racial and Gender Biases in Healthcare. medRxiv (2023), 2023-07.
  151. Hubert D Zając, Dana Li, Xiang Dai, Jonathan F Carlsen, Finn Kensing, and Tariq O Andersen. 2023. Clinician-facing AI in the Wild: Taking Stock of the Sociotechnical Challenges and Opportunities for HCI. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1-39.
  152. Esra Zihni, Vince Istvan Madai, Michelle Livne, Ivana Galinovic, Ahmed A Khalil, Jochen B Fiebach, and Dietmar Frey. 2020. Opening the black box of artificial intelligence for clinical decision support: A study predicting stroke outcome. Plos one 15, 4 (2020), e0231166. ACM Trans. Comput.-Hum. Interact.

Cited by

Sorted by citations

Authors
Thieme, A., Rajamohan, A., Cooper, B., Groombridge, H., Simister, R., Wong, B., Woznitza, N., Pinnock, M. A., Wetscherek, M. T., Morrison, C., Richardson, H., Pérez-García, F., Hyland, S. L., Bannur, S., Castro, D. C., Bouzid, K., Schwaighofer, A., Ranjit, M., Sharma, H., Lungren, M. P., Oktay, O., Alvarez-Valle, J., Nori, A., Harris, S., & Jacob, J.
Affiliations
  • Microsoft (United Kingdom) (GB)
  • University College London Hospitals NHS Foundation Trust (GB)
  • University College London (GB)
  • University of Cambridge (GB)
  • Microsoft Research (United Kingdom) (GB)
  • University of California, San Francisco (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
32
Issue
4
Pages
1-61
ISSN
1073-0516 (ISSN-L)
DOI
10.48550/arxiv.2405.05299
arXiv
2405.05299
OpenAlex
W4407406114
Cited by
10
References
0
Citations by year
2026: 4 · 2025: 5 · 2024: 1
FWCI
2.19
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • ACM Transactions on Computer-Human Interaction (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Wellcome Trust (Z/17/Z, 209553/Z/17/Z)
  • National Institute for Health and Care Research
  • University College London Hospitals NHS Foundation Trust
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
nasogastric tube insertion, chest radiography, artificial intelligence in radiology, clinical workflow integration, responsible AI design, human-centered design, data bias, data documentation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review