CoChat

Collaboration, not Confrontation: Understanding General Practitioners’ Attitudes Towards Natural Language and Text Automation in Clinical Practice

Fraile Navarro, David, Kocaballi, A. Baki, Dras, Mark, Berkovsky, Shlomo · 2023 · ACM Transactions on Computer-Human Interaction

The DOI matches its Crossref record; 127 of the 127 references it cites were found in a registry or an index.

Abstract

General Practitioners are among the primary users and curators of textual electronic health records, highlighting the need for technologies supporting record access and administration. Recent advancements in natural language processing facilitate the development of clinical systems, automating some time-consuming record-keeping tasks. However, it remains unclear what automation tasks would benefit clinicians most, what features such automation should exhibit, and how clinicians will interact with the automation. We conducted semi-structured interviews with General Practitioners uncovering their views and attitudes toward text automation. The main emerging theme was doctor-AI collaboration, addressing a reciprocal clinician-technology relationship that does not threaten to substitute clinicians, but rather establishes a constructive synergistic relationship. Other themes included: (i) desired features for clinical text automation; (ii) concerns around clinical text automation; and (iii) the consultation of the future. Our findings will inform the design of future natural language processing systems, to be implemented in general practice.

Overview

Integrity signals

Registry

Crossref · 10.1145/3569893

Cites

127 of 127 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 127 references

Research works printed but not linked: 14

  1. Åsa Cajander and Christiane Grünloh. 2019. Electronic health records are more than a work tool: Conflicting needs of direct and indirect stakeholders. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.
  2. Hao-Fei Cheng, Ruotong Wang, Zheng Zhang, Fiona O'Connell, Terrance Gray, F. Maxwell Harper, and Haiyi Zhu. 2019. Explaining decision-making algorithms through UI: Strategies to help non-expert stakeholders. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
  3. Enrico Coiera, Baki Kocaballi, John Halamka, and Liliana Laranjo. 2018. The digital scribe. NPJ Digit. Med. 1, 1 (2018), 1–5.
  4. Christine Dearnley. 2005. A reflection on the use of semi-structured interviews. Nurse Res. 13, 1 (2005).
  5. Sarah Freymann Fontenot. 2013. The Affordable Care Act and electronic health care records. Physician Exec. 39, 6 (2013), 72–76.
  6. Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press.
  7. W. Gossman, V. Lew, and S. Ghassemzadeh. 2020. SOAP Notes. StatPearls [Internet]. https://www.ncbi.nlm.nih.gov/books/NBK482263/.
  8. Bruce Hanington and Bella Martin. 2019. Universal Methods of Design Expanded and Revised: 125 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publishers.
  9. Anssi Lensu. 2002. Computationally intelligent methods for qualitative data analysis. Jyväskylä Studies in Computing 23 (2002). Retrieved November 22, 2022 from https://jyx.jyu.fi/handle/123456789/13284.
  10. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space BT-1st international conference on learning representations. In International Conference on Learning Representations (ICLR'13, Scottsdale, Arizona, USA, May 2-4, 2013, Workshop Track Proceedings). Retrieved from http://arxiv.org/abs/1301.3781. · arXiv
  11. James Proudman. 2018. Cyborg supervision–the application of advanced analytics in prudential supervision. In Proceedings of the Speech, Workshop on Research on Bank Supervision, London.
  12. Dean F. Sittig. 2013. Electronic Health Records: Challenges in Design and Implementation. CRC Press.
  13. Neeraj Varshney Swaroop Mishra and Chitta Baral. 2020. It's better to say “I can't answer” than answering incorrectly: Towards safety critical NLP systems. arXiv:2008.09371. Retrieved from https://arxiv.org/abs/2008.09371. · arXiv
  14. Dakuo Wang, Elizabeth Churchill, Pattie Maes, Xiangmin Fan, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2020. From human-human collaboration to human-ai collaboration: Designing ai systems that can work together with people. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–6.

Cited by

Metadata

Authors
Fraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S.
Affiliations
  • Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, NSW, Australia
  • University of Technology Sydney (AU)
  • Macquarie University (AU)
Venue
ACM Transactions on Computer-Human Interaction
Published
2023-04-13
Volume
30
Issue
2
Pages
1-34
ISSN
  • 1073-0516 (ISSN-L)
  • 1557-7325
OpenAlex
W4307444957
Cited by
28
References
125
Citations by year
2026: 7 · 2025: 12 · 2024: 7 · 2023: 2
FWCI
3.94
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Computer-Human Interaction (publishedVersion)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
Keywords
general practitioners, natural language processing, electronic health records, clinical record keeping, clinician attitudes, clinical decision support, human-AI interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.