Collaboration, not Confrontation: Understanding General Practitioners’ Attitudes Towards Natural Language and Text Automation in Clinical Practice
The DOI matches its Crossref record; 127 of the 127 references it cites were found in a registry or an index.
Abstract
General Practitioners are among the primary users and curators of textual electronic health records, highlighting the need for technologies supporting record access and administration. Recent advancements in natural language processing facilitate the development of clinical systems, automating some time-consuming record-keeping tasks. However, it remains unclear what automation tasks would benefit clinicians most, what features such automation should exhibit, and how clinicians will interact with the automation. We conducted semi-structured interviews with General Practitioners uncovering their views and attitudes toward text automation. The main emerging theme was doctor-AI collaboration, addressing a reciprocal clinician-technology relationship that does not threaten to substitute clinicians, but rather establishes a constructive synergistic relationship. Other themes included: (i) desired features for clinical text automation; (ii) concerns around clinical text automation; and (iii) the consultation of the future. Our findings will inform the design of future natural language processing systems, to be implemented in general practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“which is another common obstacle to accessing and using some of these tools [40,45,65,104]”
From Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults (2024) · cites this paper as [40]
In the citing paper
“older adults generally have lower technology proficiency compared to younger generations”
From Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults (2024) · cites this paper as [40]
In the citing paper
“lack of digital literacy is a widely known issue [40,91,104]”
From Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults (2024) · cites this paper as [40]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 2×
“In particular, the discovery of new deep learning language algorithms including statistical language models based on continuous vector representations of words [87] with subsequent development of transformer models, such as BERT [35], GPT-3 [14], and their specific derivatives, e.g., trained on clinical text corpora […”
BackgroundHighly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · cited 1×
“Progress in areas such as computer vision [63] and developments that spread beyond what humans are capable of, such as protein folding [61] or real-time weather prediction [106], demonstrate that AI systems performing cognitively complex tasks may become a reality soon.”
BackgroundLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“…models based on continuous vector representations of words [87] with subsequent development of transformer models, such as BERT [35], GPT-3 [14], and their specific derivatives, e.g., trained on clinical text corpora [2], have allowed their application for complex NLP tasks including named…”
BackgroundHow Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 3×
“Applications of AI in medicine recently have focused on high-stake decisions, such as ruling out diseases and providing diagnosis [124] or question-answering systems and conversational agents [94].”
BackgroundTransformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 1×
“Although there is a certain degree of limitation of black box AI systems (Adadi & Berrada, 2018), more recent approaches and developments shed some light on the inner workings of the algorithms (Adadi & Berrada, 2018).”
BackgroundClinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Research works printed but not linked: 14
- Åsa Cajander and Christiane Grünloh. 2019. Electronic health records are more than a work tool: Conflicting needs of direct and indirect stakeholders. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.
- Hao-Fei Cheng, Ruotong Wang, Zheng Zhang, Fiona O'Connell, Terrance Gray, F. Maxwell Harper, and Haiyi Zhu. 2019. Explaining decision-making algorithms through UI: Strategies to help non-expert stakeholders. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
- Enrico Coiera, Baki Kocaballi, John Halamka, and Liliana Laranjo. 2018. The digital scribe. NPJ Digit. Med. 1, 1 (2018), 1–5.
- Christine Dearnley. 2005. A reflection on the use of semi-structured interviews. Nurse Res. 13, 1 (2005).
- Sarah Freymann Fontenot. 2013. The Affordable Care Act and electronic health care records. Physician Exec. 39, 6 (2013), 72–76.
- Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press.
- W. Gossman, V. Lew, and S. Ghassemzadeh. 2020. SOAP Notes. StatPearls [Internet]. https://www.ncbi.nlm.nih.gov/books/NBK482263/.
- Bruce Hanington and Bella Martin. 2019. Universal Methods of Design Expanded and Revised: 125 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publishers.
- Anssi Lensu. 2002. Computationally intelligent methods for qualitative data analysis. Jyväskylä Studies in Computing 23 (2002). Retrieved November 22, 2022 from https://jyx.jyu.fi/handle/123456789/13284.
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space BT-1st international conference on learning representations. In International Conference on Learning Representations (ICLR'13, Scottsdale, Arizona, USA, May 2-4, 2013, Workshop Track Proceedings). Retrieved from http://arxiv.org/abs/1301.3781. · arXiv
- James Proudman. 2018. Cyborg supervision–the application of advanced analytics in prudential supervision. In Proceedings of the Speech, Workshop on Research on Bank Supervision, London.
- Dean F. Sittig. 2013. Electronic Health Records: Challenges in Design and Implementation. CRC Press.
- Neeraj Varshney Swaroop Mishra and Chitta Baral. 2020. It's better to say “I can't answer” than answering incorrectly: Towards safety critical NLP systems. arXiv:2008.09371. Retrieved from https://arxiv.org/abs/2008.09371. · arXiv
- Dakuo Wang, Elizabeth Churchill, Pattie Maes, Xiangmin Fan, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2020. From human-human collaboration to human-ai collaboration: Designing ai systems that can work together with people. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–6.
Cited by
Yang, Z., Xu, X., Yao, B., Rogers, E., Zhang, S., Intille, S., Shara, N., Gao, G. G., & Wang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659625 · Cited by 120
AI and Primary Care: Scoping Review
Katonai, G., Árvai, N., & Meskó, B. (2025) · Journal of Medical Internet Research · doi:10.2196/65950 · Cited by 63
“GPs expressed support for doctor-AI collaboration but raised concerns about usability and workflow integration [92].”
Expert evaluation of large language models for clinical dialogue summarization
Navarro, D. F., Coiera, E. W., Hambly, T. W., Triplett, Z., Asif, N., Susanto, A. P., Chowdhury, A., Azcoaga-Lorenzo, A., Dras, M., & Berkovsky, S. (2025) · Scientific Reports · doi:10.1038/s41598-024-84850-x · Cited by 77
Self-citationAndersen, T. O., Nunes, F., Wilcox, L., Coiera, E., & Rogers, Y. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3589961 · Cited by 40
Martínez-Martínez, H., Alfonso, J. M., Sánchez-Rojo-Huertas, B., Reynolds-Cortez, V., Turégano-Chumillas, A., Meseguer-Ruiz, V. A., Cekrezi, S., & Martínez‐Vizcaíno, V. (2025) · Journal of Medical Internet Research · doi:10.2196/71186 · Cited by 40
“…clinical decisions and create an environment of distrust and pressure that could affect both their medical practice and personal well-being [28]: If everything was completely recorded and stored...the entire conversation, if that was recorded and stored, and the doctor missed something,…”
Influential
Metadata
- Authors
- Fraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S.
- Affiliations
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, NSW, Australia
- University of Technology Sydney (AU)
- Macquarie University (AU)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2023-04-13
- Volume
- 30
- Issue
- 2
- Pages
- 1-34
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W4307444957
- Cited by
- 28
- References
- 125
- Citations by year
- 2026: 7 · 2025: 12 · 2024: 7 · 2023: 2
- FWCI
- 3.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- general practitioners, natural language processing, electronic health records, clinical record keeping, clinician attitudes, clinical decision support, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Collaboration, not Confrontation: Understanding General Practitioners’ Attitudes Towards Natural Language and Text Automation in Clinical Practice. https://app.cochat.ai/papers/10.1145/3569893
- The paper
- Fraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023). Collaboration, not Confrontation: Understanding General Practitioners’ Attitudes Towards Natural Language and Text Automation in Clinical Practice. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/3569893
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.