Open AI meets open notes: surveillance capitalism, patient privacy and online record access
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Patient online record access (ORA) is spreading worldwide, and in some countries, including Sweden, and the USA, access is advanced with patients obtaining rapid access to their full records. In the UK context, from 31 October 2023 as part of the new NHS England general practitioner (GP) contract it will be mandatory for GPs to offer ORA to patients aged 16 and older. Patients report many benefits from reading their clinical records including feeling more empowered, better understanding and remembering their treatment plan, and greater awareness about medications including possible adverse effects. However, a variety of indirect evidence suggests these benefits are unlikely to accrue without supplementation from internet-based resources. Using such routes to augment interpretation of the data and notes housed in electronic health records, however, comes with trade-offs in terms of exposing sensitive patient information to internet corporations. Furthermore, increased work burdens on clinicians, including the unique demands of ORA, combined with the easy availability and capability of a new generation of large language model (LLM)-powered chatbots, create a perfect collision course for exposing sensitive patient information to private tech companies. This paper surveys how ORA intersects with internet associated privacy risks and offers a variety of multilevel suggestions for how these risks might be better mitigated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ayers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613
Internet Health Information Seeking and the Patient-Physician Relationship: A Systematic Review
Tan, S. S.-L., & Goonawardene, N. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5729 · Cited by 1,101
Epistemic injustice in healthcare: a philosophial analysis
Carel, H., & Kidd, I. J. (2014) · Medicine, Health Care and Philosophy · doi:10.1007/s11019-014-9560-2 · Cited by 749
Online Health Information Seeking Behavior: A Systematic Review
Jia, X., Pang, Y., & Liu, L. S. (2021) · Healthcare · doi:10.3390/healthcare9121740 · Cited by 547
AI-Generated Medical Advice—GPT and Beyond
Haupt, C. E., & Marks, M. (2023) · JAMA · doi:10.1001/jama.2023.5321 · Cited by 346 · cited 2×
“55 Unlike traditional search engines which offer lists of webpages, LLM-based chatbots facilitate exchanges that mimic dialogue and ‘remember’ previous prompts, helping to create the perception of smoother exchanges.”
BackgroundBlease, C., Kaptchuk, T. J., Bernstein, M. H., Mandl, K. D., Halamka, J. D., & DesRoches, C. M. (2019) · Journal of Medical Internet Research · doi:10.2196/12802 · Cited by 346
Self-citationHuckvale, K., Torous, J., & Larsen, M. E. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.2542 · Cited by 312 · cited 1×
“54”
Walker, J., Leveille, S., Bell, S., Chimowitz, H., Dong, Z., Elmore, J. G., Fernandez, L., Fossa, A., Gerard, M., Fitzgerald, P., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/13876 · Cited by 309
Use of Artificial Intelligence Chatbots for Cancer Treatment Information
Chen, S., Kann, B. H., Foote, M. B., Aerts, H. J. W. L., Savova, G. K., Mak, R. H., & Bitterman, D. S. (2023) · JAMA Oncology · doi:10.1001/jamaoncol.2023.2954 · Cited by 251 · cited 1×
“57 The extent to which patients use generative-AI chatbots to augment understanding about their healthcare is only beginning to be explored.”
BackgroundPutting ChatGPT’s Medical Advice to the (Turing) Test: Survey Study
Nov, O., Singh, N., & Mann, D. (2023) · JMIR Medical Education · doi:10.2196/46939 · Cited by 198 · cited 1×
“59 These attributes could render LLMs such as Chat-GPT particularly potent extractors of sensitive and detailed health information.”
Background
Cited by
Mapping the ethics of generative AI: a comprehensive scoping review
Hagendorff, T. (2024) · Minds and Machines · doi:10.1007/s11023-024-09694-w · Cited by 141
“To safeguard privacy, papers stress the importance of protecting sensitive and personal data transmitted to AI operators (Allen et al., 2024; Blease, 2024; Kenwright, 2023).”
Blease, C., Worthen, A., & Torous, J. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.115724 · Cited by 113
“Put another way, the standard for consent is unfeasibly onerous for patients and consumers, a concern that persists with LLM tools and health privacy (Blease, 2023).”
Self-citationKharko, A., McMillan, B., Hagström, J., Muli, I., Davidge, G., Hägglund, M., & Blease, C. (2024) · DIGITAL HEALTH · doi:10.1177/20552076241291384 · Cited by 27
Self-citationLarge Language Models in Spine Surgery: A Promising Technology
Shah, R., & Schwab, J. H. (2025) · HSS Journal®: The Musculoskeletal Journal of Hospital for Special Surgery · doi:10.1177/15563316251340696 · Cited by 5
Metadata
- Authors
- Blease, C.
- Venue
- Journal of Medical Ethics
- Publisher
- BMJ
- Published
- 2023-11-23
- Volume
- 50
- Issue
- 2
- Pages
- 84-89
- ISSN
- 0306-6800 (ISSN-L)
- 1473-4257
- OpenAlex
- W4388947060
- Cited by
- 44
- References
- 11
- FWCI
- 9.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Open AI meets open notes: surveillance capitalism, patient privacy and online record access. https://app.cochat.ai/papers/10.1136/jme-2023-109574
- The paper
- Blease, C. (2024). Open AI meets open notes: surveillance capitalism, patient privacy and online record access. Journal of Medical Ethics. https://doi.org/10.1136/jme-2023-109574
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.