Ethical Use of Electronic Health Record Data and Artificial Intelligence: Recommendations of the Primary Care Informatics Working Group of the International Medical Informatics Association
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Summary: Objective: To create practical recommendations for the curation of routinely collected health data and artificial intelligence (AI) in primary care with a focus on ensuring their ethical use. Methods: We defined data curation as the process of management of data throughout its lifecycle to ensure it can be used into the future. We used a literature review and Delphi exercises to capture insights from the Primary Care Informatics Working Group (PCIWG) of the International Medical Informatics Association (IMIA). Results: We created six recommendations: (1) Ensure consent and formal process to govern access and sharing throughout the data life cycle; (2) Sustainable data creation/collection requires trust and permission; (3) Pay attention to Extract-Transform-Load (ETL) processes as they may have unrecognised risks; (4) Integrate data governance and data quality management to support clinical practice in integrated care systems; (5) Recognise the need for new processes to address the ethical issues arising from AI in primary care; (6) Apply an ethical framework mapped to the data life cycle, including an assessment of data quality to achieve effective data curation. Conclusions: The ethical use of data needs to be integrated within the curation process, hence running throughout the data lifecycle. Current information systems may not fully detect the risks associated with ETL and AI; they need careful scrutiny. With distributed integrated care systems where data are often used remote from documentation, harmonised data quality assessment, management, and governance is important. These recommendations should help maintain trust and connectedness in contemporary information systems and planned developments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This might for example entail an initial risk assessment of vulnerabilities in data and software, including the risk of re-identification33, the risk of data loss and manipulation33,35, and the risk of adversarial attacks9,22,23,26,35,43,59.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [33]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423 · cited 1×
“We incorporated the FAIR guiding principles for scientific data management: Findability, Accessibility, Interoperability and Re-usability [14].”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“Discrimination prevention ensures that data mining models do not lead to discriminatory decisions, even if the data set is inherently biased against vulnerable and disadvantaged groups [40].”
BackgroundKim, D. J., Ferrin, D. L., & Rao, H. R. (2008) · Decision Support Systems · doi:10.1016/j.dss.2007.07.001 · Cited by 3,613 · cited 1×
“Deployment of “apps” and systems that enable unethical and unlawful exchange of digital information undermine trust [24].”
BackgroundBig healthcare data: preserving security and privacy
Abouelmehdi, K., Beni-Hessane, A., & Khaloufi, H. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0110-7 · Cited by 738 · cited 2×
“Data repositories are difficult to access to verify and validate the quality of the data and algorithms used [4, 5].”
BackgroundBlockchain technology for improving clinical research quality
Benchoufi, M., & Ravaud, P. (2017) · Trials · doi:10.1186/s13063-017-2035-z · Cited by 367 · cited 1×
“New and often disruptive technologies such as blockchain are being used to accelerate the consent process for clinical trials [22], potentially addressing personal data privacy concerns associated with data sharing in integrated service delivery.”
MethodAvailability and quality of mobile health app privacy policies
Sunyaev, A., Dehling, T., Taylor, P. L., & Mandl, K. D. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002605 · Cited by 360 · cited 1×
“Recommendation 2: Implement sustainable data creation/collection to build and maintain trust as well as permission Community-driven health data repositories may not be as private as citizens assume [23].”
BackgroundMagrabi, F., Ammenwerth, E., McNair, J. B., De Keizer, N. F., Hyppönen, H., Nykänen, P., Rigby, M., Scott, P. J., Vehko, T., Wong, Z. S.-Y., et al. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677903 · Cited by 347 · cited 1×
“Trials comparing AI-based or AI-guided practice with usual practice are needed to provide the evidence to support policy recommendations and requirements for current poorly regulated AI practices [41].”
MethodAlgorithmic Bias: From Discrimination Discovery to Fairness-aware Data Mining
Hajian, S., Bonchi, F., & Castillo, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2945386 · Cited by 334
Ten Ways Artificial Intelligence Will Transform Primary Care
Lin, S. Y., Mahoney, M. R., & Sinsky, C. A. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05035-1 · Cited by 248 · cited 1×
“AI in primary care should “augment (not subvert) the patient-physician relationship” [38].”
BackgroundLiyanage, H., Liaw, S.-T., Jonnagaddala, J., Schreiber, R., Kuziemsky, C., Terry, A. L., & de Lusignan, S. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677901 · Cited by 200 · cited 2×
“The tendency for a ‘black-box’ paradigm with AI systems, especially those where intrinsic estimations are biased or not clinically interpretable in biological terms [11], should be strongly discouraged.”
BackgroundSelf-citation
Research works printed but not linked: 5
- H Liyanage, 2014, Big Data Usage Patterns in the Health Care Domain: A Use Case Driven Approach Applied to the Assessment of Vaccination Benefits and Risks, Yearb Med Inform, 27
- H Liyanage, 2019, Artificial Intelligence in Primary Health Care: Perceptions, Issues, and Challenges, Yearb Med Inform, 41
- S T Liaw, 2015, Optimising use of EHR data: current issues, evolving opportunities, strategies and scope for collaboration, Aust Fam Physician, 45, 153
- G N Guo, 2019, Comparison of cohort selection performance of Aust Med Terminology to Anatomic Therapeutic Chemical mappings, J Am Med Inform Assoc, 26, 37
- F Magrabi, 2019, Artificial Intelligence in Clinical Decision Support: Challenges for Evaluating AI and Practical Implications, Yearb Med Inform, 128
Cited by
Ethical and regulatory challenges of AI technologies in healthcare: A narrative review
Mennella, C., Maniscalco, U., De Pietro, G., & Esposito, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26297 · Cited by 1,229
“Vigilance in recognizing potential pitfalls and implementing safeguards is essential for ensuring the reliability and security of the data transfer process [108].”
Backgroundde Hond, A. A. H., Leeuwenberg, A. M., Hooft, L., Kant, I. M. J., Nijman, S. W. J., van Os, H. J. A., Aardoom, J. J., Debray, T. P. A., Schuit, E., van Smeden, M., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-021-00549-7 · Cited by 499
“Legislation may require identi fi cation of the right legal basis (such as informed consent) for processing con fi dential information of individuals 12,20,26,32,33,36,37 .”
BackgroundInfluentialKarimian, G., Petelos, E., & Evers, S. M. A. A. (2022) · AI and Ethics · doi:10.1007/s43681-021-00131-7 · Cited by 279
“The principle of explicability of AI algorithms was also frequently discussed in the literature [35, 38, 41, 45, 46, 48–51].”
BackgroundInfluentialDigital technologies, artificial intelligence, and bureaucratic transformation
Newman, J., Mintrom, M., & O'Neill, D. (2022) · Futures · doi:10.1016/j.futures.2021.102886 · Cited by 129
“On the negative side, critics have argued that automation in public administration can pose ethical problems (Liaw et al., 2020), increase inequality (Eubanks, 2018), and generally reduce the quality of democratic governance (Young et al., 2019: 312).”
Javaid, M., Haleem, A., & Singh, R. P. (2024) · Informatics and Health · doi:10.1016/j.infoh.2024.05.001 · Cited by 163
Metadata
- Authors
- Liaw, S.-T., Liyanage, H., Kuziemsky, C., Terry, A. L., Schreiber, R., Jonnagaddala, J., & de Lusignan, S.
- Affiliations
- UNSW Sydney (AU)
- University of Oxford (GB)
- MacEwan University (CA)
- Western University (CA)
- Geisinger Health System (US)
- Clnical Informatics and Health Outcomes Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Eagle House, 7 Walton Well Road, Oxford, OX2 6ED, UK
- ORCID
- Venue
- Yearbook of Medical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2020-04-17
- Volume
- 29
- Issue
- 01
- Pages
- 051-057
- ISSN
- 0943-4747 (ISSN-L)
- 2364-0502
- PMC
- PMC7442527
- OpenAlex
- W3017144593
- Cited by
- 76
- References
- 34
- Citations by year
- 2026: 11 · 2025: 18 · 2024: 19 · 2023: 9 · 2022: 14 · 2021: 3 · 2020: 2
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Yearbook of Medical Informatics (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, AI ethics, data curation, data lifecycle, primary care, data governance, data quality management, informed consent, integrated care systems, ethical frameworks
- MeSH terms
- Data Accuracy, Artificial Intelligence, Ethics, Medical, Humans, Medical Informatics, Primary Health Care, Medical Records Systems, Computerized, Information Dissemination, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ethical Use of Electronic Health Record Data and Artificial Intelligence: Recommendations of the Primary Care Informatics Working Group of the International Medical Informatics Association. https://app.cochat.ai/papers/10.1055/s-0040-1701980
- The paper
- Liaw, S.-T., Liyanage, H., Kuziemsky, C., Terry, A. L., Schreiber, R., Jonnagaddala, J., & de Lusignan, S. (2020). Ethical Use of Electronic Health Record Data and Artificial Intelligence: Recommendations of the Primary Care Informatics Working Group of the International Medical Informatics Association. Yearbook of Medical Informatics. https://doi.org/10.1055/s-0040-1701980
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
