A “Do No Harm” novel safety checklist and research approach to determine whether to launch an artificial intelligence-based medical technology: introducing the Biological-Psychological, Economic, and Social (BPES) framework
Open accessPublished version of a preprint
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Given the impact artificial intelligence (AI)–based medical technologies (hardware devices, software programs, and mobile apps) can have on society, debates regarding the principles behind their development and deployment are emerging. Using the biopsychosocial model applied in psychiatry and other fields of medicine as our foundation, we propose a novel 3-step framework to guide industry developers of AI-based medical tools as well as health care regulatory agencies on how to decide if a product should be launched—a “Go or No-Go” approach. More specifically, our novel framework places stakeholders’ (patients, health care professionals, industry, and government institutions) safety at its core by asking developers to demonstrate the biological-psychological (impact on physical and mental health), economic, and social value of their AI tool before it is launched. We also introduce a novel cost-effective, time-sensitive, and safety-oriented mixed quantitative and qualitative clinical phased trial approach to help industry and government health care regulatory agencies test and deliberate on whether to launch these AI-based medical technologies. To our knowledge, our biological-psychological, economic, and social (BPES) framework and mixed method phased trial approach are the first to place the Hippocratic Oath of “Do No Harm” at the center of developers’, implementers’, regulators’, and users’ mindsets when determining whether an AI-based medical technology is safe to launch. Moreover, as the welfare of AI users and developers becomes a greater concern, our framework’s novel safety feature will allow it to complement existing and future AI reporting guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“While the Biological-Psychological, Economic, and Social checklist by Khan and Seto [32] covers the planning aspect of AI development, it does not go beyond that phase, which is a limitation in its application.”
From Checklist Approach to Developing and Implementing AI in Clinical Settings: Instrument Development Study (2025) · cites this paper as [32]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“For example, at a given risk score, Black patients were found to be significantly sicker than White patients in most active chronic illnesses [23].”
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 3×
“Nevertheless, AI is now being used to accelerate the process of drug discovery by using deep learning model analysis that reduces the dependency on slower and expensive physical experiments [20].”
InfluentialPrinciples of early drug discovery
Hughes, J., Rees, S., Kalindjian, S., & Philpott, K. (2011) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2010.01127.x · Cited by 2,859
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Large-Scale Assessment of a Smartwatch to Identify Atrial Fibrillation
Perez, M. V., Mahaffey, K. W., Hedlin, H., Rumsfeld, J. S., Garcia, A., Ferris, T., Balasubramanian, V., Russo, A. M., Rajmane, A., Cheung, L., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1901183 · Cited by 1,917
Implementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857 · cited 1×
“Private-sector AI medical technology companies might also be subject to similar temptations, especially when reimbursement rates are based on metrics that do not always reflect better care [3].”
Fullman, N., Yearwood, J., Abay, S. M., Abbafati, C., Abd-Allah, F., Abdela, J., Abdelalim, A., Abebe, Z., Abebo, T. A., Aboyans, V., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30994-2 · Cited by 1,013 · cited 1×
“However, providing access to affordable quality of care is often viewed as a leading objective in improving medical outcomes in a health care system [26].”
Evidence for Health Decision Making — Beyond Randomized, Controlled Trials
Frieden, T. R. (2017) · New England Journal of Medicine · doi:10.1056/nejmra1614394 · Cited by 770
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673
Vasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070904 · Cited by 665 · cited 2×
“…users and developers becomes a greater concern, our framework’s novel safety feature will allow it to complement existing and future AI reporting guidelines such as “DECIDE-AI” (Developmental and Exploratory Clinical Investigations of Decision support systems driven by Artificial Intelligence) [7].”
The Social Control of Technology
Mayne, A. J. (1982) · Journal of the Operational Research Society · doi:10.2307/2634327 · Cited by 577
Turakhia, M. P., Desai, M., Hedlin, H., Rajmane, A., Talati, N., Ferris, T., Desai, S., Nag, D., Patel, M., Kowey, P., et al. (2019) · American Heart Journal · doi:10.1016/j.ahj.2018.09.002 · Cited by 474 · cited 1×
“Several studies have since evaluated this claim, which the company justified by stating 700,000 Americans with atrial fibrillation remain undiagnosed at a cost of US $3.2 billion in potentially avoidable arrhythmia-related strokes [11,12].”
InfluentialMachine Learning and the Profession of Medicine
Darcy, A. M., Louie, A. K., & Roberts, L. W. (2016) · JAMA · doi:10.1001/jama.2015.18421 · Cited by 434
Systematic Review of Economic Impact Studies of Artificial Intelligence in Health Care
Wolff, J., Pauling, J., Keck, A., & Baumbach, J. (2020) · Journal of Medical Internet Research · doi:10.2196/16866 · Cited by 261
Overdiagnosis in primary care: framing the problem and finding solutions
Kale, M. S., & Korenstein, D. (2018) · BMJ · doi:10.1136/bmj.k2820 · Cited by 165
Ganguli, I., Lupo, C., Mainor, A. J., Raymond, S., Wang, Q., Orav, E. J., Chang, C., Morden, N. E., Rosenthal, M. B., Colla, C. H., et al. (2019) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2019.1739 · Cited by 123
Analysis of Physician Variation in Provision of Low-Value Services
Schwartz, A. L., Jena, A. B., Zaslavsky, A. M., & McWilliams, J. M. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.5086 · Cited by 96
Wolf, R. M., Channa, R., Abramoff, M. D., & Lehmann, H. P. (2020) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2020.3190 · Cited by 87
Evaluation of machine learning solutions in medicine
Antoniou, T., & Mamdani, M. (2021) · Canadian Medical Association Journal · doi:10.1503/cmaj.210036 · Cited by 62
Gervasi, S. S., Chen, I. Y., Smith-McLallen, A., Sontag, D., Obermeyer, Z., Vennera, M., & Chawla, R. (2022) · Health Affairs · doi:10.1377/hlthaff.2021.01287 · Cited by 60
The Social Determinants of Health
Beatty, K., & White, M. (2022) · The University Press of Kentucky eBooks · doi:10.5810/kentucky/9780813155579.003.0004 · Cited by 47
Holloway, J., Neely, C., Yuan, X., Zhang, Y., Ouyang, J., Cantrell, D., Chaisson, J., Bergeron, T., Washington, V., & Nigam, S. (2019) · Journal of Medical Economics · doi:10.1080/13696998.2019.1666854 · Cited by 35
Governance of Emerging Technologies in Health and Medicine — Creating a New Framework
Mathews, D., Balatbat, C. A., & Dzau, V. J. (2022) · New England Journal of Medicine · doi:10.1056/nejmms2200907 · Cited by 33
Machine Learning and the Pursuit of High-Value Health Care
Ganguli, I., Gordon, W. J., Lupo, C., Sands-Lincoln, M., George, J. K., Jackson, G. P., Rhee, K. B. L., & Bates, D. W. (2020) · NEJM Catalyst · doi:10.1056/cat.20.0094 · Cited by 22
Thinking with the living body: the biopsychosocial model and the cosmopolitics of existence
Schillmeier, M. (2019) · Medical Humanities · doi:10.1136/medhum-2018-011584 · Cited by 10
Cited by
Opportunities and risks of large language models in psychiatry
Obradovich, N., Khalsa, S. S., Khan, W. U., Suh, J., Perlis, R. H., Ajilore, O., & Paulus, M. P. (2024) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-024-00010-z · Cited by 79
Self-citationGyevnár, B., & Kasirzadeh, A. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01020-y · Cited by 86
New trend in artificial intelligence-based assistive technology for thoracic imaging
Yanagawa, M., Ito, R., Nozaki, T., Fujioka, T., Yamada, A., Fujita, S., Kamagata, K., Fushimi, Y., Tsuboyama, T., Matsui, Y., et al. (2023) · La radiologia medica · doi:10.1007/s11547-023-01691-w · Cited by 36
Owoyemi, A., Osuchukwu, J., Salwei, M. E., & Boyd, A. (2025) · JMIRx Med · doi:10.2196/65565 · Cited by 18
“While the Biological-Psychological, Economic, and Social checklist by Khan and Seto [32] covers the planning aspect of AI development, it does not go beyond that phase, which is a limitation in its application.”
A Risk Ontology for Evaluating AI-Powered Psychotherapy Virtual Agents
Steenstra, I., & Bickmore, T. (2025) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3717511.3749286 · Cited by 17
Metadata
- Authors
- Khan, W. U., & Seto, E.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Khan, Waqas Ullah
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-04-05
- Volume
- 25
- Pages
- e43386
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC10131977
- OpenAlex
- W4323911815
- Cited by
- 15
- References
- 28
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 3 · 2023: 2
- FWCI
- 0.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- artificial intelligence in healthcare, product launch decisions, safety checklist, do no harm principle, biopsychosocial model, health care regulation
- MeSH terms
- Artificial Intelligence, Government, Government Agencies, Humans, Checklist, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.