An Ethics Checklist for Digital Health Research in Psychiatry: Viewpoint
Open accessPublished version of a preprint
The DOI matches its Crossref record; 55 of the 56 references it cites were found in a registry or an index.
Abstract
Background: Psychiatry has long needed a better and more scalable way to capture the dynamics of behavior and its disturbances, quantitatively across multiple data channels, at high temporal resolution in real time. By combining 24/7 data—on location, movement, email and text communications, and social media—with brain scans, genetics, genomics, neuropsychological batteries, and clinical interviews, researchers will have an unprecedented amount of objective, individual-level data. Analyzing these data with ever-evolving artificial intelligence could one day include bringing interventions to patients where they are in the real world in a convenient, efficient, effective, and timely way. Yet, the road to this innovative future is fraught with ethical dilemmas as well as ethical, legal, and social implications (ELSI). Objective: The goal of the Ethics Checklist is to promote careful design and execution of research. It is not meant to mandate particular research designs; indeed, at this early stage and without consensus guidance, there are a range of reasonable choices researchers may make. However, the checklist is meant to make those ethical choices explicit, and to require researchers to give reasons for their decisions related to ELSI issues. The Ethics Checklist is primarily focused on procedural safeguards, such as consulting with experts outside the research group and documenting standard operating procedures for clearly actionable data (eg, expressed suicidality) within written research protocols. Methods: We explored the ELSI of digital health research in psychiatry, with a particular focus on what we label “deep phenotyping” psychiatric research, which combines the potential for virtually boundless data collection and increasingly sophisticated techniques to analyze those data. We convened an interdisciplinary expert stakeholder workshop in May 2020, and this checklist emerges out of that dialogue. Results: Consistent with recent ELSI analyses, we find that existing ethical guidance and legal regulations are not sufficient for deep phenotyping research in psychiatry. At present, there are regulatory gaps, inconsistencies across research teams in ethics protocols, and a lack of consensus among institutional review boards on when and how deep phenotyping research should proceed. We thus developed a new instrument, an Ethics Checklist for Digital Health Research in Psychiatry (“the Ethics Checklist”). The Ethics Checklist is composed of 20 key questions, subdivided into 6 interrelated domains: (1) informed consent; (2) equity, diversity, and access; (3) privacy and partnerships; (4) regulation and law; (5) return of results; and (6) duty to warn and duty to report. Conclusions: Deep phenotyping research offers a vision for vastly more effective care for people with, or at risk for, psychiatric disease. The potential perils en route to realizing this vision are significant; however, and researchers must be willing to address the questions in the Ethics Checklist before embarking on each leg of the journey.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ethical use of digital health tools remains an active area of investigation, with frameworks emerging but none yet consistently adopted55,56.”
From Selecting and describing control conditions in mobile health randomized controlled trials: a proposed typology (2023) · cites this paper as [56]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Privacy in the age of medical big data
Price, W. N., & Cohen, I. G. (2019) · Nature Medicine · doi:10.1038/s41591-018-0272-7 · Cited by 1,522 · cited 1×
“” The literature on ethics of deep phenotyping has similarly identified privacy as foundational [39,40].”
BackgroundDigital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833 · cited 1×
“Ideally, this could one day include bringing interventions to patients where they are in the real world, in a convenient, efficient, effective, and timely way [5,6].”
BackgroundHarnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726
Self-citationDiversity in clinical and biomedical research: a promise yet to be fulfilled
Oh, S. S., Galanter, J., Thakur, N., Pino-Yanes, M., Barcelo, N. E., White, M. J., de Bruin, D. M., Greenblatt, R. M., Bibbins-Domingo, K., Wu, A. H. B., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001918 · Cited by 585 · cited 1×
“It is well established that biomedical research generally [28] and psychiatric research specifically struggle to enroll racially and ethnically diverse participants [29].”
BackgroundDecisional Capacity for Informed Consent in Schizophrenia Research
Carpenter, W. T. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.6.533 · Cited by 506 · cited 1×
“In addition, researchers in psychiatry must address a further question that has long been challenging for the field, “how to ensure meaningful and valid informed consent with participants who have a mental illness?” [25,26].”
BackgroundAssessing Decisional Capacity for Clinical Research or Treatment: A Review of Instruments
Dunn, L. B., Nowrangi, M. A., Palmer, B. W., Jeste, D. V., & Saks, E. R. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.8.1323 · Cited by 464 · cited 1×
“The question of decisional capacity in psychiatric research has been well researched, with multiple instruments now available [27], but the field will need to revisit the effectiveness of these instruments in the new context of deep biobehavioral research.”
BackgroundDynamic Consent: a potential solution to some of the challenges of modern biomedical research
Budin-Ljøsne, I., Teare, H. J. A., Kaye, J., Beck, S., Bentzen, H. B., Caenazzo, L., Collett, C., D’Abramo, F., Felzmann, H., Finlay, T., et al. (2017) · BMC Medical Ethics · doi:10.1186/s12910-016-0162-9 · Cited by 374 · cited 1×
“They may also consider staged informed consent [21,22], dynamic consent to facilitate 2-way communication between researchers and participants [23], or a systemic oversight approach for big data research that provides flexibility for addressing uncertainty in how data will be used [24].”
BackgroundJarvik, G. P., Amendola, L. M., Berg, J. S., Brothers, K., Clayton, E. W., Chung, W., Evans, B. J., Evans, J. P., Fullerton, S. M., Gallego, C. J., et al. (2014) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2014.04.009 · Cited by 369 · cited 1×
“The Ethics Checklist includes 4 different questions on return of results, including, “Have we considered whether our study will generate any ‘actionable’ results, based on established guidelines, and how have we defined actionability?” The concept of actionability is debated across multiple fields [50,52], and in the…”
BackgroundAvailability and quality of mobile health app privacy policies
Sunyaev, A., Dehling, T., Taylor, P. L., & Mandl, K. D. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002605 · Cited by 360 · cited 1×
“This may not be an easy task, as research on mobile health apps suggests that many vendors do not have a privacy policy publicly available [46].”
BackgroundTorous, J., Onnela, J.-P., & Keshavan, M. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.25 · Cited by 347 · cited 1×
“By combining 24/7 data—on location, movement, email and text communications, and social media—with brain scans, genetics, genomics, neuropsychological batteries, and clinical interviews, researchers will have an unprecedented amount of objective, individual-level data [2,3].”
Background
Research works printed but not linked: 3
- Solove DJ Privacy self-management and the consent dilemma Harvard Law Review 2012 11 04 126 1880 1903
- Jones OD Schall JD Shen FX Law and Neuroscience, Second Edition 2020 09 15 Philadelphia, PA, US Wolters Kluwer
- Marks M Emergent Medical Data: Health Information Inferred by Artificial Intelligence UC Irvine Law Review 2021 11 4 995 1066
Cited by
Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis
Kolbinger, F. R., Veldhuizen, G. P., Zhu, J., Truhn, D., & Kather, J. N. (2024) · Communications Medicine · doi:10.1038/s43856-024-00492-0 · Cited by 160
New and emerging approaches to treat psychiatric disorders
Scangos, K. W., State, M. W., Miller, A. H., Baker, J. T., & Williams, L. M. (2023) · Nature Medicine · doi:10.1038/s41591-022-02197-0 · Cited by 179
Self-citationSeiferth, C., Vogel, L., Aas, B., Brandhorst, I., Carlbring, P., Conzelmann, A., Esfandiari, N., Finkbeiner, M., Hollmann, K., Lautenbacher, H., et al. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00085-1 · Cited by 122
Goldberg, S. B., Sun, S., Carlbring, P., & Torous, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00923-7 · Cited by 75
Birk, R. H., & Samuel, G. N. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01358-9 · Cited by 63
“Digital phenotyping raises significant ethical questions, including ownership of data [11], sustainability [39], privacy [32], and more.”
BackgroundMethod
Metadata
- Authors
- Shen, F. X., Silverman, B. C., Monette, P., Kimble, S., Rauch, S. L., & Baker, J. T.
- Affiliations
- University of Minnesota (US)
- Harvard University (US)
- McLean Hospital (US)
- Corresponding author
- Shen, Francis X
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-02-09
- Volume
- 24
- Issue
- 2
- Pages
- e31146
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8867294
- OpenAlex
- W3211054186
- Cited by
- 43
- References
- 56
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 6 · 2023: 11 · 2022: 2
- FWCI
- 4.12
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Institutes of Health
- National Institute of Mental Health (U01MH116925)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- digital health research, psychiatry, research ethics, deep phenotyping, ethical, legal and social implications, informed consent, privacy, data sharing, duty to warn, reporting requirements, return of results, research ethics committees, legislative gaps, artificial intelligence in psychiatry, suicidality
- MeSH terms
- Artificial Intelligence, Humans, Informed Consent, Psychiatry, Privacy, Ethics Committees, Research, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.