CoChat

Development of a decision-making checklist tool to support technology selection in digital health research

Open access
Nebeker, Camille, Bartlett Ellis, Rebecca J, Torous, John · 2020 · Translational Behavioral Medicine

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Digital technologies offer researchers new approaches to test personalized and adaptive health interventions tailored to an individual. Yet, research leveraging technologies to capture personal health data involve technical and ethical consideration during the study design phase. No guidance exists to facilitate responsible digital technology selection for research purposes. A stakeholder-engaged and iterative approach was used to develop, test, and refine a checklist designed to aid researchers in selecting technologies for their research. First, stakeholders (n = 7) discussed and informed key decision-making domains to guide app/device selection derived from the American Psychiatric Association’s framework that included safety, evidence, usability, and interoperability. We added “ethical principles” to the APA’s hierarchical model and created a checklist that was used by a small group of behavioral scientists (n = 7). Findings revealed the “ethical principles” domains of respect, beneficence, and justice cut across each decision-making domains and the checklist questions/prompts were revised accordingly and can be found at thecore.ucsd.edu. The refined checklist contains four decision-making domains with prompts/questions and ethical principles embedded within the domains of privacy, risk/benefit, data management, and access/evidence. This checklist is the first step in leading the narrative of decision-making when selecting digital health technologies for research. Given the dynamic and rapidly evolving nature of digital health technology use in research, this tool will need to be further evaluated for usefulness in technology selection.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/tbm/ibz074

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 4

  1. Nebeker, 2016, Exploring mobile imaging, sensing and tracking ethics (MIST-E) in behavioral science research: participant perspectives from the iWatch study, Transl Behav Med, 6, 57
  2. US Department of Health Human Services, 2016, Examining Oversight of the Privacy & Security of Health Data Collected by Entities not Regulated by HIPAA
  3. U.S. Department of Health and Human Services, 45 CFR 46, 1991, Subpart A––basic HHS policy for protection of human research subjects, Fed Reg, 56, 28012
  4. Saldaña, 2015, The Coding Manual for Qualitative Researchers

Cited by

See all 99

Metadata

Authors
Nebeker, C., Bartlett Ellis, R. J., & Torous, J.
Affiliations
  • University of California San Diego (US)
  • Indiana University School of Nursing, Indianapolis, IN, USA
  • Beth Israel Deaconess Medical Center (US)
Corresponding author
Nebeker, Camille
Venue
Translational Behavioral Medicine
Published
2019-05-23
Volume
10
Issue
4
Pages
1004-1015
ISSN
  • 1613-9860 (ISSN-L)
  • 1869-6716
OpenAlex
W2945020779
Cited by
99
References
13
Citations by year
2026: 10 · 2025: 10 · 2024: 18 · 2023: 12 · 2022: 16 · 2021: 19 · 2020: 11 · 2019: 3
FWCI
16.69
Type
journal article
Language
en
Open access
Locations
  • Translational Behavioral Medicine (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • IUScholarWorks (Indiana University) (submittedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
Funders
  • Robert Wood Johnson Foundation (#72876)
  • National Institute of Mental Health (1K23MH116130-01)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
Keywords
research ethics, ethical principles, privacy, risk-benefit assessment, data management, interoperability, stakeholder engagement
MeSH terms
Humans, Research Design, Technology, Biomedical Technology, Checklist

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Development of a decision-making checklist tool to support technology selection in digital health research. https://app.cochat.ai/papers/10.1093/tbm/ibz074
The paper
Nebeker, C., Bartlett Ellis, R. J., & Torous, J. (2020). Development of a decision-making checklist tool to support technology selection in digital health research. Translational Behavioral Medicine. https://doi.org/10.1093/tbm/ibz074

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.