The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Outcome measures based on digital health technology sensor data: data- and patient-centric approaches
Open accessAbstract
Digital health technology tools (DHTTs) are digital tools that remotely and frequently acquire health and disease-related data from individuals (see Table 1 for a list of terms and definitions used here). DHTTs are becoming a standard part of clinical research studies in which patients collect two basic modalities of sensor data 1 , 2 , 3 , 4 , 5 , 6 , 7 : (1) sensor data can be captured while patients perform specific tasks designed to measure key symptoms (“active tests”) and (2) sensors may monitor human behavior passively (“passive monitoring”). Active tests can be administered, e.g., using tablets, smartphones, and to a limited extent also smartwatches. Passive data can be collected using a wide range of devices such as smartphones, smartwatches, wearables, beacons, nearables, and smart patches. Digital sensors can sample behavior at a frequency many times higher than is possible during traditional in-clinic testing. Thus, there are many advantages to the use of this technology in clinical research. Firstly, information is collected from patients much more frequently than would be possible at infrequent clinic visits, with the potential to increase the signal to noise and increasing reliability and validity 8 and the measures’ ability to detect change over time 9 . Secondly, the acquired data are objective: while trained healthcare professionals have a wealth of knowledge with which to characterize and treat patients’ symptoms, the reliance on such ratings necessarily adds a subjective component to assessments including possible increased interrater variability and decreased reliability (e.g., see ref. 10 ). Thirdly, data are collected in the environment in which individuals actually live and work, generating ecologically valid measurements, i.e., ones which approximate the real world. A fourth key advantage is the amount of sensor data generated (e.g., via continuous 50 Hz sampling), promising the phenotypic characterization of patients with an unprecedented breadth and precision. These advantages have led to DHTTs being used with increasing frequency in clinical trials and observational studies to complement traditional clinical outcome assessments (COA) and biomarkers. However, one of the chief open questions now facing the field is what to do with this vast amount of sensor data, i.e., how can patients’ sensor data be integrated into one or several outcome measures which meaningfully recapitulate the clinical status of the patient 5 , 11 ?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In recent years, consumer-grade mobile applications (app.) and wearable devices have shown promise to objectively measure participants’ symptoms during daily life7; these digital health technologies (DHT) tools8 have shown to increase study engagement, improve patient convenience, streamline collection of PROs9, and potentially generate more frequent and accurate data that can characterise disease”
From Digital health technologies and machine learning augment patient reported outcomes to remotely characterise rheumatoid arthritis (2024) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522 · cited 1×
“Cross-validation and boot-strapping assess the robustness of each candidate model and generate estimates of variability to facilitate model selection 27 , which can be based on two criteria: minimizing variability of the cross-validation (minimization criterion) and maximizing the change over time…”
MethodThe role and validity of actigraphy in sleep medicine: an update
Sadeh, A. (2011) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2010.10.001 · Cited by 1,415 · cited 2×
“We note that this approach can be applied to any DHTT and corresponding disease area, e.g., actigraphy data to quantify sleep quality 21 or photoplethysmography data from, e.g., the Apple Watch to quantify cardiovascular health 22 , as described in the Conclusions section.”
MethodGhamari, M. (2018) · International Journal of Biosensors & Bioelectronics · doi:10.15406/ijbsbe.2018.04.00125 · Cited by 945 · cited 2×
“We note that this approach can be applied to any DHTT and corresponding disease area, e.g., actigraphy data to quantify sleep quality 21 or photoplethysmography data from, e.g., the Apple Watch to quantify cardiovascular health 22 , as described in the Conclusions section.”
MethodTechnology in Parkinson’s disease: challenges and opportunities
Espay, A. J., Bonato, P., Nahab, F. B., Maetzler, W., Dean, J. M., Klucken, J., Eskofier, B. M., Merola, A., Horak, F., Lang, A. E., et al. (2016) · Movement Disorders · doi:10.1002/mds.26642 · Cited by 654
The mPower study, Parkinson disease mobile data collected using ResearchKit
Bot, B. M., Suver, C., Neto, E. C., Kellen, M., Klein, A., Bare, C., Doerr, M., Pratap, A., Wilbanks, J., Dorsey, E. R., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.11 · Cited by 630
Turakhia, M. P., Desai, M., Hedlin, H., Rajmane, A., Talati, N., Ferris, T., Desai, S., Nag, D., Patel, M., Kowey, P., et al. (2019) · American Heart Journal · doi:10.1016/j.ahj.2018.09.002 · Cited by 474 · cited 1×
“For example, such approaches are underway with smartwatch photoplethysmogra-phy data to identify individuals with potentially undiagnosed atrial fi brillation 35 , e.g., in the Apple Watch Study 36 , and to identify perceived stress levels 37 .”
BackgroundDetecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study
Arora, S., Venkataraman, V., Zhan, A., Donohue, S., Biglan, K. M., Dorsey, E. R., & Little, M. A. (2015) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2015.02.026 · Cited by 387
Zhan, A., Mohan, S., Tarolli, C., Schneider, R. B., Adams, J. L., Sharma, S., Elson, M. J., Spear, K. L., Glidden, A. M., Little, M. A., et al. (2018) · JAMA Neurology · doi:10.1001/jamaneurol.2018.0809 · Cited by 381
Research works printed but not linked: 2
- Yang, J. & Honavar, V. In: Liu, H., Motoda, H. (eds) Feature Extraction, Construction and Selection 453 (Springer, 1998).
- Food and Drug Administration. Patient-Focused Drug Development Guidance Public Workshop: Incorporating Clinical Outcome Assessments into Endpoints for Regulatory Decision-Making, Silver Spring, MD, 6 December (FDA, 2019). https://globalforum.diaglobal.org/issue/june-2019/regulatory-perspective-digital-health-technology-tools/.
Cited by
Creagh, A. P., Hamy, V., Yuan, H., Mertes, G., Tomlinson, R., Chen, W.-H., Williams, R., Llop, C., Yee, C., Duh, M. S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01013-y · Cited by 64
“3b (expanded in Supplementary Table 6).”
BackgroundMethodInfluentialCreagh, A. P., Hamy, V., Yuan, H., Mertes, G., Tomlinson, R., Chen, W.-H., Williams, R., Llop, C., Yee, C., Duh, M. S., et al. (2022) · doi:10.1101/2022.11.18.22282305 · Cited by 64
Mammen, J. R., Speck, R. M., Stebbins, G. M., Müller, M. L. T. M., Yang, P. T., Campbell, M., Cosman, J., Crawford, J. E., Dam, T., Hellsten, J., et al. (2023) · Journal of Parkinson’s Disease · doi:10.3233/jpd-225122 · Cited by 38
Roussos, G., Herrero, T. R., Hill, D. L., Dowling, A. V., L. T. M. Müller, M., Evers, L. J. W., Burton, J., Derungs, A., Fisher, K., Kilambi, K. P., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00643-4 · Cited by 28
Metadata
- Authors
- Taylor, K. I., Staunton, H., Lipsmeier, F., Nobbs, D., & Lindemann, M.
- Affiliations
- F. Hoffmann-La Roche AG (CH)
- Roche (United Kingdom) (GB)
- Corresponding author
- Taylor, Kirsten I.
- Venue
- npj Digital Medicine
- Published
- 2020-07-23
- Volume
- 3
- Issue
- 1
- Pages
- 97-97
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC7378210
- OpenAlex
- W3044978152
- Cited by
- 85
- References
- 34
- Citations by year
- 2026: 9 · 2025: 16 · 2024: 16 · 2023: 12 · 2022: 20 · 2021: 10 · 2020: 1
- FWCI
- 11.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- F. Hoffmann-La Roche
- Prothena
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Keywords
- digital health technologies, sensor data, outcome measures, passive monitoring, wearable devices, smartphone sensors, clinical outcome assessment, clinical trials, phenotypic characterization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Outcome measures based on digital health technology sensor data: data- and patient-centric approaches. https://app.cochat.ai/papers/10.1038/s41746-020-0305-8
- The paper
- Taylor, K. I., Staunton, H., Lipsmeier, F., Nobbs, D., & Lindemann, M. (2020). Outcome measures based on digital health technology sensor data: data- and patient-centric approaches. npj Digital Medicine. https://doi.org/10.1038/s41746-020-0305-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.