Comparing laboratory and in-the-wild data for continuous Parkinson’s Disease tremor detection
Open accessAbstract
Passive, continuous monitoring of Parkinson's Disease (PD) symptoms in the wild (i.e., in home environments) could improve disease management, thereby improving a patient's quality of life.We envision a system that uses machine learning to automatically detect PD symptoms from accelerometer data collected in the wild.Building such systems, however, is challenging because it is difficult to obtain labels of symptom occurrences in the wild.Many researchers therefore train machine learning algorithms on laboratory data with the assumption that findings will translate to the wild.This paper assesses how well laboratory data represents wild data by comparing PD symptom (tremor) detection performance of three models on both lab and wild data.Findings indicate that, for this application, laboratory data is not a good representation of wild data.Results also show that training on wild data, even though labels are less precise, leads to better performance on wild data than training on accurate labels from laboratory data.Clinical relevance-Results in this paper suggest that, when building a system for in-the-wild PD symptom detection, it is better to train machine learning algorithms on data from the wild as opposed to from the lab, even though wild labels are less precise.This paper also presents a newly released dataset for PD tremor detection in lab and wild environments.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Zhang et al. developed both a generic model and a person-specific model using an SVM classifier and achieved best accuracies of 80.7% and 85.9%.
“In comparison, Zhang et al. [45] developed both generic model and personspecific model using SVM classifier and achieved best accuracy of 80.7% and 85.9%.”
From Detection and Quantification of Resting Tremor in Parkinson's Disease Using Long-Term Acceleration Data (2021) · cites this paper as [45]
Cites
The mPower study, Parkinson disease mobile data collected using ResearchKit
Bot, B. M., Suver, C., Neto, E. C., Kellen, M., Klein, A., Bare, C., Doerr, M., Pratap, A., Wilbanks, J., Dorsey, E. R., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.11 · Cited by 630 · see citing works
Salarian, A., Russmann, H., Wider, C., Burkhard, P. R., Vingerhoets, F. J. G., & Aminian, K. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2006.886670 · Cited by 416 · see citing works
Lipsmeier, F., Taylor, K. I., Kilchenmann, T., Wolf, D., Scotland, A., Schjodt‐Eriksen, J., Cheng, W., Fernandez‐Garcia, I., Siebourg‐Polster, J., Jin, L., et al. (2018) · Movement Disorders · doi:10.1002/mds.27376 · Cited by 266 · see citing works
Kubota, K. J., Chen, J. A., & Little, M. A. (2016) · Movement Disorders · doi:10.1002/mds.26693 · Cited by 210 · see citing works
PD Disease State Assessment in Naturalistic Environments Using Deep Learning
Hammerla, N., Fisher, J., Andras, P., Rochester, L., Walker, R., & Ploetz, T. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9484 · Cited by 179 · see citing works
Feasibility of large-scale deployment of multiple wearable sensors in Parkinson's disease
Silva de Lima, A. L., Hahn, T., Evers, L. J. W., de Vries, N. M., Cohen, E., Afek, M., Bataille, L., Daeschler, M., Claes, K., Boroojerdi, B., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0189161 · Cited by 162 · see citing works
New methods for the assessment of Parkinson's disease (2005 to 2015): A systematic review
Sánchez‐Ferro, Á., Elshehabi, M., Godinho, C., Salkovic, D., Hobert, M. A., Domingos, J., van Uem, J. M., Ferreira, J. J., & Maetzler, W. (2016) · Movement Disorders · doi:10.1002/mds.26723 · Cited by 145 · see citing works
Large-Scale Wearable Sensor Deployment in Parkinson’s Patients: The Parkinson@Home Study Protocol
Silva de Lima, A. L., Hahn, T., de Vries, N. M., Cohen, E., Bataille, L., Little, M. A., Baldus, H., Bloem, B. R., & Faber, M. J. (2016) · JMIR Research Protocols · doi:10.2196/resprot.5990 · Cited by 63 · see citing works
Zhan, A., Little, M. A., Harris, D. A., Abiola, S. O., Dorsey, E. R., Saria, S., & Terzis, A. (2016) · arXiv · doi:10.48550/arxiv.1601.00960 · Cited by 50 · see citing works
Weakly-supervised learning for Parkinson's Disease tremor detection
Zhang, A., Cebulla, A., Panev, S., Hodgins, J., & De la Torre, F. (2017) · 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8036782 · Cited by 22 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Yuan, H., Liu, S., Liu, J., Lin, H., Yang, C., Cai, X., Zeng, L., & Li, S. (2021) · Mathematical Problems in Engineering · doi:10.1155/2021/5669932 · Cited by 10 · see citing works
- Authors
- Zhang, A., De la Torre, F., & Hodgins, J.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
- Publisher
- IEEE
- Published
- 2020-07
- Volume
- 2020
- Pages
- 5436-5441
- ISSN
- 2375-7477 (ISSN-L)
- OpenAlex
- W3082581423
- Cited by
- 12
- References
- 10
- Citations by year
- 2026: 1 · 2025: 2 · 2023: 1 · 2022: 5 · 2021: 2 · 2020: 1
- FWCI
- 0.69
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (1602337)
- Center for Machine Learning and Health, School of Computer Science, Carnegie Mellon University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Keywords
- Parkinson's disease, tremor detection, in-the-wild data, laboratory findings, accelerometer data, distribution shift, family environment
- MeSH terms
- Machine Learning, Algorithms, Humans, Parkinson Disease, Quality of Life, Tremor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
