Unobtrusive detection of Parkinson’s disease from multi-modal and in-the-wild sensor data using deep learning techniques
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Parkinson’s Disease (PD) is the second most common neurodegenerative disorder, affecting more than 1% of the population above 60 years old with both motor and non-motor symptoms of escalating severity as it progresses. Since it cannot be cured, treatment options focus on the improvement of PD symptoms. In fact, evidence suggests that early PD intervention has the potential to slow down symptom progression and improve the general quality of life in the long term. However, the initial motor symptoms are usually very subtle and, as a result, patients seek medical assistance only when their condition has substantially deteriorated; thus, missing the opportunity for an improved clinical outcome. This situation highlights the need for accessible tools that can screen for early motor PD symptoms and alert individuals to act accordingly. Here we show that PD and its motor symptoms can unobtrusively be detected from the combination of accelerometer and touchscreen typing data that are passively captured during natural user-smartphone interaction. To this end, we introduce a deep learning framework that analyses such data to simultaneously predict tremor, fine-motor impairment and PD. In a validation dataset from 22 clinically-assessed subjects (8 Healthy Controls (HC)/14 PD patients with a total data contribution of 18.305 accelerometer and 2.922 typing sessions), the proposed approach achieved 0.86/0.93 sensitivity/specificity for the binary classification task of HC versus PD. Additional validation on data from 157 subjects (131 HC/26 PD with a total contribution of 76.528 accelerometer and 18.069 typing sessions) with self-reported health status (HC or PD), resulted in area under curve of 0.87, with sensitivity/specificity of 0.92/0.69 and 0.60/0.92 at the operating points of highest sensitivity or specificity, respectively. Our findings suggest that the proposed method can be used as a stepping stone towards the development of an accessible PD screening tool that will passively monitor the subject-smartphone interaction for signs of PD and which could be used to reduce the critical gap between disease onset and start of treatment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MDS clinical diagnostic criteria for Parkinson’s disease
Postuma, R. B., Berg, D., Stern, M., Poewe, W., Olanow, C. W., Oertel, W., Obeso, J., Marek, K., Litvan, I., Lang, A. E., et al. (2015) · Movement Disorders · doi:10.1002/mds.26424 · Cited by 7,653
Parkinson's disease: clinical features and diagnosis
Jankovic, J. (2008) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2007.131045 · Cited by 5,720
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Alzheimer's Disease and Parkinson's Disease
Nussbaum, R. L., & Ellis, C. E. (2003) · New England Journal of Medicine · doi:10.1056/nejm2003ra020003 · Cited by 1,351
Multiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740
Novel Speech Signal Processing Algorithms for High-Accuracy Classification of Parkinson’s Disease
Tsanas, A., Little, M. A., McSharry, P. E., Spielman, J., & Ramig, L. O. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2183367 · Cited by 732
Detecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study
Arora, S., Venkataraman, V., Zhan, A., Donohue, S., Biglan, K. M., Dorsey, E. R., & Little, M. A. (2015) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2015.02.026 · Cited by 387
Multimodal assessment of Parkinson’s disease: a deep learning approach
Vasquez-Correa, J. C., Arias-Vergara, T., Orozco-Arroyave, J. R., Eskofier, B., Klucken, J., & Noth, E. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2866873 · Cited by 262
The pathophysiology of parkinsonian tremor: a review
Deuschl, G., Raethjen, J., Baron, R., Lindemann, M., Wilms, H., & Krack, P. (2000) · Journal of Neurology · doi:10.1007/pl00007781 · Cited by 251
The use of smartphones for health research
Dorsey, E. R., “Yvonne” Chan, Y.-F., McConnell, M. V., Shaw, S. Y., Trister, A. D., & Friend, S. H. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001205 · Cited by 154
Research works printed but not linked: 29
- Wang, H. et al. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the global burden of disease study 2015. The Lancet 388, 1459–1544 (2016). · DOI · Paper page
- Murman, D. L. Early treatment of parkinson’s disease: opportunities for managed care. Am. J. Managed Care 18, S183-8 (2012).
- Lima, L. O., Scianni, A. & de Paula, F. R. Progressive resistance exercise improves strength and physical performance in people with mild to moderate parkinson’s disease: a systematic review. J. Physiother. 59, 7–13. https://doi.org/10.1016/S1836-9553(13)70141-3 (2013). · DOI · Paper page
- Fahn, S. et al. Recent developments in parkinson’s disease. Ann. Neurol. 22, 672–672. https://doi.org/10.1002/ana.410220556 (1987). · doi:10.1002/ana.410220556
- Drotár, P. et al. Evaluation of handwriting kinematics and pressure for differential diagnosis of parkinson’s disease. Artif. Intell. Med. 67, 39–46. https://doi.org/10.1016/j.artmed.2016.01.004 (2016). · DOI · Paper page
- Giancardo, L. et al. Computer keyboard interaction as an indicator of early parkinson’s disease. Sci. Rep. 5, 34468. https://doi.org/10.1038/srep34468 (2016). · DOI · Paper page
- Hadjidimitriou, S. et al. Active and healthy ageing for parkinson’s disease patients’ support: A user’s perspective within the i-prognosis framework. In 2016 1st International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW), 1–8 (2016). · DOI
- Schmidhuber, J. Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015). · DOI · Paper page
- Barth, J. et al. Combined analysis of sensor data from hand and gait motor function improves automatic recognition of parkinson’s disease. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 5122–5125 (IEEE, 2012). · DOI · Paper page
- Chang, H., Hsu, Y., Yang, S., Lin, J. & Wu, Z. A wearable inertial measurement system with complementary filter for gait analysis of patients with stroke or parkinson’s disease. IEEE Access 4, 8442–8453 (2016). · DOI
- Cuzzolin, F. et al. Metric learning for parkinsonian identification from imu gait measurements. Gait & Posture 54, 127–132 (2017). · DOI
- Caramia, C. et al. Imu-based classification of parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J. Biomed. Health Inform. 22, 1765–1774. https://doi.org/10.1109/JBHI.2018.2865218 (2018). · DOI · Paper page
- Daneault, J.-F., Carignan, B., Éric Codère, C., Sadikot, A. & Duval, C. Using a smart phone as a standalone platform for detection and monitoring of pathological tremors. Front. Hum. Neurosci. 6, 357. https://doi.org/10.3389/fnhum.2012.00357 (2012). · DOI · Paper page
- Dai, H., Zhang, P. & Lueth, T. C. Quantitative assessment of parkinsonian tremor based on an inertial measurement unit. Sensors 15, 25055–25071 (2015). · DOI · Paper page
- Orozco-Arroyave, J. R. et al. Towards an automatic monitoring of the neurological state of parkinson’s patients from speech. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 6490–6494 (IEEE, 2016). · DOI · Paper page
- Cernak, M. et al. Characterisation of voice quality of parkinson’s disease using differential phonological posterior features. Comput. Speech Lang. 46, 196–208 (2017). · DOI · Paper page
- Gunduz, H. Deep learning-based parkinson’s disease classification using vocal feature sets. IEEE Access 7, 115540–115551. https://jnnp.bmj.com/content/79/4/368.full.pdf0 (2019). · DOI · Paper page
- Iakovakis, D. et al. Touchscreen typing-pattern analysis for detecting fine motor skills decline in early-stage parkinson’s disease. Sci. Rep.https://doi.org/10.1038/s41598-018-25999-0 (2018). · DOI · Paper page
- Iakovakis, D. et al. Motor impairment estimates via touchscreen typing dynamics toward parkinson’s disease detection from data harvested in-the-wild. Front. ICT 5, 28 (2018). · DOI
- Pereira, C. R. et al. A new computer vision-based approach to aid the diagnosis of parkinson’s disease. Comput. Methods Programs Biomed. 136, 79–88. https://jnnp.bmj.com/content/79/4/368.full.pdf1 (2016). · DOI · Paper page
- Vásquez-Correa, J. C. et al. Multi-view representation learning via gcca for multimodal analysis of parkinson’s disease. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2966–2970 (2017). · DOI · Paper page
- Zhan, A. et al. Using smartphones and machine learning to quantify parkinson disease severity: the mobile Parkinson disease score. JAMA Neurol.75, 876–880. https://doi.org/10.1001/jamaneurol.2018.0809(2018). https://jamanetwork.com/journals/jamaneurology/articlepdf/2676504/jamaneurology_zhan_2018_br_180003.pdf. · DOI · Paper page
- Das, S. et al. Detecting parkinsons’ symptoms in uncontrolled home environments: a multiple instance learning approach. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 3688–3691 (IEEE, 2012). · DOI · Paper page
- Shirlow, M. & Mathers, C. A study of caffeine consumption and symptoms: indigestion, palpitations, tremor, headache and insomnia. Int. J. Epidemiol. 14, 239–248 (1985). · DOI
- Ilse, M., Tomczak, J. & Welling, M. Attention-based deep multiple instance learning. In Proceedings of the 35th International Conference on Machine Learning, 2127–2136 (2018).
- Zaheer, M. et al. Deep sets. In Advances in Neural Information Processing Systems 30, 3391–3401 (NIPS, 2017).
- Bahdanau, D., Cho, K. & Bengio, Y. Neural machine translation by jointly learning to align and translate. arXiv:1409.0473 (2014). · arXiv
- Klingelhoefer, L. et al. Medical evaluation as gold standard to control iprognosis application derived data for early parkinson’s disease detection. Mov. Disord. 34, S913–S914 (2019).
- Kingma, D. P. & Ba, J. Adam: A method for stochastic optimization. arXiv:1412.6980 (2014). · arXiv
Cited by
Multi-modality approaches for medical support systems: A systematic review of the last decade
Salvi, M., Loh, H. W., Seoni, S., Barua, P. D., García, S., Molinari, F., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102134 · Cited by 144
Paolillo, E. W., Casaletto, K. B., Clark, A. L., Taylor, J. C., Heuer, H. W., Wise, A. B., Dhanam, S., Sanderson-Cimino, M., Saloner, R., Kramer, J. H., et al. (2024) · JMIR Aging · doi:10.2196/52831 · Cited by 16
Mahali, M. I., Leu, J.-S., Avian, C., Darmawan, J. T., Faisal, M., Putro, N. A. S., & Prakosa, S. W. (2025) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2025.106599 · Cited by 1
Metadata
- Authors
- Papadopoulos, A., Iakovakis, D., Klingelhoefer, L., Bostantjopoulou, S., Chaudhuri, K. R., Kyritsis, K., Hadjidimitriou, S., Charisis, V., Hadjileontiadis, L. J., & Delopoulos, A.
- Venue
- Scientific Reports
- Published
- 2020-12-07
- Volume
- 10
- Issue
- 1
- Pages
- 21370-21370
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W3111834362
- Cited by
- 51
- References
- 13
- FWCI
- 3.12
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Horizon 2020 (690494)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Unobtrusive detection of Parkinson’s disease from multi-modal and in-the-wild sensor data using deep learning techniques. https://app.cochat.ai/papers/10.1038/s41598-020-78418-8
- The paper
- Papadopoulos, A., Iakovakis, D., Klingelhoefer, L., Bostantjopoulou, S., Chaudhuri, K. R., Kyritsis, K., Hadjidimitriou, S., Charisis, V., Hadjileontiadis, L. J., & Delopoulos, A. (2020). Unobtrusive detection of Parkinson’s disease from multi-modal and in-the-wild sensor data using deep learning techniques. Scientific Reports. https://doi.org/10.1038/s41598-020-78418-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.