CoChat

Unobtrusive detection of Parkinson’s disease from multi-modal and in-the-wild sensor data using deep learning techniques

Open access
Papadopoulos, Alexandros, Iakovakis, Dimitrios, Klingelhoefer, Lisa, Bostantjopoulou, Sevasti, Chaudhuri, K. Ray, Kyritsis, Konstantinos, Hadjidimitriou, Stelios, Charisis, Vasileios, Hadjileontiadis, Leontios J., Delopoulos, Anastasios · 2020 · Scientific Reports
Cited by 51

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Parkinson’s Disease (PD) is the second most common neurodegenerative disorder, affecting more than 1% of the population above 60 years old with both motor and non-motor symptoms of escalating severity as it progresses. Since it cannot be cured, treatment options focus on the improvement of PD symptoms. In fact, evidence suggests that early PD intervention has the potential to slow down symptom progression and improve the general quality of life in the long term. However, the initial motor symptoms are usually very subtle and, as a result, patients seek medical assistance only when their condition has substantially deteriorated; thus, missing the opportunity for an improved clinical outcome. This situation highlights the need for accessible tools that can screen for early motor PD symptoms and alert individuals to act accordingly. Here we show that PD and its motor symptoms can unobtrusively be detected from the combination of accelerometer and touchscreen typing data that are passively captured during natural user-smartphone interaction. To this end, we introduce a deep learning framework that analyses such data to simultaneously predict tremor, fine-motor impairment and PD. In a validation dataset from 22 clinically-assessed subjects (8 Healthy Controls (HC)/14 PD patients with a total data contribution of 18.305 accelerometer and 2.922 typing sessions), the proposed approach achieved 0.86/0.93 sensitivity/specificity for the binary classification task of HC versus PD. Additional validation on data from 157 subjects (131 HC/26 PD with a total contribution of 76.528 accelerometer and 18.069 typing sessions) with self-reported health status (HC or PD), resulted in area under curve of 0.87, with sensitivity/specificity of 0.92/0.69 and 0.60/0.92 at the operating points of highest sensitivity or specificity, respectively. Our findings suggest that the proposed method can be used as a stepping stone towards the development of an accessible PD screening tool that will passively monitor the subject-smartphone interaction for signs of PD and which could be used to reduce the critical gap between disease onset and start of treatment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-020-78418-8

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 29

  1. Wang, H. et al. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the global burden of disease study 2015. The Lancet 388, 1459–1544 (2016). · DOI · Paper page
  2. Murman, D. L. Early treatment of parkinson’s disease: opportunities for managed care. Am. J. Managed Care 18, S183-8 (2012).
  3. Lima, L. O., Scianni, A. & de Paula, F. R. Progressive resistance exercise improves strength and physical performance in people with mild to moderate parkinson’s disease: a systematic review. J. Physiother. 59, 7–13. https://doi.org/10.1016/S1836-9553(13)70141-3 (2013). · DOI · Paper page
  4. Fahn, S. et al. Recent developments in parkinson’s disease. Ann. Neurol. 22, 672–672. https://doi.org/10.1002/ana.410220556 (1987). · doi:10.1002/ana.410220556
  5. Drotár, P. et al. Evaluation of handwriting kinematics and pressure for differential diagnosis of parkinson’s disease. Artif. Intell. Med. 67, 39–46. https://doi.org/10.1016/j.artmed.2016.01.004 (2016). · DOI · Paper page
  6. Giancardo, L. et al. Computer keyboard interaction as an indicator of early parkinson’s disease. Sci. Rep. 5, 34468. https://doi.org/10.1038/srep34468 (2016). · DOI · Paper page
  7. Hadjidimitriou, S. et al. Active and healthy ageing for parkinson’s disease patients’ support: A user’s perspective within the i-prognosis framework. In 2016 1st International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW), 1–8 (2016). · DOI
  8. Schmidhuber, J. Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015). · DOI · Paper page
  9. Barth, J. et al. Combined analysis of sensor data from hand and gait motor function improves automatic recognition of parkinson’s disease. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 5122–5125 (IEEE, 2012). · DOI · Paper page
  10. Chang, H., Hsu, Y., Yang, S., Lin, J. & Wu, Z. A wearable inertial measurement system with complementary filter for gait analysis of patients with stroke or parkinson’s disease. IEEE Access 4, 8442–8453 (2016). · DOI
  11. Cuzzolin, F. et al. Metric learning for parkinsonian identification from imu gait measurements. Gait & Posture 54, 127–132 (2017). · DOI
  12. Caramia, C. et al. Imu-based classification of parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J. Biomed. Health Inform. 22, 1765–1774. https://doi.org/10.1109/JBHI.2018.2865218 (2018). · DOI · Paper page
  13. Daneault, J.-F., Carignan, B., Éric Codère, C., Sadikot, A. & Duval, C. Using a smart phone as a standalone platform for detection and monitoring of pathological tremors. Front. Hum. Neurosci. 6, 357. https://doi.org/10.3389/fnhum.2012.00357 (2012). · DOI · Paper page
  14. Dai, H., Zhang, P. & Lueth, T. C. Quantitative assessment of parkinsonian tremor based on an inertial measurement unit. Sensors 15, 25055–25071 (2015). · DOI · Paper page
  15. Orozco-Arroyave, J. R. et al. Towards an automatic monitoring of the neurological state of parkinson’s patients from speech. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 6490–6494 (IEEE, 2016). · DOI · Paper page
  16. Cernak, M. et al. Characterisation of voice quality of parkinson’s disease using differential phonological posterior features. Comput. Speech Lang. 46, 196–208 (2017). · DOI · Paper page
  17. Gunduz, H. Deep learning-based parkinson’s disease classification using vocal feature sets. IEEE Access 7, 115540–115551. https://jnnp.bmj.com/content/79/4/368.full.pdf0 (2019). · DOI · Paper page
  18. Iakovakis, D. et al. Touchscreen typing-pattern analysis for detecting fine motor skills decline in early-stage parkinson’s disease. Sci. Rep.https://doi.org/10.1038/s41598-018-25999-0 (2018). · DOI · Paper page
  19. Iakovakis, D. et al. Motor impairment estimates via touchscreen typing dynamics toward parkinson’s disease detection from data harvested in-the-wild. Front. ICT 5, 28 (2018). · DOI
  20. Pereira, C. R. et al. A new computer vision-based approach to aid the diagnosis of parkinson’s disease. Comput. Methods Programs Biomed. 136, 79–88. https://jnnp.bmj.com/content/79/4/368.full.pdf1 (2016). · DOI · Paper page
  21. Vásquez-Correa, J. C. et al. Multi-view representation learning via gcca for multimodal analysis of parkinson’s disease. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2966–2970 (2017). · DOI · Paper page
  22. Zhan, A. et al. Using smartphones and machine learning to quantify parkinson disease severity: the mobile Parkinson disease score. JAMA Neurol.75, 876–880. https://doi.org/10.1001/jamaneurol.2018.0809(2018). https://jamanetwork.com/journals/jamaneurology/articlepdf/2676504/jamaneurology_zhan_2018_br_180003.pdf. · DOI · Paper page
  23. Das, S. et al. Detecting parkinsons’ symptoms in uncontrolled home environments: a multiple instance learning approach. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 3688–3691 (IEEE, 2012). · DOI · Paper page
  24. Shirlow, M. & Mathers, C. A study of caffeine consumption and symptoms: indigestion, palpitations, tremor, headache and insomnia. Int. J. Epidemiol. 14, 239–248 (1985). · DOI
  25. Ilse, M., Tomczak, J. & Welling, M. Attention-based deep multiple instance learning. In Proceedings of the 35th International Conference on Machine Learning, 2127–2136 (2018).
  26. Zaheer, M. et al. Deep sets. In Advances in Neural Information Processing Systems 30, 3391–3401 (NIPS, 2017).
  27. Bahdanau, D., Cho, K. & Bengio, Y. Neural machine translation by jointly learning to align and translate. arXiv:1409.0473 (2014). · arXiv
  28. Klingelhoefer, L. et al. Medical evaluation as gold standard to control iprognosis application derived data for early parkinson’s disease detection. Mov. Disord. 34, S913–S914 (2019).
  29. Kingma, D. P. & Ba, J. Adam: A method for stochastic optimization. arXiv:1412.6980 (2014). · arXiv

Cited by

See all 51

Metadata

Authors
Papadopoulos, A., Iakovakis, D., Klingelhoefer, L., Bostantjopoulou, S., Chaudhuri, K. R., Kyritsis, K., Hadjidimitriou, S., Charisis, V., Hadjileontiadis, L. J., & Delopoulos, A.
Venue
Scientific Reports
Published
2020-12-07
Volume
10
Issue
1
Pages
21370-21370
ISSN
2045-2322 (ISSN-L)
OpenAlex
W3111834362
Cited by
51
References
13
FWCI
3.12
Type
journal article
Language
en
Open access
gold
Licence
Funders
Horizon 2020 (690494)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Unobtrusive detection of Parkinson’s disease from multi-modal and in-the-wild sensor data using deep learning techniques. https://app.cochat.ai/papers/10.1038/s41598-020-78418-8
The paper
Papadopoulos, A., Iakovakis, D., Klingelhoefer, L., Bostantjopoulou, S., Chaudhuri, K. R., Kyritsis, K., Hadjidimitriou, S., Charisis, V., Hadjileontiadis, L. J., & Delopoulos, A. (2020). Unobtrusive detection of Parkinson’s disease from multi-modal and in-the-wild sensor data using deep learning techniques. Scientific Reports. https://doi.org/10.1038/s41598-020-78418-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.