Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
The ubiquity and remarkable technological progress of wearable consumer devices and mobile-computing platforms (smart phone, smart watch, tablet), along with the multitude of sensor modalities available, have enabled continuous monitoring of patients and their daily activities. Such rich, longitudinal information can be mined for physiological and behavioral signatures of cognitive impairment and provide new avenues for detecting MCI in a timely and cost-effective manner. In this work, we present a platform for remote and unobtrusive monitoring of symptoms related to cognitive impairment using several consumer-grade smart devices. We demonstrate how the platform has been used to collect a total of 16TB of data during the Lilly Exploratory Digital Assessment Study, a 12-week feasibility study which monitored 31 people with cognitive impairment and 82 without cognitive impairment in free living conditions. We describe how careful data unification, time-alignment, and imputation techniques can handle missing data rates inherent in real-world settings and ultimately show utility of these disparate data in differentiating symptomatics from healthy controls based on features computed purely from device data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment
Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53221.x · Cited by 25,553 · cited 1×
“Common clinical screening tools for cognitive impairment, such as the Mini Mental State Examination [12] or the Montreal Cognitive Assessment [31], do not consistently detect the earliest stages of cognitive impairment [19].”
MethodA Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
Jack, C. R., Albert, M. S., Knopman, D. S., McKhann, G. M., Sperling, R. A., Carrillo, M. C., Thies, B., & Phelps, C. H. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.004 · Cited by 2,042 · cited 1×
“Participants with MCI and mild AD dementia had to meet the NIA-AA coreclinical criteriafortheirrespectiveADdiseasestates[21].”
MethodMissed and Delayed Diagnosis of Dementia in Primary Care: Prevalence and Contributing Factors
Bradford, A., Kunik, M. E., Schulz, P., Williams, S. P., & Singh, H. (2009) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e3181a6bebc · Cited by 969 · cited 1×
“Early symptoms are subtle, insidious, and easily dismissed as "normal aging" [5].”
BackgroundLearning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
Maruff, P., Thomas, E., Cysique, L., Brew, B., Collie, A., Snyder, P., & Pietrzak, R. H. (2009) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acp010 · Cited by 635
Detecting Cancer Metastases on Gigapixel Pathology Images
Liu, Y., Gadepalli, K., Norouzi, M., Dahl, G. E., Kohlberger, T., Boyko, A., Venugopalan, S., Timofeev, A., Nelson, P. Q., Corrado, G. S., et al. (2017) · arXiv · doi:10.48550/arxiv.1703.02442 · Cited by 506 · cited 1×
“To overcome this limitation we use a data augmentation technique, popular for data-inefficient applications such as CNN for image classification [27].”
MethodDigital biomarkers for Alzheimer’s disease: the mobile/wearable devices opportunity
Kourtis, L. C., Regele, O. B., Wright, J. M., & Jones, G. B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0084-2 · Cited by 476 · cited 1×
“Other digital assessments to discriminate between AD and healthy controls have been tested, including typing speed, speech and language, eye movements, and pupillary reflex [23].”
BackgroundSelf-citationGoldberg, T. E., Harvey, P. D., Wesnes, K. A., Snyder, P. J., & Schneider, L. S. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.003 · Cited by 343
Cited by
Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images
Chen, R. J., Lu, M. Y., Weng, W.-H., Chen, T. Y., Williamson, D. F., Manz, T., Shady, M., & Mahmood, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00398 · Cited by 398
Self-citationThe role of machine learning in clinical research: transforming the future of evidence generation
Weissler, E. H., Naumann, T., Andersson, T., Ranganath, R., Elemento, O., Luo, Y., Freitag, D. F., Benoit, J., Hughes, M. C., Khan, F., et al. (2021) · Trials · doi:10.1186/s13063-021-05489-x · Cited by 280
Designing the next-generation clinical care pathway for Alzheimer’s disease
Hampel, H., Au, R., Mattke, S., van der Flier, W. M., Aisen, P., Apostolova, L., Chen, C., Cho, M., De Santi, S., Gao, P., et al. (2022) · Nature Aging · doi:10.1038/s43587-022-00269-x · Cited by 191
Cosmo: contrastive fusion learning with small data for multimodal human activity recognition
Ouyang, X., Shuai, X., Zhou, J., Shi, I. W., Xie, Z., Xing, G., & Huang, J. (2022) · Proceedings of the 28th Annual International Conference on Mobile Computing And Networking · doi:10.1145/3495243.3560519 · Cited by 94
Digitally Enabled, Patient‐Centric Clinical Trials: Shifting the Drug Development Paradigm
Dockendorf, M. F., Hansen, B. J., Bateman, K. P., Moyer, M., Shah, J. K., & Shipley, L. A. (2021) · Clinical and Translational Science · doi:10.1111/cts.12910 · Cited by 67
“Clinical trial research has observed that subtle changes in cognition, sensory, and motor function precede clinical manifestations of neurodegenerative disease by several years,(78) and there are a number of trials exploring feasibility of digital biomarkers for Parkinson’s and Alzheimer’s disease.(84,85) Although dig…”
Background
Metadata
- Authors
- Chen, R., Jankovic, F., Marinsek, N., Foschini, L., Kourtis, L., Signorini, A., Pugh, M., Shen, J., Yaari, R., Maljkovic, V., Sunga, M., Song, H. H., Jung, H. J., Tseng, B., & Trister, A.
- Venue
- Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2019-07-25
- Pages
- 2145-2155
- OpenAlex
- W2950283932
- Cited by
- 114
- References
- 14
- FWCI
- 5.82
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams. https://app.cochat.ai/papers/10.1145/3292500.3330690
- The paper
- Chen, R., Jankovic, F., Marinsek, N., Foschini, L., Kourtis, L., Signorini, A., Pugh, M., Shen, J., Yaari, R., Maljkovic, V., Sunga, M., Song, H. H., Jung, H. J., Tseng, B., & Trister, A. (2019). Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. https://doi.org/10.1145/3292500.3330690
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.