Talk2Me: Automated linguistic data collection for personal assessment
Open accessThe DOI matches its Crossref record; 98 of the 101 references it cites were found in a registry or an index.
Abstract
Language is one the earliest capacities affected by cognitive change. To monitor that change longitudinally, we have developed a web portal for remote linguistic data acquisition, called Talk2Me, consisting of a variety of tasks. In order to facilitate research in different aspects of language, we provide baselines including the relations between different scoring functions within and across tasks. These data can be used to augment studies that require a normative model; for example, we provide baseline classification results in identifying dementia. These data are released publicly along with a comprehensive open-source package for extracting approximately two thousand lexico-syntactic, acoustic, and semantic features. This package can be applied arbitrarily to studies that include linguistic data. To our knowledge, this is the most comprehensive publicly available software for extracting linguistic features. The software includes scoring functions for different tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282 · cited 2×
“Talk2Me collects data through tasks similar to those used in standard assessments of cognition (including the Mini-Mental State Examination [21], the Montréal Cognitive Assessment [22], and the Western Aphasia Battery [23]).”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment
Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53221.x · Cited by 25,553 · cited 2×
“Talk2Me collects data through tasks similar to those used in standard assessments of cognition (including the Mini-Mental State Examination [21], the Montréal Cognitive Assessment [22], and the Western Aphasia Battery [23]).”
MethodBLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 1×
“, ‘bilingual evaluation understudy’) [53] to score the vocabulary task.”
BackgroundHirono, N., Mori, E., Ikejiri, Y., Imamura, T., Shimomura, T., Hashimoto, M., Yamashita, H., & Ikeda, M. (1997) · Brain and nerve · Cited by 21,038
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Kok, J. S., Berg, I. J., & Scherder, E. J. A. (2013) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000353441 · Cited by 20,589
Older Adults' Reasons for Using Technology while Aging in Place
Peek, S. T. M., Luijkx, K. G., Rijnaard, M. D., Nieboer, M. E., van der Voort, C. S., Aarts, S., van Hoof, J., Vrijhoef, H. J. M., & Wouters, E. J. M. (2016) · Gerontology · doi:10.1159/000430949 · Cited by 19,690
Sensitivity and False Alarm Rate of a Fall Sensor in Long-Term Fall Detection in the Elderly
Kangas, M., Korpelainen, R., Vikman, I., Nyberg, L., & Jämsä, T. (2015) · Gerontology · doi:10.1159/000362720 · Cited by 18,909
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657
Studies of interference in serial verbal reactions
Stroop, J. R. (1935) · Journal of Experimental Psychology · doi:10.1037/h0054651 · Cited by 18,622
Development and validation of a geriatric depression screening scale: a preliminary report
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., & Leirer, V. O. (1982) · Journal of Psychiatric Research · doi:10.1016/0022-3956(82)90033-4 · Cited by 15,025 · cited 1×
“Self-reported disposition Participants answer five questions taken from a validated shortform version [37] of the Geriatric Depression Scale (GDS), which is a 30-item self-assessment used to identify depression in the elderly [38].”
MethodWordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 8×
“If the word is not found, we use WordNet to check if the category word is its hypernym.”
MethodInfluentialThe Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037 · cited 1×
“We measure the polarity of transcripts by computing averages and standard deviations of norms derived from the Multi-Perspective Question Answering (MPQA) lexicon [58] and the Stanford Sentiment analyzer [59].”
MethodAn Information-Theoretic Definition of Similarity
Lin, D. (1998) · International Conference on Machine Learning · Cited by 4,697
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Natural language processing with Python
Bird, S., Klein, E., & Loper, E. (2009) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,955
Rhetorical Structure Theory: Toward a functional theory of text organization
MANN, W. C., & THOMPSON, S. A. (1988) · Text - Interdisciplinary Journal for the Study of Discourse · doi:10.1515/text.1.1988.8.3.243 · Cited by 3,853 · cited 1×
“Next, we extract features related to rhetorical structure theory (RST), which is a classic framework for discourse parsing in which partitions of text are arranged in a tree structure by pragmatic relations such as Elaboration or Contrast [73].”
MethodGonzalez, R. C., & Woods, R. E. (1977) · SDÜ Bilgi Merkezi · Cited by 3,736
Bleu: a method for automatic evaluation of machine translation
Papineni, K. (2024) · doi:10.57702/ljteqmrb · Cited by 3,672
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Cognitive Stimulation in Patients with Dementia: Randomized Controlled Trial
Mapelli, D., Di Rosa, E., Nocita, R., & Sava, D. (2013) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000353457 · Cited by 3,453
Recognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345 · cited 1×
“We measure the polarity of transcripts by computing averages and standard deviations of norms derived from the Multi-Perspective Question Answering (MPQA) lexicon [58] and the Stanford Sentiment analyzer [59].”
MethodUsing Information Content to Evaluate Semantic Similarity in a Taxonomy
Resnik, P. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9511007 · Cited by 3,193 · cited 2×
“We also extract multiple WordNet measures of similarity: Resnik [68], Jiang-Coranth [69], Lin [47], Leacock-Chodorow [70], and Wu-Palmer [71].”
Verbs semantics and lexical selection
Wu, Z., & Palmer, M. (1994) · Proceedings of the 32nd annual meeting on Association for Computational Linguistics - · doi:10.3115/981732.981751 · Cited by 3,136 · cited 1×
“We measure the similarity (on [0..1]) between user input and the set of provided annotations using Wu-Palmer Similarity (WuP) [44] on the ontology provided by WordNet [45].”
MethodBrysbaert, M., & New, B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.977 · Cited by 2,821 · cited 1×
“We compute the mean frequency (with which a word occurs in a corpus) of words based on the SUBTL frequency norms [60].”
MethodSemantic Similarity Based on Corpus Statistics and Lexical Taxonomy
Jiang, J. J., & Conrath, D. W. (1997) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9709008 · Cited by 2,743
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
Norms of valence, arousal, and dominance for 13,915 English lemmas
Warriner, A. B., Kuperman, V., & Brysbaert, M. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0314-x · Cited by 1,959 · cited 1×
“, the pleasantness) of words are derived from the Affective Norms for English Words (ANEW) ratings [63] and the Warriner norms [64].”
MethodThe Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
Combining Local Context and WordNet Similarity for Word Sense Identification
Leacock, C. (1998) · WordNet · doi:10.7551/mitpress/7287.003.0018 · Cited by 1,662
Automatic evaluation of summaries using N-gram co-occurrence statistics
Lin, C.-Y., & Hovy, E. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073465 · Cited by 1,578 · cited 1×
“We transcribe the audio recordings of story recall, and score the task using the ROUGE score (i.e., ‘recall-oriented understudy for gisting evaluation’) [52].”
Method(1999) · Cited by 1,435
2017 Alzheimer's disease facts and figures
(2017) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2017.02.001 · Cited by 1,311
Recent developments in openSMILE, the munich open-source multimedia feature extractor
Eyben, F., Weninger, F., Gross, F., & Schuller, B. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502224 · Cited by 1,241 · cited 1×
“We extract acoustic features with the openSMILE open-source tool [74], which includes features related to formants, loudness, approximations of pitch, including zero-crossing rate and Mel-frequency cepstral coefficients (MFCCs) among others.”
MethodAge-of-acquisition ratings for 30,000 English words
Kuperman, V., Stadthagen-Gonzalez, H., & Brysbaert, M. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0210-4 · Cited by 1,217 · cited 1×
“Each word is assigned a difficulty based on its age-of-acquisition, derived from the Kuperman norms [31].”
MethodUsing Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139 · cited 1×
“This can also be a limitation due to the potential for deliberate participant misrepresentation [87].”
BackgroundNagamatsu, L. S., Chan, A., Davis, J. C., Beattie, B. L., Graf, P., Voss, M. W., Sharma, D., & Liu-Ambrose, T. (2013) · Journal of Aging Research · doi:10.1155/2013/861893 · Cited by 1,089
Automatic analysis of syntactic complexity in second language writing
Lu, X. (2010) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.15.4.02lu · Cited by 1,041 · cited 3×
“For the former, we measure language complexity automatically using Lu’s Syntactic Complexity Analyzer (SCA) [46].”
MethodLevesque, H. J., Davis, E., & Morgenstern, L. (2011) · Cited by 885
Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words
Gilhooly, K. J., & Logie, R. H. (1980) · Behavior Research Methods & Instrumentation · doi:10.3758/bf03201693 · Cited by 868
Verbal fluency performance in dementia of the Alzheimer’s type: a meta-analysis
Henry, J. D., Crawford, J. R., & Phillips, L. H. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.02.001 · Cited by 847 · cited 2×
“Alzheimer’s disease, for example, has a greater impact on semantic fluency than on other types of fluency [16, 50].”
BackgroundLinguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797 · cited 1×
“Fraser et al used over 370 automatically extracted acoustic, lexical, and syntactic features to detect AD [2] based on acoustics and speech transcripts.”
MethodSelf-citationKincaid, J. P., Robert, P. F. L., Richard, L. R., & Brad, S. (1975) · Cited by 739
Snowdon, D. A. (1996) · JAMA · doi:10.1001/jama.1996.03530310034029 · Cited by 696 · cited 1×
“We extract propositional [67] and content density [3], respectively:”
MethodVoice and Articulation Drillbook. By Grant Fairbanks. Harper and Brothers, 1941. Cloth, 234 pp.
(1941) · The Laryngoscope · doi:10.1288/00005537-194112000-00007 · Cited by 663 · cited 1×
“Stories used in this task are the ‘My Grandfather’ short story [28], the ‘Rainbow’ passage [29], and the ‘Limpy’ passage (http://itcdland.”
MethodThe Natural History of Alzheimer's Disease: Description of Study Cohort and Accuracy of Diagnosis
Becker, J. T. (1994) · Archives of Neurology · doi:10.1001/archneur.1994.00540180063015 · Cited by 576
Boston Diagnostic Aphasia Examination
(2012) · SpringerReference · doi:10.1007/springerreference_183639 · Cited by 527
A model and an hypothesis for language structure
Yngve, V. H. (1960) · Cited by 522
RECOVERY PATTERNS AND PROGNOSIS IN APHASIA
KERTESZ, A., & MCCABE, P. (1977) · Brain · doi:10.1093/brain/100.1.1 · Cited by 514
Speech Correction: Principles and Methods
(1940) · Physical Therapy · doi:10.1093/ptj/20.6.376 · Cited by 492 · cited 1×
“Stories used in this task are the ‘My Grandfather’ short story [28], the ‘Rainbow’ passage [29], and the ‘Limpy’ passage (http://itcdland.”
MethodCutting the Gordian Knot: The Moving-Average Type–Token Ratio (MATTR)
Covington, M. A., & McFall, J. D. (2010) · Journal of Quantitative Linguistics · doi:10.1080/09296171003643098 · Cited by 473 · cited 1×
“To compute vocabulary richness, we calculate the type-token-ratio and the moving-average-type-token-ratio [55] with window sizes of 10, 20, 30, 40, and 50.”
MethodPendlebury, S. T., Welch, S. J. V., Cuthbertson, F. C., Mariz, J., Mehta, Z., & Rothwell, P. M. (2013) · Stroke · doi:10.1161/strokeaha.112.673384 · Cited by 391
Speech Correction: Principles and Methods
(1940) · Journal of the American Medical Association · doi:10.1001/jama.1940.02810150072030 · Cited by 376
Romeo S Revnic, C., Revnic, F., & Voinea, S. (2017) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2017.06.033 · Cited by 369
Spoken Language Derived Measures for Detecting Mild Cognitive Impairment
Roark, B., Mitchell, M., Hosom, J.-P., Hollingshead, K., & Kaye, J. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2112351 · Cited by 355 · cited 2×
“We extract propositional [67] and content density [3], respectively:”
BackgroundMethodAn analysis of environment, microphone and data simulation mismatches in robust speech recognition
Vincent, E., Watanabe, S., Nugraha, A. A., Barker, J., & Marxer, R. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2016.11.005 · Cited by 351
Local-Learning-Based Feature Selection for High-Dimensional Data Analysis
Sun, Y., Todorovic, S., & Goodison, S. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.190 · Cited by 347 · cited 1×
“FMS [78] Elasticnet [79] KPLS [80] Logo [81] MetaDist [82] No Feature Selection Without CCA (micro) 76.”
Mueller, K. D., Hermann, B., Mecollari, J., & Turkstra, L. S. (2018) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2018.1446513 · Cited by 336 · cited 1×
“Connected speech is often used for assessing AD, as it provides insight into semantic processing and syntactic complexity [5].”
BackgroundThe Bristol norms for age of acquisition, imageability, and familiarity
Stadthagen-Gonzalez, H., & Davis, C. J. (2006) · Behavior Research Methods · doi:10.3758/bf03193891 · Cited by 315
van Marwijk, H., Wallace, P., de Bock, G. H., Hermans, J., Kaptein, A. A., & Mulder, J. (1995) · Europe PMC (PubMed Central) · Cited by 302
Semantic knowledge in mild cognitive impairment and mild Alzheimer's disease
Adlam, A.-L. R., Bozeat, S., Arnold, R., Watson, P., & Hodges, J. R. (2006) · Cortex · doi:10.1016/s0010-9452(08)70404-0 · Cited by 274
Forbes-McKay, K. E., & Venneri, A. (2005) · Neurological Sciences · doi:10.1007/s10072-005-0467-9 · Cited by 261 · cited 1×
“Forbes-McKay and Venneri [7] found that deficiencies in semantic processing were apparent not only in participants with AD, but also in those diagnosed with mild or moderate forms of cognitive decline.”
BackgroundCohort Profile: Wisconsin longitudinal study (WLS)
Herd, P., Carr, D., & Roan, C. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dys194 · Cited by 257 · cited 1×
“We extract the same scores as in the Wisconsin Longitudinal Study [49] for the same type of task, including the number of tokens in a category and the number of tokens out-of-category.”
Toward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245 · cited 1×
“08%, which is approximately state-ofthe-art for large-vocabulary speech recognition [42].”
BackgroundBucks, R. S., Singh, S., Cuerden, J. M., & Wilcock, G. K. (2000) · Aphasiology · doi:10.1080/026870300401603 · Cited by 233
A systematic meta-analysis of the Stroop task in depression
Epp, A. M., Dobson, K. S., Dozois, D. J. A., & Frewen, P. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.005 · Cited by 232 · cited 1×
“The Stroop test has a high degree of discriminative power in Alzheimer’s disease [34], depression [35], and bipolar disorder [36], for example.”
Background(2018) · Advances in Geospatial Technologies · doi:10.4018/978-1-5225-3270-5.ch002 · Cited by 221
The naming disorder of dementia
Kirshner, H. S., Webb, W. G., & Kelly, M. P. (1984) · Neuropsychologia · doi:10.1016/0028-3932(84)90004-6 · Cited by 178
Aided diagnosis of dementia type through computer-based analysis of spontaneous speech
Jarrold, W., Peintner, B., Wilkins, D., Vergryi, D., Richey, C., Gorno-Tempini, M. L., & Ogar, J. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3204 · Cited by 178 · cited 1×
“Jarrold et al [8] collected speech from 48 participants completing a picture description task.”
BackgroundBoston Diagnostic Aphasia Examination
Helm-Estabrooks, N. (2018) · Encyclopedia of Clinical Neuropsychology · doi:10.1007/978-3-319-57111-9_868 · Cited by 160
Speech in Alzheimer's Disease: Can Temporal and Acoustic Parameters Discriminate Dementia?
Meilán, J. J. G., Martínez-Sánchez, F., Carro, J., López, D. E., Millian-Morell, L., & Arana, J. M. (2014) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000356726 · Cited by 152 · cited 1×
“AD) [6] Often, connected speech is elicited through the picture description task.”
BackgroundCheng, Q. S., Zhou, H., & Cheng, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.195 · Cited by 143 · cited 1×
“FMS [78] Elasticnet [79] KPLS [80] Logo [81] MetaDist [82] No Feature Selection Without CCA (micro) 76.”
MethodGiles, E., Patterson, K., & Hodges, J. R. (1996) · Aphasiology · doi:10.1080/02687039608248419 · Cited by 139 · cited 1×
“In a study involving 48 participants, Giles et al [10] used information content to classify participants into four categories of impairment: none, minimal, mild, and moderate.”
BackgroundMicrolinguistic aspects of the oral narrative in patients with Alzheimer's disease
de Lira, J. O., Ortiz, K. Z., Campanha, A. C., Bertolucci, P. H. F., & Minett, T. S. C. (2011) · International Psychogeriatrics · doi:10.1017/s1041610210001092 · Cited by 137 · cited 1×
“Similarly, de Lira et al extracted linguistic features from transcripts of 121 older adults completing a picture description task and concluded that participants with AD displayed more word-finding difficulties, revisions, and repetitions than healthy controls [9].”
BackgroundWoods, R. T., Orrell, M., Bruce, E., Edwards, R. T., Hoare, Z., Hounsome, B., Keady, J., Moniz-Cook, E., Orgeta, V., Rees, J., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152843 · Cited by 124
Effects of Practice on Category Fluency in Alzheimers Disease*
Cooper, D. B., Epker, M., Lacritz, L., Weiner, M., Rosenberg, R. N., Honig, L., & Cullum, C. M. (2001) · The Clinical Neuropsychologist · doi:10.1076/clin.15.1.125.1914 · Cited by 66
Woods, D. L., Wyma, J. M., Herron, T. J., & Yund, E. W. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166439 · Cited by 66 · cited 1×
“Verbal performance on this task can differentiate a variety of conditions, including traumatic brain injury [26] and dementia [27].”
BackgroundA Kernel-Based Multivariate Feature Selection Method for Microarray Data Classification
Sun, S., Peng, Q., & Shakoor, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102541 · Cited by 64 · cited 1×
“FMS [78] Elasticnet [79] KPLS [80] Logo [81] MetaDist [82] No Feature Selection Without CCA (micro) 76.”
Methodi-Vectors in speech processing applications: a survey
Verma, P., & Das, P. K. (2015) · International Journal of Speech Technology · doi:10.1007/s10772-015-9295-3 · Cited by 62 · cited 1×
“…transcribe audio files for the picture description, story recall, and word-col-our Stroop tasks with Kaldi, an open-source speech recognition toolkit [39], using a long short-term memory neural network with i-Vector input [40] and a reverberation model, trained on the Fisher data [41].”
MethodAn N-Gram Based Approach to the Automatic Diagnosis of Alzheimer’s Disease from Spoken Language
Wankerl, S., Nöth, E., & Evert, S. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1572 · Cited by 62
Vector-space topic models for detecting Alzheimer's disease
Yancheva, M., & Rudzicz, F. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1221 · Cited by 57 · cited 2×
“On DementiaBank, Yancheva and Rudzicz [13] automatically detected information content using word embeddings for binary classification of AD and achieved an F-score of 0.74.”
InfluentialSelf-citationLiu, Z., Hsiao, W., Cantarel, B. L., Drábek, E. F., & Fraser, C. M. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr547 · Cited by 51 · cited 1×
“FMS [78] Elasticnet [79] KPLS [80] Logo [81] MetaDist [82] No Feature Selection Without CCA (micro) 76.”
MethodBen‐David, B. M., Tewari, A., Shakuf, V., & Lieshout, P. H. H. M. V. (2013) · Journal of Alzheimer s Disease · doi:10.3233/jad-131244 · Cited by 48 · cited 1×
“The Stroop test has a high degree of discriminative power in Alzheimer’s disease [34], depression [35], and bipolar disorder [36], for example.”
BackgroundClark, D. G., Kapur, P., Geldmacher, D. S., Brockington, J. C., Harrell, L., DeRamus, T. P., Blanton, P. D., Lokken, K., Nicholas, A. P., & Marson, D. C. (2014) · Cortex · doi:10.1016/j.cortex.2013.12.013 · Cited by 44 · cited 1×
“Verbal performance on this task can differentiate a variety of conditions, including traumatic brain injury [26] and dementia [27].”
BackgroundMulti-view representation learning via gcca for multimodal analysis of Parkinson's disease
Vasquez-Correa, J. C., Orozco-Arroyave, J. R., Arora, R., Noth, E., Dehak, N., Christensen, H., Rudzicz, F., Bocklet, T., Cernak, M., Chinaei, H., et al. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952700 · Cited by 36 · cited 2×
“We adopt the approach used by Vasquez-Correa et al [77] for multi-view representation learning via canonical correlation analysis (CCA) to improve the classification of dementia from healthy controls.”
Self-citationStroop-test interference in bipolar disorder
Kravariti, E., Schulze, K., Kane, F., Kalidindi, S., Bramon, E., Walshe, M., Marshall, N., Hall, M.-H., Georgiades, A., McDonald, C., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.052639 · Cited by 35 · cited 1×
“The Stroop test has a high degree of discriminative power in Alzheimer’s disease [34], depression [35], and bipolar disorder [36], for example.”
BackgroundSentence segmentation of aphasic speech
Fraser, K., Ben-David, N., Hirst, G., Graham, N. L., & Rochon, E. A. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1087 · Cited by 28 · cited 1×
“com/lowerquality/ gentle), and then segmented into sentences based on pitch, pause, and parts-of-speech features [43].”
BackgroundSelf-citationvan Mierlo, L. D., Wouters, H., Sikkes, S. A. M., van der Flier, W. M., Prins, N. D., Bremer, J. A. E., Koene, T., & van Hout, H. P. J. (2016) · Journal of Alzheimer s Disease · doi:10.3233/jad-160566 · Cited by 20 · cited 2×
“Van Mierlo et al [20] built a web- and telephone-based system for administering cognitive self-tests as a method of automatic screening.”
MethodLearning multiview embeddings for assessing dementia
Pou-Prom, C., & Rudzicz, F. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1304 · Cited by 20 · cited 1×
“Along these lines, we have started to take a multi-view approach based on canonical correlation analysis, trained on Talk2Me, to improve the accuracy of classification [88].”
Self-citationSpeech-Based Automated Cognitive Impairment Detection From Remotely-Collected Cognitive Test Audio
Yu, B., Williamson, J. R., Mundt, J. C., & Quatieri, T. F. (2018) · IEEE Access · doi:10.1109/access.2018.2856478 · Cited by 16 · cited 1×
“Using an interactive-voice-response telephone system, Yu et al [19] extracted speech features and achieved an AUC of 0.”
MethodRobustness against the channel effect in pathological voice detectionPreprint
Hsu, Y.-T., Zhu, Z., Wang, C., Fang, S., Rudzicz, F., & Tsao, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.10376 · Cited by 15 · cited 1×
“In our reported analyses, we have previously attempted to mitigate such factors using spectral noise subtraction [84], and we have shown that software can reduce the effect of the channel in identifying differences in the voice [85].”
MethodSelf-citationRapčan, V., D’Arcy, S., Pénard, N., Robertson, I. H., & Reilly, R. B. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-282 · Cited by 14 · cited 2×
“Rapcan et al [18] administered a battery of language assessments over the telephone and found that speech features (e.g., number of pauses, length of utterances) could be reliably extracted by telephone recordings and did not significantly differ from in-person clinic recordings.”
BackgroundSpeech enhancement using minimum mean square error filter and spectral subtraction filter
Kirubagari, B., Palanivel, S., & Subathra, N. (2014) · International Conference on Information Communication and Embedded Systems · doi:10.1109/icices.2014.7034042 · Cited by 10 · cited 1×
“In our reported analyses, we have previously attempted to mitigate such factors using spectral noise subtraction [84], and we have shown that software can reduce the effect of the channel in identifying differences in the voice [85].”
Method
Research works printed but not linked: 4
- WN Francis, 1979, Brown corpus manual, Brown University, 2
- D Lin, 1998, Proceedings of ICML, 296
- CD Manning, 2014, ACL (System Demonstrations), 55
- Wu Z, Palmer M. Verbs semantics and lexical selection. In: Proceedings of the 32nd annual meeting on Association for Computational Linguistics. Association for Computational Linguistics; 1994. p. 133–138. · DOI · Paper page
Cited by
A Conversational Robot for Older Adults with Alzheimer's Disease
Pou-Prom, C., Raimondo, S., & Rudzicz, F. (2020) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3380785 · Cited by 59
“…of the kinds of linguistic analysis that could be performed on conversations with a robot, from conversation transcripts, we extract an extensive list of linguistic features using available open-source software, 10 which have previously been used for analyzing cognition and speech impairment [21].”
MethodSelf-citationDetection of Mild Cognitive Impairment Through Natural Language and Touchscreen Typing Processing
Ntracha, A., Iakovakis, D., Hadjidimitriou, S., Charisis, V. S., Tsolaki, M., & Hadjileontiadis, L. J. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.567158 · Cited by 62
“Tools, like the computer-based software of (16), collecting both textual and acoustic linguistic features from different tasks, facilitate the research toward such direction.”
Bartlett, L., Doherty, K., Farrow, M., Kim, S., Hill, E., King, A. E., Alty, J., Eccleston, C. E. A., Kitsos, A., Bindoff, A. D., et al. (2021) · JMIR Research Protocols · doi:10.2196/34688 · Cited by 51
Repeatability of Commonly Used Speech and Language Features for Clinical Applications
Stegmann, G. M., Hahn, S., Liss, J., Shefner, J., Rutkove, S. B., Kawabata, K., Bhandari, S., Shelton, K., Duncan, C. J., & Berisha, V. (2020) · Digital Biomarkers · doi:10.1159/000511671 · Cited by 47
Jeong, L., Lee, M., Eyre, B., Balagopalan, A., Rudzicz, F., & Gabilondo, C. (2023) · Psychiatric Research and Clinical Practice · doi:10.1176/appi.prcp.20230003 · Cited by 37
“A total of 393 features were obtained (23).”
BackgroundSelf-citation
Metadata
- Authors
- Komeili, M., Pou-Prom, C., Liaqat, D., Fraser, K. C., Yancheva, M., & Rudzicz, F.
- Affiliations
- Carleton University (CA)
- St. Michael's Hospital (CA)
- University of Toronto (CA)
- National Research Council Canada (CA)
- Corresponding author
- Rudzicz, Frank
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-03-27
- Volume
- 14
- Issue
- 3
- Pages
- e0212342
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6436678
- OpenAlex
- W2925077947
- Semantic Scholar
- f9313ca0ddb194ad1c116aeb1058445a2dbd247e
- Cited by
- 23
- References
- 101
- Citations by year
- 2026: 2 · 2025: 2 · 2023: 4 · 2022: 1 · 2021: 8 · 2020: 5 · 2019: 1
- FWCI
- 2.98
- Type
- journal article
- Language
- en
- Update notices
- correction (2019-04-30)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- NPARC (submittedVersion)
- Carleton University's Institutional Repository (MacOdrum Library, Carleton University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- NSERC (RGPIN 435874)
- Alzheimer Society Research Program (Young Investigator 2015)
- Canadian Institutes of Health Research (CHRP 440 381332)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Keywords
- online assessment, longitudinal cognitive change, language loss, dementia detection, normative model, acoustic features, semantic features, linguistic feature extraction, open source software, scoring functions
- MeSH terms
- Patient Portals, Adult, Aged, Aged, 80 and over, Data Collection, Female, Humans, Language, Linguistics, Male, Middle Aged, Semantics, Software, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.