Cited by 86Neurobiology of Language and BilingualismFunctional Brain Connectivity StudiesStroke Rehabilitation and Recovery

Enhanced estimations of post‐stroke aphasia severity using stacked multimodal predictions

Open access
Pustina, Dorian, Coslett, Harry Branch, Ungar, Lyle, Faseyitan, Olufunsho K., Medaglia, John D., Avants, Brian, Schwartz, Myrna F.·2017·Human Brain Mapping

Abstract

The severity of post‐stroke aphasia and the potential for recovery are highly variable and difficult to predict. Evidence suggests that optimal estimation of aphasia severity requires the integration of multiple neuroimaging modalities and the adoption of new methods that can detect multivariate brain‐behavior relationships. We created and tested a multimodal framework that relies on three information sources (lesion maps, structural connectivity, and functional connectivity) to create an array of unimodal predictions which are then fed into a final model that creates “stacked multimodal predictions” (STAMP). Crossvalidated predictions of four aphasia scores (picture naming, sentence repetition, sentence comprehension, and overall aphasia severity) were obtained from 53 left hemispheric chronic stroke patients (age: 57.1 ± 12.3 yrs, post‐stroke interval: 20 months, 25 female). Results showed accurate predictions for all four aphasia scores (correlation true vs. predicted: r = 0.79–0.88). The accuracy was slightly smaller but yet significant ( r = 0.66) in a full split crossvalidation with each patient considered as new. Critically, multimodal predictions produced more accurate results that any single modality alone. Topological maps of the brain regions involved in the prediction were recovered and compared with traditional voxel‐based lesion‐to‐symptom maps, revealing high spatial congruency. These results suggest that neuroimaging modalities carry complementary information potentially useful for the prediction of aphasia scores. More broadly, this study shows that the translation of neuroimaging findings into clinically useful tools calls for a shift in perspective from unimodal to multimodal neuroimaging, from univariate to multivariate methods, from linear to nonlinear models, and, conceptually, from inferential to predictive brain mapping. Hum Brain Mapp 38:5603–5615, 2017 . © 2017 Wiley Periodicals, Inc.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/hbm.23752

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Seven included studies primarily relied on error metrics, such as root mean square error and mean absolute error, combined with indicators such as the Pearson correlation coefficient and coefficient of determination.

    “Seven studies (21, 23, 26, 31, 32, 35, 36) primarily relied on error metrics, such as root mean square error and mean absolute error, combined with indicators, such as the Pearson correlation coefficient and coefficient of determination, to provide a more comprehensive assessment.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 61

  1. Amunts K Schleicher A Burgel U Mohlberg H Uylings HB Zilles K 1999 Broca's region revisited: cytoarchitecture and intersubject variability J Comp Neurol 412 319 41 10441759
  2. Avants BB Duda JT Kilroy E Krasileva K Jann K Kandel BT Tustison NJ Yan L Jog M Smith R Wang Y Dapretto M Wang DJ 2015 The pediatric template of brain perfusion Sci Data 2 150003 25977810 PMC4413243
  3. Avants BB Tustison NJ Song G Cook PA Klein A Gee JC 2011 A reproducible evaluation of ANTs similarity metric performance in brain image registration Neuroimage 54 2033 44 20851191 PMC3065962
  4. Basilakos A Fillmore PT Rorden C Guo D Bonilha L Fridriksson J 2014 Regional white matter damage predicts speech fluency in chronic post-stroke aphasia Front Hum Neurosci 8 845 25368572 PMC4201347
  5. Bates E Wilson SM Saygin AP Dick F Sereno MI Knight RT Dronkers NF 2003 Voxel-based lesion-symptom mapping Nat Neurosci 6 448 50 12704393
  6. Behzadi Y Restom K Liau J Liu TT 2007 A component based noise correction method (CompCor) for BOLD and perfusion based fMRI Neuroimage 37 90 101 17560126 PMC2214855
  7. Benjamini Y Hochberg Y 1995 Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society Series B (Methodological) 57 289 300
  8. Bennett CM Wolford GL Miller MB 2009 The principled control of false positives in neuroimaging Soc Cogn Affect Neurosci 4 417 22 20042432 PMC2799957
  9. Boes AD Prasad S Liu H Liu Q Pascual-Leone A Caviness VS Jr Fox MD 2015 Network localization of neurological symptoms from focal brain lesions Brain 138 3061 75 26264514 PMC4671478
  10. Broca P 1861 Remarques sur le siege de la faculté du langage articulé, suivies d'une observation d'aphémie (perte de la parole) [Remarks on the seat of the faculty of articulated language, following an observation of aphemia (loss of speech)] Bulletin de la Société Anatomique 36 330 357
  11. Bullmore E Sporns O 2009 Complex brain networks: graph theoretical analysis of structural and functional systems Nat Rev Neurosci 10 186 98 19190637
  12. Carter AR Shulman GL Corbetta M 2012 Why use a connectivity-based approach to study stroke and recovery of function? Neuroimage 62 2271 80 22414990 PMC3733251
  13. Chai LR Mattar MG Blank IA Fedorenko E Bassett DS 2016 Functional Network Dynamics of the Language System Cereb Cortex PMC5066829 27550868
  14. Collins FS Tabak LA 2014 Policy: NIH plans to enhance reproducibility Nature 505 612 3 24482835 PMC4058759
  15. Corbetta M Kincade MJ Lewis C Snyder AZ Sapir A 2005 Neural basis and recovery of spatial attention deficits in spatial neglect Nat Neurosci 8 1603 10 16234807
  16. Crofts JJ Higham DJ Bosnell R Jbabdi S Matthews PM Behrens TE Johansen-Berg H 2011 Network analysis detects changes in the contralesional hemisphere following stroke Neuroimage 54 161 9 20728543 PMC3677803
  17. Dell GS Schwartz MF Nozari N Faseyitan O Branch Coslett H 2013 Voxel-based lesion-parameter mapping: Identifying the neural correlates of a computational model of word production Cognition 128 380 96 23765000 PMC3709005
  18. Drakesmith M Caeyenberghs K Dutt A Lewis G David AS Jones DK 2015 Overcoming the effects of false positives and threshold bias in graph theoretical analyses of neuroimaging data Neuroimage 118 313 33 25982515 PMC4558463
  19. Dronkers NF Plaisant O Iba-Zizen MT Cabanis EA 2007 Paul Broca's historic cases: high resolution MR imaging of the brains of Leborgne and Lelong Brain 130 1432 41 17405763
  20. Duncan ES Small SL 2016 Increased Modularity of Resting State Networks Supports Improved Narrative Production in Aphasia Recovery Brain Connect 6 524 9 27345466 PMC5084363
  21. Eklund A Nichols TE Knutsson H 2016 Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates Proc Natl Acad Sci U S A 113 7900 5 27357684 PMC4948312
  22. Fedorenko E Hsieh PJ Nieto-Castanon A Whitfield-Gabrieli S Kanwisher N 2010 New method for fMRI investigations of language: defining ROIs functionally in individual subjects J Neurophysiol 104 1177 94 20410363 PMC2934923
  23. Forkel SJ Thiebaut de Schotten M Dell'Acqua F Kalra L Murphy DG Williams SC Catani M 2014 Anatomical predictors of aphasia recovery: a tractography study of bilateral perisylvian language networks Brain 137 2027 39 24951631
  24. Fridriksson J Yourganov G Bonilha L Basilakos A Den Ouden DB Rorden C 2016 Revealing the dual streams of speech processing Proc Natl Acad Sci U S A 15108 13 27956600 PMC5206517
  25. Grefkes C Fink GR 2014 Connectivity-based approaches in stroke and recovery of function Lancet Neurol 13 206 16 24457190
  26. Hope TM Seghier ML Prejawa S Leff AP Price CJ 2016 Distinguishing the effect of lesion load from tract disconnection in the arcuate and uncinate fasciculi Neuroimage 125 1169 73 26388553 PMC4692449
  27. Kertesz A Harlock W Coates R 1979 Computer tomographic localization, lesion size, and prognosis in aphasia and nonverbal impairment Brain Lang 8 34 50 476474
  28. Kimberg DY Coslett HB Schwartz MF 2007 Power in Voxel-based lesion-symptom mapping J Cogn Neurosci 19 1067 80 17583984
  29. Kuceyeski A Navi BB Kamel H Raj A Relkin N Toglia J Iadecola C O'Dell M 2016 Structural connectome disruption at baseline predicts 6-months post-stroke outcome Hum Brain Mapp 37 2587 601 27016287 PMC4905801
  30. Kuceyeski A Navi BB Kamel H Relkin N Villanueva M Raj A Toglia J O'Dell M Iadecola C 2015 Exploring the brain's structural connectome: A quantitative stroke lesion-dysfunction mapping study Hum Brain Mapp 36 2147 60 25655204 PMC4414746
  31. Lo A Chernoff H Zheng T Lo SH 2015 Why significant variables aren't automatically good predictors Proc Natl Acad Sci U S A 112 13892 7 26504198 PMC4653162
  32. Mah YH Husain M Rees G Nachev P 2014 Human brain lesion-deficit inference remapped Brain 137 2522 31 24974384 PMC4132645
  33. Mahowald K Fedorenko E 2016 Reliable individual-level neural markers of high-level language processing: A necessary precursor for relating neural variability to behavioral and genetic variability Neuroimage 139 74 93 27261158
  34. Medaglia JD Lynall ME Bassett DS 2015 Cognitive network neuroscience J Cogn Neurosci 27 1471 91 25803596 PMC4854276
  35. Mirman D Chen Q Zhang Y Wang Z Faseyitan OK Coslett HB Schwartz MF 2015 Neural organization of spoken language revealed by lesion-symptom mapping Nat Commun 6 6762 25879574 PMC4400840
  36. Mozaffarian D Benjamin EJ Go AS Arnett DK Blaha MJ Cushman M de Ferranti S Després JP Fullerton HJ Howard VJ Huffman MD Judd SE Kissela BM Lackland DT Lichtman JH Lisabeth LD Liu S Mackey RH Matchar DB McGuire DK Mohler ER Moy CS Muntner P Mussolino ME Nasir K Neumar RW Nichol G Palaniappan L Pandey DK Reeves MJ Rodriguez CJ Sorlie PD Stein J Towfighi A Turan TN Virani SS Willey JZ Woo D Yeh RW Turner MB 2015 Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association Circulation 131 e29 e322 25520374
  37. Price CJ Hope TM Seghier ML 2016 Ten problems and solutions when predicting individual outcome from lesion site after stroke Neuroimage PMC5154378 27502048
  38. Price CJ Seghier ML Leff AP 2010 Predicting Language Outcome and Recovery After Stroke (PLORAS). Nature reviews Neurology 6 202 210 20212513 PMC3556582
  39. Pustina D Coslett HB Turkeltaub PE Tustison N Schwartz MF Avants B 2016b Automated segmentation of chronic stroke lesions using LINDA: Lesion identification with neighborhood data analysis Hum Brain Mapp 37 1405 21 26756101 PMC4783237
  40. Rahim M Thirion B Bzdok D Buvat I Varoquaux G 2017 Joint prediction of multiple scores captures better individual traits from brain images Neuroimage 28676298
  41. Rorden C Karnath HO 2004 Using human brain lesions to infer function: a relic from a past era in the fMRI age? Nat Rev Neurosci 5 813 9 15378041
  42. Saur D Lange R Baumgaertner A Schraknepper V Willmes K Rijntjes M Weiller C 2006 Dynamics of language reorganization after stroke Brain 129 1371 84 16638796
  43. Schwartz MF Faseyitan O Kim J Coslett HB 2012 The dorsal stream contribution to phonological retrieval in object naming Brain 135 3799 814 23171662 PMC3525060
  44. Schwartz MF Kimberg DY Walker GM Brecher A Faseyitan OK Dell GS Mirman D Coslett HB 2011 Neuroanatomical dissociation for taxonomic and thematic knowledge in the human brain Proc Natl Acad Sci U S A 108 8520 4 21540329 PMC3100928
  45. Schwartz MF Kimberg DY Walker GM Faseyitan O Brecher A Dell GS Coslett HB 2009 Anterior temporal involvement in semantic word retrieval: voxel-based lesion-symptom mapping evidence from aphasia Brain 132 3411 27 19942676 PMC2792374
  46. Seghier ML Patel E Prejawa S Ramsden S Selmer A Lim L Browne R Rae J Haigh Z Ezekiel D Hope TM Leff AP Price CJ 2015 The PLORAS Database: A data repository for Predicting Language Outcome and Recovery After Stroke Neuroimage PMC4658335 25882753
  47. Siegel JS Ramsey LE Snyder AZ Metcalf NV Chacko RV Weinberger K Baldassarre A Hacker CD Shulman GL Corbetta M 2016 Disruptions of network connectivity predict impairment in multiple behavioral domains after stroke Proc Natl Acad Sci U S A 113 E4367 76 27402738 PMC4968743
  48. Sperber C Karnath HO 2017 Impact of correction factors in human brain lesion-behavior inference Hum Brain Mapp 38 1692 1701 28045225 PMC6866937
  49. Thothathiri M Kimberg DY Schwartz MF 2011 The neural basis of reversible sentence comprehension: evidence from voxel-based lesion symptom mapping in aphasia J Cogn Neurosci 24 212 22 21861679 PMC3389786
  50. Tournier JD Calamante F Connelly A 2012 MRtrix: Diffusion tractography in crossing fiber regions International Journal of Imaging Systems and Technology 22 53 66
  51. Turkeltaub PE Messing S Norise C Hamilton RH 2011 Are networks for residual language function and recovery consistent across aphasic patients? Neurology 76 1726 34 21576689 PMC3100133
  52. Turken AU Dronkers NF 2011 The neural architecture of the language comprehension network: converging evidence from lesion and connectivity analyses Front Syst Neurosci 5 1 21347218 PMC3039157
  53. van den Heuvel MP Mandl RC Stam CJ Kahn RS Hulshoff Pol HE 2010 Aberrant frontal and temporal complex network structure in schizophrenia: a graph theoretical analysis J Neurosci 30 15915 26 21106830 PMC6633761
  54. Varentsova A Zhang S Arfanakis K 2014 Development of a high angular resolution diffusion imaging human brain template NeuroImage 91 177 186 24440528 PMC3965645
  55. Wang J Marchina S Norton AC Wan CY Schlaug G 2013 Predicting speech fluency and naming abilities in aphasic patients Front Hum Neurosci 7 831 24339811 PMC3857577
  56. Willmes K Poeck K 1993 To what extent can aphasic syndromes be localized? Brain 116 Pt 6 1527 40 8293285
  57. Wu J Quinlan EB Dodakian L McKenzie A Kathuria N Zhou RJ Augsburger R See J Le VH Srinivasan R Cramer SC 2015a Connectivity measures are robust biomarkers of cortical function and plasticity after stroke Brain 138 2359 69 26070983 PMC4840951
  58. Wu O Cloonan L Mocking SJ Bouts MJ Copen WA Cougo-Pinto PT Fitzpatrick K Kanakis A Schaefer PW Rosand J Furie KL Rost NS 2015b Role of Acute Lesion Topography in Initial Ischemic Stroke Severity and Long-Term Functional Outcomes Stroke 46 2438 44 26199314 PMC4550548
  59. Xia M Wang J He Y 2013 BrainNet Viewer: a network visualization tool for human brain connectomics PLoS One 8 e68910 23861951 PMC3701683
  60. Yourganov G Fridriksson J Rorden C Gleichgerrcht E Bonilha L 2016 Multivariate Connectome-Based Symptom Mapping in Post-Stroke Patients: Networks Supporting Language and Speech J Neurosci 36 6668 79 27335399 PMC4916245
  61. Zhang Y Kimberg DY Coslett HB Schwartz MF Wang Z 2014 Multivariate lesion-symptom mapping using support vector regression Hum Brain Mapp 35 5861 76 25044213 PMC4213345

Cited by

Sorted by citations

Authors
Pustina, D., Coslett, H. B., Ungar, L., Faseyitan, O. K., Medaglia, J. D., Avants, B., & Schwartz, M. F.
Affiliations
  • University of Pennsylvania (US)
  • Moss Rehabilitation Hospital (US)
Venue
Human Brain Mapping
Publisher
Wiley
Published
2017-08-07
Volume
38
Issue
11
Pages
5603-5615
ISSN
  • 1065-9471 (ISSN-L)
  • 1097-0193
OpenAlex
W2744571415
Cited by
86
References
11
Citations by year
2026: 5 · 2025: 9 · 2024: 17 · 2023: 13 · 2022: 7 · 2021: 7 · 2020: 14 · 2019: 7 · 2018: 5 · 2017: 2
FWCI
4.39
Type
journal article
Language
en
Open access
Locations
  • Human Brain Mapping (publishedVersion)
  • Europe PMC (PubMed Central) (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
National Institute on Deafness and Other Communication Disorders (RO1DC000191)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
  • Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
Keywords
post-stroke aphasia, structural connectivity, functional connectivity, chronic stroke, left hemisphere, picture naming, sentence imitation, sentence comprehension, voxel-based lesion-symptom mapping
MeSH terms
Aphasia, Brain, Cerebrovascular Circulation, Chronic Disease, Female, Humans, Language Tests, Magnetic Resonance Imaging, Male, Middle Aged, Oxygen, Rest, Severity of Illness Index, Multivariate Analysis, Linear Models, Nonlinear Dynamics, Stroke, Connectome, Multimodal Imaging

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review