Prediction of a multiple sclerosis diagnosis in patients with clinically isolated syndrome using the 2016 MAGNIMS and 2010 McDonald criteria: a retrospective study
Open accessAbstract
Background In 2016, the Magnetic Resonance Imaging in Multiple Sclerosis (MAGNIMS) network proposed modifications to the MRI criteria to define dissemination in space (DIS) and time (DIT) for the diagnosis of multiple sclerosis in patients with clinically isolated syndrome (CIS). Changes to the DIS definition included removal of the distinction between symptomatic and asymptomatic lesions, increasing the number of lesions needed to define periventricular involvement to three, combining cortical and juxtacortical lesions, and inclusion of optic nerve evaluation. For DIT, removal of the distinction between symptomatic and asymptomatic lesions was suggested. We compared the performance of the 2010 McDonald and 2016 MAGNIMS criteria for multiple sclerosis diagnosis in a large multicentre cohort of patients with CIS to provide evidence to guide revisions of multiple sclerosis diagnostic criteria. Methods Brain and spinal cord MRI and optic nerve assessments from patients with typical CIS suggestive of multiple sclerosis done less than 3 months from clinical onset in eight European multiple sclerosis centres were included in this retrospective study. Eligible patients were 16-60 years, and had a first CIS suggestive of CNS demyelination and typical of relapsing-remitting multiple sclerosis, a complete neurological examination, a baseline brain and spinal cord MRI scan obtained less than 3 months from clinical onset, and a follow-up brain scan obtained less than 12 months from CIS onset. We recorded occurrence of a second clinical attack (clinically definite multiple sclerosis) at months 36 and 60. We evaluated MRI criteria performance for DIS, DIT, and DIS plus DIT with a time-dependent receiver operating characteristic curve analysis. Findings Between June 16, 1995, and Jan 27, 2017, 571 patients with CIS were screened, of whom 368 met all study inclusion criteria. At the last evaluation (median 50·0 months [IQR 27·0-78·4]), 189 (51%) of 368 patients developed clinically definite multiple sclerosis. At 36 months, the two DIS criteria showed high sensitivity (2010 McDonald 0·91 [95% CI 0·85-0·94] and 2016 MAGNIMS 0·93 [0·88-0·96]), similar specificity (0·33 [0·25-0·42] and 0·32 [0·24-0·41]), and similar area under the curve values (AUC; 0·62 [0·57-0·67] and 0·63 [0·58-0·67]). Performance was not affected by inclusion of symptomatic lesions (sensitivity 0·92 [0·87-0·96], specificity 0·31 [0·23-0·40], AUC 0·62 [0·57-0·66]) or cortical lesions (sensitivity 0·92 [0·87-0·95], specificity 0·32 [0·24-0·41], AUC 0·62 [0·57-0·67]). Requirement of three periventricular lesions resulted in slightly lower sensitivity (0·85 [0·78-0·90], slightly higher specificity (0·40 [0·32-0·50], and similar AUC (0·63 [0·57-0·68]). Inclusion of optic nerve evaluation resulted in similar sensitivity (0·92 [0·87-0·96]), and slightly lower specificity (0·26 [0·18-0·34]) and AUC (0·59 [0·55-0·64]). AUC values were also similar for DIT (2010 McDonald 0·61 [0·55-0·67] and 2016 MAGNIMS 0·61 [0·55-0·66]) and DIS plus DIT (0·62 [0·56-0·67] and 0·64 [0·58-0·69]). Interpretation The 2016 MAGNIMS criteria showed similar accuracy to the 2010 McDonald criteria in predicting the development of clinically definite multiple sclerosis. Inclusion of symptomatic lesions is expected to simplify the clinical use of MRI criteria without reducing accuracy, and our findings suggest that needing three lesions to define periventricular involvement might slightly increase specificity, suggesting that these two factors could be considered during further revisions of multiple sclerosis diagnostic criteria. Funding UK MS Society, National Institute for Health Research University College London Hospitals Biomedical Research Centre, Dutch MS Research Foundation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The lesions detected by special MRI techniques for cortical lesions are primarily of the leukocortical type; subpial lesions are rarely detected.
“The lesions detected by these techniques are primarily of the leukocortical type; subpial lesions are rarely detected.”
From Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria (2018) · cites this paper as [76]
The Methods (p. 8) describe identifying cortical and juxtacortical lesions using MRI sequences, but do not classify the detected cortical lesions by subtype. A search for leukocortical and subpial lesions found no passage stating that leukocortical lesions predominate or that subpial lesions are rarely detected. (LLM, conf=0.70)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria
Polman, C. H., Reingold, S. C., Banwell, B., Clanet, M., Cohen, J. A., Filippi, M., Fujihara, K., Havrdova, E., Hutchinson, M., Kappos, L., et al. (2011) · Annals of Neurology · doi:10.1002/ana.22366 · Cited by 9,802 · see citing works
Self-citationDiagnosis of multiple sclerosis: progress and challenges
Brownlee, W. J., Hardy, T. A., Fazekas, F., & Miller, D. H. (2017) · The Lancet · doi:10.1016/s0140-6736(16)30959-x · Cited by 701 · see citing works
Self-citationThe contemporary spectrum of multiple sclerosis misdiagnosis
Solomon, A. J., Bourdette, D. N., Cross, A. H., Applebee, A., Skidd, P. M., Howard, D. B., Spain, R. I., Cameron, M. H., Kim, E., Mass, M. K., et al. (2016) · Neurology · doi:10.1212/wnl.0000000000003152 · Cited by 334 · see citing works
MRI criteria for MS in patients with clinically isolated syndromes
Montalban, X., Tintoré, M., Swanton, J., Barkhof, F., Fazekas, F., Filippi, M., Frederiksen, J., Kappos, L., Palace, J., Polman, C., et al. (2010) · Neurology · doi:10.1212/wnl.0b013e3181cec45c · Cited by 252 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 23
- [1]1. McDonald WI, Compston A, Edan G, Goodkin D, Hartung HP, Lublin FD, et al. Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the diagnosis of multiple sclerosis. Ann Neurol 2001; 50 :121-7.
- [2]2. Polman CH, Reingold SC, Edan G, Filippi M, Hartung HP, Kappos L, et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the "McDonald Criteria". Ann Neurol 2005; 58 :8406.
- [5]5. Filippi M, Rocca MA, Ciccarelli O, De Stefano N, Evangelou N, Kappos L, et al. MRI criteria for the diagnosis of multiple sclerosis: MAGNIMS consensus guidelines. The Lancet Neurology 2016; 15 :292-303.
- [6]6. Brownlee WJ, Swanton JK, Miszkiel KA, Miller DH, Ciccarelli O. Should the symptomatic region be included in dissemination in space in MRI criteria for MS? Neurology 2016; 87 :680-3.
- [7]7. Tintore M, Otero-Romero S, Rio J, Arrambide G, Pujal B, Tur C, et al. Contribution of the symptomatic lesion in establishing MS diagnosis and prognosis. Neurology 2016; 87 :1368-74.
- [9]9. Absinta M, Rocca MA, Colombo B, Copetti M, De Feo D, Falini A, et al. Patients with migraine do not have MRI-visible cortical lesions. Journal of neurology 2012; 259 :2695-8.
- [10]10. Liu S, Kullnat J, Bourdette D, Simon J, Kraemer DF, Murchison C, et al. Prevalence of brain magnetic resonance imaging meeting Barkhof and McDonald criteria for dissemination in space among headache patients. Multiple sclerosis 2013; 19 :1101-5.
- [11]11. Ruet A, Arrambide G, Brochet B, Auger C, Simon E, Rovira A, et al. Early predictors of multiple sclerosis after a typical clinically isolated syndrome. Multiple sclerosis 2014; 20 :1721-6.
- [12]12. Kim SS, Richman DP, Johnson WO, Hald JK, Agius MA. Limited utility of current MRI criteria for distinguishing multiple sclerosis from common mimickers: primary and secondary CNS vasculitis, lupus and Sjogren's syndrome. Multiple sclerosis 2014; 20 :57-63.
- [14]14. Filippi M, Rocca MA, Calabrese M, Sormani MP, Rinaldi F, Perini P, et al. Intracortical lesions: relevance for new MRI diagnostic criteria for multiple sclerosis. Neurology 2010; 75 :198894.
- [15]15. Optic Neuritis Study G. Multiple sclerosis risk after optic neuritis: final optic neuritis treatment trial follow-up. Archives of neurology 2008; 65 :727-32.
- [16]16. Swanton JK, Fernando KT, Dalton CM, Miszkiel KA, Altmann DR, Plant GT, et al. Early MRI in optic neuritis: the risk for clinically definite multiple sclerosis. Multiple sclerosis 2010; 16 :156-65.
- [17]17. Tintore M, Rovira A, Rio J, Otero-Romero S, Arrambide G, Tur C, et al. Defining high, medium and low impact prognostic factors for developing multiple sclerosis. Brain 2015; 138 :186374.
- [18]18. Rovira A, Swanton J, Tintore M, Huerga E, Barkhof F, Filippi M, et al. A single, early magnetic resonance imaging study in the diagnosis of multiple sclerosis. Archives of neurology 2009; 66 :587-92.
- [19]19. Swanton JK, Rovira A, Tintore M, Altmann DR, Barkhof F, Filippi M, et al. MRI criteria for multiple sclerosis in patients presenting with clinically isolated syndromes: a multicentre retrospective study. The Lancet Neurology 2007; 6 :677-86.
- [20]20. Miller D, Barkhof F, Montalban X, Thompson A, Filippi M. Clinically isolated syndromes suggestive of multiple sclerosis, part I: natural history, pathogenesis, diagnosis, and prognosis. The Lancet Neurology 2005; 4 :281-8.
- [22]22. Hung H, Chiang C. Estimation models for time-dependent AUC with survival data. Canadian Journal of Statistics 2010; 38 :8-26.
- [23]23. Efron B. Better Bootstrap Confidence Intervals. Journal of the American Statistical Association 1987; 82 :171-85.
- [24]24. Glidden DV, Vittinghoff E. Modelling clustered survival data from multicentre clinical trials. Stat Med 2004; 23 :369-88.
- [27]27. Arrambide G, Tintore M, Auger C, Río J, Castilló J, Vidal-Jordana A, et al. Lesion topographies in multiple sclerosis diagnosis: a reappraisal. Neurology 2017, in press.
- [28]28. Preziosa P, Rocca MA, Mesaros S, Meani A, Montalban X, Drulovic J, et al. Diagnosis of multiple sclerosis: a multicenter study to compare revised McDonald-2010 and Filippi-2010 criteria. J Neurol Neurosurg Psychiatry 2017; July 19) [epub ahead of print July 19, 2017; doi: 10.1136/jnnp-2017-315863]. · DOI · Paper page
- [29]29. Wattjes MP, Lutterbey GG, Harzheim M, Gieseke J, Traber F, Klotz L, et al. Higher sensitivity in the detection of inflammatory brain lesions in patients with clinically isolated syndromes suggestive of multiple sclerosis using high field MRI: an intraindividual comparison of 1.5 T with 3.0 T. European radiology 2006; 16 :2067-73.
- [30]30. Wattjes MP, Harzheim M, Lutterbey GG, Hojati F, Simon B, Schmidt S, et al. Does high field MRI allow an earlier diagnosis of multiple sclerosis? Journal of neurology 2008; 255 :1159-63. Table 1. Main baseline demographic, clinical, and MRI findings from the final cohort of clinically isolated syndrome (CIS) patients. Abbreviations: CIS=clinically isolated syndrome; MRI=magnetic resonance imaging; IQR=interquartile range; EDSS=Expanded Disability Status Scale; CSF=cerebrospinal fluid; FU=follow-up; CDMS=clinically definite multiple sclerosis; PV=periventricular; JC=juxtacortical; CL=cortical lesion; PF=posterior fossa; SC=spinal cord; Gd=gadolinium. See text for further details. Table 2. Performance of the different combined MRI criteria for dissemination in space (DIS), dissemination in time (DIT) and DIS plus DIT for development of clinically definite multiple sclerosis (CDMS) in the final cohort (n=368). Abbreviations: MRI=magnetic resonance imaging; CI=confidence interval; AUC=area under the curve; PPV=positive predictive value; NPV=negative predictive value; DIS=dissemination in space; DIT=dissemination in time; PV=periventricular; CL=cortical lesion; JC=juxtacortical; ON=optic nerve; M=month. Modified DIS criteria 1: McDonald 2010 criteria modified to include symptomatic lesions; modified DIS criteria 2: McDonald 2010 criteria modified to change to 3 the minimum number of lesions necessary to define PV involvement; modified DIS criteria 3: McDonald 2010 criteria modified to combine CL and JC; modified DIS criteria 4: McDonald 2010 criteria modified to include ON involvement as an additional location for the definition of DIS. Table 3. Adjusted hazard ratios (aHRs) with their corresponding 95% confidence intervals (CI) and a bootstrap-based comparison with the McDonald 2010 criteria. aHRs were obtained from extended Cox regression models using time to clinically definite multiple sclerosis (CDMS) as the outcome in the final cohort. Abbreviations: aHR=adjusted hazard ratios; CI=confidence interval; DIS=dissemination in space; DIT=dissemination in time; PV=periventricular; CL=cortical lesion; JC=juxtacortical; ON=optic nerve. *=adjusted for age, sex, centre, treatment, type of onset and oligoclonal bands.
Cited by
Sorted by citations
Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria
Thompson, A. J., Banwell, B. L., Barkhof, F., Carroll, W. M., Coetzee, T., Comi, G., Correale, J., Fazekas, F., Filippi, M., Freedman, M. S., et al. (2018) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30470-2 · Cited by 8,167 · see citing works
Self-citation
- Authors
- Filippi, M., Preziosa, P., Meani, A., Ciccarelli, O., Mesaros, S., Rovira, A., Frederiksen, J., Enzinger, C., Barkhof, F., Gasperini, C., Brownlee, W., Drulovic, J., Montalban, X., Cramer, S. P., Pichler, A., Hagens, M., Ruggieri, S., Martinelli, V., Miszkiel, K., Tintorè, M., Comi, G., Dekker, I., Uitdehaag, B., Dujmovic-Basuroski, I., & Rocca, M. A.
- Affiliations
- Vita-Salute San Raffaele University (IT)
- National Institute for Health and Care Research (GB)
- University of Copenhagen (DK)
- Medical University of Graz (AT)
- Azienda Ospedaliera San Camillo-Forlanini (IT)
- University of Belgrade (RS)
- Rigshospitalet (DK)
- Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Filippi, Massimo
- ORCID
- Venue
- The Lancet Neurology
- Publisher
- Elsevier BV
- Published
- 2018-02
- Volume
- 17
- Issue
- 2
- Pages
- 133-142
- ISSN
- 1474-4422 (ISSN-L)
- OpenAlex
- W2776062928
- Cited by
- 124
- References
- 4
- Citations by year
- 2026: 1 · 2025: 8 · 2024: 10 · 2023: 8 · 2022: 14 · 2021: 19 · 2020: 17 · 2019: 21 · 2018: 23 · 2017: 3
- FWCI
- 13.32
- Type
- journal article
- Language
- en
- Open access
- green
- pure.amsterdamumc.nl
- Licence
- Locations
- The Lancet Neurology (publishedVersion)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- Archivio Istituzionale della Ricerca - Università Vita-Salute San Raffaele (submittedVersion, cc-by-nc-nd)
- UCL Discovery (University College London) (submittedVersion)
- IRIS Research product catalog (Sapienza University of Rome) (submittedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Università degli Studi di Genova
- Topics
- Health Sciences › Medicine › Pathology and Forensic Medicine › Multiple Sclerosis Research Studies
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Medicine › Oncology › Polyomavirus and related diseases
- Keywords
- multiple sclerosis, clinically isolated syndrome, dissemination in space, dissemination in time, MRI diagnostic criteria, periventricular lesions, optic nerve lesions, relapsing-remitting multiple sclerosis, sensitivity and specificity, recurrence prediction, disability progression
- MeSH terms
- Adult, Brain, Brain Stem, Cerebellar Diseases, Cerebral Ventricles, Demyelinating Diseases, Diagnosis, Differential, Female, Follow-Up Studies, Humans, Magnetic Resonance Imaging, Male, Multiple Sclerosis, Neurologic Examination, Optic Nerve, Optic Neuritis, Spinal Cord, Cohort Studies, Kaplan-Meier Estimate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review