Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To develop a patient-based, disease-specific measure of the health impact of multiple sclerosis (MS) for use in clinical trials and clinical practice. DATA SOURCES: People with MS. Members of the MS Society of Great Britain and Northern Ireland. METHODS: Standard psychometric methods were used to develop the Multiple Sclerosis Impact Scale (MSIS-29) in three stages. Stage 1 (item generation): questionnaire items were generated from 30 patient interviews on the impact of MS on their lives, expert opinion and literature review. Stage 2 (item reduction and scale generation): the questionnaire developed in stage 1 was administered by postal survey to 1530 randomly selected members of the MS Society. Standard item reduction techniques were used to develop a rating scale from the pool of questionnaire items. Stage 3 (psychometric evaluation): the questionnaire was evaluated for data quality, scaling assumptions, acceptability, reliability and validity in a separate postal survey of 1250 MS Society members. Responsiveness was evaluated in 55 people admitted to hospital for rehabilitation and intravenous steroid treatment of MS relapses. RESULTS: Stage 1 resulted in a 129-item questionnaire. Stage 2 resulted in a 29-item rating scale measuring the physical and psychological impact of MS. The MSIS-29 satisfied all recommended psychometric criteria for rigorous measurement. Data quality was excellent: missing data were low, item test-retest reliability was high and scale scores could be generated for over 98% of respondents. Item descriptive statistics, item convergent and discriminant validity, and factor analysis supported summing items to produce two summary scores. MSIS-29 physical and psychological scale scores showed good variability, low floor and ceiling effects, good internal consistency and test-retest reliability. Correlations with other measures and confirmation of hypotheses about group differences provided evidence for the validity of the MSIS-29 as a measure of the physical and psychological impact of multiple sclerosis. Effect sizes provided preliminary evidence for responsiveness. CONCLUSIONS: The 29-item MSIS-29 is a rigorous new measure of the physical and psychological impact of MS. All psychometric criteria were satisfied and there is preliminary evidence of responsiveness. The MSIS-29 is particularly appropriate for use in clinical trials to evaluate therapeutic effectiveness from the patient's perspective. Further critical evaluations of the MSIS-29 completed by people with neurologist-confirmed MS in different settings are suggested. Head-to-head comparisons of the psychometric properties of the MSIS-29 and other outcome measures for MS will help to determine the relative advantages of different instruments so that the choice of measures for studies can be evidence based.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
EuroQol: a new facility for the measurement of health-related quality of life
(1990) · Health Policy · doi:10.1016/0168-8510(90)90421-9 · Cited by 15,736
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Statistical methods for assessing agreement between two methods of clinical measurement
Bland, J. M., & Altman, D. G. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.10.001 · Cited by 5,220
Measuring Functioning and Well-Being: The Medical Outcomes Study Approach
Stewart, A., & Ware, J. (1992) · doi:10.7249/cb361 · Cited by 2,689
Effect Sizes for Interpreting Changes in Health Status
Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989) · Medical Care · doi:10.1097/00005650-198903001-00015 · Cited by 2,401
Individual-patient monitoring in clinical practice: are available health status surveys adequate?
McHorney, C. A., & Tarlov, A. R. (1995) · Quality of Life Research · doi:10.1007/bf01593882 · Cited by 2,206
Cited by
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Self-citationSelf-monitoring of blood glucose in type 2 diabetes: systematic review
Clar, C., Barnard, K., Cummins, E., Royle, P., & Waugh, N. (2010) · Health Technology Assessment · doi:10.3310/hta14120 · Cited by 274
Martinez-Martin, P., Rodriguez-Blazquez, C., Alvarez-Sanchez, M., Arakaki, T., Bergareche-Yarza, A., Chade, A., Garretto, N., Gershanik, O., Kurtis, M. M., Martinez-Castrillo, J. C., et al. (2013) · Journal of Neurology · doi:10.1007/s00415-012-6624-1 · Cited by 252
Farrar, J. T., Troxel, A. B., Stott, C., Duncombe, P., & Jensen, M. P. (2008) · Clinical Therapeutics · doi:10.1016/j.clinthera.2008.05.011 · Cited by 252
Hind, D., Cotter, J., Thake, A., Bradburn, M., Cooper, C., Isaac, C., & House, A. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-5 · Cited by 180
“ondary outcome was the score on the Multiple Sclerosis Impact Scale (MSIS-29) psychological subscale [38].”
MethodLittle, P., Turner, S., Rumsby, K., Warner, G., Moore, M., Lowes, J., Smith, H., Hawke, C., Turner, D., Leydon, G., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13190 · Cited by 137
Vitamin K to prevent fractures in older women: systematic review and economic evaluation
Stevenson, M., Lloyd-Jones, M., & Papaioannou, D. (2009) · Health Technology Assessment · doi:10.3310/hta13450 · Cited by 90
Redefining functionality and treatment efficacy in multiple sclerosis
Foley, J. F., & Brandes, D. W. (2009) · Neurology · doi:10.1212/wnl.0b013e3181a99bc2 · Cited by 34
(2018) · International journal of body, mind and culture · doi:10.22122/ijbmc.v5i2.117 · Cited by 1
Metadata
- Authors
- Hobart, J., Riazi, A., Lamping, D., Fitzpatrick, R., & Thompson, A.
- Venue
- Health Technology Assessment
- Published
- 2004-03
- Volume
- 8
- Issue
- 9
- Pages
- iii, 1-48
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W1973185874
- Cited by
- 245
- References
- 14
- FWCI
- 4.02
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.