CoChat

Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods

Open access
Hobart, J, Cano, S · 2009 · Health Technology Assessment

The DOI matches its Crossref record; 241 of the 241 references it cites were found in a registry or an index.

Abstract

OBJECTIVES: In this monograph we examine the added value of new psychometric methods (Rasch measurement and Item Response Theory) over traditional psychometric approaches by comparing and contrasting their psychometric evaluations of existing sets of rating scale data. We have concentrated on Rasch measurement rather than Item Response Theory because we believe that it is the more advantageous method for health measurement from a conceptual, theoretical and practical perspective. Our intention is to provide an authoritative document that describes the principles of Rasch measurement and the practice of Rasch analysis in a clear, detailed, non-technical form that is accurate and accessible to clinicians and researchers in health measurement. REVIEW METHODS: A comparison was undertaken of traditional and new psychometric methods in five large sets of rating scale data: (1) evaluation of the Rivermead Mobility Index (RMI) in data from 666 participants in the Cannabis in Multiple Sclerosis (CAMS) study; (2) evaluation of the Multiple Sclerosis Impact Scale (MSIS-29) in data from 1725 people with multiple sclerosis; (3) evaluation of test-retest reliability of MSIS-29 in data from 150 people with multiple sclerosis; (4) examination of the use of Rasch analysis to equate scales purporting to measure the same health construct in 585 people with multiple sclerosis; and (5) comparison of relative responsiveness of the Barthel Index and Functional Independence Measure in data from 1400 people undergoing neurorehabilitation. RESULTS: Both Rasch measurement and Item Response Theory are conceptually and theoretically superior to traditional psychometric methods. Findings from each of the five studies show that Rasch analysis is empirically superior to traditional psychometric methods for evaluating rating scales, developing rating scales, analysing rating scale data, understanding and measuring stability and change, and understanding the health constructs we seek to quantify. CONCLUSIONS: There is considerable added value in using Rasch analysis rather than traditional psychometric methods in health measurement. Future research directions include the need to reproduce our findings in a range of clinical populations, detailed head-to-head comparisons of Rasch analysis and Item Response Theory, and the application of Rasch analysis to clinical practice.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3310/hta13120

Cites

241 of 241 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Items 201–241 of 241

Cited by

See all 643

Metadata

Authors
Hobart, J., & Cano, S.
Affiliations
  • Peninsula College of Medicine and Dentistry (GB)
  • UCL Queen Square Institute of Neurology (GB)
Corresponding author
Hobart, J
Venue
Health Technology Assessment
Published
2009-02
Volume
13
Issue
12
Pages
iii, ix-x, 1
ISSN
  • 1366-5278 (ISSN-L)
  • 2046-4924
OpenAlex
W2063923378
Cited by
621
References
240
Citations by year
2026: 34 · 2025: 46 · 2024: 59 · 2023: 48 · 2022: 38 · 2021: 58 · 2020: 41 · 2019: 36 · 2018: 29 · 2017: 41 · 2016: 27 · 2015: 35 · 2014: 29 · 2013: 35 · 2012: 22
FWCI
9.38
Type
journal article
Language
en
Open access
Locations
  • Health Technology Assessment (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Health Technology Assessment programme (95/01/05)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Health Sciences › Medicine › Clinical Neurology › Multiple Sclerosis Research Studies
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
Keywords
Rasch measurement, item response theory, multiple sclerosis, rating scales, psychometric assessment, Rivermead Mobility Index, MSIS-29, test-retest reliability, Barthel Index, Functional Independence Measure, neurorehabilitation, health measurement
MeSH terms
Activities of Daily Living, Evaluation Studies as Topic, Humans, Models, Psychological, Multiple Sclerosis, Psychometrics, Reproducibility of Results, Logistic Models, Sickness Impact Profile, Self Efficacy, Mobility Limitation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.