Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods
Open accessThe DOI matches its Crossref record; 241 of the 241 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: In this monograph we examine the added value of new psychometric methods (Rasch measurement and Item Response Theory) over traditional psychometric approaches by comparing and contrasting their psychometric evaluations of existing sets of rating scale data. We have concentrated on Rasch measurement rather than Item Response Theory because we believe that it is the more advantageous method for health measurement from a conceptual, theoretical and practical perspective. Our intention is to provide an authoritative document that describes the principles of Rasch measurement and the practice of Rasch analysis in a clear, detailed, non-technical form that is accurate and accessible to clinicians and researchers in health measurement. REVIEW METHODS: A comparison was undertaken of traditional and new psychometric methods in five large sets of rating scale data: (1) evaluation of the Rivermead Mobility Index (RMI) in data from 666 participants in the Cannabis in Multiple Sclerosis (CAMS) study; (2) evaluation of the Multiple Sclerosis Impact Scale (MSIS-29) in data from 1725 people with multiple sclerosis; (3) evaluation of test-retest reliability of MSIS-29 in data from 150 people with multiple sclerosis; (4) examination of the use of Rasch analysis to equate scales purporting to measure the same health construct in 585 people with multiple sclerosis; and (5) comparison of relative responsiveness of the Barthel Index and Functional Independence Measure in data from 1400 people undergoing neurorehabilitation. RESULTS: Both Rasch measurement and Item Response Theory are conceptually and theoretically superior to traditional psychometric methods. Findings from each of the five studies show that Rasch analysis is empirically superior to traditional psychometric methods for evaluating rating scales, developing rating scales, analysing rating scale data, understanding and measuring stability and change, and understanding the health constructs we seek to quantify. CONCLUSIONS: There is considerable added value in using Rasch analysis rather than traditional psychometric methods in health measurement. Future research directions include the need to reproduce our findings in a range of clinical populations, detailed head-to-head comparisons of Rasch analysis and Item Response Theory, and the application of Rasch analysis to clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“To this end, the Rasch measurement model [14] provides a powerful alternative by determining the extent to which observed data confirm with the model [11 -15].”
From Construct validity of a revised version of the Occupational Balance Questionnaire (2020) · cites this paper as [12]
The cited source says what the claim attributes to it.
In the citing paper
“However, CTT approaches to assessing the measurement properties of scales have limitations [11 -13].”
From Construct validity of a revised version of the Occupational Balance Questionnaire (2020) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
(1992) · PubMed · Cited by 33,716
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
EuroQol: a new facility for the measurement of health-related quality of life
(1990) · Health Policy · doi:10.1016/0168-8510(90)90421-9 · Cited by 15,736
(1965) · PubMed · Cited by 14,925
The Scree Test For The Number Of Factors
Cattell, R. B. (1966) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0102_10 · Cited by 13,554
Functional evaluation : Barthel index
Mahonery, F. I. (1965) · Medical Entomology and Zoology · Cited by 12,762
SF-36 health survey: Manual and interpretation guide
Ware, J. (2003) · Medical Entomology and Zoology · Cited by 11,424
Cited by
Items 601–643 of 643
Alexithymia and illness perceptions in persons with multiple sclerosis and their partners:
Luca, M. (2024) · Lancaster EPrints (Lancaster University) · doi:10.17635/lancaster/thesis/2389
Seebacher, B., Mills, R. J., Reindl, M., Zamarian, L., Kircher, S., Brenneis, C., Ehling, R., & Deisenhammer, F. (2021) · Figshare · doi:10.6084/m9.figshare.14445090
Alenius, S., Westergren, A., Lindström, P. N., Nilsson, M., Rask, M., & Behm, L. (2024) · Figshare · doi:10.6084/m9.figshare.25282915
Seebacher, B., Mills, R. J., Reindl, M., Zamarian, L., Kircher, S., Brenneis, C., Ehling, R., & Deisenhammer, F. (2021) · Figshare · doi:10.6084/m9.figshare.14445084
Seebacher, B., Mills, R. J., Reindl, M., Zamarian, L., Kircher, S., Brenneis, C., Ehling, R., & Deisenhammer, F. (2021) · Figshare · doi:10.6084/m9.figshare.14445087
Alenius, S., Westergren, A., Lindström, P. N., Nilsson, M., Rask, M., & Behm, L. (2024) · Figshare · doi:10.6084/m9.figshare.25282810
Active ageing in the right place - Contributions from the RELOC-AGE programme
Nordeström, F. (2024) · Lund University Publications (Lund University)
Basagni, B., Pellicciari, L., TANTI, A. D., Caselli, S., Piscitelli, D., Algeri, L., Ciurli, P., Conforti, J. M., Estraneo, A., Moretta, P., et al. (2025) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.25.08685-x
Kim, H.-R., Jo, E., Jin, X., Lee, S.-E., & Choi, C.-H. (2026) · F1000Research · doi:10.12688/f1000research.171305.1
Eriksson, A. F., Orwelius, L., Årestedt, K., Chew, M. S., & Wenemark, M. (2026) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-026-00993-7
Rasch Methodology for Assessment in International Contexts
Adu, P., Bartholomew, E. J., & Medvedev, O. N. (2026) · Springer eBooks · doi:10.1007/978-3-030-89738-3_5-1 · Cited by 2
Gaikwad, A. B., Bayan, B., Priyadarshani, A., Mullapudi, V. N., & Padiyar, A. P. (2026) · Cogent Food & Agriculture · doi:10.1080/23311932.2026.2621443
Ragnarsson, E. H., Lindgren, A., Johansson, M., Hellner, C., Nordgren, L. B., Forster, M. O., & Lundgren, T. (2026) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2026.100982
Are Intelligence Measures Stable Across Time and Groups? A Study of Invariance in a Synonyms Test
Melin, J., Wahlkrantz, E., Brandebo, M. F., Larsson, G., & Annell, S. (2026) · Educational methods and psychometrics · doi:10.65301/emp.2026.262
Hagell, P. (2026) · Educational methods and psychometrics · doi:10.65301/emp.2026.256
Cultural Generalizability of the Multidimensional Model of Mindfulness in the Indian Context
Raman, K. (2023) · Tuwhera (Auckland University of Technology)
Oliveira, A. R. S., Pereira, R. V. V., Dohoo, I. R., Angelos, J. A., VanHoy, G., Depenbrock, S. M., Williams, D. R., Barr, M. C., & Maier, G. U. (2026) · American Journal of Veterinary Research · doi:10.2460/ajvr.25.12.0453
Measurement Properties of the Swedish Empowerment Audiology Questionnaire: A Rasch Analysis
Yngve, M., Larsson, J., & Karlsson, E. (2026) · Journal of Speech Language and Hearing Research · doi:10.1044/2026_jslhr-25-00821
Samuelsson, M., Möllerberg, M., Maus, B., Olsson, C. M., & Jakobsson, J. (2026) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-026-06495-9
Petrocelli, M., Cutrupi, S., Vaira, L. A., Salzano, G., Manfuso, A., & Copelli, C. (2026) · European Journal of Plastic Surgery · doi:10.1007/s00238-026-02472-0
Donzé, C., Mékiès, C., Mouzawak, C., Pau, D., Civet, A., Brechenmacher, L., Paillot, G., Cohen, M., & Vermersch, P. (2026) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2026.107288 · Cited by 1
Regnault, A., Delbecque, L., M’Hari, M., Mazerolle, F., Biglan, K., Chandler, J., Schoen, I., Mamikonyan, E., Siderowf, A. D., & Weintraub, D. A. (2026) · Movement Disorders Clinical Practice · doi:10.1002/mdc3.70677
Bayan, B., Gaikwad, A. B., Mullapudi, V. N., Priyadarshani, A., Panemangalore, A. P., Rossignoli, C., & Dubey, S. K. (2026) · Environmental Development · doi:10.1016/j.envdev.2026.101501
Spray, I., Grzeda, M. T., Wilburn, J. N., Johnstone, E., Frank, W., Squitieri, F., Giancaterino, G., Minà, P. E., D’Alessio, B., Arnesen, A., et al. (2026) · Journal of Neurology · doi:10.1007/s00415-026-13898-8
Arcidiacono, F., Sesso, G., Prinzi, A., Barca, I., Palermo, A., Re, G., Naciu, A. M., Tabacco, G., Sigglekow, H., Frasca, F., et al. (2026) · Journal of Endocrinological Investigation · doi:10.1007/s40618-026-02944-x
Luo, Y., Hu, J., Tsang, A. P. L., & Bai, X. (2026) · Health & Social Care in the Community · doi:10.1155/hsc/8148071
Evaluation of statistical methods applied in observational studies in neurology
Tomašević, J., Pajčin, M., Stanisavljevic, D. M., Milošević, N., Kostić, S., & Stanić, M. (2026) · Srpski medicinski casopis Lekarske komore · doi:10.5937/smclk7-67463
Hossain, M. A., & Islam, M. N. (2026) · Bangladesh Journal of Psychology · doi:10.3329/bjop.v26i1.87137
Capturing Children's Voices in Healthcare: Development of the PREM‐Ped Questionnaire
Broström, E. W., Jungner, J. G., Bartholdson, C., Norgren, S., & Wenemark, M. (2026) · Acta Paediatrica · doi:10.1111/apa.70674
Klassen, A. F., Rae, C. S., de Vries, C. E. E., Dalaei, F., Kaur, M. N., Gallo, L., Hoogbergen, M. M., Poulsen, L., Pusic, A. L., & Cano, S. (2026) · Obesity · doi:10.1002/oby.70254
Self-citationGuidi, G., Esposto, M., Massai, P., Ottonello, M., Ceruso, M., Caselli, S., Porta, F. L., Piscitelli, D., & Pellicciari, L. (2026) · Disability and Rehabilitation · doi:10.1080/09638288.2026.2706362
Fawson, S., Mortimer, H., Abouzahr, A., Proudfoot, H., Ibrahimi, E., Dodsworth, N., Jackson, T., Milne‐Ives, M., REFUEL-M. S. Patient Advisory Group, Sanders, T., et al. (2026) · Trials · doi:10.1186/s13063-026-09925-8
Li, Y.-J., Zhu, D., & Tang, X.-L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1904485
Samuelsson, M., Jakobsson, J., Maus, B., Olsson, C. M., & Möllerberg, M. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-15491-1
Smith, A. B., Mealing, S., Lewis, D., & Joseph, A. (2026) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-026-01193-z
Bartholdson, C., Bennesved, A., Wenemark, M., Grönlund, C. F., Bremer, A., Brännström, M., Pergert, P., & Svantesson, M. (2026) · BMC Medical Ethics · doi:10.1186/s12910-026-01573-6
Validation and Psychometric Properties of the Thai Version of Phubbing Scale in Adolescents
Kim, Y., Dhammasaccakarn, W., Laeheem, K., & Rinthaisong, I. (2024) · Hatyai Academic Journal
Klassen, A. F., Rae, C. S., Morrison, S. D., Johnson, N., Khatchadourian, K., Graesser, J. G., & Kaur, M. N. (2026) · JMIR Research Protocols · doi:10.2196/100420
Measurement properties of subscales in the work environment impact questionnaire (WEIQ)
Yngve, M., Ekbladh, E., & Melin, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-77753-6
Fagerström, M., Festin, K., Lundgren, M. D. S. F. D. S., Löf, M., Melin, J., Neher, M., Nyström, C. D., & Thomas, K. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-15953-6
Yalcin, O. (n.d.) · Murdoch University Research Portal
Oyama, N., Crawford, F., Wada, S., Saito, K., & Bateman, A. (2026) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2026.2758193
Metadata
- Authors
- Hobart, J., & Cano, S.
- Affiliations
- Peninsula College of Medicine and Dentistry (GB)
- UCL Queen Square Institute of Neurology (GB)
- Corresponding author
- Hobart, J
- Venue
- Health Technology Assessment
- Published
- 2009-02
- Volume
- 13
- Issue
- 12
- Pages
- iii, ix-x, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2063923378
- Semantic Scholar
- 2f17618556f8b0f11d05f13faf9e03eb40d8876a
- Cited by
- 621
- References
- 240
- Citations by year
- 2026: 34 · 2025: 46 · 2024: 59 · 2023: 48 · 2022: 38 · 2021: 58 · 2020: 41 · 2019: 36 · 2018: 29 · 2017: 41 · 2016: 27 · 2015: 35 · 2014: 29 · 2013: 35 · 2012: 22
- FWCI
- 9.38
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Technology Assessment (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Health Technology Assessment programme (95/01/05)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Medicine › Clinical Neurology › Multiple Sclerosis Research Studies
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- Rasch measurement, item response theory, multiple sclerosis, rating scales, psychometric assessment, Rivermead Mobility Index, MSIS-29, test-retest reliability, Barthel Index, Functional Independence Measure, neurorehabilitation, health measurement
- MeSH terms
- Activities of Daily Living, Evaluation Studies as Topic, Humans, Models, Psychological, Multiple Sclerosis, Psychometrics, Reproducibility of Results, Logistic Models, Sickness Impact Profile, Self Efficacy, Mobility Limitation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.