Cited by 4,465Delphi Technique in ResearchHealth Education and ValidationHealth Systems, Economic Evaluations, Quality of Life

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes

Open access

Mokkink, Lidwine B., Terwee, Caroline B., Patrick, Donald L., Alonso, Jordi, Stratford, Paul W., Knol, Dirk L., Bouter, Lex M., de Vet, Henrica C.W.·2010·Journal of Clinical Epidemiology

DOI 10.1016/j.jclinepi.2010.02.006

Open this paper in CoChat — free account Open PDF

Abstract

Objective Lack of consensus on taxonomy, terminology, and definitions has led to confusion about which measurement properties are relevant and which concepts they represent. The aim was to clarify and standardize terminology and definitions of measurement properties by reaching consensus among a group of experts and to develop a taxonomy of measurement properties relevant for evaluating health instruments.Study design and setting An international Delphi study with four written rounds was performed. Participating experts had a background in epidemiology, statistics, psychology, and clinical medicine. The panel was asked to rate their (dis)agreement about proposals on a five-point scale. Consensus was considered to be reached when at least 67% of the panel agreed.Results Of 91 invited experts, 57 agreed to participate and 43 actually participated. Consensus was reached on positions of measurement properties in the taxonomy (68-84%), terminology (74-88%, except for structural validity [56%]), and definitions of measurement properties (68-88%). The panel extensively discussed the positions of internal consistency and responsiveness in the taxonomy, the terms "reliability" and "structural validity," and the definitions of internal consistency and reliability.Conclusions Consensus on taxonomy, terminology, and definitions of measurement properties was reached. Hopefully, this will lead to a more uniform use of terms and definitions in the literature on measurement properties.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.jclinepi.2010.02.006

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764
Self-citation
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 7×
“According to these sources, homogeneity of the items refers to the unidimensionality of a scale [11] and is a prerequisite for a clear interpretation of the internal consistency statistic [8,11].”
BackgroundMethodInfluential
The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9606-8 · Cited by 4,260
Self-citation
Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,611
The Delphi List
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., Bouter, L. M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00131-0 · Cited by 2,470
Self-citation
Assessing health status and quality-of-life instruments: Attributes and review criteria
Lohr, K. N. (2002) · Quality of Life Research · doi:10.1023/a:1015291021312 · Cited by 2,281
Standards for Educational and Psychological Testing.
Jiménez-García, E. (2017) · Revista Española de Pedagogía · doi:10.22550/2174-0909.3051 · Cited by 2,227

Show all 16 references

Sorted by citations

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9606-8 · Cited by 4,260
Self-citation
COSMIN guideline for systematic reviews of patient-reported outcome measures
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1798-3 · Cited by 3,345
Self-citation
COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures
Mokkink, L. B., de Vet, H. C. W., Prinsen, C. A. C., Patrick, D. L., Alonso, J., Bouter, L. M., & Terwee, C. B. (2018) · Quality of Life Research · doi:10.1007/s11136-017-1765-4 · Cited by 2,479
Self-citation
COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study
Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Mokkink, L. B. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1829-0 · Cited by 2,348
Self-citation
Review of the Psychometric Evidence of the Perceived Stress Scale
Lee, E.-H. (2012) · Asian Nursing Research · doi:10.1016/j.anr.2012.08.004 · Cited by 2,305
The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content
Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-22 · Cited by 1,850
Self-citation
The Pittsburgh sleep quality index as a screening tool for sleep dysfunction in clinical and non-clinical samples: A systematic review and meta-analysis
Mollayeva, T., Thurairajah, P., Burton, K., Mollayeva, S., Shapiro, C. M., & Colantonio, A. (2016) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2015.01.009 · Cited by 1,847
Measures of knee function: International Knee Documentation Committee (IKDC) Subjective Knee Evaluation Form, Knee Injury and Osteoarthritis Outcome Score (KOOS), Knee Injury and Osteoarthritis Outcome Score Physical Function Short Form (KOOS‐PS), Knee Outcome Survey Activities of Daily Living Scale (KOS‐ADL), Lysholm Knee Scoring Scale, Oxford Knee Score (OKS), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Activity Rating Scale (ARS), and Tegner Activity Score (TAS)
Collins, N. J., Misra, D., Felson, D. T., Crossley, K. M., & Roos, E. M. (2011) · Arthritis Care & Research · doi:10.1002/acr.20632 · Cited by 1,238
Untitled work
(2011) · Amsterdam UMC (VU Amsterdam) - Institutional Repository · Cited by 1,209
Self-citation
Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures
Anthoine, E., Moret, L., Regnault, A., Sebille, V., & Hardouin, J.-B. (2014) · Health and Quality of Life Outcomes · doi:10.1186/s12955-014-0176-2 · Cited by 1,149
How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”–a practical guideline
Prinsen, C. A. C., Vohra, S., Rose, M. R., Boers, M., Tugwell, P., Clarke, M., Williamson, P. R., & Terwee, C. B. (2016) · Trials · doi:10.1186/s13063-016-1555-2 · Cited by 1,106
Self-citation
A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus
Epstein, J., Santo, R. M., & Guillemin, F. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.021 · Cited by 1,095
The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument
Mokkink, L. B., Prinsen, C. A. C., Bouter, L. M., de Vet, H. C. W., & Terwee, C. B. (2016) · Brazilian Journal of Physical Therapy · doi:10.1590/bjpt-rbf.2014.0143 · Cited by 915
Self-citation
ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research
Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., Schwartz, C. E., Revicki, D. A., Moinpour, C. M., McLeod, L., et al. (2013) · Quality of Life Research · doi:10.1007/s11136-012-0344-y · Cited by 887
Self-citation
Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments
Terwee, C. B., Jansma, E. P., Riphagen, I. I., & de Vet, H. C. W. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9528-5 · Cited by 849
Self-citation
Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0
Boers, M., Kirwan, J. R., Wells, G., Beaton, D., Gossec, L., d'Agostino, M.-A., Conaghan, P. G., Bingham, C. O., Brooks, P., Landewé, R., et al. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.013 · Cited by 781
“Drawing on key developments that have occurred after the formulation of the first Filter such as the work by the COSMIN group [31,32], and the GRADE recommendations [30], OMERACT is developing specific guidelines on the procedures to document applicability of instruments.”
Method
Measurement Properties of Visual Analogue Scale, Numeric Rating Scale, and Pain Severity Subscale of the Brief Pain Inventory in Patients With Low Back Pain: A Systematic Review
Chiarotto, A., Maxwell, L. J., Ostelo, R., Boers, M., Tugwell, P., & Terwee, C. B. (2018) · Journal of Pain · doi:10.1016/j.jpain.2018.07.009 · Cited by 780
Self-citation
Knee Injury and Osteoarthritis Outcome Score (KOOS): systematic review and meta-analysis of measurement properties
Collins, N. J., Prinsen, C. A. C., Christensen, R., Bartels, E. M., Terwee, C. B., & Roos, E. M. (2016) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2016.03.010 · Cited by 761
Self-citation
Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21022 · Cited by 719
Self-citation
COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study
Mokkink, L. B., Boers, M., van der Vleuten, C. P. M., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01179-5 · Cited by 588
Self-citation
The Copenhagen Hip and Groin Outcome Score (HAGOS): development and validation according to the COSMIN checklist
Thorborg, K., Hölmich, P., Christensen, R., Petersen, J., & Roos, E. M. (2011) · British Journal of Sports Medicine · doi:10.1136/bjsm.2010.080937 · Cited by 520
Meaningful changes for the Oxford hip and knee scores after joint replacement surgery
Beard, D. J., Harris, K. K., Dawson, J., Doll, H., Murray, D. W., Carr, A. J., & Price, A. J. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.009 · Cited by 501
Getting serious about test–retest reliability: a critique of retest research and some recommendations
Polit, D. F. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0632-9 · Cited by 492
Construct Validity of the Individual Work Performance Questionnaire
Koopmans, L., Bernaards, C., Hildebrandt, V., de Vet, H. D., & van der Beek, A. J. (2014) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000000113 · Cited by 396
Core outcome measurement instruments for clinical trials in nonspecific low back pain
Chiarotto, A., Boers, M., Deyo, R. A., Buchbinder, R., Corbin, T. P., Costa, L. O. P., Foster, N. E., Grotle, M., Koes, B. W., Kovacs, F. M., et al. (2018) · Pain · doi:10.1097/j.pain.0000000000001117 · Cited by 461
Self-citation
Conceptualizing and measuring mental illness stigma: The mental illness stigma framework and critical review of measures.
Fox, A. B., Earnshaw, V. A., Taverna, E. C., & Vogt, D. S. (2017) · Stigma and Health · doi:10.1037/sah0000104 · Cited by 504
EASI, (objective) SCORAD and POEM for atopic eczema: responsiveness and minimal clinically important difference
Schram, M. E., Spuls, P. I., Leeflang, M., Lindeboom, R., Bos, J. D., & Schmitt, J. M. (2011) · Allergy · doi:10.1111/j.1398-9995.2011.02719.x · Cited by 383
Is EQ-5D-5L Better Than EQ-5D-3L? A Head-to-Head Comparison of Descriptive Systems and Value Sets from Seven Countries
Janssen, M. F., Bonsel, G. J., & Luo, N. (2018) · PharmacoEconomics · doi:10.1007/s40273-018-0623-8 · Cited by 391
Measuring Teamwork in Health Care Settings
Valentine, M., Nembhard, I. M., & Edmondson, A. C. (2013) · Medical Care · doi:10.1097/mlr.0b013e31827feef6 · Cited by 408
A Core Set of Outcome Measures for Adults With Neurologic Conditions Undergoing Rehabilitation
Moore, J. L., Potter, K., Blankshain, K., Kaplan, S. L., O’Dwyer, L., & Sullivan, J. E. (2018) · Neurology Report · doi:10.1097/npt.0000000000000229 · Cited by 373
Mindfulness: a systematic review of instruments to measure an emergent patient-reported outcome (PRO)
Park, T., Reilly-Spong, M., & Gross, C. R. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0395-8 · Cited by 370
Cross-cultural adaptation of the Health Education Impact Questionnaire: experimental study showed expert committee, not back-translation, added value
Epstein, J., Osborne, R. H., Elsworth, G. R., Beaton, D., & Guillemin, F. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.07.013 · Cited by 357
Recommendations for selection of self-report pain intensity measures in children and adolescents: a systematic review and quality assessment of measurement properties
Birnie, K. A., Hundert, A. S., Lalloo, C., Nguyen, C., & Stinson, J. (2018) · Pain · doi:10.1097/j.pain.0000000000001377 · Cited by 358
Evaluating complex interventions in End of Life Care: the MORECare Statement on good practice generated by a synthesis of transparent expert consultations and systematic reviews
Higginson, I. J., Evans, C., Grande, G., Preston, N. J., Morgan, M., McCrone, P., Lewis, P. J., Fayers, P. M., Harding, R., Hotopf, M. H., et al. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-111 · Cited by 338
Evaluation of the measurement properties of the Epworth sleepiness scale: A systematic review
Kendzerska, T. B., Smith, P. M., Brignardello-Petersen, R., Leung, R. S., & Tomlinson, G. A. (2014) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2013.08.002 · Cited by 334
Adaptación cultural y validación de cuestionarios de salud: revisión y recomendaciones metodológicas
Ramada, J. M., Pujadas, C. S., & Delclós-Clanchet, G. L. (2013) · Salud Pública de México · doi:10.1590/s0036-36342013000100009 · Cited by 334
Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a ‘core outcome set’
Prinsen, C. A. C., Vohra, S., Rose, M. R., King-Jones, S., Ishaque, S., Bhaloo, Z., Adams, D., & Terwee, C. B. (2014) · Trials · doi:10.1186/1745-6215-15-247 · Cited by 332
Self-citation
Patient-Reported Outcomes In Performance Measurement
Cella, D. F., Hahn, E. A., Jensen, S. E., Butt, Z. A., Nowinski, C. J., Rothrock, N. E., & Lohr, K. N. (2015) · doi:10.3768/rtipress.2015.bk.0014.1509 · Cited by 339
The Harmonising Outcome Measures for Eczema (HOME) statement to assess clinical signs of atopic eczema in trials
Schmitt, J., Spuls, P. I., Thomas, K. S., Simpson, E., Furue, M., Deckert, S., Dohil, M., Apfelbacher, C., Singh, J. A., Chalmers, J., et al. (2014) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2014.07.043 · Cited by 319
Clinical Outcome Assessments: Conceptual Foundation—Report of the ISPOR Clinical Outcomes Assessment – Emerging Good Practices for Outcomes Research Task Force
Walton, M. K., Powers, J. H., Hobart, J. C., Patrick, D. L., Marquis, P., Vamvakas, S., Isaac, M., Molsen, E., Cano, S., & Burke, L. B. (2015) · Value in Health · doi:10.1016/j.jval.2015.08.006 · Cited by 310
Self-citation
The reliability of the Glasgow Coma Scale: a systematic review
Reith, F. C. M., den Brande, R. V., Synnot, A., Gruen, R. L., & Maas, A. I. R. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-4124-3 · Cited by 305
Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools
Lichtner, V., Dowding, D., Esterhuizen, P., Closs, S. J., Long, A., Corbett, A., & Briggs, M. (2014) · BMC Geriatrics · doi:10.1186/1471-2318-14-138 · Cited by 298
What the Eczema Area and Severity Index score tells us about the severity of atopic dermatitis: an interpretability study
Leshem, Y. A., Hajar, T., Hanifin, J. M., & Simpson, E. L. (2015) · British Journal of Dermatology · doi:10.1111/bjd.13662 · Cited by 295
Assessment of clinical signs of atopic dermatitis: A systematic review and recommendation
Schmitt, J. M., Langan, S., Deckert, S., Svensson, Å., von Kobyletzki, L., Thomas, K. S., & Spuls, P. I. (2013) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2013.07.008 · Cited by 295
Measuring Change in Quality of Life: Bias in Prospective and Retrospective Evaluation
Blome, C., & Augustin, M. (2015) · Value in Health · doi:10.1016/j.jval.2014.10.007 · Cited by 312
A systematic review of AI literacy scales
Lintner, T. (2024) · npj Science of Learning · doi:10.1038/s41539-024-00264-4 · Cited by 292
Systematic review of the QoR-15 score, a patient- reported outcome measure measuring quality of recovery after surgery and anaesthesia
Kleif, J., Waage, J., Christensen, K. B., & Gögenür, I. (2017) · British Journal of Anaesthesia · doi:10.1016/j.bja.2017.11.013 · Cited by 291
Roland-Morris disability questionnaire and Oswestry Disability Index: which has better measurement properties for measuring physical functioning in nonspecific low back pain? Systematic review and meta-analysis
Chiarotto, A., Maxwell, L. J., Terwee, C. B., Wells, G. A., Tugwell, P., & Ostelo, R. W. (2016) · Physical Therapy · doi:10.2522/ptj.20150420 · Cited by 290
Self-citation
2019 Update of the American College of Rheumatology Recommended Rheumatoid Arthritis Disease Activity Measures
England, B. R., Tiong, B. K., Bergman, M. J., Curtis, J. R., Kazi, S., Mikuls, T. R., O’Dell, J. R., Ranganath, V. K., Limanni, A., Suter, L. G., et al. (2019) · Arthritis Care & Research · doi:10.1002/acr.24042 · Cited by 290
Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21243 · Cited by 288
Self-citation
Revisiting the theoretical and methodological foundations of depression measurement
Fried, E. I., Flake, J. K., & Robinaugh, D. J. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00050-2 · Cited by 314
Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist
Mokkink, L. B., Terwee, C. B., Gibbons, E. J., Stratford, P. W., Alonso, J., Patrick, D. L., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-82 · Cited by 282
Self-citation
Spearman–Brown prophecy formula and Cronbach's alpha: different faces of reliability and opportunities for new applications
de Vet, H. C. W., Mokkink, L. B., Mosmuller, D. G. M., & Terwee, C. B. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.01.013 · Cited by 282
Self-citation
A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS)
Dambi, J. M., Corten, L., Chiwaridzo, M., Jack, H. E., Mlambo, T., & Jelsma, J. M. (2018) · Health and Quality of Life Outcomes · doi:10.1186/s12955-018-0912-0 · Cited by 302
Determination and comparison of the smallest detectable change (SDC) and the minimal important change (MIC) of four-shoulder patient-reported outcome measures (PROMs)
van Kampen, D. A., Willems, W. J., van Beers, L. W. A. H., Castelein, R. M., Scholtes, V. A., & Terwee, C. B. (2013) · Journal of Orthopaedic Surgery and Research · doi:10.1186/1749-799x-8-40 · Cited by 273
Self-citation
The Use of Patient-reported Outcomes (PRO) Within Comparative Effectiveness Research: Implications for Clinical Practice and Health Care Policy
Ahmed, S., Berzon, R. A., Revicki, D. A., Lenderking, W. R., Moinpour, C. M., Basch, E., Reeve, B. B., & Wu, A. W. (2012) · Medical Care · doi:10.1097/mlr.0b013e318268aaff · Cited by 272
Qualitative Attributes and Measurement Properties of Physical Activity Questionnaires: A Checklist
Terwee, C. B., Mokkink, L. B., van Poppel, M. N. M., Chinapaw, M. J. M., van Mechelen, W., & de Vet, H. C. W. (2010) · Sports Medicine · doi:10.2165/11531370-000000000-00000 · Cited by 269
Self-citation
The COPD assessment test: a systematic review
Gupta, N., Pinto, L., Morogan, A., & Bourbeau, J. (2014) · European Respiratory Journal · doi:10.1183/09031936.00025214 · Cited by 269
Measurement Properties of the Central Sensitization Inventory: A Systematic Review
Scerbo, T., Colasurdo, J., Dunn, S., Unger, J., Nijs, J., & Cook, C. E. (2017) · Pain Practice · doi:10.1111/papr.12636 · Cited by 268
What makes a measurement instrument valid and reliable?
Scholtes, V. A., Terwee, C. B., & Poolman, R. W. (2010) · Injury · doi:10.1016/j.injury.2010.11.042 · Cited by 267
Self-citation
Psychometric properties of gross motor assessment tools for children: a systematic review
Griffiths, A., Toovey, R. A. M., Morgan, P. E., & Spittle, A. J. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-021734 · Cited by 262
Appraising convergent validity of patient-reported outcome measures in systematic reviews: constructing hypotheses and interpreting outcomes
Abma, I. L., Rovers, M. M., & van der Wees, P. J. (2016) · BMC Research Notes · doi:10.1186/s13104-016-2034-2 · Cited by 269
Minimal important difference to infer changes in health-related quality of life—a systematic review
Jayadevappa, R., Cook, R., & Chhatre, S. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.009 · Cited by 248
Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review
Schellingerhout, J. M., Verhagen, A. P., Heymans, M. W., Koes, B. W., de Vet, H. C. W., & Terwee, C. B. (2011) · Quality of Life Research · doi:10.1007/s11136-011-9965-9 · Cited by 250
Self-citation
Framework and guidance for implementing patient-reported outcomes in clinical practice: evidence, challenges and opportunities
Porter, I. H., Gonçalves, D. C., Ricci‐Cabello, I., Sidey-Gibbons, C. J., Gangannagaripalli, J., Fitzpatrick, R. M., Black, N. A., Greenhalgh, J., & Valderas, J. M. (2016) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2015-0014 · Cited by 236
An introduction to patient-reported outcome measures (PROMs) in physiotherapy
Kyte, D. G., Calvert, M., van der Wees, P. J., ten Hove, R., Tolan, S., & Hill, J. C. (2014) · Physiotherapy · doi:10.1016/j.physio.2014.11.003 · Cited by 234
eHealth Literacy Instruments: Systematic Review of Measurement Properties
Lee, J., Lee, E., & Chae, D. (2021) · Journal of Medical Internet Research · doi:10.2196/30644 · Cited by 239
The harmonizing outcome measures for eczema (HOME) roadmap: a methodological framework to develop core sets of outcome measurements in dermatology
Schmitt, J., Apfelbacher, C., Spuls, P. I., Thomas, K. S., Simpson, E. L., Furue, M., Chalmers, J., & Williams, H. C. (2015) · Journal of Investigative Dermatology · doi:10.1038/jid.2014.320 · Cited by 230
A systematic review of the characteristics and validity of monitoring technologies to assess Parkinson’s disease
Godinho, C., Domingos, J., Cunha, G., Santos, A. T., Fernandes, R. M., Abreu, D., Gonçalves, N., Matthews, H., Isaacs, T., Duffen, J., et al. (2016) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-016-0136-7 · Cited by 226
Developing a Valid Patient-Reported Outcome Measure
Rothrock, N. E., Kaiser, K. A., & Cella, D. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.195 · Cited by 222
Patient reported outcomes in orthopaedics
Gagnier, J. J. (2017) · Journal of Orthopaedic Research® · doi:10.1002/jor.23604 · Cited by 223
Measurement Properties of the Barthel Index in Geriatric Rehabilitation
Bouwstra, H., Smit, E. B., Wattel, E., van der Wouden, J. C., Hertogh, C. M. P. M., Terluin, B., & Terwee, C. B. (2018) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2018.09.033 · Cited by 230
Self-citation
Selecting and Implementing Patient-Reported Outcome and Experience Measures to Assess Health System Performance
Bull, C. F., Teede, H. J., Watson, D. E., & Callander, E. J. (2022) · JAMA Health Forum · doi:10.1001/jamahealthforum.2022.0326 · Cited by 238
Psychometric properties of multicomponent tools designed to assess frailty in older adults: A systematic review
Sutton, J. L., Gould, R. L., Daley, S., Coulson, M., Ward, E. V., Butler, A. M., Nunn, S., & Howard, R. J. (2016) · BMC Geriatrics · doi:10.1186/s12877-016-0225-2 · Cited by 224
Assessing measurement in health: Beyond reliability and validity
Polit, D. F. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2015.07.002 · Cited by 210
Systematic Review of Body Image Measures
Kling, J., Kwakkenbos, L., Diedrichs, P. C., Rumsey, N., Frisén, A., Brandão, M. P., Silva, A. G., Dooley, B., Rodgers, R. F., & Fitzgerald, A. (2019) · Body Image · doi:10.1016/j.bodyim.2019.06.006 · Cited by 209
Outcome Measures in Clinical Trials for Multiple Sclerosis
van Munster, C. E. P., & Uitdehaag, B. M. J. (2017) · CNS Drugs · doi:10.1007/s40263-017-0412-5 · Cited by 202
White Paper by the European Society for Swallowing Disorders: Screening and Non-instrumental Assessment for Dysphagia in Adults
Speyer, R., Cordier, R., Farneti, D., Nascimento, W. V., Pilz, W., Vérin, É., Walshe, M., & Woisard, V. (2021) · Dysphagia · doi:10.1007/s00455-021-10283-7 · Cited by 216
Instruments to assess physical activity in patients with osteoarthritis of the hip or knee: a systematic review of measurement properties
Terwee, C. B., Bouwmeester, W., van Elsland, S. L., de Vet, H. C. W., & Dekker, J. (2011) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2011.01.002 · Cited by 201
Self-citation
Systematic review of the measurement properties of self-report physical activity questionnaires in healthy adult populations
Silsbury, Z., Goldsmith, R. H., & Rushton, A. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008430 · Cited by 200
Measuring women’s childbirth experiences: a systematic review for identification and analysis of validated instruments
Nilvér, H., Begley, C., & Berg, M. (2017) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-017-1356-y · Cited by 198
Responsiveness and Minimally Important Differences for 4 Patient-Reported Outcomes Measurement Information System Short Forms: Physical Function, Pain Interference, Depression, and Anxiety in Knee Osteoarthritis
Lee, A. C., Driban, J. B., Price, L. L., Harvey, W. F., Rodday, A. M., & Wang, C. (2017) · The Journal of Pain · doi:10.1016/j.jpain.2017.05.001 · Cited by 197
Anxiety scales used in pregnancy: systematic review
Sinesi, A., Maxwell, M., O’Carroll, R. E., & Cheyne, H. (2019) · BJPsych Open · doi:10.1192/bjo.2018.75 · Cited by 200
Systematic review of measurement properties of patient-reported outcome measures used in patients undergoing hip and knee arthroplasty
Harris, K. K., Dawson, J., Gibbons, E. J., Lim, C., Beard, D. J., Fitzpatrick, R. M., & Price, A. D. F. (2016) · Patient Related Outcome Measures · doi:10.2147/prom.s97774 · Cited by 194
The quality of instruments to assess the process of shared decision making: A systematic review
Gärtner, F. R., Bomhof‐Roordink, H., Smith, I. P., Scholl, I., Stiggelbout, A. M., & Pieterse, A. H. (2018) · PLoS ONE · doi:10.1371/journal.pone.0191747 · Cited by 203
Clinician-Reported Outcome Assessments of Treatment Benefit: Report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force
Powers, J. H., Patrick, D. L., Walton, M. K., Marquis, P., Cano, S., Hobart, J., Isaac, M., Vamvakas, S., Slagle, A., Molsen, E., et al. (2017) · Value in Health · doi:10.1016/j.jval.2016.11.005 · Cited by 191
Self-citation
Should we reframe how we think about physical activity and sedentary behaviour measurement? Validity and reliability reconsidered
Kelly, P., Fitzsimons, C. F., & Baker, G. (2016) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-016-0351-4 · Cited by 190
Measure once, cut twice—adding patient-reported outcome measures to the electronic health record for comparative effectiveness research
Wu, A. W., Kharrazi, H. H. K., Boulware, L. E., & Snyder, C. F. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.04.005 · Cited by 187
Development and initial cohort validation of the Arthritis Research UK Musculoskeletal Health Questionnaire (MSK-HQ) for use across musculoskeletal care pathways
Hill, J. C., Kang, S., Benedetto, E., Myers, H., Blackburn, S. J., Smith, S., Dunn, K. M., Hay, E. M., Rees, J. L., Beard, D. J., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012331 · Cited by 193
Measurement properties of the QuickDASH (Disabilities of the Arm, Shoulder and Hand) outcome measure and cross-cultural adaptations of the QuickDASH: a systematic review
Kennedy, C. A., Beaton, D., Smith, P. M., Eerd, D. V., Tang, K., Inrig, T., Hogg‐Johnson, S., Linton, D., & Couban, R. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0362-4 · Cited by 190
Self-report fatigue questionnaires in multiple sclerosis, Parkinson’s disease and stroke: a systematic review of measurement properties
Elbers, R. G., Rietberg, M. B., van Wegen, E. E. H., Verhoef, J., Kramer, S. F., Terwee, C. B., & Kwakkel, G. (2011) · Quality of Life Research · doi:10.1007/s11136-011-0009-2 · Cited by 188
Self-citation
Construct validity of the Post-COVID-19 Functional Status Scale in adult subjects with COVID-19
Machado, F. V. C., Meys, R., Delbressine, J. M., Vaes, A. W., Goërtz, Y. M. J., Herck, M. V., Houben‐Wilke, S., Boon, G. J. A. M., Barco, S., Burtin, C., et al. (2021) · Health and Quality of Life Outcomes · doi:10.1186/s12955-021-01691-2 · Cited by 194
Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales
Cömert, M., Zill, J. M., Christalle, E., Dirmaier, J., Härter, M. C., & Scholl, I. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152717 · Cited by 194
The “ W ound‐ QoL ”: A short questionnaire measuring quality of life in patients with chronic wounds based on three established disease‐specific instruments
Blome, C., Baade, K., Debus, E. S., Price, P., & Augustin, M. (2014) · Wound Repair and Regeneration · doi:10.1111/wrr.12193 · Cited by 188
Infusion phlebitis assessment measures: a systematic review
Ray‐Barruel, G., Polit, D. F., Murfield, J., & Rickard, C. M. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12107 · Cited by 179
Clinician-friendly lower extremity physical performance measures in athletes: a systematic review of measurement properties and correlation with injury, part 1. The tests for knee function including the hop tests
Hegedus, E. J., McDonough, S., Bleakley, C., Cook, C. E., & Baxter, D. G. (2014) · British Journal of Sports Medicine · doi:10.1136/bjsports-2014-094094 · Cited by 178
European white paper: oropharyngeal dysphagia in head and neck cancer
Baijens, L. W. J., Walshe, M., Aaltonen, L., Arens, C., Cordier, R., Cras, P. P., Crevier‐Buchman, L., Curtis, C., Golusiński, W., Govender, R., et al. (2020) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-020-06507-5 · Cited by 191
An Updated Systematic Review of Childhood Physical Activity Questionnaires
Hidding, L. M., Chinapaw, M. J. M., van Poppel, M. N. M., Mokkink, L. B., & Altenburg, T. M. (2018) · Sports Medicine · doi:10.1007/s40279-018-0987-0 · Cited by 184
Self-citation
Patient-reported outcomes: pathways to better health, better services, and better societies
Black, N. A., Burke, L. B., Forrest, C. B., Sieberer, U. H. R., Ahmed, S., Valderas, J. M., Bartlett, S. J., & Alonso, J. (2015) · Quality of Life Research · doi:10.1007/s11136-015-1168-3 · Cited by 171
Self-citation
The validity and reliability of screening measures for depression and anxiety disorders in multiple sclerosis
Marrie, R. A., Zhang, L., Lix, L. M., Graff, L. A., Walker, J. R., Fisk, J. D., Patten, S. B., Hitchon, C. A., Bolton, J. M., Sareen, J., et al. (2018) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2017.12.007 · Cited by 169

Authors: Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W.
Affiliations: Amsterdam Public Health (NL)
University of Washington (US)
Municipal Institute for Medical Research (ES)
McMaster University (CA)
Corresponding author: Mokkink, Lidwine B.
ORCID: Mokkink, Lidwine B.
Terwee, Caroline B.
Patrick, Donald L.
Alonso, Jordi
Stratford, Paul W.
Bouter, Lex M.
Venue: Journal of Clinical Epidemiology
Publisher: Elsevier BV
Published: 2010-07
Volume: 63
Issue: 7
Pages: 737-745
ISSN: 0895-4356 (ISSN-L)
DOI: 10.1016/j.jclinepi.2010.02.006
OpenAlex: W2171762906
Cited by: 4,465
References: 16
Citations by year: 2026: 345 · 2025: 416 · 2024: 495 · 2023: 458 · 2022: 425 · 2021: 452 · 2020: 384 · 2019: 278 · 2018: 253 · 2017: 236 · 2016: 220 · 2015: 149 · 2014: 149 · 2013: 92 · 2012: 60
FWCI: 205.30
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Journal of Clinical Epidemiology (publishedVersion)
PubMed (publishedVersion)
Pure Amsterdam UMC (publishedVersion)
Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
VU Research Portal (submittedVersion, other-oa)
Data Archiving and Networked Services (DANS) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Topics: Social Sciences › Sociology and Political Science › Delphi Technique in Research
Health Sciences › Nursing › Research and Theory › Health Education and Validation
Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
Keywords: measurement properties, COSMIN, terminology standardization, internal consistency, responsiveness, reliability statistics, structural validity, expert consensus
MeSH terms: Clinical Protocols, Data Interpretation, Statistical, Delphi Technique, Health Status, Health Status Indicators, Humans, International Cooperation, Terminology as Topic, Psychometrics, Quality of Life, Surveys and Questionnaires, Reproducibility of Results, Outcome Assessment, Health Care, Guidelines as Topic, Consensus

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks