Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist. Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist. Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,584
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., Bouter, L. M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00131-0 · Cited by 2,379
Self-citationAssessing health status and quality-of-life instruments: Attributes and review criteria
Lohr, K. N. (2002) · Quality of Life Research · doi:10.1023/a:1015291021312 · Cited by 2,269
Health Measurement Scales--A Practical Guide to Their Development and Use
Waclawski, E. R. (2010) · Occupational Medicine · doi:10.1093/occmed/kqp179 · Cited by 1,874
How to measure comorbiditya critical review of available methods
DEGROOT, V, BECKERMAN, H., LANKHORST, G., & BOUTER, L. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00585-1 · Cited by 1,757
Self-citationA methodological framework for assessing health indices
Kirshner, B., & Guyatt, G. (1985) · Journal of Chronic Diseases · doi:10.1016/0021-9681(85)90005-0 · Cited by 1,538
Methods for assessing responsiveness
Husted, J. A., Cook, R. J., Farewell, V. T., & Gladman, D. D. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00206-1 · Cited by 1,471
Evers, S., Goossens, M., de Vet, H., van Tulder, M., & Ament, A. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305050324 · Cited by 856
Self-citationA Comparative Review of Generic Quality-of-Life Instruments
Coons, S. J., Rao, S., Keininger, D. L., & Hays, R. D. (2000) · PharmacoEconomics · doi:10.2165/00019053-200017010-00002 · Cited by 822
Terwee, C. B., Dekker, F. W., Wiersinga, W. M., Prummel, M. F., & Bossuyt, P. M. M. (2003) · Quality of Life Research · doi:10.1023/a:1023499322593 · Cited by 664
Self-citationEvaluating quality-of-life and health status instruments: development of scientific review criteria
Lohr, K. N., Aaronson, N. K., Alonso, J., Audrey Burnam, M., Patrick, D. L., Perrin, E. B., & Roberts, J. S. (1996) · Clinical Therapeutics · doi:10.1016/s0149-2918(96)80054-3 · Cited by 591
Self-citationClinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature
Bot, S. D. M., Terwee, C. B., van der Windt, D. A. W. M., Bouter, L. M., Dekker, J., & de Vet, H. C. W. (2004) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2003.007724 · Cited by 541
Self-citationOutcome measures for adult critical care: a systematic review.
Hayes, Black, Jenkinson, Young, Rowan, Daly, & Ridley (2000) · Health Technology Assessment · doi:10.3310/hta4240 · Cited by 413
For the European Regulatory Issues on Quality of Life Assessment Group, Chassany, O., Sagnier, P., Marquis, P., Fullerton, S., & Aaronson, N. (2002) · Drug Information Journal · doi:10.1177/009286150203600127 · Cited by 365
Willke, R. J., Burke, L. B., & Erickson, P. (2004) · Controlled Clinical Trials · doi:10.1016/j.cct.2004.09.003 · Cited by 305
Group Techniques for Idea Building.
Anderson, K. L., & Moore, C. M. (1988) · Contemporary Sociology · doi:10.2307/2069666 · Cited by 292
Marinus, J. (2002) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.72.2.241 · Cited by 288
Psychometric properties of vision‐related quality of life questionnaires: a systematic review
De Boer, M. R., Moll, A. C., De Vet, H. C. W., Terwee, C. B., Völker‐Dieben, H. J. M., & Van Rens, G. H. M. B. (2004) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2004.00187.x · Cited by 263
Self-citationHealth-related quality of life outcomes measures
Andresen, E. M., & Meyers, A. R. (2000) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/apmr.2000.20621 · Cited by 229
Evaluation of Measures Used to Assess Quality of Life After Stroke
Buck, D., Jacoby, A., Massey, A., & Ford, G. (2000) · Stroke · doi:10.1161/01.str.31.8.2004 · Cited by 196
Outcome measures in palliative care for advanced cancer patients: a review
Hearn, J., & Higginson, I. J. (1997) · Journal of Public Health · doi:10.1093/oxfordjournals.pubmed.a024608 · Cited by 178
Measuring Quality of Life in Paediatric Patients
Connolly, M. A., & Johnson, J. A. (1999) · PharmacoEconomics · doi:10.2165/00019053-199916060-00002 · Cited by 170
Michener, L. A., & Leggin, B. G. (2001) · Journal of Hand Therapy · doi:10.1016/s0894-1130(01)80036-3 · Cited by 169
Margolis, M. K., Coyne, K., Kennedy-Martin, T., Baker, T., Schein, O., & Revicki, D. A. (2002) · PharmacoEconomics · doi:10.2165/00019053-200220120-00001 · Cited by 167
Assessing sensitivity to change: choosing the appropriate change coefficient
Stratford, P. W., & Riddle, D. L. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-23 · Cited by 157
Self-citationde Korte, J., Mombers, F. M. C., Sprangers, M. A. G., & Bos, J. D. (2002) · Archives of Dermatology · doi:10.1001/archderm.138.9.1221 · Cited by 146
Reliable and Valid Self-Report Outcome Measures in Sexual (Dys)function: A Systematic Review
Daker‐White, G. (2002) · Archives of Sexual Behavior · doi:10.1023/a:1014743304566 · Cited by 124
Development Standards for Health Measures
McDowell, I., & Jenkinson, C. (1996) · Journal of Health Services Research & Policy · doi:10.1177/135581969600100410 · Cited by 120
Sun, Y., Stürmer, T., Gunther, K. P., & Brenner, H. (1997) · Clinical Rheumatology · doi:10.1007/bf02247849 · Cited by 108
Methodological considerations in functional assessment.
Bombardier, C., & Tugwell, P. (1987) · PubMed · Cited by 99
Spinal cord injury and quality of life measures: a review of instrument psychometric quality
Hallin, P., Sullivan, M., & Kreuter, M. (2000) · Spinal Cord · doi:10.1038/sj.sc.3101054 · Cited by 90
Edwards, B., & Ung, L. (2002) · Cancer Nursing · doi:10.1097/00002820-200210000-00002 · Cited by 80
Quality of life instruments in studies of menorrhagia: a systematic review
Clark, T. J., Khan, K. S., Foon, R., Pattison, H. M., Bryan, S., & Gupta, J. K. (2002) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/s0301-2115(02)00076-3 · Cited by 77
Fried, B., Boers, M., & Baker, P. (1993) · PubMed · Cited by 45
Instruments for quality of life assessment in patients with inflammatory bowel disease
Pallis, A. G., & Mouzas, I. (2000) · Digestive and Liver Disease · doi:10.1016/s1590-8658(00)80330-8 · Cited by 35
A review of functional status measures for workers with upper extremity disorders
Salerno, D. F., Copley‐Merriman, C., Taylor, T. N., Shinogle, J. A., & Schulz, R. (2002) · Occupational and Environmental Medicine · doi:10.1136/oem.59.10.664 · Cited by 33
Psychometric evaluation of self-report questionnaires: the development of a checklist.
Bot, S. D. M., Terwee, C. B., van der Windt, D., Bouter, L. M., Dekker, J., & de Vet, H. C. W. (2003) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · Cited by 27
Self-citationde Tiedra, A. G., Mercadal, J., a, X. B., Mascar, J. M., & Lozano, R. (1998) · PharmacoEconomics · doi:10.2165/00019053-199814040-00007 · Cited by 25
A systematic review of the content and quality of wrist outcome instruments
Bialocerkowski, A. E., Grimmer, K. A., & Bain, G. I. (2000) · International Journal for Quality in Health Care · doi:10.1093/intqhc/12.2.149 · Cited by 24
Brennan, P. A., Palacios‐Callender, M., Zaki, G. A., Spedding, A. V., & Langdon, J. (2001) · Head & Neck · doi:10.1002/1097-0347(200103)23:3<201::aid-hed1019>3.0.co;2-m · Cited by 15
Swinkels, R. A. H. M., Oostendorp, R. A. B., & Bouter, L. M. (2004) · PubMed · Cited by 9
Self-citation
Cited by
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9606-8 · Cited by 4,260
Self-citationMokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., Bouter, L. M., & de Vet, H. C. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-22 · Cited by 1,834
Self-citationMokkink, L. B., Prinsen, C. A. C., Bouter, L. M., Vet, H. C. W. D., & Terwee, C. B. (2016) · Brazilian Journal of Physical Therapy · doi:10.1590/bjpt-rbf.2014.0143 · Cited by 895
Self-citationReeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., Schwartz, C., Revicki, D. A., Moinpour, C. M., McLeod, L. D., et al. (2013) · Quality of Life Research · doi:10.1007/s11136-012-0344-y · Cited by 845
Self-citationGuidelines for designing and evaluating feasibility pilot studies
Teresi, J. A., Yu, X., Stewart, A. L., & Hays, R. D. (2022) · Medical Care · doi:10.1097/mlr.0000000000001664 · Cited by 734
Metadata
- Authors
- Mokkink, L., Terwee, C., Knol, D., Stratford, P., Alonso, J., Patrick, D., Bouter, L., & de Vet, H.
- Venue
- BMC Medical Research Methodology
- Published
- 2006-01-24
- Volume
- 6
- Issue
- 1
- Pages
- 2-2
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2104471097
- Cited by
- 394
- References
- 42
- FWCI
- 16.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.