The DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study
Open accessPublished version of a preprint
Abstract
Background: Scores on an outcome measurement instrument depend on the type and settings of the instrument used, how instructions are given to patients, how professionals administer and score the instrument, etc. The impact of all these sources of variation on scores can be assessed in studies on reliability and measurement error, if properly designed and analyzed. The aim of this study was to develop standards to assess the quality of studies on reliability and measurement error of clinician-reported outcome measurement instruments, performance-based outcome measurement instrument, and laboratory values. Methods: We conducted a 3-round Delphi study involving 52 panelists. Results: Consensus was reached on how a comprehensive research question can be deduced from the design of a reliability study to determine how the results of a study inform us about the quality of the outcome measurement instrument at issue. Consensus was reached on components of outcome measurement instruments, i.e. the potential sources of variation. Next, we reached consensus on standards on design requirements ( n = 5), standards on preferred statistical methods for reliability ( n = 3) and measurement error ( n = 2), and their ratings on a four-point scale. There was one term for a component and one rating of one standard on which no consensus was reached, and therefore required a decision by the steering committee. Conclusion: We developed a tool that enables researchers with and without thorough knowledge on measurement properties to assess the quality of a study on reliability and measurement error of outcome measurement instruments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Confirmatory factor analysis for applied research
Brown, T. A. (2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,621
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.006 · Cited by 4,465
Self-citationMokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9606-8 · Cited by 4,260
Self-citationCOSMIN guideline for systematic reviews of patient-reported outcome measures
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1798-3 · Cited by 3,345
Self-citationThe Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,611
Research works printed but not linked: 2
- Shavelson RJ, Webb NM. Generalizability Theory. A primer. Measurement Methods for the Social Science, vol. 1. Newbury Park: Sage Publishing; 1991.
- CANCHILD Centre for disability research, I.o.a.h.s., McMaster University. Outcome measures rating form guideline. 2004[31/8/2017]; Available from: https://www.canchild.ca/system/tenon/assets/attachments/000/000/372/original/measrate.pdf?license=yes.
Cited by
Sorted by citations
Items 201–300 of 587
Elsig, S., Allet, L., Bastiaenen, C. H. G., de Bie, R. A., & Hilfiker, R. (2023) · Archives of Physiotherapy · doi:10.1186/s40945-023-00170-9 · Cited by 6
“Two researchers (SE and RH) assessed methodological quality, applying the COSMIN risk of bias tool in the adapted version for clinician-reported or performance-based outcome measures [38].”
BackgroundMethodInfluentialBerardi, A., Galeoto, G., Ruffini, M., Simeon, R., Gonzalez-Bernal, J. J., & Seco‐Calvo, J. (2023) · Children · doi:10.3390/children10091528 · Cited by 6
“In the following validation study, the Consensus-Based Standards for the Selection of Health Status Measurement Instrument (COSMIN) checklist was followed, evaluating reliability and validity through internal consistency and construct validity [25].”
The reliability and applicability of the Ten Test in hand injuries: A systematic review
Chua, M., Seth, I., & Rozen, W. M. (2024) · Hand Therapy · doi:10.1177/17589983241230249 · Cited by 6
“21 Only through such investigations can the TT be validated for widespread clinical use.”
BackgroundAron, V., Strul, D., Vægter, H. B., Pitance, L., & Armijo-Olivo, S. L. (2024) · Scandinavian Journal of Pain · doi:10.1515/sjpain-2023-0104 · Cited by 6
Lally, E., Ericksen, H. M., & Earl-Boehm, J. E. (2022) · Journal of Sport Rehabilitation · doi:10.1123/jsr.2021-0288 · Cited by 6
Torres, R., Faria, S. I., Cavalheiro, L. M., Ferreira, P. L., & Gonçalves, R. S. (2022) · Acta Médica Portuguesa · doi:10.20344/amp.15119 · Cited by 6
COSMIN: Consensus-Based Standards for the Selection of Health Status Measurement Instruments
Mokkink, L. B., Terwee, C. B., & de Vet, H. C. W. (2021) · Springer eBooks · doi:10.1007/978-3-319-69909-7_595-2 · Cited by 6
Self-citationBocos-Corredor, E., Moggioli, F., Pérez-Fernández, T., Armijo-Olivo, S. L., Liébana, S., & Martín‐Pintado‐Zugasti, A. (2024) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-024-01438-2 · Cited by 5
Marshall, J., Gosa, M. M., & Dodrill, P. (2025) · International Journal of Speech-Language Pathology · doi:10.1080/17549507.2025.2538617 · Cited by 5
“…tools that assess the feeding skills domain of PFD. Quality assessment of the psychometric properties of the identified tools was completed using the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist (Mokkink et al., 2020; Terwee et al., 2012).”
Galeoto, G., Berardi, A., Alatri, F., Giannini, M. T., Tofani, M., & Valente, D. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-08890-2_16 · Cited by 5
Measurement properties of the Inclusion Body Myositis Functional Rating Scale
Salam, S., Symonds, T. L., Doll, H., Rousell, S., Randall, J., Lloyd-Price, L., Hudgens, S. A., Guldberg, C., Herbelin, L. L., Barohn, R. J., et al. (2024) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2024-333617 · Cited by 5
Amen, X., Roy, J., Baudry, S., Mouraux, D., & CANT, J. V. (2025) · International Journal of Sports Physical Therapy · doi:10.26603/001c.129585 · Cited by 5
Üneş, S., Tunçdemir, M., Özal, C., Delioğlu, K., Bıyık, K. S., & Günel, M. K. (2025) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x251336009 · Cited by 5
Translation and validation of the contact lens dry eye questionnaire 8 (CLDEQ-8) in Canadian French
Lortie-Milner, É., Boily, L., Michaud, L., Quesnel, N., Simard, P., Milner, V., & Boissy, P. (2022) · Contact Lens and Anterior Eye · doi:10.1016/j.clae.2022.101779 · Cited by 5
Bilika, P., Paliouras, A., Savvoulidou, K., Arribas‐Romano, A., Dimitriadis, Z., Billis, E. V., Στριμπάκος, Ν., & Kapreli, E. (2023) · PubMed Central · Cited by 5
do Bomfim, K. D. X., Leite, U. D. R., & de Góes, P. S. A. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e21027 · Cited by 5
“This review employed the updated Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) methodology for systematic reviews of PROMs [31,32].”
MethodInfluentialDeiss, V., Bähler, P., Kolly, P., Schärer, A., Henle, P., Eichelberger, P., Lutz, N., & Baur, H. (2024) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-024-07343-y · Cited by 5
“1, A), a digital version of the well-researched, reliable and valid Rolimeter [4, 13].”
MethodBorszcz, F. K., de Aguiar, R. A., Costa, V. P., Denadai, B. S., & de Lucas, R. D. (2024) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000004772 · Cited by 6
Guallar-Bouloc, M., Gómez-Bueno, P., González‐Sánchez, M., Molina‐Torres, G., Lomas‐Vega, R., & Galán-Mercant, A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312858 · Cited by 5
“In addition, the methodological quality of the studies was evaluated following the criteria of the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) tool [20].”
MethodHartley, L., Zappalà, M., Ehiogu, U. D., Heneghan, N. R., & Gardner, A. C. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02077-1 · Cited by 5
Development of the Observable Well-Being in Living With Dementia-Scale
Madsø, K. G., Pachana, N. A., & Nordhus, I. H. (2023) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/15333175231171990 · Cited by 5
“40 The coding is also described in such a way that knowing the client personally is not required.”
BackgroundInfluentialLally, E., Ericksen, H. M., & Earl-Boehm, J. E. (2022) · Journal of Sport Rehabilitation · doi:10.1123/jsr.2021-0287 · Cited by 6
Test-retest reliability of joint position sense in the carpometacarpal joint among healthy adults
Valdes, K. A., & Rider, J. V. (2023) · Journal of Hand Therapy · doi:10.1016/j.jht.2023.08.014 · Cited by 5
Psychometric properties of the German Stroke and Aphasia Quality of Life Scale 39 generic version
Breitenstein, C., on behalf of FCET2EC Study Group, Hilari, K., Baumgaertner, A., Grewe, T., Flöel, A., Ziegler, W., Martus, P., Ringelstein, E. B., Huber, W., et al. (2025) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.25.08963-4 · Cited by 4
de la Cuadra-Grande, A., Rejas, J., Casado, M. Á., Monroy, M., & Ruiz, M. Á. (2025) · Journal of Neurology · doi:10.1007/s00415-025-13348-x · Cited by 7
“As mentioned previously, all these properties were critically reviewed via the COSMIN Risk of Bias Tool (Online Resource 2) [25–27].”
InfluentialAmbaum, C., & Hoppe, M. (2025) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2025.1650741 · Cited by 4
Alanezi, T. N., Li, B., Al‐Omran, L., Alshabanah, L., Alkhayal, N. K., Verma, M., Alrumaih, H. A., Hussain, M. A., Mamdani, M. M., & Al-Omran, M. A. (2026) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-026-00992-8 · Cited by 4
Anand, E., van Croonenburg, T. J., Samaan, S., Tozer, P. J., Hart, A., Deepak, P., Ballard, D. H., Stoker, J., & Lung, P. (2026) · Insights into Imaging · doi:10.1186/s13244-026-02260-1 · Cited by 4
“Using the COSMIN framework, key measurement properties such as validity, reliability, and responsiveness were rigorously assessed [17, 18].”
Socorro-Cumplido, J. L., Chaler, J., Almirall, M., Sánchez‐Raya, J., Cano, M., & Román‐Viñas, B. (2024) · Journal of Pain · doi:10.1016/j.jpain.2024.104749 · Cited by 4
Galeoto, G., Berardi, A., Simeon, R., Seco‐Calvo, J., & Gonzalez-Bernal, J. J. (2024) · Neurological Sciences · doi:10.1007/s10072-024-07891-0 · Cited by 3
“Following approval from the original instrument developers, the SULCS and ARAT were translated from English to Italian in accordance with the principles outlined in the 'Translation and Cultural Adaptation of Patient-Reported Outcomes Measures' guideline [45].”
den Broecke, M. V., de Jong, S., Mbengi, R. K., & Vanroelen, C. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-087798 · Cited by 4
“44 However, few existing HRQoL instruments incorporate items related to the environmental factors (contextual factors, eg, attitudes), 57 leading to a gap in measures that can inform PRE items in relation to contextual barriers and facilitators.”
da Mata, D. A., Pais‐Cunha, I., Ferraz, S. C., Couto, D. D. R., Ferraz, C., Silva, S., Valente, J., Vieira‐Marques, P., Fonseca, J., Azevedo, I., et al. (2025) · JMIR Pediatrics and Parenting · doi:10.2196/73531 · Cited by 4
“The evaluation of the CARATKids questionnaire’s reliability adhered to the COSMIN Risk of Bias guidelines, ensuring a methodologically robust approach [33].”
Schonne, I., Gregg, L., & Wittkowski, A. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1426198 · Cited by 5
Holdsworth, C., Bladen, M., Harbidge, H., Drechsler, W. I., Mahaffey, R., Pérez‐Alenda, S., Sayers, F., Strike, K., Timmer, M. A., & Stephensen, D. (2025) · Haemophilia · doi:10.1111/hae.70081 · Cited by 4
Baroni, A. V., Perachiotti, G., Carpineto, A., Fregna, G., Antonioni, A., Flacco, M. E., & Straudi, S. (2025) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2025.07.013 · Cited by 4
Swan, K., Speyer, R., Scharitzer, M., Farneti, D., Brown, T., & Cordier, R. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11030724 · Cited by 5
Hansen, T., Rasmussen, S. A. F., Fabricius, J., Grove, L.-M. D., & Simpelaere, I. S. (2023) · Disability and Rehabilitation · doi:10.1080/09638288.2023.2178033 · Cited by 4
“This updated systematic review is guided by the PRISMA statement [21] and the Guideline for Systematic Reviews of Outcome Measurement Instruments by COSMIN [9,14,20,22–24].”
MethodSoares, A. L. C., Carvalho, R. F., Mogami, R., Meirelles, C., & Gomes, P. S. C. (2023) · Brazilian Journal of Kinanthropometry and Human Performance · doi:10.1590/1980-0037.2023v25e93936 · Cited by 4
Aakrann, E. B., & Brincks, J. (2024) · Clinical Rehabilitation · doi:10.1177/02692155241236609 · Cited by 4
Outcome Measurement Instruments Used to Evaluate Dermatologic Adverse Events in Cancer Trials
Shaigany, S., Mastacouris, N. C., Tannenbaum, R., Strunk, A., Luan, C., Burshtein, J. G., Burshtein, A. L., Carvajal, R. D., Garg, A., & Alloo, A. (2024) · JAMA Dermatology · doi:10.1001/jamadermatol.2024.0053 · Cited by 5
Graham, B., Smith, J. E., Wei, Y., Nelmes, P., & Latour, J. M. (2024) · Emergency Medicine Journal · doi:10.1136/emermed-2023-213521 · Cited by 4
“19 participants mainly reported a positive ED experience, several items with higher proportions of negative responses related to waiting experience (eg, I was given updates while waiting), physical comfort (eg, the seat or bed was comfortable) and provision of refreshments (‘eg, I was able to get…”
Galeoto, G., Berardi, A., Simeon, R., Panuccio, F., Fabbrini, G., Belvisi, D., Gonzalez-Bernal, J. J., & Seco‐Calvo, J. (2024) · Healthcare · doi:10.3390/healthcare12131351 · Cited by 4
“According to the 95% confidence interval of the ICC estimate, values less than 0.5 indicate poor reliability, values between 0.5 and 0.75 indicate moderate reliability, values between 0.75 and 0.9 indicate good reliability, and values greater than 0.90 indicate excellent reliability [55,56].”
BackgroundInfluentialElsman, E. B. M., Mokkink, L. B., & Offringa, M. (2024) · Quality of Life Research · doi:10.1007/s11136-024-03687-z · Cited by 4
Self-citationConcordance among pulse wave velocity assessment methods: A network meta-analysis
Cavero‐Redondo, I., Sequí‐Domínguez, I., Saz‐Lara, A., Klepzig, J. L. G., Lucerón‐Lucas‐Torres, M., Martínez‐García, I., Álvarez‐Bueno, C., & Martínez‐Vizcaíno, V. (2024) · Chinese Medical Journal · doi:10.1097/cm9.0000000000003205 · Cited by 4
Osman, A., Radman, D. P., Belchior, P. D. C., & Gélinas, I. (2025) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.13013 · Cited by 6
“The methodological quality of the selected studies, including the adequacy of their measurement properties, was assessed using the COSMIN checklist (Mokkink et al., 2020).”
InfluentialBuijs, G. S., Wee, M. A. T., Klein, C., Mokkink, L. B., Dobbe, J. G. G., Maas, M. M., Schafroth, M. U., Streekstra, G. J., Blankevoort, L., & Kievit, A. J. (2025) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2025.106531 · Cited by 4
Self-citationClinical rating scales for assessing pain in newborn infants
Bruschettini, M., Olsson, E., Persad, E., Garratt, A., & Soll, R. F. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000064 · Cited by 4
Villepinte, C., Cormier, C., Couderc, M., Lebely, C., Chih, H., Boissezon, X. D., Ranka, J. L., & Gasq, D. (2022) · Disability and Rehabilitation · doi:10.1080/09638288.2022.2055164 · Cited by 4
Stanford, G. E., Jones, M., Charman, S. C., Bilton, D., Usmani, O. S., Davies, J. C., & Simmonds, N. J. (2022) · Therapeutic Advances in Respiratory Disease · doi:10.1177/17534666221122572 · Cited by 4
Farooq, M. N., Naz, S., Kousar, A., & Shahzad, K. (2023) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-023-06586-5 · Cited by 4
“96 × √2 [35, 36] and standard deviation × √ (1 – ICC) [36], respectively, were used to determine measurement error [32].”
MethodValentine, K. D., Vo, H., Mancini, B., Urman, R. D., Arias, F., Barry, M. J., & Sepucha, K. (2023) · Medical Decision Making · doi:10.1177/0272989x231182436 · Cited by 4
“High school graduate or GED 3 (4) 5 (10) Some college or 2-y degree 15 (21) 15 (31) 4-y college graduate 21 (29) 11 (22) More than a 4-y college degree 32 (44) 17 (35) Health literacy, n (%) 0.”
BackgroundRavinskaya, M., Verbeek, J. H. A. M., Langendam, M. W., Daams, J. G., Hulshof, C. T. J., & Hoving, J. L. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.10.025 · Cited by 4
Olsson, H., Åhlund, K., Alfredsson, J., Andersson, D., Boström, A., Guidetti, S. G. E., Prytz, M., & Ekerstad, N. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-04525-6 · Cited by 4
Gallagher, K., Chant, K., Mancini, A., Bluebond‐Langner, M., & Marlow, N. (2023) · BMC Palliative Care · doi:10.1186/s12904-023-01326-x · Cited by 5
“An evaluation of the methodological qualities of the studies and the measurement properties will be undertaken using the COnsensus-based Standards for the selection of health Measurement INstruments (COS-MIN) guidelines [62–64].”
MethodElizagaray-García, I., Obispo-Villamayor, Á., Prats-Martínez, C., Prieto-Hernández, G., & Carvalho, G. F. (2024) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2024.102950 · Cited by 4
Wirdnam, M., Bonello, C., Mayes, S., Cook, J. L., & Ferrar, K. (2024) · Journal of Dance Medicine & Science · doi:10.1177/1089313x241272139 · Cited by 3
“17,18 Reflecting the 2-fold aim of the study, a 2-step systematic review with two separate literature searches was conducted.”
InfluentialKlukowska, A. M., Ciobanu-Caraus, O., Germans, M. R., Vandertop, W. P., Schröder, M. L., & Staartjes, V. E. (2024) · The Spine Journal · doi:10.1016/j.spinee.2024.10.027 · Cited by 3
Ntshingila, M. L. (2025) · EUREKA Social and Humanities · doi:10.21303/2504-5571.2025.003703 · Cited by 5
Mitchell, C., Kouaissi, S. E., Duncan-Zaleski, M., Bowen, A., Conroy, P., Whelan, B., Wallace, S. J., Cheyne, J. D., & Kirkham, J. J. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-099662 · Cited by 3
“…following: type of measurement tool and construct measured, number and aetiology of participants on whom it was tested, test procedure and analysis method used, psychometric properties tested and the results of their analysis, clinical utility and quality assessment (COSMIN risk of bias tool 19 ).”
Machado, C. M. M., Lanna, C. C. D., Garrido, J. C., Monticielo, O. A., Klumb, E. M., Tres, G. L., Moura, F. D. M., & Telles, R. W. (2025) · Rheumatology · doi:10.1093/rheumatology/keaf366 · Cited by 3
How many strides are needed for reliable markerless gait analysis?
Carvalho, A., Vanrenterghem, J., Pataky, T. C., Robinson, M. A., Veloso, A., & Moniz-Pereira, V. (2025) · Gait & Posture · doi:10.1016/j.gaitpost.2025.110020 · Cited by 3
Fahey, J. T., Bramah, C., Barber, R., Williams, J. R., McMahon, J. J., Comfort, P., & Ripley, N. J. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2606621 · Cited by 3
“Studies which included relative reliability (intraclass correlation coefficients [ICC]) were assessed for risk of bias using the COSMIN tool (Mokkink et al., 2020).”
Meldrum, K., Wallace, V., Webb, T., Ridgway, L., Quigley, R., Strivens, E., & Russell, S. (2023) · PLoS ONE · doi:10.1371/journal.pone.0292162 · Cited by 3
“Secondly, panellist drop-out from round-to-round is a potential limitation, especially when the rounds are conducted over a long period of time and are expecting a large time commitment [31].”
InfluentialPietragalla, G., Galeoto, G., Moresi, M., Ruffini, M., Simeon, R., Panuccio, F., Valente, D., & Berardi, A. (2024) · Brain Sciences · doi:10.3390/brainsci14070644 · Cited by 3
“The translation and cultural adaptation were conducted by applying international guidelines [21–23, For construct validity analysis, a comparison was carried out with the SPM scale, as the it investigates the child’s sensory processing, practices, and social participation, focusing not only on the…”
MethodTakasaki, H., & Kanayasu, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0308973 · Cited by 3
“For absolute reliability, minimum detectable changes (MDCs) were calculated using the standard deviations of the values and the ICC values on the basis of the following formulas: Interpretations of the ICC and kappa values were as follows: insufficient, < .7; sufficient, � .7 [15].”
MethodOszlánszky, J., Mensch, K., Hermann, P., & Zrubka, Z. (2024) · BMC Oral Health · doi:10.1186/s12903-024-05198-2 · Cited by 3
Feenstra, M. M., Sidenius, A., Nielsen, C., Kristensen, S. B., & Rudnicki, M. (2025) · Current Medical Research and Opinion · doi:10.1080/03007995.2025.2470749 · Cited by 3
“Validity and reliability constitute crucial psychometric attributes of an instrument to ensure measurements are accurate and dependable 22,23 .”
Norris, R. N., Price, A., Maddox, T. W., Boswell, W., Kerin, C., & Oldershaw, R. A. (2025) · Journal of Experimental Orthopaedics · doi:10.1002/jeo2.70251 · Cited by 2
“…mitigate bias related to the study design, signalling questions from the Consensus ‐ based Standards for the selection of health Measurement Instruments (COSMIN) [23] and Quality Assessment of Diagnostic Accuracy Studies (QUADAS ‐ 2) [37] risk of bias tools were considered during the design phase.”
Berardi, A., Conte, A., Cimmino, L., Cimmino, C., Baione, V., Crisafulli, S. G., Tofani, M., Tartaglia, M., Fabbrini, G., & Galeoto, G. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.847786 · Cited by 3
Bérubé-Mercier, P., Tapp, D., Cimon, M.-È., Li, T., Park, S. B., Bouhêlier, É., McGarragle, K., Robichaud, L.-A., Gewandter, J. S., Bouchard, M., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-057950 · Cited by 3
Ataman, R., Thomas, A., Roberge‐Dao, J., McKerral, M., Auger, C., Wittich, W., Talla, P. K., Boychuck, Z., & Ahmed, S. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2022.08.051 · Cited by 3
Liu, H., Li, Y., Li, Y., Wang, J., Su, N., Cui, N., Xu, K., Sun, Y., & Cao, F. (2023) · BMC Psychiatry · doi:10.1186/s12888-022-04506-w · Cited by 3
Lee, U., Lee, S., Kim, S.-A., Lee, J.-D., & Lee, S. (2023) · Medicine · doi:10.1097/md.0000000000033893 · Cited by 3
da Silva, R. S., Silva, S., Santos, V., Fernandes, J. G., Oliveira, R., Ribeiro, K. M. O. B. D. F., Fernandes, A. B. G. S., & Ribeiro, T. S. (2023) · F1000Research · doi:10.12688/f1000research.134161.1 · Cited by 1
“of studies that perform this analysis using the “COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments”.(18)”
MethodGrechi, G., Figueiredo, R. D. M., Nakamoto, L., Queiroz, I. P., da Rocha, M. P. P., de Sousa, R. R., & Leite, H. R. (2023) · Disability and Rehabilitation · doi:10.1080/09638288.2023.2251877 · Cited by 3
“The sample size followed the recommendations of the COSMIN standards, which recommend a minimum sample size of 50 subjects for reliability studies [18].”
Reliability of inter-recti distance measurement on ultrasound images captured by novice examiners
Chmielewska, D. D., Cebula, M., Gnat, R., Rudek-Zeprzałka, M., Gruszczyńska, K., Baron, J., & Opala-Berdzik, A. (2023) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2023.2255897 · Cited by 3
“The study design regarding the intra and inter-examiner reliability was based on the COSMIN checklist (Mokkink et al., 2020).”
Fabricio, A. M. F., Moreira, R. D. F. C., Poli, G. G., Venancio, M. G., Silva, C. M. D. A., Ferreira, C. H. J., Driusso, P., & Beleza, A. C. S. (2024) · International Urogynecology Journal · doi:10.1007/s00192-024-05747-x · Cited by 3
Eiger, B., Straszek, C. L., Pate, J. W., & Rathleff, M. S. (2024) · Scandinavian Journal of Pain · doi:10.1515/sjpain-2023-0092 · Cited by 3
Alfaro‐Díaz, C., Esandi, N., Clausen, A. M., Canga‐Armayor, N., Pueyo‐Garrigues, M., & Dieperink, K. B. (2024) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2024.151729 · Cited by 3
Freitas, M., Pinho, F., Martins, N. A., Pinho, L., Silva, S., Figueira, V., Vilas‐Boas, J. P., & Silva, A. (2024) · Disability and Rehabilitation · doi:10.1080/09638288.2024.2402085 · Cited by 3
“The Mini-BESTest_EP demonstrated excellent internal consistency with a Cronbach’s alpha of 0.89, indicating that the measured variables consistently reflect the same construct [59].”
InfluentialTranslation and validation of Malay version of NIOSH worker well-being questionnaire (WellBQ)
Sampil, N. S., Daud, A., & Hairon, S. M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322451 · Cited by 3
Tan, J. M., Halford, G. R. J., McBain, B., Lukin, M., & Köhler, F. (2023) · Prosthetics and Orthotics International · doi:10.1097/pxr.0000000000000220 · Cited by 3
“Where applicable, the COSMIN 2020 update for PerfOMs will also be used.(7) In accordance with the COSMIN”
MethodThron, M., Düking, P., Ruf, L., Härtel, S., Wöll, A., & Altmann, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2686847/v1 · Cited by 3
COSMIN: Consensus-Based Standards for the Selection of Health Status Measurement Instruments
Mokkink, L. B., Terwee, C. B., & de Vet, H. C. W. (2023) · Springer eBooks · doi:10.1007/978-3-031-17299-1_595 · Cited by 3
Self-citationBhat, A., Lee, A. L., Maiya, A. G., & Vaishali, K. (2023) · F1000Research · doi:10.12688/f1000research.138593.1 · Cited by 2
“For these reasons, an adapted COSMIN Risk of Bias checklist on reliability and measurement error will be used for performance-based outcome measures.(31) Any discrepancies will be discussed with AL.”
MethodOccupational Therapy Assessments of Cortical or Cerebral Visual Impairment: A Systematic Review
Weisser-Pike, O., Mitchell, A. W., & Cordova, L. (2023) · American Journal of Occupational Therapy · doi:10.5014/ajot.2023.050313 · Cited by 2
“We independently used the COnsensus-based Standards for the selection of health Measurement INstru-ments (COSMIN) Risk of Bias checklist (Mokkink et al., 2020, 2021; Mokkink, de Vet, et al., 2018; Mokkink, Prinsen, et al., 2018; Terwee et al., 2018) to assess the methodological quality of the…”
COSMIN Yanlılık Riski Kontrol Listesi’nin Türkçe’ye Uyarlanması
Uğur, H. G., Bektaş, M., Hendekçi, A., YAVUZ, A. Y., & ÇİÇEK, E. (2024) · Ordu Üniversitesi Hemşirelik Çalışmaları Dergisi · doi:10.38108/ouhcd.1359302 · Cited by 2
YORULMAZ, D. S. (2025) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70056 · Cited by 3
“Numerous methods, including Cronbach's alpha coefficient, two ‐ half test consistency, item ‐ total score correlation, and test ‐ retest reliability, are used to assess the reliability of measurement tools [39].”
Marreiros, D. J. D. O., Lokhorst, M. M., Young‐Afat, D. A., Stor, M. L. E., Horbach, S. E. R., Roorda, L. D., Luijten, M. A. J., Haverman, L., van der Horst, C. M. A. M., & Spuls, P. I. (2025) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2025.05.036 · Cited by 2
Repo, J. P., Pernaa, K. I., Pekkanen, L. T., Hatakka, J., Mäntymäki, H., Malmivaara, A. V., Salo, H., Suominen, E. N., Kankare, J., & Huttunen, J. (2025) · Brain and Spine · doi:10.1016/j.bas.2025.104325 · Cited by 2
“The FinSpine research steering group developed the study methodology, following the Consensus-based standards for the selection of health measurement instruments Risk of Bias tool (Mokkink et al., 2020) guidelines.”
Akkurt, L., Aksoy, C. C., & Yaman, F. (2025) · Applied Neuropsychology Adult · doi:10.1080/23279095.2025.2545543 · Cited by 2
Peak VO2 and heart rate depend on running slope: a systematic review and meta-analysis
de Lucas, R. D., Lanzarini, L. D. V., Lana, I. D., Turnes, T., Ventura, T. P., Denadai, B. S., & Borszcz, F. K. (2025) · Sport Sciences for Health · doi:10.1007/s11332-025-01543-2 · Cited by 3
“I) sample size; II) reporting of participants’ details; III) reporting of participants’ inclusion/exclusion criteria; and IV) reporting of stability of participants and test conditions) adapted from the COSMIN tool [26] (Supplementary Material, Table S3).”
Sontag, M., Röijezon, U., Brogårdh, C. B., & Ekstrand, E. (2025) · Journal of Rehabilitation Medicine – Clinical Communications · doi:10.2340/jrm-cc.v8.43929 · Cited by 2
Hassanmirzaei, B., Tabben, M., Schumacher, Y. O., Mammeri, H., Chaabane, M., Rekik, R., Drumond, R., Chebbi, S., & Bahr, R. (2025) · British Journal of Sports Medicine · doi:10.1136/bjsports-2025-110063 · Cited by 2
Ramalho, R. B., Montilha, V. B. V., Casonato, N. A., Mattiello, S. M., & Selistre, L. F. A. (2025) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2025.10.024 · Cited by 2
Craven, J., Theunissen, W. W. E. S., Lane, O., Beattie, S., Griffin, X. L., & Perry, D. C. (2025) · Bone & Joint Open · doi:10.1302/2633-1462.611.bjo-2025-0117.r1 · Cited by 2
“14-18 The COSMIN guidelines are widely considered the gold standard for assessing the quality of measurement properties.”
Ogura, A., Florio, E., Wileman, T. M., Dennison, L., & Psarakis, M. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2589689 · Cited by 2
“For reliability and measurement error, we used the COSMIN Risk of Bias tool (Version 1.0, 2020) (Mokkink et al., 2020), which offers updated criteria specifically suited for non-patient-reported outcome measures such as ClinROMs, PerFOMs, and laboratory values.”
InfluentialCheung, D., Wesson, J., Paul, S. S., Mackenzie, L. A., Goh, L., Canning, C. G., Almeida, L. R. S., Enright, M., & Allen, N. E. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2592495 · Cited by 2
Warneke, K., Oraže, M., Herbsleb, M., Afonso, J. R., & Wallot, S. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.12.007 · Cited by 2
Farley, C., Newman, A. N. L., Phillips, S. M., Smith‐Turchyn, J., & Brooks, D. (2025) · Thorax · doi:10.1136/thorax-2025-223967 · Cited by 2
Metadata
- Authors
- Mokkink, L. B., Boers, M., van der Vleuten, C. P. M., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B.
- Affiliations
- Amsterdam Public Health (NL)
- Universitat Pompeu Fabra (ES)
- University of Washington (US)
- Corresponding author
- Mokkink, L. B.
- Venue
- BMC Medical Research Methodology
- Published
- 2020-12
- Volume
- 20
- Issue
- 1
- Pages
- 293-293
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC7712525
- OpenAlex
- W3107903990
- Cited by
- 588
- References
- 31
- Citations by year
- 2026: 106 · 2025: 121 · 2024: 149 · 2023: 101 · 2022: 72 · 2021: 37 · 2020: 2
- FWCI
- 32.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, cc-by)
- VU Research Portal (publishedVersion, other-oa)
- Pure Amsterdam UMC (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (submittedVersion)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (91617098)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- COSMIN, risk of bias, reliability statistics, measurement error, outcome measurement instruments, clinician-reported outcomes, performance-based outcome measures, laboratory parameters, study quality assessment, Delphi consensus, measurement properties
- MeSH terms
- Delphi Technique, Humans, Reproducibility of Results, Bias, Consensus
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
