Measures of response agreement for qualitative data: Some generalizations and alternatives.

A Coefficient of Agreement for Nominal Scales

Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · see citing works

Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit

Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · see citing works

Rank Correlation Methods.

Kendall, M. G. (1957) · Biometrika · doi:10.2307/2333282 · Cited by 6,444 · see citing works

Some Methods for Strengthening the Common χ 2 Tests

Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001616 · Cited by 3,718 · see citing works

Measures of Association for Cross Classifications

Goodman, L. A., & Kruskal, W. (1979) · Springer series in statistics · doi:10.1007/978-1-4612-9995-0 · Cited by 2,255 · see citing works

Reliability of Content Analysis: The Case of Nominal Scale Coding

Scott, W. A. (1955) · Public Opinion Quarterly · doi:10.1086/266577 · Cited by 1,853 · see citing works

Large sample standard errors of kappa and weighted kappa.

Fleiss, J. L., Cohen, J., & Everitt, B. S. (1969) · Psychological Bulletin · doi:10.1037/h0028106 · Cited by 1,542 · see citing works

Estimation of the reliability of ratings.

Ebel, R. L. (1951) · Psychometrika · doi:10.1007/bf02288803 · Cited by 976 · see citing works

Intraclass Correlation and the Analysis of Variance

Trese, T., & Haggard, E. A. (1958) · The American Catholic Sociological Review · doi:10.2307/3708305 · Cited by 403 · see citing works

A NEW VIEW OF INTER‐OBSERVER AGREEMENT1

Burdock, E. I., Fleiss, J. L., & Hardesty, A. S. (1963) · Personnel Psychology · doi:10.1111/j.1744-6570.1963.tb01283.x · Cited by 221 · see citing works

The Statistical Measurement of Agreement

Robinson, W. S. (1957) · American Sociological Review · doi:10.2307/2088760 · Cited by 221 · see citing works

The Robustness of Homogeneity Tests in 2 x N Tables

Lewontin, R. C., & Felsenstein, J. (1965) · Biometrics · doi:10.2307/2528349 · Cited by 194 · see citing works

MOMENTS OF THE STATISTICS KAPPA AND WEIGHTED KAPPA

Everitt, B. S. (1968) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1968.tb00400.x · Cited by 156 · see citing works

Estimating the Accuracy of Dichotomous Judgments

Fleiss, J. L. (1965) · Psychometrika · doi:10.1007/bf02289537 · Cited by 58 · see citing works

AN INTRODUCTION TO SOME NON-PARAMETRIC GENERALIZATIONS OF ANALYSIS OF VARIANCE AND MULTIVARIATE ANALYSIS

Roy, S., & Mitra, S. K. (1956) · Biometrika · doi:10.1093/biomet/43.3-4.361 · Cited by 53 · see citing works

Symposium on statistics for the clinician

Zubin, J. (1950) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195001)6:1 · Cited by 32 · see citing works

A Rapid Non-Parametric Estimate of Multi-Judge Reliability

Cartwright, D. S. (1956) · Psychometrika · doi:10.1007/bf02289084 · Cited by 20 · see citing works

The Measurement of Observer Agreement for Categorical Data

Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works

Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial

Hallgren, K. A. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p023 · Cited by 3,884 · see citing works

Relation of sample size to the stability of component patterns.

Guadagnoli, E., & Velicer, W. F. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.2.265 · Cited by 2,880 · see citing works

Computing inter‐rater reliability and its variance in the presence of high agreement

Gwet, K. L. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711006x126600 · Cited by 2,167 · see citing works

Reliability of Nominal Data Based on Qualitative Judgments

Perreault, W. D., & Leigh, L. E. (1989) · Journal of Marketing Research · doi:10.2307/3172601 · Cited by 1,575 · see citing works

A Qualitative Investigation of Perceived Executive Ethical Leadership: Perceptions from Inside and Outside the Executive Suite

Treviño, L. K., Brown, M., & Hartman, L. P. (2003) · Human Relations · doi:10.1177/0018726703056001448 · Cited by 1,372 · see citing works

Rape Myth Acceptance: Exploration of Its Structure and Its Measurement Using theIllinois Rape Myth Acceptance Scale

Payne, D. L., Lonsway, K. A., & Fitzgerald, L. F. (1999) · Journal of Research in Personality · doi:10.1006/jrpe.1998.2238 · Cited by 1,114 · see citing works

Autism diagnostic interview: A standardized investigator-based instrument

Le Couteur, A., Rutter, M., Lord, C., Rios, P., Robertson, S., Holdgrafer, M., & McLennan, J. (1989) · Journal of Autism and Developmental Disorders · doi:10.1007/bf02212936 · Cited by 1,036 · see citing works

Beyond kappa: a review of interrater agreement measures

Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999) · Canadian Journal of Statistics · doi:10.2307/3315487 · Cited by 976 · see citing works

Comparative reproducibility and validity of systems for assessing cardiovascular functional class: advantages of a new specific activity scale.

Goldman, L., Hashimoto, B. E., Cook, E. F., & Loscalzo, A. (1981) · Circulation · doi:10.1161/01.cir.64.6.1227 · Cited by 976 · see citing works

INTEGRATED AND DECOUPLED CORPORATE SOCIAL PERFORMANCE: MANAGEMENT COMMITMENTS, EXTERNAL PRESSURES, AND CORPORATE ETHICS PRACTICES.

Weaver, G. R., Treviño, L. K., & Cochran, P. L. (1999) · Academy of Management Journal · doi:10.2307/256975 · Cited by 941 · see citing works

The Handbook of Research Synthesis

Ziegel, E. R., Cooper, H., & Hedges, L. V. (1995) · Technometrics · doi:10.2307/1269651 · Cited by 936 · see citing works

CORPORATE ETHICS PROGRAMS AS CONTROL SYSTEMS: INFLUENCES OF EXECUTIVE COMMITMENT AND ENVIRONMENTAL FACTORS.

Weaver, G. R., Treviño, L. K., & Cochran, P. L. (1999) · Academy of Management Journal · doi:10.2307/256873 · Cited by 674 · see citing works

The Reliability of Clinical Methods, Data and Judgments

Koran, L. M. (1975) · New England Journal of Medicine · doi:10.1056/nejm197509252931307 · Cited by 654 · see citing works

A Re-analysis of the Reliability of Psychiatric Diagnosis

Spitzer, R. L., & Fleiss, J. L. (1974) · The British Journal of Psychiatry · doi:10.1192/bjp.125.4.341 · Cited by 612 · see citing works

Integration and generalization of kappas for multiple raters

Conger, A. J. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.2.322 · Cited by 545 · see citing works

Kappa coefficients in medical research

KRAEMER, H. C., Periyakoil, V. S., & Noda, A. M. (2002) · Statistics in Medicine · doi:10.1002/sim.1180 · Cited by 533 · see citing works

Reliability from α to ω: A tutorial.

Revelle, W., & Condon, D. M. (2019) · Psychological Assessment · doi:10.1037/pas0000754 · Cited by 514 · see citing works

Moral Awareness in Business Organizations: Influences of Issue-Related and Social Context Factors

Butterfield, K. D., Trevin, L. K., & Weaver, G. R. (2000) · Human Relations · doi:10.1177/0018726700537004 · Cited by 508 · see citing works

Applied MANOVA and Discriminant Analysis

Huberty, C. J., & Olejnik, S. F. (2005) · Wiley series in probability and statistics · doi:10.1002/047178947x · Cited by 507 · see citing works

Measuring Agreement between Two Judges on the Presence or Absence of a Trait

Fleiss, J. L. (1975) · Biometrics · doi:10.2307/2529549 · Cited by 501 · see citing works

SPECIES: A Spatial Evaluation of Climate Impact on the Envelope of Species

Pearson, R. G., Dawson, T. P., Berry, P. M., & Harrison, P. A. (2002) · Ecological Modelling · doi:10.1016/s0304-3800(02)00056-x · Cited by 474 · see citing works

Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce — Part 1: definition and development of a standardised, consensus-based scoring system

D’Agostino, M. A., Terslev, L., Aegerter, P., Backhaus, M., Balint, P. V., Bruyn, G. A. W., Filippucci, E., Grassi, W., Iagnocco, A., Jousse‐Joulin, S., et al. (2017) · RMD Open · doi:10.1136/rmdopen-2016-000428 · Cited by 438 · see citing works

The Appropriateness Evaluation Protocol

Gertman, P. M., & Restuccia, J. D. (1981) · Medical Care · doi:10.1097/00005650-198108000-00005 · Cited by 403 · see citing works

Examining the Dimensions of Cancer-Related Information Seeking and Scanning Behavior

Niederdeppe, J., Hornik, R., Kelly, B., Frosch, D. L., Romantan, A., Stevens, R. S., Barg, F. K., Weiner, J. L., & Schwartz, J. S. (2007) · Health Communication · doi:10.1080/10410230701454189 · Cited by 396 · see citing works

Lamina-Specific Alterations in the Dopamine Innervation of the Prefrontal Cortex in Schizophrenic Subjects

Akil, M., Pierri, J. N., Whitehead, R. E., Edgar, C. L., Mohila, C., Sampson, A. R., & Lewis, D. A. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.10.1580 · Cited by 393 · see citing works

Measuring Agreement for Multinomial Data

Davies, M., & Fleiss, J. L. (1982) · Biometrics · doi:10.2307/2529886 · Cited by 355 · see citing works

A Review and Taxonomy of Choice Architecture Techniques

Münscher, R., Vetter, M., & Scheuerle, T. (2015) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1897 · Cited by 353 · see citing works

Topic Modeling as a Strategy of Inquiry in Organizational Research: A Tutorial With an Application Example on Organizational Culture

Schmiedel, T., Müller, O., & vom Brocke, J. (2019) · Organizational Research Methods · doi:10.1177/1094428118773858 · Cited by 319 · see citing works

MultiPic: A standardized set of 750 drawings with norms for six European languages

Duñabeitia, J. A., Crepaldi, D., Meyer, A. S., New, B., Pliatsikas, C., Smolka, E., & Brysbaert, M. (2017) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2017.1310261 · Cited by 308 · see citing works

Barriers to the Use of Mobile Health in Improving Health Outcomes in Developing Countries: Systematic Review

Kruse, C., Betancourt, J., Ortiz, S., Valdes Luna, S. M., Bamrah, I. K., & Segovia, N. (2019) · Journal of Medical Internet Research · doi:10.2196/13263 · Cited by 299 · see citing works

Symptoms of temporomandibular disorders in the population: an epidemiological study.

Gonçalves, D. A. D. G., Fabbro, A. L. D., Campos, J. Á. D. B., BIGAL, M. E., & Speciali, J. G. (2010) · PubMed · Cited by 295 · see citing works

Ramifications of a Population Model for κ as a Coefficient of Reliability

KRAEMER, H. C. (1979) · Psychometrika · doi:10.1007/bf02296208 · Cited by 295 · see citing works

2 x 2 Kappa Coefficients: Measures of Agreement or Association

Bloch, D. A., & KRAEMER, H. C. (1989) · Biometrics · doi:10.2307/2532052 · Cited by 291 · see citing works

Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce-Part 2: reliability and application to multiple joints of a standardised consensus-based scoring system

Terslev, L., Naredo, E., Aegerter, P., Wakefield, R. J., Backhaus, M., Balint, P. V., Bruyn, G. A. W., Iagnocco, A., Jousse‐Joulin, S., Schmidt, W., et al. (2017) · RMD Open · doi:10.1136/rmdopen-2016-000427 · Cited by 289 · see citing works

Utilization Barriers and Medical Outcomes Commensurate With the Use of Telehealth Among Older Adults: Systematic Review

Kruse, C., Fohn, J., Wilson, N., Nunez Patlan, E., Zipp, S., & Mileski, M. (2020) · JMIR Medical Informatics · doi:10.2196/20359 · Cited by 295 · see citing works

Reliability of a consensus-based ultrasound definition and scoring for enthesitis in spondyloarthritis and psoriatic arthritis: an OMERACT US initiative

Balint, P. V., Terslev, L., Aegerter, P., Bruyn, G. A. W., Chary-Valckenaere, I., Gandjbakhch, F., Iagnocco, A., Jousse‐Joulin, S., Möller, I., Naredo, E., et al. (2018) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2018-213609 · Cited by 281 · see citing works

Objective Quantification of the Ki67 Proliferative Index in Neuroendocrine Tumors of the Gastroenteropancreatic System

Tang, L. H., Gönen, M., Hedvat, C. V., Modlin, I. M., & Klimstra, D. S. (2012) · The American Journal of Surgical Pathology · doi:10.1097/pas.0b013e318263207c · Cited by 259 · see citing works

The development and application of a classification scheme of informal helping behaviours.

Gottlieb, B. H. (1978) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/h0081539 · Cited by 243 · see citing works

A Generalization of Cohen's Kappa Agreement Measure to Interval Measurement and Multiple Raters

Berry, K. J., & Mielke, P. W. (1988) · Educational and Psychological Measurement · doi:10.1177/0013164488484007 · Cited by 240 · see citing works

Definitions and reliability assessment of elementary ultrasound lesions in giant cell arteritis: a study from the OMERACT Large Vessel Vasculitis Ultrasound Working Group

Chrysidis, S., Duftner, C., Dejaco, C., Schäfer, V. S., Ramiro, S., Carrara, G., Scirè, C. A., Hočevar, A., Diamantopoulos, A. P., Iagnocco, A., et al. (2018) · RMD Open · doi:10.1136/rmdopen-2017-000598 · Cited by 238 · see citing works

Measuring interrater reliability among multiple raters: An example of methods for nominal data

Posner, K. L., Sampson, P. D., Caplan, R. A., Ward, R. J., & Cheney, F. W. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090917 · Cited by 229 · see citing works

Inequalities between multi-rater kappas

Warrens, M. (2010) · Advances in Data Analysis and Classification · doi:10.1007/s11634-010-0073-4 · Cited by 244 · see citing works

Defining Enthesitis in Spondyloarthritis by Ultrasound: Results of a Delphi Process and of a Reliability Reading Exercise

Terslev, L., Naredo, E., Iagnocco, A., Balint, P. V., Wakefield, R. J., Aegerter, P., Aydın, S. Z., Bachta, A., Hammer, H. B., Bruyn, G. A. W., et al. (2013) · Arthritis Care & Research · doi:10.1002/acr.22191 · Cited by 216 · see citing works

The Comprehensive System for the Rorschach: A Critical Examination

Wood, J. M., Nezworski, M. T., & Stejskal, W. J. (1996) · Psychological Science · doi:10.1111/j.1467-9280.1996.tb00658.x · Cited by 211 · see citing works

PUNISHMENT FROM THE MANAGER'S PERSPECTIVE: A GROUNDED INVESTIGATION AND INDUCTIVE MODEL.

Butterfield, K. D., Treviño, L. K., & Ball, G. A. (1996) · Academy of Management Journal · doi:10.2307/257066 · Cited by 211 · see citing works

Headache and Symptoms of Temporomandibular Disorder: An Epidemiological Study

Gonçalves, D. A. D. G., BIGAL, M. E., Jales, L. C. F., Camparis, C. M., & Speciali, J. G. (2009) · Headache The Journal of Head and Face Pain · doi:10.1111/j.1526-4610.2009.01511.x · Cited by 209 · see citing works

What Makes Smartphone Use Meaningful or Meaningless?

Lukoff, K., Yu, C., Kientz, J., & Hiniker, A. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191754 · Cited by 205 · see citing works

Observer Agreement and Reliabilities of Classroom Observational Measures

Frick, T. W., & Semmel, M. I. (1978) · Review of Educational Research · doi:10.3102/00346543048001157 · Cited by 205 · see citing works

Statistical methods for assessing agreement for ordinal data

Jakobsson, U., & Westergren, A. (2005) · Scandinavian Journal of Caring Sciences · doi:10.1111/j.1471-6712.2005.00368.x · Cited by 207 · see citing works

The Reliability of Dichotomous Judgments: Unequal Numbers of Judges per Subject

Fleiss, J. L., & Cuzick, J. M. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300410 · Cited by 191 · see citing works

Effects of Instruction in Deriving Word Meaning from Context: A Meta-Analysis

Fukkink, R. G., & de Glopper, K. (1998) · Review of Educational Research · doi:10.3102/00346543068004450 · Cited by 185 · see citing works

Fast track algorithm: How to differentiate a “scleroderma pattern” from a “non-scleroderma pattern”

Smith, V. M., Vanhaecke, A., Herrick, A. L., Distler, O., Guerra, M. G., Denton, C. P., Deschepper, E., Foeldvari, I., Gutiérrez, M., HACHULLA, E., et al. (2019) · Autoimmunity Reviews · doi:10.1016/j.autrev.2019.102394 · Cited by 177 · see citing works

Intercoder Reliability Estimation Approaches in Marketing: A Generalizability Theory Framework for Quantitative Data

Hughes, M. A., & Garrett, D. E. (1990) · Journal of Marketing Research · doi:10.1177/002224379002700206 · Cited by 172 · see citing works

Modeling Agreement Among Raters

Tanner, M. A., & Young, M. A. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10477157 · Cited by 162 · see citing works

An EULAR study group pilot study on reliability of simple capillaroscopic definitions to describe capillary morphology in rheumatic diseases

Smith, V. M., Beeckman, S., Herrick, A. L., Decuman, S., Deschepper, E., Keyser, F. D., Distler, O., Foeldvari, I., Ingegnoli, F., Müller‐Ladner, U., et al. (2016) · Lara D. Veeken · doi:10.1093/rheumatology/kev441 · Cited by 160 · see citing works

Reliability of Psychiatric Diagnosis

Helzer, J. E. (1977) · Archives of General Psychiatry · doi:10.1001/archpsyc.1977.01770140019001 · Cited by 158 · see citing works

Cognitive impairment in systemic lupus erythematosus: A neuropsychological study of individual and group deficits

Denburg, S. D., Carbotte, R. M., & Denburg, J. A. (1987) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688638708405054 · Cited by 144 · see citing works

Quantifying the development of agreement among experts in Delphi studies

Meijering, J. V., Kampen, J. K., & Tobi, H. (2013) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2013.01.003 · Cited by 139 · see citing works

Cognitive/affective and somatic/affective symptoms of depression in patients with heart disease and their association with cardiovascular prognosis: a meta-analysis

Azevedo, R. D. M., Roest, A. M., Hoen, P. W., & de Jonge, P. (2014) · Psychological Medicine · doi:10.1017/s0033291714000063 · Cited by 138 · see citing works

Evaluation of cutaneous photodamage using a photographic scale

Larnier, C., Ortonne, J. ‐., Alain Venot, A., FAIVRE, B., Béani, J.-C., THOMAS, P., BROWN, T. C., & Sendagorta, E. (1994) · British Journal of Dermatology · doi:10.1111/j.1365-2133.1994.tb02895.x · Cited by 137 · see citing works

Where is the human in human-centered AI? Insights from developer priorities and user experiences

Bingley, W., Curtis, C., Lockey, S., Bialkowski, A., Gillespie, N. A., Haslam, S. A., Ko, R. K. L., Steffens, N. K., Wiles, J., & Worthy, P. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107617 · Cited by 143 · see citing works

Interrater Agreement Measures: Comments on Kappa n , Cohen's Kappa, Scott's π, and Aickin's α

Hsu, L. M., & Field, R. (2003) · Understanding Statistics · doi:10.1207/s15328031us0203_03 · Cited by 133 · see citing works

A review of statistical methods in the analysis of data arising from observer reliability studies (Part I)*

Landis, J. R., & Koch, G. G. (1975) · Statistica Neerlandica · doi:10.1111/j.1467-9574.1975.tb00254.x · Cited by 135 · see citing works

The Potential of ChatGPT as a Self-Diagnostic Tool in Common Orthopedic Diseases: Exploratory Study

Kuroiwa, T., Sarcon, A. K., Ibara, T., Yamada, E., Yamamoto, A., Tsukamoto, K., & Fujita, K. (2023) · Journal of Medical Internet Research · doi:10.2196/47621 · Cited by 129 · see citing works

Role of Ultrasound in the Assessment of Vocal Cord Function in Infants and Children

Friedman, E. M. (1997) · Annals of Otology Rhinology & Laryngology · doi:10.1177/000348949710600304 · Cited by 128 · see citing works

Complexity in Attitudes Toward Abortion Access: Results from Two Studies

Jozkowski, K. N., Crawford, B. L., & Hunt, M. E. (2018) · Sexuality Research and Social Policy · doi:10.1007/s13178-018-0322-4 · Cited by 127 · see citing works

Facilitators and Barriers to the Adoption of Telemedicine During the First Year of COVID-19: Systematic Review

Kruse, C. S., & Heinemann, K. (2021) · Journal of Medical Internet Research · doi:10.2196/31752 · Cited by 130 · see citing works

Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Indices

Feng, G. C. (2014) · Methodology · doi:10.1027/1614-2241/a000086 · Cited by 121 · see citing works

Effects of Augmentative and Alternative Communication on Challenging Behavior: A Meta-Analysis

Walker, V. L., & Snell, M. E. (2013) · Augmentative and Alternative Communication · doi:10.3109/07434618.2013.785020 · Cited by 124 · see citing works

Evaluating carotid artery disease. The concordance between pulsed Doppler/spectrum analysis and angiography

Langlois, Y., Roederer, G. O., Chan, A., Phillips, D. J., Beach, K. W., Martin, D., Chikos, P. M., & Strandness, D. E. (1983) · Ultrasound in Medicine & Biology · doi:10.1016/0301-5629(83)90109-6 · Cited by 121 · see citing works

A Method for Meta-Analysis of Epidemiological Studies

Einarson, T. R., Leeder, J. S., & Koren, G. (1988) · Annals of Pharmacotherapy · doi:10.1177/106002808802201021 · Cited by 120 · see citing works

Intercoder reliability indices: disuse, misuse, and abuse

Feng, G. C. (2013) · Quality & Quantity · doi:10.1007/s11135-013-9956-8 · Cited by 117 · see citing works

Chance and interrater agreement on manuscripts.

Watkins, M. W. (1979) · American Psychologist · doi:10.1037/0003-066x.34.9.796 · Cited by 116 · see citing works

Assessing the inter-rater agreement for ordinal data through weighted indexes

Marasini, D., Quatto, P., & Ripamonti, E. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280214529560 · Cited by 116 · see citing works

Measuring repeatability and validity of histological diagnosis--a brief review with some practical examples.

Silcocks, P. B. S. (1983) · Journal of Clinical Pathology · doi:10.1136/jcp.36.11.1269 · Cited by 115 · see citing works

Measures of Effectiveness, Efficiency, and Quality of Telemedicine in the Management of Alcohol Abuse, Addiction, and Rehabilitation: Systematic Review

Kruse, C. S., Lee, K., Watson, J. B., Lobo, L. G., Stoppelmoor, A. G., & Oyibo, S. E. (2019) · Journal of Medical Internet Research · doi:10.2196/13252 · Cited by 114 · see citing works

A Comparison of Reliability Coefficients for Ordinal Rating Scales

de Raadt, A., Warrens, M. J., Bosker, R., & Kiers, H. A. L. (2021) · Journal of Classification · doi:10.1007/s00357-021-09386-5 · Cited by 114 · see citing works

Adaptive Non‐Interventional Heuristics for Covariation Detection in Causal Induction: Model Comparison and Rational Analysis

Hattori, M., & Oaksford, M. (2007) · Cognitive Science · doi:10.1080/03640210701530755 · Cited by 112 · see citing works

Career advancement and family balance strategies of executive women

Ezzedeen, S. R., & Ritchey, K. G. (2009) · Gender in Management An International Journal · doi:10.1108/17542410910980388 · Cited by 109 · see citing works

Establishment of Histological Criteria for High-risk Node-negative Breast Carcinoma for a Multi-institutional Randomized Clinical Trial of Adjuvant Therapy

Tsuda, H., Akiyama, F., Kurosumi, M., Sakamoto, G., Watanabe, T., & Section, J. N. S. A. S. O. B. C. (.-B. P. (1998) · Japanese Journal of Clinical Oncology · doi:10.1093/jjco/28.8.486 · Cited by 105 · see citing works

Predicting <i>Sargassum</i> blooms in the Caribbean Sea from MODIS observations

Wang, M., & Hu, C. (2017) · Geophysical Research Letters · doi:10.1002/2017gl072932 · Cited by 111 · see citing works

The gingival biotype: measurement of soft and hard tissue dimensions ‐ a radiographic morphometric study

Stein, J. M., Lintel‐Höping, N., Hammächer, C., Kašaj, A., Tamm, M., & Hanisch, O. (2013) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12169 · Cited by 104 · see citing works

Effects of deficient reporting on meta-analysis: A conceptual framework and reanalysis.

Orwin, R. G., & Cordray, D. S. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.134 · Cited by 103 · see citing works

The role of patient navigators in ambulatory care: overview of systematic reviews

Budde, H., Williams, G. A., Winkelmann, J., Pfirter, L., & Maier, C. B. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07140-6 · Cited by 101 · see citing works

The current state of methods for establishing reliability in qualitative chemistry education research articles

Watts, F. M., & Finkenstaedt-Quinn, S. A. (2021) · Chemistry Education Research and Practice · doi:10.1039/d1rp00007a · Cited by 103 · see citing works

An Inductive Model of Collaboration From the Stakeholder’s Perspective

Butterfield, K. D., Reed, R., & Lemak, D. J. (2004) · Business & Society · doi:10.1177/0007650304265956 · Cited by 100 · see citing works

Definition and Reliability Assessment of Elementary Ultrasonographic Findings in Calcium Pyrophosphate Deposition Disease: A Study by the OMERACT Calcium Pyrophosphate Deposition Disease Ultrasound Subtask Force

Filippou, G., Scirè, C. A., DAMJANOV, N. S., Adinolfi, A., Carrara, G., Picerno, V., Toscano, C., Bruyn, G. A. W., D’Agostino, M. A., Sedie, A. D., et al. (2017) · The Journal of Rheumatology · doi:10.3899/jrheum.161057 · Cited by 98 · see citing works

Examiner alignment and assessment in clinical periodontal research

Hefti, A. F., & Preshaw, P. M. (2012) · Periodontology 2000 · doi:10.1111/j.1600-0757.2011.00436.x · Cited by 101 · see citing works

Replication of Special Education Research

Makel, M. C., Plucker, J. A., Freeman, J., Lombardi, A. R., Simonsen, B. M., & Coyne, M. D. (2016) · Remedial and Special Education · doi:10.1177/0741932516646083 · Cited by 97 · see citing works

Fat is fashionable and fit: A comparative content analysis of Fatspiration and Health at Every Size ® Instagram images

Webb, J. B., Thomas, E. V., Bonar, A. S., Davies, A., & Etzel, L. (2017) · Body Image · doi:10.1016/j.bodyim.2017.05.003 · Cited by 95 · see citing works

Schizophrenics With Tardive Dyskinesia

Wegner, J. T. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790320028004 · Cited by 97 · see citing works

Reliability of a Qualitative Video Analysis for Running

Pipkin, A., Kotecki, K., Hetzel, S., & Heiderscheit, B. C. (2016) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2016.6280 · Cited by 96 · see citing works

Identification of calcium pyrophosphate deposition disease (CPPD) by ultrasound: reliability of the OMERACT definitions in an extended set of joints—an international multiobserver study by the OMERACT Calcium Pyrophosphate Deposition Disease Ultrasound Subtask Force

Filippou, G., Scirè, C. A., Adinolfi, A., DAMJANOV, N. S., Carrara, G., Bruyn, G. A. W., Cazenave, T., D’Agostino, M. A., Sedie, A. D., Sabatino, V. D., et al. (2018) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2017-212542 · Cited by 96 · see citing works

Calibration of remotely sensed proportion or area estimates for misclassification error

Czaplewski, R. L., & Catts, G. P. (1992) · Remote Sensing of Environment · doi:10.1016/0034-4257(92)90138-a · Cited by 95 · see citing works

The effect of coronary artery disease defined by quantitative coronary angiography and SYNTAX score upon outcome after transcatheter aortic valve implantation (TAVI) using the Edwards bioprosthesis

Khawaja, M. Z., Asrress, K., Haran, H., Arri, S., Nadra, I. J., Bolter, K., Wilson, K., Clack, L., Hancock, J., Young, C. P., et al. (2015) · EuroIntervention · doi:10.4244/eijy14m05_09 · Cited by 94 · see citing works

Comparing the Joint Agreement of Several Raters with Another Rater

Williams, G. W. (1976) · Biometrics · doi:10.2307/2529750 · Cited by 94 · see citing works

The agreement chart

Bangdiwala, S. I., & Shankar, V. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-97 · Cited by 93 · see citing works

Telemedicine and health policy: A systematic review

Kruse, C. S., Williams, K., Bohls, J., & Shamsi, W. (2021) · Health Policy and Technology · doi:10.1016/j.hlpt.2020.10.006 · Cited by 88 · see citing works

Surgical treatment options following chemotherapy plus cetuximab or bevacizumab in metastatic colorectal cancer—central evaluation of FIRE-3

Modest, D. P., Denecke, T., Pratschke, J., Ricard, I., Lang, H., Bemelmans, M. H. A., Becker, T., Rentsch, M., Seehofer, D., Bruns, C. J., et al. (2017) · European Journal of Cancer · doi:10.1016/j.ejca.2017.10.028 · Cited by 91 · see citing works

A computer program to compute measures of response agreement for nominal scale data obtained from two judges

Antonak, R. F. (1977) · Behavior Research Methods & Instrumentation · doi:10.3758/bf03214005 · Cited by 10 · see citing works

Measuring nominal scale agreement among many raters.

Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · see citing works

A Measure of Agreement Among Subjective Judgments

Lu, K. H. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100105 · Cited by 23 · see citing works

A note on the Couch and Keniston measure of agreement response set.

Edwards, A. L., & Walker, J. N. (1961) · Journal of Abnormal & Social Psychology · doi:10.1037/h0045955 · Cited by 15 · see citing works

A Generalized Agreement Measure

Berry, K. J., & Mielke, P. W. (1990) · Educational and Psychological Measurement · doi:10.1177/0013164490501012 · Cited by 6 · see citing works