Large sample variance of kappa in the case of different sets of raters.

Abstract

Published formulas for the large sample variance of the kappa statistic that are appropriate for the case of different sets of raters for different Ss, when each set of raters is selected at random from a larger pool of available raters, are determined to be incorrect. New formulas are derived and c

Cites (3)

1. The Measurement of Observer Agreement for Categorical Data
   Landis, J. Richard, Koch, Gary G. · 1977 · Biometrics
2. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
   Cohen, Jacob · 1968 · Psychological Bulletin
3. Measuring nominal scale agreement among many raters.
   Fleiss, Joseph L. · 1971 · Psychological Bulletin

Show all 3 references

Cited by (22)

1. The kappa statistic in reliability studies: use, interpretation, and sample size requirements
   Sim, Julius, Wright, Chris C · 2005 · Physical Therapy
2. Dermoscopy of pigmented skin lesions: Results of a consensus meeting via the Internet
   Argenziano, Giuseppe, Soyer, H.Peter, Chimenti, Sergio, Talamini, Renato, Corona, Rosamaria, Sera, Francesco, Binder, Michael, Cerroni, Lorenzo, De Rosa, Gaetano, Ferrara, Gerardo et al. · 2003 · Journal of the American Academy of Dermatology
3. Reliability of DSM-IV anxiety and mood disorders: implications for the classification of emotional disorders
   Brown, Timothy A., Di Nardo, Peter A., Lehman, Cassandra L., Campbell, Laura A. · 2001 · Journal of Abnormal Psychology
4. Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research
   Hruschka, Daniel J., Schwartz, Deborah, St.John, Daphne Cobb, Picone-Decaro, Erin, Jenkins, Richard A., Carey, James W. · 2004 · Field Methods
5. Interleukin-2 liposome inhalation therapy is safe and effective for dogs with spontaneous pulmonary metastases
   Khanna, Chand, Anderson, Peter M., Hasz, Diane E., Katsanis, Emmanuel, Neville, Mary, Klausner, Jeffrey S. · 1997 · Cancer

See all 398