A Measure of Agreement for Interval or Nominal Multivariate Observations by Different Sets of Judges

This article addresses the problem of accounting overall multivariate chance-corrected interobserver agreement when targets have been rated by different sets of judges (not necessarily equal in number). The proposed approach builds on Janson and Olsson’s multivariate generalization of Cohen’s kap…