Interrater agreement on binary measurements with more than two raters is often assessed using Fleiss' κ, which is known to be difficult to interpret. In situations where the same raters rate all items, however, the far less known κ suggested by Conger, Hubert, and Schouten is more appropriate. We…