Restricted Quasi-Independent Model Resolves Paradoxical Behaviors of Cohen’s Kappa

Abstract

Cohen’s kappa, an index of inter-rater agreement, behaves paradoxically in 2×2 tables. λ_A is derived, an index from the restricted quasi-independent model for 2×2 tables. Simulation studies are used to demonstrate λ_A has superior performance compared to Scott’s pi. Moreover, λ_A does not show paradoxical behavior for 2×2 tables.