Is interrater correlation really a proper measurement of reliability?
Topic: Measurement, Research Methodology, Statistics Publication: Human Performance Article: Exploring the relationship between interrater correlations and validity of peer ratings Blogger: Rob Stilson Interrater reliability (still with me?, Ok good) is often used as the main reliability estimate for the correction of validity coefficients when the criterion is job performance. Issues arise with this practice when one considers that the errors present between raters may not


