Topic: Feedback, Job Performance, Measurement
Publication: Personnel Psychology (AUTUMN 2012)
Article: Evidence for the effectiveness of an alternative multisource performance rating methodology
Authors: B. J. Hoffman, C. A. Gorman, C. A. Blair, J. P. Meriac, B. Overstreet, & E. K. Atchley
Reviewed by: Alexandra Rechlin
Do you receive multisource feedback (also called 360 degree feedback) at work? Based on its extreme popularity, my guess is that you do. An important question, therefore, is how to make the ratings more accurate and thus more informative for development. Brian Hoffman and his colleagues recently conducted two studies in which they developed and evaluated the efficacy of a new type of scale, called frame-of-reference scales (FORS), to use in multisource feedback systems.
FORS start with a definition of the dimension being rated, as well as examples of both effective and ineffective behavior for that dimension. The actual items are then presented. FORS differ from normal rating scales in that a definition and behavioral examples are provided. In this way, FORS are similar to frame-of-reference training, except that the information is presented in written format along with the items (as opposed to being provided in a training program). FORS are different from behaviorally anchored rating scales (BARS) in that BARS link specific behaviors with each scale point (whereas FORS provide examples of effective and ineffective behavior).
The authors compared FORS with standard rating scales (which were similar to behavioral observation scales) and found that using FORS increased accuracy and led to greater differentiation among dimensions. When compared to frame-of-reference training, using FORS led to similar levels of accuracy. FORS therefore seem to be an important development in the improvement of multisource feedback ratings; FORS lead to increased accuracy and are not as expensive or time-consuming as BARS and frame-of-reference training.
Hoffman, B. J., Gorman, C. A., Blair, C. A., Meriac, J. P., Overstreet, B., & Atchley, E. K. (2012). Evidence for the effectiveness of an alternative multisource performance rating methodology. Personnel Psychology, 65, 531-563. doi: 10.1111/j.1744-6570.2012.01252.x
human resource management, organizational industrial psychology, organizational management