SJTs: They’re Not Perfect, but Gosh Darn it they Work!
Posted at 4:30 AM On 03/19/2010Topic: Selection
Publication: Human Performance
Article: Contextual effects on SJT responses: An examination of construct validity and mean differences across applicant and incumbent contexts
Authors: W.I. MacKenzie, R.E. Ployhart, J.A. Weekley, and C. Ehlers
Reviewed By: Benjamin Granger
A situational judgment test (SJT) is a
commonly used employee selection tool which presents job applicants with
realistic work situations. Job
applicants are required to choose from several response options, which range in
their effectiveness (as rated by subject matter experts). While SJTs tend to predict future job
performance rather well, there is still debate as to what SJTs actually measure
(SJTs correlate with and likely measure cognitive ability, personality, job
knowledge, and experience simultaneously) and how they operate in different
contexts (e.g., job applicants vs. incumbents).
To further investigate the validity of SJTs, MacKenzie et al. (2010) addressed a few major issues common in SJT research. For example, much of the existing research on SJTs relies on samples of job incumbents. However, SJTs are most frequently used in new employee selection and the authors speculate that the knowledge, skills, and abilities of incumbents may differ significantly from that of job applicants. In other words, SJTs may operate differently for job incumbents and applicants.


