The development psychometric evaluation, and validation of a low-fidelity situational judgement inventory for personnel selection: An alternative approach to cognitive assessment

David Scott Pegorsch

Abstract

The current study had two primary goals; the first goal was to develop and evaluate an instrument that represented a recent and innovative approach to personnel selection. The second goal was to investigate the notion of "practical intelligence," as an independent construct in the area of cognitive ability assessment. A low-fidelity situational judgement inventory (SJI) was developed, evaluated psychometrically, and validated using applicants and incumbent fire alarm dispatchers from three metropolitan Fire Departments. Results of the study demonstrated that the SJI was a highly valid and fair predictor of job performance. Significant positive correlations between the SJI and job performance ranged from.36 to.69, with no between group differences for ethnic or gender subgroups. In addition, a number of pieces of evidence further substantiated the notion of "practical intelligence" as a construct that is independent of general cognitive ability, or more specifically "academic intelligence." Based on the results of the present study, the SJI was demonstrated to be a powerful tool for personnel selection. Applications of the SJI as a theoretical measure of practical intelligence, and implications for future research are discussed.