Patterned scaled expectation interview: Reliability studies on a new technique

Abstract

A proposed interview procedure has ratings based on scaled examples of on-the-job behavior. Traits necessary were determined, and examples were written of behaviors related to these traits. Examples were checked for agreement as to trait category, and scaled as to degree of the trait exhibited. Interviewers rated each candidate by making analogies from the candidate's responses to job behavior that might be expected of the candidate. Interviews using 3 raters to judge 1 candidate simultaneously and using 2 different interviewers to judge the same candidate 1 at a time, indicate the technique's high reliability. Interrater reliability was significantly higher (p < .01) using the scaled expectation rating method than when using a traditional adjective rating scale. (Sources of variance in interviews are specified.) (PsycInfo Database Record (c) 2025 APA, all rights reserved)