Generalizability analysis of a point-method job evaluation instrument

Abstract

A generalizability analysis was performed using the ratings of 20 job descriptions of office and business personnel by 10 trained graduate student raters on an 11-scale point-method job evaluation instrument. Scales, jobs, and the interaction between them were the major sources of variance in the ratings. When differences in the 11 scales were not considered to add variance, reducing the number of raters from 10 to 1 had a negligible effect on the generalizability coefficient. Results provide further evidence of the high reliability of job evaluation ratings. (23 ref) (PsycInfo Database Record (c) 2025 APA, all rights reserved)