Comparison of predictor and criterion judgments of managerial performance using the multitrait-multimethod approach

Abstract

Used the multitrait-multimethod matrix technique to examine the predictive validity of ratings of management potential derived from an industrial assessment center program. Ss were 71 professional, technical, and lower level managerial personnel. Psychologists' and managers' ratings on 13 assessment dimensions were correlated with supervisors' ratings of current job performance on the same dimensions. Ratings obtained of on-the-job performance were lower in quality than the predictor ratings. The median reliability of the criterion ratings was .52 compared to median reliabilities of .85 and .89 for the psychologists' and managers' ratings, respectively. Supervisors failed to differentiate the various dimensions. Results are compared with findings of other studies that used this technique to determine the sources of unreliability in the criterion. (PsycInfo Database Record (c) 2025 APA, all rights reserved)