A new method for obtaining weighted composites of ratings

Abstract

Amethod of weighting ratings in terms of (1) the rater's tendency to rate on qualities in common with other raters and (2) the rater's degree of confidence in his rating of particular individuals, is described. Four raters each rated 761 hospital ward aides on effectiveness, and rated his own assurance of the correctness of each rating. A factor analysis of the inter-rater correlations for the effectiveness ratings yielded one common factor; a factor analysis of the assurance ratings gave two common factors (communalities of acquaintance with the ratees). "It was demonstrated that weighted composite ratings based on [the factor loadings] were definitely more reliable than corresponding unweighted composites." (PsycInfo Database Record (c) 2025 APA, all rights reserved)