Rater reliability and "judgmental demoralization."

Abstract

"Undergraduate students Ss (N = 120) were divided into six groups and asked to rate lists of food names for preference value. Two of the groups rated a total of 30 foods, two groups rated 45 foods, and the remaining two rated 60 foods with different lists of foods used with each group. Measures of rater reliability and rater bias were computed for foods in ordinal positions 1 to 10 and 21 to 30 and the transformed measures analyzed by analysis of variance. Results indicated that the main variables of the total number of stimuli rated by the Ss and the ordinal position of the foods in the list had no significant effect on either reliability or bias. It was concluded that judgmental fatigue and judgmental demoralization had no effect upon the reliability of food-preference ratings." (PsycInfo Database Record (c) 2025 APA, all rights reserved)