Reliability of short rating scales and the heterogeneity of the rated stimuli

Abstract

"Three lists of 10 food stimuli were selected so that the lists varied in the heterogeneity of the stimuli. Preference ratings were collected from 278 Ss using rating scales with 2, 3, 4, or 5 categories. Rating reliability was highest with the most heterogeneous list and with the 4-category scale and was lowest with the most homogeneous list and the 2-category scale. Rater bias results were more tentative, with the list of intermediate stimuli heterogeneity and the 4-category scale most subject to systematic rater error on the part of the Ss." (PsycInfo Database Record (c) 2025 APA, all rights reserved)