The relation between objectivity and validity in the arrangement of items in rank order

Abstract

The results of these experiments are reported on: (1) ranking in importance 8 methods for evaluating student achievement, (2) ranking photographs according to intelligence, and (3) arranging in order a series of weights. Average intercorrelations on rankings assigned for each item in a series by individuals—individual objectivity—range from .26 to .45. The agreement in ranks assigned to each item in a series of experiments by two different groups—composite objectivity—yields rank order correlations from .91 to 1.00. A comparison of individual rankings with objective measures for intelligence and weight yield correlations of .25 and .42 respectively. Similarly, comparison of group rankings for these two series with objective measures yield correlations of .20 and .73. (PsycInfo Database Record (c) 2025 APA, all rights reserved)