The validity of validity: An analysis of validation study designs

Abstract

Draws a distinction between validity (logic of inferences) and validation (the process of research using a specific design) to evaluate 11 criterion-related validation designs that differ in the timing of measurement of test behavior and job performance and in the selection procedure (random, existing tests, and experimental tests). Comparisons are based on T. D. Cook and D. T. Campbell's (1949) 4 interrelated criteria: statistical conclusion, internal, construct, and external validity. The analysis marks the selection procedure as a major design property that influences the validity of validation studies. Important differences between concurrent and predictive validation are identified for several aspects of validity. The fact that no specific design is considered most appropriate for all purposes suggests the use of validation research programs, based on a series of studies with different designs, to enhance the validity of validation research. (30 ref) (PsycInfo Database Record (c) 2025 APA, all rights reserved)