Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach

John D. Storey, Jonathan E. Taylor, David Siegmund

Journal of the Royal Statistical Society: Series B (Statistical Methodology) · 2004 · Volume 66 · Issue 1

DOI: 10.1111/j.1467-9868.2004.00439.x

Abstract

Summary.The false discovery rate (FDR) is a multiple hypothesis testing quantity that describes the expected proportion of false positive results among all rejected null hypotheses. Benjamini and Hochberg introduced this quantity and proved that a particular step-upp-value method controls the FDR. Storey introduced a point estimate of the FDR for fixed significance regions. The former approach conservatively controls the FDR at a fixed predetermined level, and the latter provides a conservatively biased estimate of the FDR for a fixed predetermined significance region. In this work, we show in both finite sample and asymptotic settings that the goals of the two approaches are essentially equivalent. In particular, the FDR point estimates can be used to define valid FDR controlling procedures. In the asymptotic setting, we also show that the point estimates can be used to estimate the FDR conservatively over all significance regions simultaneously, which is equivalent to controlling the FDR at all levels simultaneously. The main tool that we use is to translate existing FDR methods into procedures involving empirical processes. This simplifies finite sample proofs, provides a framework for asymptotic results and proves that these procedures are valid even under certain forms of dependence.

Keywords

Multiple comparisons, Positive false discovery rate, P-values, Q-values, Simultaneous inference

Enable JavaScript for citation tools and additional paper interactions.