Tests alternative to higher criticism for high-dimensional means under sparsity and column-wise dependence

The Annals of Statistics · 2013 · Volume 41 · Issue 6

Abstract

We consider two alternative tests to the Higher Criticism test of Donoho and Jin [Ann. Statist. 32 (2004) 962–994] for high-dimensional means under the sparsity of the nonzero means for sub-Gaussian distributed data with unknown column-wise dependence. The two alternative test statistics are constructed by first thresholding $L_{1}$ and $L_{2}$ statistics based on the sample means, respectively, followed by maximizing over a range of thresholding levels to make the tests adaptive to the unknown signal strength and sparsity. The two alternative tests can attain the same detection boundary of the Higher Criticism test in [Ann. Statist. 32 (2004) 962–994] which was established for uncorrelated Gaussian data. It is demonstrated that the maximal $L_{2}$-thresholding test is at least as powerful as the maximal $L_{1}$-thresholding test, and both the maximal $L_{2}$ and $L_{1}$-thresholding tests are at least as powerful as the Higher Criticism test.

Keywords

62G20, 62G32, 62H15, large $p$, large deviation, optimal detection boundary, small $n$, sparse signal, thresholding, Weak dependence

Enable JavaScript for citation tools and additional paper interactions.