SHARP OPTIMALITY FOR HIGH-DIMENSIONAL COVARIANCE TESTING UNDER SPARSE SIGNALS

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

This paper considers one-sample testing of a high-dimensional covariance matrix by deriving the detection boundary as a function of the signal sparsity and signal strength under the sparse alternative hypotheses. It first shows that the optimal detection boundary for testing sparse means is the minimax detection lower boundary for testing the covariance matrix. A multilevel thresholding test is proposed and is shown to be able to attain the detection lower boundary over a substantial range of the sparsity parameter, implying that the multilevel thresholding test is sharp optimal in the minimax sense over the range. The asymptotic distribution of the multilevel thresholding statistic for covariance matrices is derived under both Gaussian and non-Gaussian distributions by developing a novel U-statistic decomposition in conjunction with the matrix blocking and the coupling techniques to handle the complex dependence among the elements of the sample covariance matrix. The superiority in the detection boundary of the multilevel thresholding test over the existing tests is also demonstrated.

Original languageEnglish
Pages (from-to)1921-1945
Number of pages25
JournalAnnals of Statistics
Volume51
Issue number5
DOIs
StatePublished - Oct 2023

Keywords

  • Covariance matrix
  • detection boundary
  • high dimensionality
  • minimax
  • rare and faint signal
  • thresholding

Fingerprint

Dive into the research topics of 'SHARP OPTIMALITY FOR HIGH-DIMENSIONAL COVARIANCE TESTING UNDER SPARSE SIGNALS'. Together they form a unique fingerprint.

Cite this