This paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered by least squares minimization under nuclear norm plus l1 norm penalization. The objective is minimized via a singular value thresholding plus soft thresholding algorithm. This paper proposes a new estimator based on an additional least-squares re-optimization step aimed at un-shrinking the eigenvalues of the low rank component estimated in the first step. We prove that such un-shrinkage causes the final estimate to approach the target as closely as possible in spectral and Frobenius norm, while recovering exactly the underlying low rank and sparsity pattern. The error bounds are derived imposing that the latent eigenvalues scale to pα and the maximum number of non-zeros per row in the sparse component scales to pδ, where p is the dimension, α∈[0,1], δ∈[0,0.5], and δ

Farné Matteo, Montanari A. (2020). A large covariance matrix estimator under intermediate spikiness regimes. JOURNAL OF MULTIVARIATE ANALYSIS, 176, 1-20 [10.1016/j.jmva.2019.104577].

A large covariance matrix estimator under intermediate spikiness regimes

Farné Matteo
;
Montanari A.
2020

Abstract

This paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered by least squares minimization under nuclear norm plus l1 norm penalization. The objective is minimized via a singular value thresholding plus soft thresholding algorithm. This paper proposes a new estimator based on an additional least-squares re-optimization step aimed at un-shrinking the eigenvalues of the low rank component estimated in the first step. We prove that such un-shrinkage causes the final estimate to approach the target as closely as possible in spectral and Frobenius norm, while recovering exactly the underlying low rank and sparsity pattern. The error bounds are derived imposing that the latent eigenvalues scale to pα and the maximum number of non-zeros per row in the sparse component scales to pδ, where p is the dimension, α∈[0,1], δ∈[0,0.5], and δ
2020
Farné Matteo, Montanari A. (2020). A large covariance matrix estimator under intermediate spikiness regimes. JOURNAL OF MULTIVARIATE ANALYSIS, 176, 1-20 [10.1016/j.jmva.2019.104577].
Farné Matteo; Montanari A.
File in questo prodotto:
File Dimensione Formato  
FarneM-MontanariA_JMVA_2019_postprint.pdf

Open Access dal 30/11/2021

Tipo: Postprint
Licenza: Licenza per Accesso Aperto. Creative Commons Attribuzione - Non commerciale - Non opere derivate (CCBYNCND)
Dimensione 527.97 kB
Formato Adobe PDF
527.97 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/744602
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 4
social impact