We study covariance estimation in high-dimensional approximate factor models with a sparse residual covariance. The estimator combines a log-det loss with nuclear-norm and off-diagonal (Formula presented.) penalties on a sample-normalized covariance scale. Under light-tailed sampling, pervasive factors and factor-space incoherence, we establish local curvature and characterize a local fixed point of the associated threshold iteration. Its low-rank component consistently recovers the latent rank; exact signed residual-support recovery additionally requires a minimum-signal condition. We derive componentwise estimation rates and sufficient conditions for positive definiteness. The analysis separates the spectral requirements for rank recovery from the entrywise requirements for residual-support recovery. A boundary-adaptive search identifies the two thresholds by extending an initial grid when its selected solution lies on a boundary. Simulations examine structural recovery and covariance accuracy, and compare log-det and Frobenius losses with covariance shrinkage methods. An application to European bank supervisory indicators illustrates the resulting decomposition into latent factors and sparse residual relationships.

Bernardi, E., Farne, M. (2026). Large Covariance Matrix Estimation by Penalized Log‐Det Heuristics. STATISTICAL ANALYSIS AND DATA MINING, 19(5), 1-12 [10.1002/sam.70115].

Large Covariance Matrix Estimation by Penalized Log‐Det Heuristics

Bernardi, Enrico;Farne, Matteo
2026

Abstract

We study covariance estimation in high-dimensional approximate factor models with a sparse residual covariance. The estimator combines a log-det loss with nuclear-norm and off-diagonal (Formula presented.) penalties on a sample-normalized covariance scale. Under light-tailed sampling, pervasive factors and factor-space incoherence, we establish local curvature and characterize a local fixed point of the associated threshold iteration. Its low-rank component consistently recovers the latent rank; exact signed residual-support recovery additionally requires a minimum-signal condition. We derive componentwise estimation rates and sufficient conditions for positive definiteness. The analysis separates the spectral requirements for rank recovery from the entrywise requirements for residual-support recovery. A boundary-adaptive search identifies the two thresholds by extending an initial grid when its selected solution lies on a boundary. Simulations examine structural recovery and covariance accuracy, and compare log-det and Frobenius losses with covariance shrinkage methods. An application to European bank supervisory indicators illustrates the resulting decomposition into latent factors and sparse residual relationships.
2026
Bernardi, E., Farne, M. (2026). Large Covariance Matrix Estimation by Penalized Log‐Det Heuristics. STATISTICAL ANALYSIS AND DATA MINING, 19(5), 1-12 [10.1002/sam.70115].
Bernardi, Enrico; Farne, Matteo
File in questo prodotto:
File Dimensione Formato  
Statistical Analysis and Data Mining An ASA Data Science Journal - 2026 - Bernardi - Large Covariance Matrix Estimation by.pdf

accesso aperto

Tipo: Versione (PDF) editoriale / Version Of Record
Licenza: Licenza per Accesso Aperto. Creative Commons Attribuzione (CCBY)
Dimensione 1.84 MB
Formato Adobe PDF
1.84 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/1088734
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
  • OpenAlex ND
social impact