arXiv Analytics

Sign in

arXiv:2101.09174 [stat.ML]AbstractReferencesReviewsResources

Sparsistent filtering of comovement networks from high-dimensional data

Arnab Chakrabarti, Anindya S. Chakrabarti

Published 2021-01-22Version 1

Network filtering is an important form of dimension reduction to isolate the core constituents of large and interconnected complex systems. We introduce a new technique to filter large dimensional networks arising out of dynamical behavior of the constituent nodes, exploiting their spectral properties. As opposed to the well known network filters that rely on preserving key topological properties of the realized network, our method treats the spectrum as the fundamental object and preserves spectral properties. Applying asymptotic theory for high dimensional data for the filter, we show that it can be tuned to interpolate between zero filtering to maximal filtering that induces sparsity and consistency while having the least spectral distance from a linear shrinkage estimator. We apply our proposed filter to covariance networks constructed from financial data, to extract the key subnetwork embedded in the full sample network.

Related articles: Most relevant | Search more
arXiv:2207.00367 [stat.ML] (Published 2022-07-01)
A geometric framework for outlier detection in high-dimensional data
arXiv:2103.13787 [stat.ML] (Published 2021-03-25)
Interpretable Approximation of High-Dimensional Data
arXiv:2007.15707 [stat.ML] (Published 2020-07-30)
Solar: a least-angle regression for accurate and stable variable selection in high-dimensional data