arXiv Analytics

Sign in

arXiv:2001.04959 [cs.LG]AbstractReferencesReviewsResources

High--Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

Alexander N. Gorban, Valery A. Makarov, Ivan Y. Tyukin

Published 2020-01-14Version 1

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states: many problems become exponentially difficult in high dimensions. Recently, the other side of the coin, the "blessing of dimensionality", has attracted much attention. It turns out that generic high-dimensional datasets exhibit fairly simple geometric properties. Thus, there is a fundamental tradeoff between complexity and simplicity in high dimensional spaces. Here we present a brief explanatory review of recent ideas, results and hypotheses about the blessing of dimensionality and related simplifying effects relevant to machine learning and neuroscience.

Related articles: Most relevant | Search more
arXiv:1301.2269 [cs.LG] (Published 2013-01-10)
Learning the Dimensionality of Hidden Variables
arXiv:2007.04440 [cs.LG] (Published 2020-07-08)
On the relationship between class selectivity, dimensionality, and robustness
arXiv:1701.00831 [cs.LG] (Published 2017-01-03)
Collapsing of dimensionality