arXiv Analytics

Sign in

arXiv:1703.06128 [cs.IT]AbstractReferencesReviewsResources

On the Minimization of Convex Functionals of Probability Distributions Under Band Constraints

Michael Fauss, Abdelhak M. Zoubir

Published 2017-03-17Version 1

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. First, a system of sufficient and necessary first order optimality conditions, which characterize global minima as solutions of a fixed-point equation, is derived. Based on these conditions, two algorithms are proposed that iteratively solve the fixed-point equation via a block coordinate descent strategy. While the first algorithm is conceptually simpler and more efficient, it is not guaranteed to converge for objective functions that are not strictly convex. This shortcoming is overcome in the second algorithm, which uses an additional outer proximal iteration, and, which is proven to converge under very mild assumptions. Two examples are given to demonstrate the theoretical usefulness of the optimality conditions as well as the high efficiency and accuracy of the proposed numerical algorithms.

Comments: 11 pages, 5 figures, 1 table, to be submitted to the IEEE Transactions on Signal Processing
Categories: cs.IT, math.IT
Subjects: 62C20
Related articles: Most relevant | Search more
arXiv:1301.1327 [cs.IT] (Published 2013-01-07, updated 2014-09-16)
Weighted $\ell_1$-minimization for generalized non-uniform sparse model
arXiv:1009.3525 [cs.IT] (Published 2010-09-18)
Analyzing Weighted $\ell_1$ Minimization for Sparse Recovery with Nonuniform Sparse Models\footnote{The results of this paper were presented in part at the International Symposium on Information Theory, ISIT 2009}
arXiv:1506.06205 [cs.IT] (Published 2015-06-20)
Trivergence of Probability Distributions, at glance