arXiv Analytics

Sign in

arXiv:1809.09087 [cs.LG]AbstractReferencesReviewsResources

Implicit Maximum Likelihood Estimation

Ke Li, Jitendra Malik

Published 2018-09-24Version 1

Implicit probabilistic models are models defined naturally in terms of a sampling procedure and often induces a likelihood function that cannot be expressed explicitly. We develop a simple method for estimating parameters in implicit models that does not require knowledge of the form of the likelihood function or any derived quantities, but can be shown to be equivalent to maximizing likelihood under some conditions. Our result holds in the non-asymptotic parametric setting, where both the capacity of the model and the number of data examples are finite. We also demonstrate encouraging experimental results.

Comments: 21 pages, 4 figures. In the interest of promoting discussion, we make the reviews available at https://people.eecs.berkeley.edu/~ke.li/papers/imle_reviews.pdf
Categories: cs.LG, cs.NE, stat.ML
Related articles: Most relevant | Search more
arXiv:1510.01225 [cs.LG] (Published 2015-10-05)
Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family
arXiv:2210.15353 [cs.LG] (Published 2022-10-27)
Learning Discrete Directed Acyclic Graphs via Backpropagation
arXiv:1904.06395 [cs.LG] (Published 2019-04-12)
Information Theoretic Lower Bounds on Negative Log Likelihood