arXiv Analytics

Sign in

arXiv:1702.07694 [stat.ML]AbstractReferencesReviewsResources

Bayes-Optimal Entropy Pursuit for Active Choice-Based Preference Learning

Stephen N. Pallone, Peter I. Frazier, Shane G. Henderson

Published 2017-02-24Version 1

We analyze the problem of learning a single user's preferences in an active learning setting, sequentially and adaptively querying the user over a finite time horizon. Learning is conducted via choice-based queries, where the user selects her preferred option among a small subset of offered alternatives. These queries have been shown to be a robust and efficient way to learn an individual's preferences. We take a parametric approach and model the user's preferences through a linear classifier, using a Bayesian prior to encode our current knowledge of this classifier. The rate at which we learn depends on the alternatives offered at every time epoch. Under certain noise assumptions, we show that the Bayes-optimal policy for maximally reducing entropy of the posterior distribution of this linear classifier is a greedy policy, and that this policy achieves a linear lower bound when alternatives can be constructed from the continuum. Further, we analyze a different metric called misclassification error, proving that the performance of the optimal policy that minimizes misclassification error is bounded below by a linear function of differential entropy. Lastly, we numerically compare the greedy entropy reduction policy with a knowledge gradient policy under a number of scenarios, examining their performance under both differential entropy and misclassification error.

Related articles: Most relevant | Search more
arXiv:1801.04695 [stat.ML] (Published 2018-01-15)
Sparsity-based Defense against Adversarial Attacks on Linear Classifiers
arXiv:2205.07739 [stat.ML] (Published 2022-05-16)
Sharp Asymptotics of Self-training with Linear Classifier
arXiv:1603.08704 [stat.ML] (Published 2016-03-29)
Interpretability of Multivariate Brain Maps in Brain Decoding: Definition and Quantification