arXiv Analytics

Sign in

arXiv:1908.04777 [cs.CL]AbstractReferencesReviewsResources

Learn How to Cook a New Recipe in a New House: Using Map Familiarization, Curriculum Learning, and Common Sense to Learn Families of Text-Based Adventure Games

Xusen Yin, Jonathan May

Published 2019-08-13Version 1

We consider the task of learning to play families of text-based computer adventure games, i.e., fully textual environments with a common theme (e.g. cooking) and goal (e.g. prepare a meal from a recipe) but with different specifics; new instances of such games are relatively straightforward for humans to master after a brief exposure to the genre but have been curiously difficult for computer agents to learn. We find that the deep Q-learning strategies that have been successfully leveraged for superhuman performance in single-instance action video games can be applied to learn families of text video games when adopting simple strategies that correlate with human-like learning behavior. Specifically, we build agents that learn to tackle simple scenarios before more complex ones (curriculum learning), that are equipped with the contextualized semantics of BERT (and we demonstrate that this provides a measure of common sense), and that familiarize themselves in an unfamiliar environment by navigating before acting. We demonstrate faster training convergence and improved task completion rates over reasonable baselines.

Related articles: Most relevant | Search more
arXiv:2403.07230 [cs.CL] (Published 2024-03-12)
Curry-DPO: Enhancing Alignment using Curriculum Learning & Ranked Preferences
arXiv:2104.02704 [cs.CL] (Published 2021-04-06)
Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge
arXiv:2212.09104 [cs.CL] (Published 2022-12-18)
LaSQuE: Improved Zero-Shot Classification from Explanations Through Quantifier Modeling and Curriculum Learning