arXiv Analytics

Sign in

arXiv:1805.11088 [cs.LG]AbstractReferencesReviewsResources

Deep Reinforcement Learning in Ice Hockey for Context-Aware Player Evaluation

Guiliang Liu, Oliver Schulte

Published 2018-05-26Version 1

A variety of machine learning models have been proposed to assess the performance of players in professional sports. However, they have only a limited ability to model how player performance depends on the game context. This paper proposes a new approach to capturing game context: we apply Deep Reinforcement Learning (DRL) to learn an action-value Q function from 3M play-by-play events in the National Hockey League (NHL). The neural network representation integrates both continuous context signals and game history, using a possession-based LSTM. The learned Q-function is used to value players' actions under different game contexts. To assess a player's overall performance, we introduce a novel Game Impact Metric (GIM) that aggregates the values of the player's actions. Empirical Evaluation shows GIM is consistent throughout a play season, and correlates highly with standard success measures and future salary.

Related articles: Most relevant | Search more
arXiv:1806.01175 [cs.LG] (Published 2018-06-04)
TD or not TD: Analyzing the Role of Temporal Differencing in Deep Reinforcement Learning
arXiv:1805.03359 [cs.LG] (Published 2018-05-09)
Reward Estimation for Variance Reduction in Deep Reinforcement Learning
arXiv:1901.02219 [cs.LG] (Published 2019-01-08)
Uncertainty-Based Out-of-Distribution Detection in Deep Reinforcement Learning