arXiv Analytics

Sign in

arXiv:2011.15079 [cs.CV]AbstractReferencesReviewsResources

Forecasting Characteristic 3D Poses of Human Actions

Christian Diller, Thomas Funkhouser, Angela Dai

Published 2020-11-30, updated 2021-04-07Version 2

We propose the task of forecasting characteristic 3D poses: from a monocular video observation of a person, to predict a future 3D pose of that person in a likely action-defining, characteristic pose - for instance, from observing a person reaching for a banana, predict the pose of the person eating the banana. Prior work on human motion prediction estimates future poses at fixed time intervals. Although easy to define, this frame-by-frame formulation confounds temporal and intentional aspects of human action. Instead, we define a semantically meaningful pose prediction task that decouples the predicted pose from time, taking inspiration from goal-directed behavior. To predict characteristic poses, we propose a probabilistic approach that first models the possible multi-modality in the distribution of likely characteristic poses. It then samples future pose hypotheses from the predicted distribution in an autoregressive fashion to model dependencies between joints and finally optimizes the resulting pose with bone length and angle constraints. To evaluate our method, we construct a dataset of manually annotated characteristic 3D poses. Our experiments with this dataset suggest that our proposed probabilistic approach outperforms state-of-the-art methods by 22% on average.

Comments: Paper Video: Project Page:
Categories: cs.CV, cs.LG
Subjects: I.4.8, I.5.1, I.5.4
Related articles: Most relevant | Search more
arXiv:2003.09893 [cs.CV] (Published 2020-03-22)
Ensembles of Deep Neural Networks for Action Recognition in Still Images
arXiv:2010.12968 [cs.CV] (Published 2020-10-24)
Video Understanding based on Human Action and Group Activity Recognition
arXiv:2006.16132 [cs.CV] (Published 2020-06-29)
Human Activity Recognition based on Dynamic Spatio-Temporal Relations