arXiv Analytics

Sign in

arXiv:2008.06046 [cs.CV]AbstractReferencesReviewsResources

Full-Body Awareness from Partial Observations

Chris Rockwell, David F. Fouhey

Published 2020-08-13Version 1

There has been great progress in human 3D mesh recovery and great interest in learning about the world from consumer video data. Unfortunately current methods for 3D human mesh recovery work rather poorly on consumer video data, since on the Internet, unusual camera viewpoints and aggressive truncations are the norm rather than a rarity. We study this problem and make a number of contributions to address it: (i) we propose a simple but highly effective self-training framework that adapts human 3D mesh recovery systems to consumer videos and demonstrate its application to two recent systems; (ii) we introduce evaluation protocols and keypoint annotations for 13K frames across four consumer video datasets for studying this task, including evaluations on out-of-image keypoints; and (iii) we show that our method substantially improves PCK and human-subject judgments compared to baselines, both on test videos from the dataset it was trained on, as well as on three other datasets without further adaptation. Project website: https://crockwell.github.io/partial_humans

Related articles:
arXiv:1904.05548 [cs.CV] (Published 2019-04-11)
Reasoning Visual Dialogs with Structural and Partial Observations
arXiv:2304.13242 [cs.CV] (Published 2023-04-26)
Learning to Predict Navigational Patterns from Partial Observations