Overview
Title: SMPL-Based 3D Pedestrian Pose Prediction
Published in: 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021)
Adversarial SMPL-based Recurrent Neural Network Architecture
Abstract
In 3D pedestrian pose prediction, joint-rotation-based pose representation is extensively used due to the unconstrained degree of freedom for each joint and its ability to regress the 3D statistical wireframe. However, all the existing joint-rotation-based pose prediction approaches ignore the centrality of the distinct pose parameter components and are consequently prone to suffer from error accumulation along the kinematic chain, which results in unnatural human poses. In joint-rotationbased pose prediction, Skinned Multi-Person Linear (SMPL) parameters are widely used to represent pedestrian pose.
In this work, a novel SMPL-based pose prediction network is proposed to address the centrality of each SMPL component by distributing the network weights among them. Furthermore, to constrain the network to generate only plausible human poses, an adversarial training approach is employed. The effectiveness of the proposed network is evaluated using the PedX and BEHAVE datasets. The proposed approach significantly outperforms state-of-the-art methods with improved prediction accuracy and generates plausible human pose predictions.
Key Contributions
- We designed a multi-layer perception generative adversarial network to penalize the network for unnatural poses while allowing natural one.
- The SMPL-based architecture is proposed to address the centrality of global rotation and translation parameters with respect to the pose parameters
Qualitative Results
