How to recover accurate 3D human body shapes in one step

Abstract

The reconstruction of realistic and precise human meshes in world coordinates is facilitated by considering scene information. Challenges related to accuracy, robustness, and computation time are faced by existing absolute human mesh recovery methods. In this paper, a one-stage model for absolute human mesh recovery with superior reconstruction precision and inference speed is presented. The proposed one-stage model is composed of two parallel branches to achieve root position estimation and human mesh regression. To effectively connect the two branches, a scene-image information aggregation module is designed. The accuracy of the estimated human meshes is improved and the end-to-end training of the whole model is facilitated by this module. Experiments are conducted on three diverse datasets, and a GMPJPE decrease of 72.3 mm/27.32% and an MPJPE reduction of 25.6 mm/27.26% are achieved by the proposed method with the lowest inference time compared to previous SOTA methods.