Human Carving: A Parsing-Based Framework For 3D Human Reconstruction

Human-centric computer vision tasks often benefit from each other. In this paper, we propose a novel framework called Human Carving to explore the relationships between human parsing and multi-view 3D human reconstruction, which is the first method to consider the two related tasks. It consists of three modules: 1) Pose-aware Multi-view Human Parsing, 2) Semantic Visual Hull Carving and 3) Hierarchical Human Model Fitting. Taking the sparse multi-view images as input, the framework automatically generates a Part-Aware Visual Hull (PAVH) of human body parts and then estimates the human shape and pose simultaneously. Experimental results on real scenes demonstrate the effectiveness of our framework.