Multi-View 3D Face Reconstruction Based on Flame

EasyChair Preprint 10653

Abstract

At present, face 3D reconstruction has broad application prospects in various fields, but the research on it is still in the development stage. In this paper, we hope to achieve better face 3D reconstruction quality by combining multi-view training framework with face parametric model FLAME, propose a multi-view training and testing model MFNet(Multi-view FLAME Network). We build a self-supervised training framework and implement constraints such as multi-view optical flow loss function and face landmark loss, and finally obtain a complete MFNet. We propose innovative implementations of multi-view optical flow loss and the covisible mask. We test our model on AFLW and facescape datasets and also take pictures of our faces to reconstruct 3D faces while simulating actual scenarios as much as possible, which achieves good results. Our work mainly addresses the problem of combining parametric models of faces with multi-view face 3D reconstruction and explores the implementation of a FLAME-based multi-view training and testing framework for contributing to the field of face 3D reconstruction.

Keyphrases: 3D reconstruction, human face, multi-view, parametric model

@booklet{EasyChair:10653,
  author    = {Wenzhuo Zheng and Junhao Zhao and Xiaohong Liu and Yongyang Pan and Zhenghao Gan and Haozhe Han and Ning Liu},
  title     = {Multi-View 3D Face Reconstruction Based on Flame},
  howpublished = {EasyChair Preprint 10653},
  year      = {EasyChair, 2023}}