Timezone: »
Face frontalization refers to the process of synthesizing the frontal view of a face from a given profile. Due to self-occlusion and appearance distortion in the wild, it is extremely challenging to recover faithful results and preserve texture details in a high-resolution. This paper proposes a High Fidelity Pose Invariant Model (HF-PIM) to produce photographic and identity-preserving results. HF-PIM frontalizes the profiles through a novel texture warping procedure and leverages a dense correspondence field to bind the 2D and 3D surface spaces. We decompose the prerequisite of warping into dense correspondence field estimation and facial texture map recovering, which are both well addressed by deep networks. Different from those reconstruction methods relying on 3D data, we also propose Adversarial Residual Dictionary Learning (ARDL) to supervise facial texture map recovering with only monocular images. Exhaustive experiments on both controlled and uncontrolled environments demonstrate that the proposed method not only boosts the performance of pose-invariant face recognition but also dramatically improves high-resolution frontalization appearances.
Author Information
Jie Cao (Center for Research on Intelligent Perception and Computing (CRIPAC) at Institute of Automation, Chinese Academy of Sciences.)
Yibo Hu (Institute of Automation, Chinese Academy of Sciences)
Hongwen Zhang (CASIA)
Ran He (NLPR, CASIA)
Zhenan Sun (Institute of Automation, Chinese Academy of Sciences (CASIA))
More from the Same Authors
-
2022 Poster: Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks »
Jiyang Guan · Jian Liang · Ran He -
2022 Spotlight: Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks »
Jiyang Guan · Jian Liang · Ran He -
2022 Spotlight: Lightning Talks 3A-1 »
Shu Ding · Wanxing Chang · Jiyang Guan · Mouxiang Chen · Guan Gui · Yue Tan · Shiyun Lin · Guodong Long · Yuze Han · Wei Wang · Zhen Zhao · Ye Shi · Jian Liang · Chenghao Liu · Lei Qi · Ran He · Jie Ma · Zemin Liu · Xiang Li · Hoang Tuan · Luping Zhou · Zhihua Zhang · Jianling Sun · Jingya Wang · LU LIU · Tianyi Zhou · Lei Wang · Jing Jiang · Yinghuan Shi -
2022 Poster: Orthogonal Transformer: An Efficient Vision Transformer Backbone with Token Orthogonalization »
Huaibo Huang · Xiaoqiang Zhou · Ran He -
2020 Poster: AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection »
Hao Zhu · Chaoyou Fu · Qianyi Wu · Wayne Wu · Chen Qian · Ran He -
2019 Poster: Dual Variational Generation for Low Shot Heterogeneous Face Recognition »
Chaoyou Fu · Xiang Wu · Yibo Hu · Huaibo Huang · Ran He -
2019 Spotlight: Dual Variational Generation for Low Shot Heterogeneous Face Recognition »
Chaoyou Fu · Xiang Wu · Yibo Hu · Huaibo Huang · Ran He -
2018 Poster: IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis »
Huaibo Huang · zhihang li · Ran He · Zhenan Sun · Tieniu Tan -
2017 Poster: Deep Supervised Discrete Hashing »
Qi Li · Zhenan Sun · Ran He · Tieniu Tan