Cascade multi-view hourglass model for robust 3D face alignment |
|
Author: | Deng, Jiankang1; Zhou, Yuxiang1; Cheng, Shiyang1; |
Organizations: |
1Department of Computing, Imperial College London, UK 2Centre for Machine Vision and Signal Analysis, University of Oulu, Finland |
Format: | article |
Version: | accepted version |
Access: | open |
Online Access: | PDF Full Text (PDF, 6.8 MB) |
Persistent link: | http://urn.fi/urn:nbn:fi-fe201902276500 |
Language: | English |
Published: |
Institute of Electrical and Electronics Engineers,
2018
|
Publish Date: | 2019-02-27 |
Description: |
AbstractEstimating the 3D facial landmarks from a 2D image remains a challenging problem. Even though state-of-the-art 2D alignment methods are able to predict accurate landmarks for semi-frontal faces, the majority of them fail to provide semantically consistent landmarks for profile faces. A de facto solution to this problem is through 3D face alignment that preserves correspondence across different poses. In this paper, we proposed a Cascade Multi-view Hourglass Model for 3D face alignment, where the first Hourglass model is explored to jointly predict semi-frontal and profile 2D facial landmarks, after removing spatial transformations, another Hourglass model is employed to estimate the 3D facial shapes. To improve the capacity without sacrificing the computational complexity, the original residual bottleneck block in the Hourglass model is replaced by a parallel, multi-scale inception-resnet block. Extensive experiments on two challenging 3D face alignment datasets, AFLW2000-3D and Menpo-3D, show the robustness of the proposed method under continuous pose changes. see all
|
ISBN: | 978-1-5386-2335-0 |
ISBN Print: | 978-1-5386-2336-7 |
Pages: | 399 - 403 |
DOI: | 10.1109/FG.2018.00064 |
OADOI: | https://oadoi.org/10.1109/FG.2018.00064 |
Host publication: |
13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 |
Conference: |
IEEE International Conference on Automatic Face and Gesture Recognition |
Type of Publication: |
A4 Article in conference proceedings |
Field of Science: |
213 Electronic, automation and communications engineering, electronics |
Subjects: | |
Funding: |
J. Deng is supported by the President’s Scholarship of Imperial College London. The work of S. Cheng is funded by the EPSRC project EP/N007743/1 (FACER2VM). We thank the NVIDIA Corporation for the GPU donations. |
Copyright information: |
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |