Face morphing using 3D-aware appearance optimization

Fei Yang, Eli Shechtman, Jue Wang, Lubomir Bourdev, Dimitris Metaxas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

Traditional automatic face morphing techniques tend to generate blurry intermediate frames when the two input faces differ significantly. We propose a new face morphing approach that deals explicitly with large pose and expression variations. We recover the 3D face geometry of the input images using a projection on a prelearned 3D face subspace. The geometry is interpolated by factoring the expression and pose and varying them smoothly across the sequence. Finally we pose the morphing problem as an iterative optimization with an objective that combines similarity of each frame to the geometry-induced warped sources, with a similarity between neighboring frames for temporal coherence. Experimental results show that our method can generate higher quality face morphing results for more extreme pose, expression and appearance changes than previous methods.

Original languageEnglish (US)
Title of host publicationProceedings - Graphics Interface 2012
Pages93-99
Number of pages7
StatePublished - 2012
Event38th Graphics Interface Conference, GI 2012 - Toronto, ON, Canada
Duration: May 28 2012May 30 2012

Publication series

NameProceedings - Graphics Interface
ISSN (Print)0713-5424

Other

Other38th Graphics Interface Conference, GI 2012
Country/TerritoryCanada
CityToronto, ON
Period5/28/125/30/12

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Face morphing using 3D-aware appearance optimization'. Together they form a unique fingerprint.

Cite this