Expression Flow for 3D-Aware Face Component Transfer

Fei Yang, Dimitri Metaxas, Jue Wang, Eli Shechtman, Lubomir Bourdev

Research output: Contribution to journalArticlepeer-review

27 Scopus citations


We address the problem of correcting an undesirable expression on a face photo by transferring local facial components, such as a smiling mouth, from another face photo of the same person which has the desired expression. Direct copying and blending using existing compositing tools results in semantically unnatural composites, since expression is a global effect and the local component in one expression is often incompatible with the shape and other components of the face in another expression. To solve this problem we present Expression Flow, a 2D flow field which can warp the target face globally in a natural way, so that the warped face is compatible with the new facial component to be copied over. To do this, starting with the two input face photos, we jointly construct a pair of 3D face shapes with the same identity but different expressions. The expression flow is computed by projecting the difference between the two 3D shapes back to 2D. It describes how to warp the target face photo to match the expression of the reference photo. User studies suggest that our system is able to generate face composites with much higher fidelity than existing methods.

Original languageEnglish (US)
Pages (from-to)1-10
Number of pages10
JournalACM Transactions on Graphics
Issue number4
StatePublished - Jul 1 2011

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design


  • face modeling
  • facial component
  • facial expression
  • facial flow
  • image warping


Dive into the research topics of 'Expression Flow for 3D-Aware Face Component Transfer'. Together they form a unique fingerprint.

Cite this