Integration of optical flow and deformable models with applications to human face shape and motion estimation

Douglas DeCarlo, Dimitris Metaxas

Research output: Contribution to journalConference articlepeer-review

141 Scopus citations

Abstract

We present a formal methodology for the integration of optical flow and deformable models. The optical flow constraint equation provides a non-holonomic constraint on the motion of the deformable model. It this augmented system, forces computed from edges and optical flow are used simultaneously. When this dynamic system is solved, a model-based least-squares solution for the optical flow is obtained and improved estimation results are achieved. The use of a 3-D model reduces or eliminates problems associated with optical flow computation. This approach instantiates a general methodology for treating visual cues as constraints on deformable models. We apply this framework to human face shape and motion estimation. Our 3-D deformable face model uses a small number of parameters to describe a rich variety of face shapes and facial expressions. We present experiments in extracting the shape and motion of a face from image sequences.

Original languageEnglish (US)
Pages (from-to)231-238
Number of pages8
JournalProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
DOIs
StatePublished - Jan 1 1996
Externally publishedYes
EventProceedings of the 1996 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - San Francisco, CA, USA
Duration: Jun 18 1996Jun 20 1996

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Integration of optical flow and deformable models with applications to human face shape and motion estimation'. Together they form a unique fingerprint.

Cite this