Facial expression analysis using nonlinear decomposable generative models

Chan Su Lee, Ahmed Elgammal

Research output: Chapter in Book/Report/Conference proceedingConference contribution

24 Scopus citations

Abstract

We present a new framework to represent and analyze dynamic facial motions using a decomposable generative model. In this paper, we consider facial expressions which lie on a one dimensional closed manifold, i.e., start from some configuration and coming back to the same configuration, while there are other sources of variability such as different classes of expression, and different people, etc., all of which are needed to be parameterized. The learned model supports tasks such as facial expression recognition, person identification, and synthesis. We aim to learn a generative model that can generate different dynamic facial appearances for different people and for different expressions. Given a single image or a sequence of images, we can use the model to solve for the temporal embedding, expression type and person identification parameters. As a result we can directly infer intensity of facial expression, expression type, and person identity from the visual input. The model can successfully be used to recognize expressions performed by different people never seen during training. We show experiment results for applying the framework for simultaneous face and facial expression recognition.

Original languageEnglish (US)
Title of host publicationAnalysis and Modelling of Faces and Gestures - Second International Workshop, AMFG 2005, Proceedings
PublisherSpringer Verlag
Pages17-31
Number of pages15
ISBN (Print)3540292292, 9783540292296
DOIs
StatePublished - 2005
Event2nd International Workshop on Analysis and Modelling of Faces and Gestures, AMFG 2005 - Beijing, China
Duration: Oct 16 2005Oct 16 2005

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3723 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other2nd International Workshop on Analysis and Modelling of Faces and Gestures, AMFG 2005
Country/TerritoryChina
CityBeijing
Period10/16/0510/16/05

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Facial expression analysis using nonlinear decomposable generative models'. Together they form a unique fingerprint.

Cite this