Segment and recognize expression phase by fusion of motion area and neutral divergence features

Shizhi Chen, Yingli Tian, Qingshan Liu, Dimitri Metaxas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

An expression can be approximated by a sequence of temporal segments called neutral, onset, offset and apex. However, it is not easy to accurately detect such temporal segments only based on facial features. Some researchers try to temporally segment expression phases with the help of body gesture analysis. The problem of this approach is that the expression temporal phases from face and gesture channels are not synchronized. Additionally, most previous work adopted facial key points tracking or body tracking to extract motion information, which is unreliable in practice due to illumination variations and occlusions. In this paper, we present a novel algorithm to overcome the above issues, in which two simple and robust features are designed to describe face and gesture information, i.e., motion area and neutral divergence features. Both features do not depend on motion tracking, and they can be easily calculated too. Moreover, it is different from previous work in that we integrate face and body gesture together in modeling the temporal dynamics through a single channel of sensorial source, so it avoids the unsynchronized issue between face and gesture channels. Extensive experimental results demonstrate the effectiveness of the proposed algorithm.

Original languageEnglish (US)
Title of host publication2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
Pages330-335
Number of pages6
DOIs
StatePublished - Jun 17 2011
Event2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011 - Santa Barbara, CA, United States
Duration: Mar 21 2011Mar 25 2011

Publication series

Name2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Other

Other2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
CountryUnited States
CitySanta Barbara, CA
Period3/21/113/25/11

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Keywords

  • motion area
  • neutral divergence
  • temporal segment

Fingerprint Dive into the research topics of 'Segment and recognize expression phase by fusion of motion area and neutral divergence features'. Together they form a unique fingerprint.

Cite this