A component-based framework for generalized face alignment

Yuchi Huang, Qingshan Liu, Dimitris N. Metaxas

Research output: Contribution to journalArticlepeer-review

18 Scopus citations


This paper presents a component-based deformable model for generalized face alignment, in which a novel bistage statistical model is proposed to account for both local and global shape characteristics. Instead of using statistical analysis on the entire shape, we build separate Gaussian models for shape components to preserve more detailed local shape deformations. In each model of components, a Markov network is integrated to provide simple geometry constraints for our search strategy. In order to make a better description of the nonlinear interrelationships over shape components, the Gaussian process latent variable model is adopted to obtain enough control of shape variations. In addition, we adopt an illumination-robust feature to lead the local fitting of every shape point when light conditions change dramatically. To further boost the accuracy and efficiency of our component-based algorithm, an efficient subwindow search technique is adopted to detect components and to provide better initializations for shape components. Based on this approach, our system can generate accurate shape alignment results not only for images with exaggerated expressions and slight shading variation but also for images with occlusion and heavy shadows, which are rarely reported in previous work.

Original languageEnglish (US)
Article number5518438
Pages (from-to)287-298
Number of pages12
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Issue number1
StatePublished - Feb 2011

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Software
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering


  • Bistage statistical model
  • Gaussian process latent variable model (GPLVM)
  • Markov network
  • component detection
  • face alignment


Dive into the research topics of 'A component-based framework for generalized face alignment'. Together they form a unique fingerprint.

Cite this