Sequential Face Alignment via Person-Specific Modeling in the Wild

Xi Peng, Junzhou Huang, Dimitris N. Metaxas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Sequential face alignment, in essence, deals with nonrigid deformation that changes over time. Although numerous methods have been proposed to show impressive success on still images, many of them still suffer from limited performance when it comes to sequential alignment in wild scenarios, e.g., involving large pose/expression variations and partial occlusions. The underlying reason is that they usually perform sequential alignment by independently applying models trained offline in each frame in a tracking-by-detection manner but completely ignoring temporal constraints that become available in sequence. To address this issue, we propose to exploit incremental learning for person-specific alignment. Our approach takes advantage of part-based representation and cascade regression for robust and efficient alignment on each frame. More importantly, it incrementally updates the representation subspace and simultaneously adapts the cascade regressors in parallel using a unified framework. Person-specific modeling is eventually achieved on the fly while the drifting issue is significantly alleviated by erroneous detection using both part and holistic descriptors. Extensive experiments on both controlled and in-the-wild datasets demonstrate the superior performance of our approach compared with the state of the arts in terms of fitting accuracy and efficiency.

Original languageEnglish (US)
Title of host publicationProceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016
PublisherIEEE Computer Society
Pages1558-1567
Number of pages10
ISBN (Electronic)9781467388504
DOIs
StatePublished - Dec 16 2016
Event29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016 - Las Vegas, United States
Duration: Jun 26 2016Jul 1 2016

Publication series

NameIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN (Print)2160-7508
ISSN (Electronic)2160-7516

Other

Other29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016
CountryUnited States
CityLas Vegas
Period6/26/167/1/16

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Sequential Face Alignment via Person-Specific Modeling in the Wild'. Together they form a unique fingerprint.

  • Cite this

    Peng, X., Huang, J., & Metaxas, D. N. (2016). Sequential Face Alignment via Person-Specific Modeling in the Wild. In Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016 (pp. 1558-1567). [7789684] (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). IEEE Computer Society. https://doi.org/10.1109/CVPRW.2016.194