A graphical model framework for image segmentation

Research output: Chapter in Book/Report/Conference proceedingChapter

1 Scopus citations

Abstract

Graphical models are probabilistic models defined in terms of graphs. The intuitive and compact graph representation and its ability to model complex probabilistic systems make graphical models a powerful modeling tool in various research areas. In this paper we introduce a graphical model framework for image segmentation based on the integration of Markov random fields (MRFs) and deformable models. A graphical model is constructed to represent the relationship of the observed image pixels, the true region labels and the underlying object contour. We then formulate the problem of image segmentation as the one of joint region-contour inference and learning in the graphical model. The graphical model representation allows us to use an approximate structured variational inference technique to solve this otherwise intractable joint inference problem. Using this technique, the MAP solution to the original model is obtained by finding the MAP solutions of two simpler models, an extended MRF model and a probabilistic deformable model, iteratively and incrementally. In the extended MRF model, the true region labels are estimated using the BP algorithm in a band area around the estimated contour from the probabilistic deformable model, and the result in turn guides the probabilistic deformable model to an improved estimation of the contour. Finally, we generalize our method from 2D to 3D. Experimental results on both synthetic and real images, in both 2D and 3D, show that our new hybrid method outperforms both the MRF-based and the deformable model-based methods using onlyhomogeneous constraints.

Original languageEnglish (US)
Title of host publicationApplied Graph Theory in Computer Vision and Pattern Recognition
EditorsAbraham Kandel, Horst Bunke, Mark Last
Pages43-63
Number of pages21
DOIs
StatePublished - Apr 19 2007

Publication series

NameStudies in Computational Intelligence
Volume52
ISSN (Print)1860-949X

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Cite this

Huang, R., Pavlovic, V., & Metaxas, D. N. (2007). A graphical model framework for image segmentation. In A. Kandel, H. Bunke, & M. Last (Eds.), Applied Graph Theory in Computer Vision and Pattern Recognition (pp. 43-63). (Studies in Computational Intelligence; Vol. 52). https://doi.org/10.1007/978-3-540-68020-8_2