Boosted learning in dynamic Bayesian networks for multimodal detection

Tanzeem Chaodhury, James M. Rehg, Vladimir Pavlović, Alex Pentland

Research output: Contribution to conferencePaper

6 Scopus citations

Abstract

Bayesian networks are an attractive modeling tool for human sensing, as they combine an intuitive graphical representation with efficient algorithms for inference and learning. Temporal fusion of multiple sensors can be efficiently formulated using dynamic Bayesian networks (DBNs) which allow the power of statistical inference and learning to be combined with contextual knowledge of the problem. Unfortunately, simple learning methods can cause such appealing models to fail when the data exhibits complex behavior We first demonstrate how boosted parameter learning could be used to improve the performance of Bayesian network classifiers for complex multimodal inference problems. As an example we apply the framework to the problem of audiovisual speaker detection in an interactive environment using "off-the-shelf" visual and audio sensors (face, skin, texture, mouth motion, and silence detectors). We then introduce a boosted structure learning algorithm. Given labeled data, our algorithm modifies both the network structure and parameters so as to improve classification accuracy. We compare its performance to both standard structure learning and boosted parameter learning. We present results for speaker detection and for datasets from the UCI repository.

Original languageEnglish (US)
Pages550-556
Number of pages7
DOIs
StatePublished - Jan 1 2002
Externally publishedYes
Event5th International Conference on Information Fusion, FUSION 2002 - Annapolis, MD, United States
Duration: Jul 8 2002Jul 11 2002

Other

Other5th International Conference on Information Fusion, FUSION 2002
CountryUnited States
CityAnnapolis, MD
Period7/8/027/11/02

All Science Journal Classification (ASJC) codes

  • Information Systems

Keywords

  • Bayesian networks
  • boosting
  • mutlimodal fusion
  • speaker detection

Fingerprint Dive into the research topics of 'Boosted learning in dynamic Bayesian networks for multimodal detection'. Together they form a unique fingerprint.

  • Cite this

    Chaodhury, T., Rehg, J. M., Pavlović, V., & Pentland, A. (2002). Boosted learning in dynamic Bayesian networks for multimodal detection. 550-556. Paper presented at 5th International Conference on Information Fusion, FUSION 2002, Annapolis, MD, United States. https://doi.org/10.1109/ICIF.2002.1021202