Sound localization and multi-modal steering for autonomous virtual agents

Yu Wang, Mubbasir Kapadia, Pengfei Huang, Ladislav Kavan, Norman I. Badler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

With the increasing realism of interactive applications, there is a growing need for harnessing additional sensory modalities such as hearing. While the synthesis and propagation of sounds in virtual environments has been explored, there has been little work that addresses sound localization and its integration into behaviors for autonomous virtual agents. This paper develops a framework that enables autonomous virtual agents to localize sounds in dynamic virtual environments, subject to distortion effects due to attenuation, reflection and diffraction from obstacles, as well as interference between multiple audio signals. We additionally integrate hearing into standard predictive collision avoidance techniques and couple it with vision to allow agents to react to what they see and hear, while navigating in virtual environments.

Original languageEnglish (US)
Title of host publicationProceedings of the 18th Meeting of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2014
PublisherAssociation for Computing Machinery
Pages23-30
Number of pages8
ISBN (Print)9781450327176
DOIs
StatePublished - 2014
Externally publishedYes
Event18th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2014 - San Francisco, CA, United States
Duration: Mar 14 2014Mar 16 2014

Publication series

NameProceedings of the Symposium on Interactive 3D Graphics

Other

Other18th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2014
Country/TerritoryUnited States
CitySan Francisco, CA
Period3/14/143/16/14

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Keywords

  • Acoustics
  • Artificial life
  • Localization
  • Steering
  • Virtual agents

Fingerprint

Dive into the research topics of 'Sound localization and multi-modal steering for autonomous virtual agents'. Together they form a unique fingerprint.

Cite this