Situation recognition: An evolving problem for heterogeneous dynamic big multimedia data

Vivek K. Singh, Mingyan Gao, Ramesh Jain

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Scopus citations

Abstract

With the growth in social media, internet of things, and planetary-scale sensing there is an unprecedented need to assimilate spatio-temporally distributed multimedia streams into actionable information. Consequently the concepts like objects, scenes, and events, need to be extended to recognize situations (e.g. epidemics, traffic jams, seasons, flash mobs). This paper motivates and computationally grounds the problem of situation recognition. It describes a systematic approach for combining multimodal real-time big data into actionable situations. Specifically it presents a generic approach for modeling and recognizing situations. A set of generic building blocks and guidelines help the domain experts model their situations of interest. The created models can be tested, refined, and deployed into practice using a developed system (EventShop). Results of applying this approach to create multiple situation-aware applications by combining heterogeneous streams (e.g. Twitter, Google Insights, Satellite imagery, Census) are presented.

Original languageEnglish (US)
Title of host publicationMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
Pages1209-1218
Number of pages10
DOIs
StatePublished - 2012
Externally publishedYes
Event20th ACM International Conference on Multimedia, MM 2012 - Nara, Japan
Duration: Oct 29 2012Nov 2 2012

Publication series

NameMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

Other

Other20th ACM International Conference on Multimedia, MM 2012
CountryJapan
CityNara
Period10/29/1211/2/12

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Keywords

  • events
  • modeling
  • sensor networks
  • situation
  • situation awareness
  • situation detection
  • social networks

Fingerprint Dive into the research topics of 'Situation recognition: An evolving problem for heterogeneous dynamic big multimedia data'. Together they form a unique fingerprint.

Cite this