Are actor and action semantics retained in video supervoxel segmentation?

Chenliang Xu, Richard F. Doell, Stephen Jose Hanson, Catherine Hanson, Jason J. Corso

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Existing methods in the semantic computer vision community seem unable to deal with the explosion and richness of modern, open-source and social video content. Although sophisticated methods such as object detection or bag-of-words models have been well studied, they typically operate on low level features and ultimately suffer from either scalability issues or a lack of semantic meaning. On the other hand, video supervoxel segmentation has recently been established and applied to large scale data processing, which potentially serves as an intermediate representation to high level video semantic extraction. The supervoxels are rich decompositions of the video content: they capture object shape and motion well. However, it is not yet known if the supervoxel segmentation retains the semantics of the underlying video content. In this paper, we conduct a systematic study of how well the action and actor semantics are retained in video supervoxel segmentation. Our study has human observers watching supervoxel segmentation videos and trying to discriminate both actor (human or animal) and action (one of eight everyday actions). We gather and analyze a large set of 640 human perceptions over 96 videos in 3 different supervoxel scales. Our ultimate findings suggest that a significant amount of semantics have been well retained in the video supervoxel segmentation.

Original languageEnglish (US)
Title of host publicationProceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013
Pages286-293
Number of pages8
DOIs
StatePublished - 2013
Event2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013 - Irvine, CA, United States
Duration: Sep 16 2013Sep 18 2013

Publication series

NameProceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013

Other

Other2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013
Country/TerritoryUnited States
CityIrvine, CA
Period9/16/139/18/13

All Science Journal Classification (ASJC) codes

  • Software

Fingerprint

Dive into the research topics of 'Are actor and action semantics retained in video supervoxel segmentation?'. Together they form a unique fingerprint.

Cite this