A two-level planning framework for mixed reality interactive narratives with user engagement

Manuel Braunschweiler, Steven Poulakos, Mubbasir Kapadia, Robert W. Sumner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

We present an event-based interactive storytelling system for virtual 3D environments that aims to offer free-form user experiences while constraining the narrative to follow author intent. The characters of our stories are represented as smart objects, each having their own state and set of capabilities that they expose to the virtual world. Our narratives are represented as a collection of branching stories, where narrative flow is controlled by author-defined states. A user model is employed to evaluate the user's engagement with smart objects and events, based on proximity, interaction patterns and visibility to the user. A two-level online planning system is designed to find the best narrative trajectory along pre-authored stories, according to the user model, and to generate a story sequence to the best trajectory with Monte Carlo Tree Search. We present the capabilities of our interactive storytelling system on an example story and describe the adaptations required for modeling user engagement in AR and VR applications.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages100-107
Number of pages8
ISBN (Electronic)9781538692691
DOIs
StatePublished - Jul 2 2018
Event1st IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018 - Taichung, Taiwan, Province of China
Duration: Dec 10 2018Dec 12 2018

Publication series

NameProceedings - 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018

Conference

Conference1st IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018
Country/TerritoryTaiwan, Province of China
CityTaichung
Period12/10/1812/12/18

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Media Technology
  • Computer Science Applications

Keywords

  • Artificial intelligence
  • Interactive narratives
  • Monte Carlo Tree Search
  • Narrative generation
  • Planning
  • User perception

Fingerprint

Dive into the research topics of 'A two-level planning framework for mixed reality interactive narratives with user engagement'. Together they form a unique fingerprint.

Cite this