TY - GEN
T1 - A two-level planning framework for mixed reality interactive narratives with user engagement
AU - Braunschweiler, Manuel
AU - Poulakos, Steven
AU - Kapadia, Mubbasir
AU - Sumner, Robert W.
N1 - Funding Information:
ACKNOWLEDGMENT We would like to thank Maurizio Nitti and Alessia Marra for creating the 3D assets of the Haunted Castle, and Mattia Ryffel and Shaula Möller-Telicsakfor making the AR and VR apps a reality and improving the authoring GUI. This work was (partly) funded through the EC H2020 Framework Programme project FLAME, Grant Agreement No. 731677.
PY - 2019/1/15
Y1 - 2019/1/15
N2 - We present an event-based interactive storytelling system for virtual 3D environments that aims to offer free-form user experiences while constraining the narrative to follow author intent. The characters of our stories are represented as smart objects, each having their own state and set of capabilities that they expose to the virtual world. Our narratives are represented as a collection of branching stories, where narrative flow is controlled by author-defined states. A user model is employed to evaluate the user's engagement with smart objects and events, based on proximity, interaction patterns and visibility to the user. A two-level online planning system is designed to find the best narrative trajectory along pre-authored stories, according to the user model, and to generate a story sequence to the best trajectory with Monte Carlo Tree Search. We present the capabilities of our interactive storytelling system on an example story and describe the adaptations required for modeling user engagement in AR and VR applications.
AB - We present an event-based interactive storytelling system for virtual 3D environments that aims to offer free-form user experiences while constraining the narrative to follow author intent. The characters of our stories are represented as smart objects, each having their own state and set of capabilities that they expose to the virtual world. Our narratives are represented as a collection of branching stories, where narrative flow is controlled by author-defined states. A user model is employed to evaluate the user's engagement with smart objects and events, based on proximity, interaction patterns and visibility to the user. A two-level online planning system is designed to find the best narrative trajectory along pre-authored stories, according to the user model, and to generate a story sequence to the best trajectory with Monte Carlo Tree Search. We present the capabilities of our interactive storytelling system on an example story and describe the adaptations required for modeling user engagement in AR and VR applications.
KW - Artificial intelligence
KW - Interactive narratives
KW - Monte Carlo Tree Search
KW - Narrative generation
KW - Planning
KW - User perception
UR - http://www.scopus.com/inward/record.url?scp=85062179877&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85062179877&partnerID=8YFLogxK
U2 - 10.1109/AIVR.2018.00021
DO - 10.1109/AIVR.2018.00021
M3 - Conference contribution
AN - SCOPUS:85062179877
T3 - Proceedings - 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018
SP - 100
EP - 107
BT - Proceedings - 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 1st IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2018
Y2 - 10 December 2018 through 12 December 2018
ER -