QuRate: Power-efficient mobile immersive video streaming

Nan Jiang, Yao Liu, Tian Guo, Wenyao Xu, Viswanathan Swaminathan, Lisong Xu, Sheng Wei

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Smartphones have recently become a popular platform for deploying the computation-intensive virtual reality (VR) applications, such as immersive video streaming (a.k.a., 360-degree video streaming). One specific challenge involving the smartphone-based head mounted display (HMD) is to reduce the potentially huge power consumption caused by the immersive video. To address this challenge, we first conduct an empirical power measurement study on a typical smartphone immersive streaming system, which identifies the major power consumption sources. Then, we develop QuRate, a quality-aware and user-centric frame rate adaptation mechanism to tackle the power consumption issue in immersive video streaming. QuRate optimizes the immersive video power consumption by modeling the correlation between the perceivable video quality and the user behavior. Specifically, QuRate builds on top of the user's reduced level of concentration on the video frames during view switching and dynamically adjusts the frame rate without impacting the perceivable video quality. We evaluate QuRate with a comprehensive set of experiments involving 5 smartphones, 21 users, and 6 immersive videos using empirical user head movement traces. Our experimental results demonstrate that QuRate is capable of extending the smartphone battery life by up to 1.24X while maintaining the perceivable video quality during immersive video streaming. Also, we conduct an Institutional Review Board (IRB)-approved subjective user study to further validate the minimum video quality impact caused by QuRate.

Original languageEnglish (US)
Title of host publicationMMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference
PublisherAssociation for Computing Machinery, Inc
Pages99-111
Number of pages13
ISBN (Electronic)9781450368452
DOIs
StatePublished - May 27 2020
Event11th ACM Multimedia Systems Online Conference, MMSys 2020 - Istanbul, Turkey
Duration: Jun 8 2020Jun 11 2020

Publication series

NameMMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference

Conference

Conference11th ACM Multimedia Systems Online Conference, MMSys 2020
Country/TerritoryTurkey
CityIstanbul
Period6/8/206/11/20

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Keywords

  • power optimization
  • video streaming
  • virtual reality

Fingerprint

Dive into the research topics of 'QuRate: Power-efficient mobile immersive video streaming'. Together they form a unique fingerprint.

Cite this