TY - GEN
T1 - QuRate
T2 - 11th ACM Multimedia Systems Online Conference, MMSys 2020
AU - Jiang, Nan
AU - Liu, Yao
AU - Guo, Tian
AU - Xu, Wenyao
AU - Swaminathan, Viswanathan
AU - Xu, Lisong
AU - Wei, Sheng
N1 - Funding Information:
We appreciate the constructive review comments from the anonymous reviewers. This work was supported in part by the National Science Foundation under awards CNS-1912593, CNS-1616087, CNS-1618931, and CNS-1755659.
Publisher Copyright:
© 2020 ACM.
PY - 2020/5/27
Y1 - 2020/5/27
N2 - Smartphones have recently become a popular platform for deploying the computation-intensive virtual reality (VR) applications, such as immersive video streaming (a.k.a., 360-degree video streaming). One specific challenge involving the smartphone-based head mounted display (HMD) is to reduce the potentially huge power consumption caused by the immersive video. To address this challenge, we first conduct an empirical power measurement study on a typical smartphone immersive streaming system, which identifies the major power consumption sources. Then, we develop QuRate, a quality-aware and user-centric frame rate adaptation mechanism to tackle the power consumption issue in immersive video streaming. QuRate optimizes the immersive video power consumption by modeling the correlation between the perceivable video quality and the user behavior. Specifically, QuRate builds on top of the user's reduced level of concentration on the video frames during view switching and dynamically adjusts the frame rate without impacting the perceivable video quality. We evaluate QuRate with a comprehensive set of experiments involving 5 smartphones, 21 users, and 6 immersive videos using empirical user head movement traces. Our experimental results demonstrate that QuRate is capable of extending the smartphone battery life by up to 1.24X while maintaining the perceivable video quality during immersive video streaming. Also, we conduct an Institutional Review Board (IRB)-approved subjective user study to further validate the minimum video quality impact caused by QuRate.
AB - Smartphones have recently become a popular platform for deploying the computation-intensive virtual reality (VR) applications, such as immersive video streaming (a.k.a., 360-degree video streaming). One specific challenge involving the smartphone-based head mounted display (HMD) is to reduce the potentially huge power consumption caused by the immersive video. To address this challenge, we first conduct an empirical power measurement study on a typical smartphone immersive streaming system, which identifies the major power consumption sources. Then, we develop QuRate, a quality-aware and user-centric frame rate adaptation mechanism to tackle the power consumption issue in immersive video streaming. QuRate optimizes the immersive video power consumption by modeling the correlation between the perceivable video quality and the user behavior. Specifically, QuRate builds on top of the user's reduced level of concentration on the video frames during view switching and dynamically adjusts the frame rate without impacting the perceivable video quality. We evaluate QuRate with a comprehensive set of experiments involving 5 smartphones, 21 users, and 6 immersive videos using empirical user head movement traces. Our experimental results demonstrate that QuRate is capable of extending the smartphone battery life by up to 1.24X while maintaining the perceivable video quality during immersive video streaming. Also, we conduct an Institutional Review Board (IRB)-approved subjective user study to further validate the minimum video quality impact caused by QuRate.
KW - power optimization
KW - video streaming
KW - virtual reality
UR - http://www.scopus.com/inward/record.url?scp=85086755276&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85086755276&partnerID=8YFLogxK
U2 - 10.1145/3339825.3391863
DO - 10.1145/3339825.3391863
M3 - Conference contribution
AN - SCOPUS:85086755276
T3 - MMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference
SP - 99
EP - 111
BT - MMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference
PB - Association for Computing Machinery, Inc
Y2 - 8 June 2020 through 11 June 2020
ER -