Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering

Luyang Liu, Ruiguang Zhong, Wuyang Zhang, Yunxin Liu, Jiansong Zhang, Lintao Zhang, Marco Gruteser

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Scopus citations

Abstract

This paper introduces an end-to-end untethered VR system design and open platform that can meet virtual reality latency and quality requirements at 4K resolution over a wireless link. High-quality VR systems generate graphics data at a data rate much higher than those supported by existing wireless-communication products such as Wi-Fi and 60GHz wireless communication. The necessary image encoding, makes it challenging to maintain the stringent VR latency requirements. To achieve the required latency, our system employs a Parallel Rendering and Streaming mechanism to reduce the add-on streaming latency, by pipelining the rendering, encoding, transmission and decoding procedures. Furthermore, we introduce a Remote VSync Driven Rendering technique to minimize display latency. To evaluate the system, we implement an end-to-end remote rendering platform on commodity hardware over a 60Ghz wireless network. Results show that the system can support current 2160x1200 VR resolution at 90Hz with less than 16ms end-to-end latency, and 4K resolution with 20ms latency, while keeping a visually lossless image quality to the user.

Original languageEnglish (US)
Title of host publicationMobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages68-80
Number of pages13
ISBN (Electronic)9781450357203
DOIs
StatePublished - Jun 10 2018
Event16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018 - Munich, Germany
Duration: Jun 10 2018Jun 15 2018

Publication series

NameMobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services

Other

Other16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018
CountryGermany
CityMunich
Period6/10/186/15/18

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Keywords

  • 60GHz
  • High-quality
  • Low latency
  • Untethered
  • Virtual Reality

Fingerprint Dive into the research topics of 'Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering'. Together they form a unique fingerprint.

  • Cite this

    Liu, L., Zhong, R., Zhang, W., Liu, Y., Zhang, J., Zhang, L., & Gruteser, M. (2018). Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering. In MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services (pp. 68-80). (MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services). Association for Computing Machinery, Inc. https://doi.org/10.1145/3210240.3210313