Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering

Luyang Liu, Ruiguang Zhong, Wuyang Zhang, Yunxin Liu, Jiansong Zhang, Lintao Zhang, Marco Gruteser

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

This paper introduces an end-to-end untethered VR system design and open platform that can meet virtual reality latency and quality requirements at 4K resolution over a wireless link. High-quality VR systems generate graphics data at a data rate much higher than those supported by existing wireless-communication products such as Wi-Fi and 60GHz wireless communication. The necessary image encoding, makes it challenging to maintain the stringent VR latency requirements. To achieve the required latency, our system employs a Parallel Rendering and Streaming mechanism to reduce the add-on streaming latency, by pipelining the rendering, encoding, transmission and decoding procedures. Furthermore, we introduce a Remote VSync Driven Rendering technique to minimize display latency. To evaluate the system, we implement an end-to-end remote rendering platform on commodity hardware over a 60Ghz wireless network. Results show that the system can support current 2160x1200 VR resolution at 90Hz with less than 16ms end-to-end latency, and 4K resolution with 20ms latency, while keeping a visually lossless image quality to the user.

Original languageEnglish (US)
Title of host publicationMobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages68-80
Number of pages13
ISBN (Electronic)9781450357203
DOIs
StatePublished - Jun 10 2018
Event16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018 - Munich, Germany
Duration: Jun 10 2018Jun 15 2018

Publication series

NameMobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services

Other

Other16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018
CountryGermany
CityMunich
Period6/10/186/15/18

Fingerprint

Wi-Fi
Communication
Virtual reality
Computer hardware
Image quality
Telecommunication links
Decoding
Wireless networks
Systems analysis
Display devices

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Keywords

  • 60GHz
  • High-quality
  • Low latency
  • Untethered
  • Virtual Reality

Cite this

Liu, L., Zhong, R., Zhang, W., Liu, Y., Zhang, J., Zhang, L., & Gruteser, M. (2018). Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering. In MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services (pp. 68-80). (MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services). Association for Computing Machinery, Inc. https://doi.org/10.1145/3210240.3210313
Liu, Luyang ; Zhong, Ruiguang ; Zhang, Wuyang ; Liu, Yunxin ; Zhang, Jiansong ; Zhang, Lintao ; Gruteser, Marco. / Cutting the cord : Designing a high-quality untethered VR system with low latency remote rendering. MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services. Association for Computing Machinery, Inc, 2018. pp. 68-80 (MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services).
@inproceedings{973e385a63c94d8288f2a7c44cf6fb95,
title = "Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering",
abstract = "This paper introduces an end-to-end untethered VR system design and open platform that can meet virtual reality latency and quality requirements at 4K resolution over a wireless link. High-quality VR systems generate graphics data at a data rate much higher than those supported by existing wireless-communication products such as Wi-Fi and 60GHz wireless communication. The necessary image encoding, makes it challenging to maintain the stringent VR latency requirements. To achieve the required latency, our system employs a Parallel Rendering and Streaming mechanism to reduce the add-on streaming latency, by pipelining the rendering, encoding, transmission and decoding procedures. Furthermore, we introduce a Remote VSync Driven Rendering technique to minimize display latency. To evaluate the system, we implement an end-to-end remote rendering platform on commodity hardware over a 60Ghz wireless network. Results show that the system can support current 2160x1200 VR resolution at 90Hz with less than 16ms end-to-end latency, and 4K resolution with 20ms latency, while keeping a visually lossless image quality to the user.",
keywords = "60GHz, High-quality, Low latency, Untethered, Virtual Reality",
author = "Luyang Liu and Ruiguang Zhong and Wuyang Zhang and Yunxin Liu and Jiansong Zhang and Lintao Zhang and Marco Gruteser",
year = "2018",
month = "6",
day = "10",
doi = "10.1145/3210240.3210313",
language = "English (US)",
series = "MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services",
publisher = "Association for Computing Machinery, Inc",
pages = "68--80",
booktitle = "MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services",

}

Liu, L, Zhong, R, Zhang, W, Liu, Y, Zhang, J, Zhang, L & Gruteser, M 2018, Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering. in MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services. MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services, Association for Computing Machinery, Inc, pp. 68-80, 16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018, Munich, Germany, 6/10/18. https://doi.org/10.1145/3210240.3210313

Cutting the cord : Designing a high-quality untethered VR system with low latency remote rendering. / Liu, Luyang; Zhong, Ruiguang; Zhang, Wuyang; Liu, Yunxin; Zhang, Jiansong; Zhang, Lintao; Gruteser, Marco.

MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services. Association for Computing Machinery, Inc, 2018. p. 68-80 (MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Cutting the cord

T2 - Designing a high-quality untethered VR system with low latency remote rendering

AU - Liu, Luyang

AU - Zhong, Ruiguang

AU - Zhang, Wuyang

AU - Liu, Yunxin

AU - Zhang, Jiansong

AU - Zhang, Lintao

AU - Gruteser, Marco

PY - 2018/6/10

Y1 - 2018/6/10

N2 - This paper introduces an end-to-end untethered VR system design and open platform that can meet virtual reality latency and quality requirements at 4K resolution over a wireless link. High-quality VR systems generate graphics data at a data rate much higher than those supported by existing wireless-communication products such as Wi-Fi and 60GHz wireless communication. The necessary image encoding, makes it challenging to maintain the stringent VR latency requirements. To achieve the required latency, our system employs a Parallel Rendering and Streaming mechanism to reduce the add-on streaming latency, by pipelining the rendering, encoding, transmission and decoding procedures. Furthermore, we introduce a Remote VSync Driven Rendering technique to minimize display latency. To evaluate the system, we implement an end-to-end remote rendering platform on commodity hardware over a 60Ghz wireless network. Results show that the system can support current 2160x1200 VR resolution at 90Hz with less than 16ms end-to-end latency, and 4K resolution with 20ms latency, while keeping a visually lossless image quality to the user.

AB - This paper introduces an end-to-end untethered VR system design and open platform that can meet virtual reality latency and quality requirements at 4K resolution over a wireless link. High-quality VR systems generate graphics data at a data rate much higher than those supported by existing wireless-communication products such as Wi-Fi and 60GHz wireless communication. The necessary image encoding, makes it challenging to maintain the stringent VR latency requirements. To achieve the required latency, our system employs a Parallel Rendering and Streaming mechanism to reduce the add-on streaming latency, by pipelining the rendering, encoding, transmission and decoding procedures. Furthermore, we introduce a Remote VSync Driven Rendering technique to minimize display latency. To evaluate the system, we implement an end-to-end remote rendering platform on commodity hardware over a 60Ghz wireless network. Results show that the system can support current 2160x1200 VR resolution at 90Hz with less than 16ms end-to-end latency, and 4K resolution with 20ms latency, while keeping a visually lossless image quality to the user.

KW - 60GHz

KW - High-quality

KW - Low latency

KW - Untethered

KW - Virtual Reality

UR - http://www.scopus.com/inward/record.url?scp=85051501168&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051501168&partnerID=8YFLogxK

U2 - 10.1145/3210240.3210313

DO - 10.1145/3210240.3210313

M3 - Conference contribution

AN - SCOPUS:85051501168

T3 - MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services

SP - 68

EP - 80

BT - MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services

PB - Association for Computing Machinery, Inc

ER -

Liu L, Zhong R, Zhang W, Liu Y, Zhang J, Zhang L et al. Cutting the cord: Designing a high-quality untethered VR system with low latency remote rendering. In MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services. Association for Computing Machinery, Inc. 2018. p. 68-80. (MobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services). https://doi.org/10.1145/3210240.3210313