EVASR: Edge-Based Video Delivery with Salience-Aware Super-Resolution

Na Li, Yao Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With the rapid growth of video content consumption, it is important to deliver high-quality streaming videos to users even under limited available network bandwidth. In this paper, we propose EVASR, a system that performs edge-based video delivery to clients with salience-Aware super-resolution. We select patches with higher saliency score to perform super-resolution while applying the simple yet efficient bicubic interpolation for the remaining patches in the same video frame. To efficiently use the computation resources available at the edge server, we introduce a new metric called "saliency visual quality"and formulate patch selection as an optimization problem to achieve the best performance when an edge server is serving multiple users. We implement EVASR based on the FFmpeg framework and conduct extensive experiments for evaluation. Results show that EVASR outperforms baseline approaches in both resource efficiency and visual quality metrics including PSNR, saliency visual quality (SVQ), and VMAF.

Original languageEnglish (US)
Title of host publicationMMSys 2023 - Proceedings of the 14th ACM Multimedia Systems Conference
PublisherAssociation for Computing Machinery, Inc
Pages142-152
Number of pages11
ISBN (Electronic)9798400701481
DOIs
StatePublished - Jun 7 2023
Event14th ACM Multimedia Systems Conference, MMSys 2023 - Vancouver, Canada
Duration: Jun 7 2023Jun 10 2023

Publication series

NameMMSys 2023 - Proceedings of the 14th ACM Multimedia Systems Conference

Conference

Conference14th ACM Multimedia Systems Conference, MMSys 2023
Country/TerritoryCanada
CityVancouver
Period6/7/236/10/23

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Keywords

  • deep-learning
  • edge computing
  • salience-Aware
  • super-resolution
  • video delivery
  • visual quality

Fingerprint

Dive into the research topics of 'EVASR: Edge-Based Video Delivery with Salience-Aware Super-Resolution'. Together they form a unique fingerprint.

Cite this