Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding

Chen，Ying1; Li，Qing2; Zhang，Aoyang3; Zou，Longhao4; Jiang，Yong5; Xu，Zhimin6; Li，Junlin3; Yuan，Zhenhui1

10.1145/3458306.3458874

2021-07-16

31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV) as part of MMSys Conference

NOSSDAV 2021 - Proceedings of the 2021 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2021

75-81

SEP 28-OCT 01, 2021

null,Istanbul,TURKEY

1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES

ASSOC COMPUTING MACHINERY

With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.

live streaming super-resolution video coding video delivery

通讯

英语

CPCI-S ; EI

National Natural Science Foundation of China[61972189,"LZC0019"]

Computer Science

Computer Science, Hardware & Architecture ; Computer Science, Information Systems ; Computer Science, Software Engineering

WOS:000748923900010

20213110706022

Audio systems ; Bandwidth ; Bandwidth compression ; Optical resolving power ; Video streaming

Information Theory and Signal Processing:716.1 ; Computer Applications:723.5 ; Light/Optics:741.1

2-s2.0-85111417109

Scopus

1.Tsinghua-Berkeley Shenzhen Institute,Tsinghua University,Shenzhen,China
2.Southern University of Science and Technology,Shenzhen,China
3.PCL Research Center of Networks and Communications,Peng Cheng Laboratory,Shenzhen,China
4.School at Shenzhen,Tsinghua University,Shenzhen,China
5.Multimedia Lab in Beijing Bytedance Technology Co,Ltd,Beijing,China
6.Department of Computer and Information Sciences,Northumbria University,United Kingdom

Chen，Ying,Li，Qing,Zhang，Aoyang,et al. Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding[C]. 1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES:ASSOC COMPUTING MACHINERY,2021:75-81.