19 September 2022 in IEEE Transactions on Multimedia
In the context of the latest growing popularity of live video streaming, ensuring high video quality has become one of the most significant challenges faced by all live streaming platforms. Insufficient uplink bandwidth is an important factor that influences these live video transmissions, affecting their bitrate and latency and consequently the associated video streaming quality. This paper proposes a novel flexible super-resolution-based video coding and uploading framework (FlexSRVC) that improves the quality of live video streaming in limited uplink network bandwidth conditions. FlexSRVC includes a flexible video coding scheme, which compresses high-resolution key and non-key video frames to a lower bitrate in order to reduce the upload delay. A new flexible bitrate adaptation algorithm is also proposed to select dynamically the number of frames to be compressed and the compression ratio by jointly considering uplink network conditions and available cloud computing resources. Trace-driven emulations demonstrate that FlexSRVC provides the same quality while reducing up to 25% of the required bandwidth compared to the original encoding method (H.264). FlexSRVC improves users' QoE by at least 50% compared to a super resolution-based method which employs reconstruction of all video frames in uplink bandwidth constrained conditions.
19 June 2018 in IEEE Transactions on Circuits and Systems for Video Technology
Dynamic Adaptive Streaming (DAS) over HTTP has been widely deployed over the Internet. However, due to the pull-based nature of HTTP/1.1, there exist intolerable streaming latency and high request overhead in the current DAS systems. With dynamic k-push, HTTP/2 live streaming promises to achieve low live latency with less overhead and small segment duration. In this paper, we propose a Quality of Experience (QoE) driven adaptive k-push mechanism (QKPush) for HTTP/2 live streaming. The client just sends one request to set push length (K) and bitrate (v) parameters and the server would push back K segments in a batch. To determine kpush parameters, a probabilistic buffer model is firstly designed to avoid buffer underflow/overflow. Also, three QoE objective functions are designed to ensure the high streaming quality (bitrate), playback continuity and smoothness. QK-Push casts this multi-objective optimization problem as a Pareto optimal problem. To solve it, a Nash bargaining solution is designed to balance the needs for video quality, bitrate smoothness and request overhead. Finally, the segments in each push cycle are selected by solving the Nash problem with a discrete space Lagrangian method. We implement an HTTP/2 live streaming prototype system, with the QK-Push algorithm over modified dash.js and Media Presentation Description. To evaluate the performances, the extensive live streaming experiments are carried out over a controllable network test-bed and real Internet trace. The results demonstrate that the proposed QK-Push algorithm is able to improve the average bitrate up to 13%, reduce the bitrate oscillations up to 81%, decrease the startup delay up to 58%, and increase the estimate the Mean Opinion Score up to 12% compared to the current HTTP/1.1 system.