Changing network conditions pose severe problems to video streaming in the Internet. HTTP adaptive streaming (HAS) is a technology employed by numerous video services that relieves these issues by adapting the video to the current network conditions. It enables service providers to improve resource utilization and Quality of Experience (QoE) by incorporating information from different layers in order to deliver and adapt a video in its best possible quality. Thereby, it allows taking into account end user device capabilities, available video quality levels, current network conditions, and current server load. For end users, the major benefits of HAS compared to classical HTTP video streaming are reduced interruptions of the video playback and higher bandwidth utilization, which both generally result in a higher QoE. Adaptation is possible by changing the frame rate, resolution, or quantization of the video, which can be done with various adaptation strategies and related client- and server-side actions. The technical development of HAS, existing open standardized solutions, but also proprietary solutions are reviewed in this paper as fundamental to derive the QoE influence factors that emerge as a result of adaptation. The main contribution is a comprehensive survey of QoE related works from human computer interaction and networking domains, which are structured according to the QoE impact of video adaptation. To be more precise, subjective studies that cover QoE aspects of adaptation dimensions and strategies are revisited. As a result, QoE influence factors of HAS and corresponding QoE models are identified, but also open issues and conflicting results are discussed. Furthermore, technical influence factors, which are often ignored in the context of HAS, affect perceptual QoE influence factors and are consequently analyzed. This survey gives the reader an overview of the current state of the art and recent developments. At the same time, it targets networking researchers who develop new solutions for HTTP video streaming or assess video streaming from a user centric point of view. Therefore, this paper is a major step toward truly improving HAS.

A Survey on Quality of Experience of HTTP Adaptive Streaming

HTTP Adaptive Streaming (HAS) is employed by more and more video streaming services in the Internet. It allows to adapt the downloaded video quality to the current network conditions, and thus, avoids stalling (i.e., playback interruptions) to the greatest possible extend. The adaptation of video streams is done by switching between different quality representation levels, which influences the user perceived quality of the video stream. In this work, the influence of several adaptation parameters, namely, switch amplitude (i.e., quality level difference), switching frequency, and recency effects, on Quality of Experience (QoE) is investigated. Therefore, crowdsourcing experiments were conducted in order to collect subjective ratings for different adaptation-related test conditions. The results of these subjective studies indicate the influence of the adaptation parameters, and based on these findings a simplified QoE model for HAS is presented, which only relies on the switch amplitude and the playback time of each layer.

Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming

Identifying QoE optimal adaptation of HTTP adaptive streaming based on subjective studies

Recently, Hypertext Transfer Protocol (HTTP)-based adaptive streaming has become the de facto standard for video streaming over the Internet. It allows clients to dynamically adapt media characteristics to the varying network conditions to ensure a high quality of experience (QoE)—that is, minimize playback interruptions while maximizing video quality at a reasonable level of quality changes. In the case of live streaming, this task becomes particularly challenging due to the latency constraints. The challenge further increases if a client uses a wireless access network, where the throughput is subject to considerable fluctuations. Consequently, live streams often exhibit latencies of up to 20 to 30 seconds. In the present work, we introduce an adaptation algorithm for HTTP-based live streaming called LOLYPOP (short for low-latency prediction-based adaptation), which is designed to operate with a transport latency of a few seconds. To reach this goal, LOLYPOP leverages Transmission Control Protocol throughput predictions on multiple time scales, from 1 to 10 seconds, along with estimations of the relative prediction error distributions. In addition to satisfying the latency constraint, the algorithm heuristically maximizes the QoE by maximizing the average video quality as a function of the number of skipped segments and quality transitions. To select an efficient prediction method, we studied the performance of several time series prediction methods in IEEE 802.11 wireless access networks. We evaluated LOLYPOP under a large set of experimental conditions, limiting the transport latency to 3 seconds, against a state-of-the-art adaptation algorithm called FESTIVE. We observed that the average selected video representation index is by up to a factor of 3 higher than with the baseline approach. We also observed that LOLYPOP is able to reach points from a broader region in the QoE space, and thus it is better adjustable to the user profile or service provider requirements.

/pdf/qoe-based-low-delay-live-streaming-using-throughput-1tqouyioew.pdf

QoE-Based Low-Delay Live Streaming Using Throughput Predictions

Recently, the way people consume video content has been undergoing a dramatic change. Plain TV sets, that have been the center of home entertainment for a long time, are losing ground to hybrid TVs, PCs, game consoles, and, more recently, mobile devices such as tablets and smartphones. The new predominant paradigm is: watch what I want, when I want, and where I want. The challenges of this shift are manifold. On the one hand, broadcast technologies such as DVB-T/C/S need to be extended or replaced by mechanisms supporting asynchronous viewing, such as IPTV and video streaming over best-effort networks, while remaining scalable to millions of users. On the other hand, the dramatic increase of wireless data traffic begins to stretch the capabilities of the existing wireless infrastructure to its limits. Finally, there is a challenge to video streaming technologies to cope with a high heterogeneity of end-user devices and dynamically changing network conditions, in particular in wireless and mobile networks. In the present work, our goal is to design an efficient system that supports a high number of unicast streaming sessions in a dense wireless access network. We address this goal by jointly considering the two problems of wireless transmission scheduling and video quality adaptation, using techniques inspired by the robustness and simplicity of proportional-integral-derivative (PID) controllers. We show that the control-theoretic approach allows to efficiently utilize available wireless resources, providing high quality of experience (QoE) to a large number of users.

/pdf/a-control-theoretic-approach-to-adaptive-video-streaming-in-ru8vscn2b0.pdf

A Control-Theoretic Approach to Adaptive Video Streaming in Dense Wireless Networks

Block-Request Adaptive Streaming (BRAS), in form of its most prominent representative HTTP-Based Adaptive Streaming (HAS), is about to become the dominating technology for video delivery over the Internet. One of the challenges in the development of BRAS clients is the design of mechanisms that dynamically adapt the streamed video quality to network conditions, in order to maximize user's Quality of Experience (QoE). The main contribution of this paper is an approach to calculating optimal adaptation trajectories. This approach not only allows to benchmark the performance of any streaming client, it also provides the possibility to study the impact of the networking environment, and of configuration parameters such as the start-up delay, number of available video representations, etc., on the achievable streaming performance. Since, to the best of our knowledge, there exist no widely accepted or standard approach to measure QoE for BRAS, we alternatively maximize the average video bit-rate, minimize the number of quality switches, and impose a hard constraint on the absence of rebuffering events. Further, we evaluate two HAS clients, Microsoft SmoothStreaming and our own streaming client that supports the recently adopted HAS standard Dynamic Adaptive Streaming over HTTP (DASH), in an indoor Wireless Local Area Network (WLAN) emulated with a high degree of precision. We compare their performance with the optimal client, and explore the configuration parameter space of the DASH client. Finally, we evaluate the impact of start-up delays and number of available video representations on achievable streaming performance.

/pdf/optimal-adaptation-trajectories-for-block-request-adaptive-4sk8g6odwi.pdf

Nicola Corda

Papers

Optimal Adaptation Trajectories for Block-Request Adaptive Video Streaming