scispace - formally typeset
Open AccessProceedings ArticleDOI

Viewport-Adaptive Navigable 360-Degree Video Delivery

Reads0
Chats0
TLDR
In this article, a viewport-adaptive 360-degree video streaming system is proposed to reduce the bandwidth waste, while still providing an immersive experience, by preparing multiple video representations, which differ not only by their bit-rate, but also by the qualities of different scene regions.
Abstract
The delivery and display of 360-degree videos on Head-Mounted Displays (HMDs) presents many technical challenges. 360-degree videos are ultra high resolution spherical videos, which contain an omnidirectional view of the scene. However only a portion of this scene is displayed on the HMD. Moreover, HMD need to respond in 10 ms to head movements, which prevents the server to send only the displayed video part based on client feedback. To reduce the bandwidth waste, while still providing an immersive experience, a viewport-adaptive 360-degree video streaming system is proposed. The server prepares multiple video representations, which differ not only by their bit-rate, but also by the qualities of different scene regions. The client chooses a representation for the next segment such that its bit-rate fits the available throughput and a full quality region matches its viewing. We investigate the impact of various spherical-to-plane projections and quality arrangements on the video quality displayed to the user, showing that the cube map layout offers the best quality for the given bit-rate budget. An evaluation with a dataset of users navigating 360-degree videos demonstrates that segments need to be short enough to enable frequent view switches.

read more

Citations
More filters
Journal ArticleDOI

A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP

TL;DR: This survey provides an overview of the different methods proposed over the last several years of bitrate adaptation algorithms for HTTP adaptive streaming, leaving it to system builders to innovate and implement their own method.
Proceedings ArticleDOI

360-Degree Video Head Movement Dataset

TL;DR: A dataset of head movements of users watching 360-degree videos on a Head-Mounted Display (HMD) is introduced and some examples of statistics that can be extracted from the collected data, for a content-dependent analysis of users' navigation patterns.
Proceedings ArticleDOI

Flare: Practical Viewport-Adaptive 360-Degree Video Streaming for Mobile Devices

TL;DR: This work conducts an IRB-approved user study and develops novel online algorithms that determine which spatial portions to fetch and their corresponding qualities for Flare, a practical system for streaming 360-degree videos on commodity mobile devices.
Proceedings ArticleDOI

Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality

TL;DR: This paper develops fixation prediction networks that concurrently leverage sensor- and content-related features to predict the viewer fixation in the future, which is quite different from the solutions in the literature.
Proceedings ArticleDOI

360° Video Viewing Dataset in Head-Mounted Virtual Reality

TL;DR: This paper presents datasets of both content data (such as image saliency maps and motion maps derived from 360° videos) and sensor data ( such as viewer head positions and orientations derived from HMD sensors) that can be used to optimize existing 360° video streaming applications and novel applications (like crowd-driven camera movements).
References
More filters
Proceedings ArticleDOI

Multiscale structural similarity for image quality assessment

TL;DR: This paper proposes a multiscale structural similarity method, which supplies more flexibility than previous single-scale methods in incorporating the variations of viewing conditions, and develops an image synthesis method to calibrate the parameters that define the relative importance of different scales.
Journal ArticleDOI

Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale

TL;DR: It is argued that it is necessary to design at the application layer using a "probe and adapt" principle for video bitrate adaptation, which is akin, but also orthogonal to the transport-layer TCP congestion control, and PANDA - a client-side rate adaptation algorithm for HAS is presented.
Proceedings ArticleDOI

Rate adaptation for adaptive HTTP streaming

TL;DR: A receiver-driven rate adaptation method for HTTP/TCP streaming that deploys a step-wise increase/ aggressive decrease method to switch up/down between the different representations of the content that are encoded at different bitrates is presented.
Proceedings ArticleDOI

Optimizing 360 video delivery over cellular networks

TL;DR: This paper proposes a cellular-friendly streaming scheme that delivers only 360 videos' visible portion based on head movement prediction, which can reduce bandwidth consumption by up to 80% based on a trace-driven simulation.
Proceedings ArticleDOI

A Framework to Evaluate Omnidirectional Video Coding Schemes

TL;DR: This paper extract viewport based head motion trajectories, and compares the original and coded videos on the viewport, and shows that the average viewport quality can be approximated by a weighted spherical PSNR.
Related Papers (5)