The delivery and display of 360-degree videos on Head-Mounted Displays (HMDs) presents many technical challenges. 360-degree videos are ultra high resolution spherical videos, which contain an omnidirectional view of the scene. However only a portion of this scene is displayed on the HMD. Moreover, HMD need to respond in 10 ms to head movements, which prevents the server to send only the displayed video part based on client feedback. To reduce the bandwidth waste, while still providing an immersive experience, a viewport-adaptive 360-degree video streaming system is proposed. The server prepares multiple video representations, which differ not only by their bit-rate, but also by the qualities of different scene regions. The client chooses a representation for the next segment such that its bit-rate fits the available throughput and a full quality region matches its viewing. We investigate the impact of various spherical-to-plane projections and quality arrangements on the video quality displayed to the user, showing that the cube map layout offers the best quality for the given bit-rate budget. An evaluation with a dataset of users navigating 360-degree videos demonstrates that segments need to be short enough to enable frequent view switches.

Viewport-Adaptive Navigable 360-Degree Video Delivery

https://hal.archives-ouvertes.fr/hal-01574040/document

Viewport-adaptive navigable 360-degree video delivery

Gradient operators for feature extraction from omnidirectional panoramic images

Measurement of visual parameters of landscape using projections of photographs in GIS

Local Moebius transformations applied to omnidirectional images

Processing spherical images is challenging. Because no spherical parameterization is globally uniform, an accurate solver must account for the spatially varying metric. We present the first efficie...

/pdf/metric-aware-processing-of-spherical-imagery-39me7w8ix4.pdf

HoppeHugues

Papers

Metric-aware processing of spherical imagery