There is disclosed a method, an apparatus, a server, a client and a non-transitory computer readable medium comprising a computer program stored therein for video coding and decoding. Depth pictures from a plurality of viewing angles are projected into a single viewing angle, making it possible to have pixel-wise joint filtering to be applied to all projected depth values. This approach enables to suppress the noise in the depth map data and provides improved performance for a view synthesis.

Apparatus, a method and a computer program for video coding and decoding

There is disclosed a method, an apparatus, a server, a client and a non-transitory computer readable medium comprising a computer program stored therein for motion compensated video coding and decoding. Texture block motion information is used to derive disparity/depth motion information. Alternatively, disparity/depth motion information is used to derive texture block motion information.

An apparatus, a method and a computer program for video coding and decoding

Processing video data may include capturing the video data with multiple cameras and stitching the video data together to obtain a 360-degree video. A frame-packed picture may be provided based on the captured and stitched video data. A current sample location may be identified in the frame-packed picture. Whether a neighboring sample location is located outside of a content boundary of the frame-packed picture may be determined. When the neighboring sample location is located outside of the content boundary, a padding sample location may be derived based on at least one circular characteristic of the 360-degree video content and the projection geometry. The 360-degree video content may be processed based on the padding sample location.

360-degree video coding using geometry projection

360-degree video streaming is expected to grow as the next disruptive innovation due to the ultra-high network bandwidth (60–100 Mbps for 6k streaming), ultra-high storage capacity, and ultra-high computation requirements. Video consumers are more interested in the immersive experience instead of conventional broadband televisions. The visible area (known as user’s viewport) of the video is displayed through Head-Mounted Display (HMD) with a very high frame rate and high resolution. Delivering the whole 360-degree frames in ultra-high-resolution to the end-user significantly adds pressure to the service providers’ overall intention. This paper surveys 360-degree video streaming by focusing on different paradigms from capturing to display. It overviews different projections, compression, and streaming techniques that either incorporate the visual features or spherical characteristics of 360-degree video. Next, the latest ongoing standardization efforts for enhanced degree-of-freedom immersive experience are presented. Furthermore, several 360-degree audio technologies and a wide range of immersive applications are consequently deliberated. Finally, some significant research challenges and implications in the immersive multimedia environment are presented and explained in detail.

360-Degree Video Streaming: A Survey of the State of the Art

A method and apparatus for deriving MVP (motion vector predictor) for Skip or Merge mode in 3D video coding are disclosed. In one embodiment, the method comprises determining an MVP candidate set for a selected block and selecting one MVP from an MVP list for motion vector coding of the block. The MVP candidate set may comprise multiple spatial MVP candidates associated with neighboring blocks and one inter-view candidate, and the MVP list is selected from the MVP candidate set. The MVP list may consist of only one MVP candidate or multiple MVP candidates. If only one MVP candidate is used, there is no need to incorporate an MVP index associated with the MVP candidate in the video bitstream corresponding to the three-dimensional video coding. Also, the MVP candidate can be the first available MVP candidate from the MVP candidate set according to a pre-defined order.

Method and apparatus of motion vector derivation for 3d video coding

A method for encoding a spherical video is disclosed. The method includes mapping a frame of the spherical video to a two dimensional representation based on a projection. Further, in a prediction process the method includes determine whether at least one block associated with a prediction scheme is on a boundary of the two dimensional representation, and upon determining the at least one block associated with the prediction scheme is on the boundary, select an adjacent end block as a block including at least one pixel for use during the prediction process, the adjacent end block being associated with two or more boundaries of the two dimensional representation.

Continuous prediction domain

Google started an opensource project, entitled the WebM Project, in 2010 to develop royaltyfree video codecs for the web The present generation codec developed in the WebM project called VP9 was finalized in mid2013 and is currently being served extensively by YouTube, resulting in billions of views per day Even though adoption of VP9 outside Google is still in its infancy, the WebM project has already embarked on an ambitious project to develop a next edition codec VP10 that achieves at least a generational bitrate reduction over the current generation codec VP9 Although the project is still in early stages, a set of new experimental coding tools have already been added to baseline VP9 to achieve modest coding gains over a large enough test set This paper provides a technical overview of these coding tools

An overview of new video coding tools under consideration for VP10: the successor to VP9

Screen content coding plays an important role in many applications. To meet the growing demands of screen content coding, the emerging AV1 video codec incorporates several coding tools, which are specially designed for screen content utilizing its distinctive characteristics. Among these tools, the intra block copy utilizes the characteristic that repeating patterns frequently occur in screen content. This paper presents the technology of intra block copy in AV1. In particular, to efficiently search the predictor in the reconstructed regions of the current picture, AV1 uses the hash matching method at the encoder side. For the generation of hash table, a bottom-to-up manner is adopted to reduce the redundant computation and then decrease the encoding time. In addition, several constraints are involved to facilitate hardware design. Experimental results demonstrate that the intra block copy in AV1 can bring 27.1% bitrate saving for screen content. When compared with the non hash-based intra block copy, the hash-based method achieves 12.2% bitrate saving.

Intra Block Copy for Screen Content in the Emerging AV1 Video Codec

Decoding encoded transform coefficients of a current block includes initializing a decoder state of a state machine having Boolean and symbol ANS decoders. The decoder state includes an ANS state and a buffer position within a buffer storing a variable string including the encoded transform coefficients. The transform coefficients are sequentially produced from the variable string using the state machine by processing a binary flag/bit using the Boolean ANS decoder and processing a token using the symbol ANS decoder. Each decoder performs state normalization when the ANS state is outside a valid state range, performs output computation to generate an output value for the binary flag/bit or token using the ANS state and a probability, and updates the ANS state using the output value and the probability as inputs. The decoder state evolution operations may be different. An encoder state machine having Boolean and symbol ANS encoders is also described.

Mixed boolean-token ans coefficient coding

Videos associated with video resolutions may be received. A first bitrate for each of the video resolutions may be identified based on a first bitrate point associated with the videos where a quality of the videos at a first video resolution that is upscaled to a second video resolution is better than a quality of the videos at the second video resolution at bitrates below the first bitrate point. The upscaling of the first video resolution may correspond to converting the videos from the first video resolution to the second video resolution at a client device. The identified corresponding first bitrate may be assigned to each of the video resolutions.

Alexander Jay Converse

Papers

Continuous prediction domain

An overview of new video coding tools under consideration for VP10: the successor to VP9

Intra Block Copy for Screen Content in the Emerging AV1 Video Codec

Mixed boolean-token ans coefficient coding

Bitrate selection for video streaming