Significant improvements in video compression capability have been demonstrated with the introduction of the H.264/MPEG-4 advanced video coding (AVC) standard. Since developing this standard, the Joint Video Team of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) has also standardized an extension of that technology that is referred to as multiview video coding (MVC). MVC provides a compact representation for multiple views of a video scene, such as multiple synchronized video cameras. Stereo-paired video for 3-D viewing is an important special case of MVC. The standard enables inter-view prediction to improve compression capability, as well as supporting ordinary temporal and spatial prediction. It also supports backward compatibility with existing legacy systems by structuring the MVC bitstream to include a compatible “base view.” Each other view is encoded at the same picture resolution as the base view. In recognition of its high-quality encoding capability and support for backward compatibility, the stereo high profile of the MVC extension was selected by the Blu-Ray Disc Association as the coding format for 3-D video with high-definition resolution. This paper provides an overview of the algorithmic design used for extending H.264/MPEG-4 AVC towards MVC. The basic approach of MVC for enabling inter-view prediction and view scalability in the context of H.264/MPEG-4 AVC is reviewed. Related supplemental enhancement information (SEI) metadata is also described. Various “frame compatible” approaches for support of stereo-view video as an alternative to MVC are also discussed. A summary of the coding performance achieved by MVC for both stereo- and multiview video is also provided. Future directions and challenges related to 3-D video are also briefly discussed.

/pdf/overview-of-the-stereo-and-multiview-video-coding-extensions-18yz9qlji4.pdf

Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard

A method of decoding a video signal is disclosed. The present invention includes obtaining identification information indicating whether a coded picture of a current NAL unit is an inter-view picture group, obtaining interview reference information of the inter-view picture group, and constructing a reference picture list for inter-view prediction using the inter-view reference information according to the identification information, wherein the inter-view reference information includes view identification information of an inter-view reference picture.

Method and apparatus for decoding/encoding a video signal

A method comprises receiving a first sequence of access units and a second sequence of access units; decoding at least one access unit of the first sequence of access units; decoding a first decodable access unit of the second sequence of access units; determining whether a next decodable access unit in the second sequence of access units can be decoded before an output time of the next decodable access unit in the second sequence of access units; and skipping decoding of the next decodable access unit based on determining that the next decodable access unit cannot be decoded before the at least one of the decoding time and the output time of the next decodable access unit.

Method and apparatus for video coding and decoding

There is disclosed a method, an apparatus, a server, a client and a non-transitory computer readable medium comprising a computer program stored therein for video coding and decoding. Depth pictures from a plurality of viewing angles are projected into a single viewing angle, making it possible to have pixel-wise joint filtering to be applied to all projected depth values. This approach enables to suppress the noise in the depth map data and provides improved performance for a view synthesis.

Apparatus, a method and a computer program for video coding and decoding

The present disclosure pertains to an image-processing device and method that make it possible to suppress block noise. A βLUT_input calculator and a clip processor determine βLUT_input, which is a value inputted to an existing-β generator and an expanded-β generator. When the value of βLUT_input qp from the clip processor is 51 or less, the existing-β generator determines β using a LUT conforming to the HVEC standard, and supplies same to a filter process determination unit. When the value of βLUT_input qp from the clip processor is larger than 51, the expanded-β generator determines the expanded β and supplies same to the filter process determination part. This disclosure, for example, can be applied to an image processing device.

Image processing device and method

An apparatus and method for multiplexing a multi-view three-dimensional moving picture according to a user's request is disclosed. The apparatus multiplexes a multi-view three-dimensional moving pictures by receiving moving pictures and information inputted from multi-view cameras and generating multi-view encoded streams corresponding to received moving pictures and information, receiving back channel information of the user, selecting necessary multi-view encoded streams according to the back channel information and multiplexing the selected multi-view encoded streams by a frame or a field having same time information. The present invention can effectively process the multi-view three-dimensional moving picture according to the display mode and system environment requested from the user by simplifying a synchronization process.

Method and apparatus for multiplexing multi-view three-dimensional moving picture

In this paper, we present an efficient approach for the compression of stereoscopic video sequences. By extending an H.264/AVC-based multi-view video coding (MVC) codec as described in a previous paper to mixed-resolution imagery, i.e., to stereoscopic videos where the right-eye view had been spatially down-sampled in order to reduce the total amount of data to be encoded, we are able to combine the benefits of both disparity-compensated prediction (DCP) and asymmetric coding. By doing so, we expect to achieve very high compression gains without reducing the overall visual quality of the resulting three-dimensional (3D) percept.

Asymmetric Coding of Stereoscopic Video for Transmission Over T-DMB

In multiview video, illumination changes can occur due to imperfect camera calibration and variations of the camera position and direction. These characteristics can cause performance degradation in multiview video coding (MVC) that uses inter-view prediction by referring to the pictures obtained from the neighboring views. In order to overcome this problem, an adaptive local illumination change compensation method is proposed. In the proposed method, we compensate for the illumination changes in the macroblock (MB) unit between the current picture and the reference picture under the assumption that the DC component in the MB is influenced by the local illumination changes. By using the proposed method, the compression ratio in the multiview video coding was increased, and a 0.1~0.6 dB peak signal-to-noise ratio (PSNR) improvement was obtained compared with the case where the proposed method was not used.

Adaptive Local Illumination Change Compensation Method for H.264/AVC-Based Multiview Video Coding

Provided are a three-dimensional (3D) stereoscopic digital broadcasting transmitting/receiving apparatus and method using 3D stereoscopic video additional data. The apparatus and method is compatible with a two-dimensional (2D) digital broadcasting system by defining and processing 3D stereoscopic video additional data, such as another 3D video, disparity information, and depth information, as an additional stream added to a 2D video transport stream, which is different from the conventional method that provides a 3D stereoscopic digital broadcasting system by using video of another viewpoint. The 3D stereoscopic digital broadcast transmitting apparatus includes: a video acquiring unit; an audio data acquiring unit, an encoding unit, a program specific information (PSI) generating unit, a packetizing unit, a transport stream (TS) generating unit, a multiplexing unit, and a modulating unit.

Apparatus and method for transmitting/receiving 3d stereoscopic digital broadcast signal by using 3d stereoscopic video additional data

Provided are an apparatus and method for predictive coding/decoding for improving a compression rate of multiview video using one or two additional reference frame buffers. The predictive encoding apparatus includes: a multiview reference picture providing unit for providing a reference picture for a predictive encoding according to temporal and spatial GOP structure information; a prediction unit for creating a vector by predicting which part of the reference picture inputted from the multiview reference picture providing unit is referred by a picture to currently encode; a transforming and quantizing unit for obtaining a difference signal between the predicted signal inputted from the prediction unit and a picture signal to currently encode, transforming the obtained difference signal, quantizing the transformed signal, and compressing the quantized signal; and an entropy encoding unit for encoding the quantized signal and the vectors according to a predetermined scheme and outputting the encoded signal.

Suk-Hee Cho

Papers

Method and apparatus for multiplexing multi-view three-dimensional moving picture

Asymmetric Coding of Stereoscopic Video for Transmission Over T-DMB

Adaptive Local Illumination Change Compensation Method for H.264/AVC-Based Multiview Video Coding

Apparatus and method for transmitting/receiving 3d stereoscopic digital broadcast signal by using 3d stereoscopic video additional data

Apparatus of predictive coding/decoding using view-temporal reference picture buffers and method using the same