A Novel Randomize Hierarchical Extension of MV-HEVC for Improved Light Field Compression
01 Dec 2019-pp 1-8
TL;DR: This paper presents a novel scheme for light field compression based on a randomize hierarchical multi-view extension of high efficiency video coding (dubbed as RH-MVHEVC), which consistently outperform the state-of-the-art compression methods on benchmark ICME 2016 and ICIP 2017 grand challenge data sets.
Abstract: This paper presents a novel scheme for light field compression based on a randomize hierarchical multi-view extension of high efficiency video coding (dubbed as RH-MVHEVC). Specifically, a light field data are arranged as a multiple pseudo-temporal video sequences which are efficiently compressed with MV-HEVC encoder, following an integrated random coding technique and hierarchical prediction scheme. The critical advantage of proposed RH-MVHEVC scheme is that it utilizes not just a temporal and inter-view prediction, but efficiently exploits the strong intrinsic similarities within each sub-aperture image and among neighboring sub-aperture images in both horizontal and vertical directions. Experimental results consistently outperform the state-of-the-art compression methods on benchmark ICME 2016 and ICIP 2017 grand challenge data sets. It achieves an average up to 33.803% BD-rate reduction and 1.7978 dB BD-PSNR improvement compared with an advanced JEM video encoder, and an average 20.4156% BD-rate reduction and 2.0644 dB BD-PSNR improvement compared with a latest image-based JEM-anchor coding scheme.
References
More filters
01 Jan 2001
4,379 citations
"A Novel Randomize Hierarchical Exte..." refers methods in this paper
...The BjontegaardDelta rate [25] is used to measure the objective quality of the proposed scheme....
[...]
01 Jan 2005
TL;DR: The plenoptic camera as mentioned in this paper uses a microlens array between the sensor and the main lens to measure the total amount of light deposited at that location, but how much light arrives along each ray.
Abstract: This paper presents a camera that samples the 4D light field on its sensor in a single photographic exposure. This is achieved by inserting a microlens array between the sensor and main lens, creating a plenoptic camera. Each microlens measures not just the total amount of light deposited at that location, but how much light arrives along each ray. By re-sorting the measured rays of light to where they would have terminated in slightly different, synthetic cameras, we can compute sharp photographs focused at different depths. We show that a linear increase in the resolution of images under each microlens results in a linear increase in the sharpness of the refocused photographs. This property allows us to extend the depth of field of the camera without reducing the aperture, enabling shorter exposures and lower image noise. Especially in the macrophotography regime, we demonstrate that we can also compute synthetic photographs from a range of different viewpoints. These capabilities argue for a different strategy in designing photographic imaging systems. To the photographer, the plenoptic camera operates exactly like an ordinary hand-held camera. We have used our prototype to take hundreds of light field photographs, and we present examples of portraits, high-speed action and macro close-ups.
2,252 citations
"A Novel Randomize Hierarchical Exte..." refers methods in this paper
...The plenoptic image is converted using Matlab Lytro toolbox [21] to a set of 15 − by − 15 grid of perspective images....
[...]
...Commercially available light field cameras such as Lytro [2] and Ratrix [3] recorded 4D light field by placing an array of small micro lenses on top of photographic sensor....
[...]
...The raw image captured by Lytro Illum is of huge size....
[...]
TL;DR: A new type of plenoptic camera with an extended depth of field and a maximal effective resolution of up to a quarter of the sensor resolution is introduced.
Abstract: Placing a micro lens array in front of an image sensor transforms a normal camera into a single lens 3D camera,
which also allows the user to change the focus and the point of view after a picture has been taken. While
the concept of such plenoptic cameras is known since 1908, only recently the increased computing power of
low-cost hardware and the advances in micro lens array production, have made the application of plenoptic
cameras feasible. This text presents a detailed analysis of plenoptic cameras as well as introducing a new type
of plenoptic camera with an extended depth of field and a maximal effective resolution of up to a quarter of the
sensor resolution.
412 citations
"A Novel Randomize Hierarchical Exte..." refers methods in this paper
...Commercially available light field cameras such as Lytro [2] and Ratrix [3] recorded 4D light field by placing an array of small micro lenses on top of photographic sensor....
[...]
Proceedings Article•
01 Jan 2016TL;DR: A publicly available light field image dataset is introduced and described in details, which contains 118 light field images captured by using a Lytro Illum light field camera.
Abstract: Recently, an emerging light field imaging technology, which enables capturing full light information in a scene, has gained a lot of interest. To design, develop, implement, and test novel algorithms in light field image processing and compression, the availability of suitable light field image datasets is essential. In this paper, a publicly available light field image dataset is introduced and described in details. The proposed dataset contains 118 light field images captured by using a Lytro Illum light field camera. Based on their content, acquired light field images were classified into ten different categories with various features covering wide range of potential usage, such as image compression and quality evaluation.
283 citations
"A Novel Randomize Hierarchical Exte..." refers methods in this paper
...We conducted experiments using EPFL Light field dataset representing different scenarios [20]....
[...]