Accurate depth map estimation from a lenslet light field camera
read more
Citations
Learning-based view synthesis for light field cameras
Learning-Based View Synthesis for Light Field Cameras
A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields
Light Field Image Processing: An Overview
Soft 3D reconstruction for view synthesis
References
Distinctive Image Features from Scale-Invariant Keypoints
Communication in the presence of noise
Light field photography with a hand-held plenoptic camera
Fast cost-volume filtering for visual correspondence and beyond
Multi-camera Scene Reconstruction via Graph Cuts
Related Papers (5)
Frequently Asked Questions (12)
Q2. What is the key to the proposed algorithm?
Central to the proposed algorithm is the use of the phase shift theorem in the Fourier domain to estimate the sub-pixel shifts of sub-aperture images.
Q3. Why did the proposed method have significant outliers?
Because the proposed depth estimation method collects matching costs using robust clipping functions, it can tolerate significant outliers.
Q4. What is the effect of d on the angular difference between the pixels?
Shortening d enlarges the angular difference between the corresponding rays of adjacent pixels and might cause radial distortion of the micro-lenses.
Q5. How does the proposed method improve the matching quality?
In addition, the calculation of the exact sub-pixel shift using the phase shift theorem improves the matching quality as demonstrated in the synthetic experiments.
Q6. What was the effect of the proposed method on the depth map?
The significant challenges of estimating the disparity using very narrow baselines was discussed, and the proposed method was found to be effective in terms of utilizing the sub-pixel shift in the frequency domain.
Q7. What is the weight term for the sub-aperture image?
weight term that considers the horizontal/vertical deviation in the st coordinates between the sub-aperture image pairs is defined.
Q8. What is the error value of AWS and Robust PCA?
The error values of AWS and Robust PCA are from [8].every x, Ĉ(x, lr(x)) is set to 0, followed by weighted median filtering [15] of the cost slices.
Q9. What is the way to compute the optimal disparity map?
The optimal disparity map is obtained through minimizinglr = argmin l ∑ x C ′ ( x, l(x) ) + λ1 ∑ x∈I ‖l(x)−la(x)‖+λ2 ∑ x∈M ‖l(x)−lc(x)‖+ λ3 ∑ x′∈Nx ‖l(x)−l(x′)‖, (10)where The authorcontains inlier pixels that are determined in the previous step in Sec. 4.2, and M denotes the pixels that have confident matching correspondences.
Q10. How can a continuous band-limited signal be reconstructed?
According to the NyquistShannon sampling theorem [21], a continuous band-limited signal can be perfectly reconstructed through convolving it with a sinc function.
Q11. Why is the baseline between sub-aperture images from a lenslet light field camera?
Because the baseline between sub-aperture images from a lenslet light field camera is very narrow, directly applying the existing stereo matching algorithms such as [20] cannot produce satisfying results, even if the applied algorithm is a top ranked method in the Middlebury stereo matching benchmark.
Q12. What is the method for detecting sub-pixel shift?
Among the sub-pixel shift methods, the proposed phase-shift based approach exhibited the best results, which supports the importance of accurate sub-pixel shifting.