scispace - formally typeset
Journal ArticleDOI

Joint image and depth completion in shape-from-focus: Taking a cue from parallax

Reads0
Chats0
TLDR
The interesting possibility of exploiting motion parallax cue in the images captured in Shape-from-focus with a practical camera to jointly inpaint the focused image and depth map is demonstrated.
Abstract
Shape-from-focus (SFF) uses a sequence of space-variantly defocused observations captured with relative motion between camera and scene. It assumes that there is no motion parallax in the frames. This is a restriction and constrains the working environment. Moreover, SFF cannot recover the structure information when there are missing data in the frames due to CCD sensor damage or unavoidable occlusions. The capability of filling-in plausible information in regions devoid of data is of critical importance in many applications. Images of 3D scenes captured by off-the-shelf cameras with relative motion commonly exhibit parallax-induced pixel motion. We demonstrate the interesting possibility of exploiting motion parallax cue in the images captured in SFF with a practical camera to jointly inpaint the focused image and depth map.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Dynamic occlusion detection and inpainting of in situ captured terrestrial laser scanning point clouds sequence

TL;DR: The proposed method achieves high precision and recall rate for dynamic occlusion detection and inpainting method for sequential TLS point clouds captured from one scan position and produces clean inpainted point clouds for further processing.
Proceedings ArticleDOI

A multimodal approach for image de-fencing and depth inpainting

TL;DR: This work proposes a multi-modal approach to address the problem of removal of fences/occlusions from images captured using a Kinect camera, and model the unoccluded image and the completed depth map as two distinct Markov random fields, respectively, and obtain their maximum a-posteriori estimates using loopy belief propagation.
Journal ArticleDOI

Depth inpainting by tensor voting.

TL;DR: This paper proposes a fast and reliable algorithm for depth map inpainting using the tensor voting (TV) framework, and align the depth maps of the training set with the target (defective) depth map and evaluates the goodness of depth estimates among candidate values using 3D TV.
Journal ArticleDOI

Towards Unrestrained Depth Inference with Coherent Occlusion Filling

TL;DR: This work proposes a depth estimation framework using calibrated images captured under general camera motion and lens parameter variations that seeks to generalize the constrained areas of stereo and shape from defocus (SFD)/focus (SFF) by handling, in tandem, various effects such as focus variation, zoom, parallax and stereo occlusions, all under one roof.
Journal ArticleDOI

Shape extraction of low‐textured objects in video microscopy

TL;DR: This paper exploits spatial dependencies by modeling the shape of the object with a discontinuity‐adaptive Markov random field wherein the focus measure profile is used to judiciously control the degree of smoothness.
References
More filters
Proceedings ArticleDOI

A graph cut algorithm for generalized image deconvolution

TL;DR: This paper shows how to use graph cuts to obtain a discontinuity preserving solution to a linear inverse system with an arbitrary non-negative system matrix.
Proceedings ArticleDOI

Seeing beyond occlusions (and other marvels of a finite lens aperture)

TL;DR: A novel algorithm is presented to reconstruct the geometry and photometry of a scene with occlusions from a collection of defocused images using the presence of a finite lens aperture to recover portions of the scene that would be occluded in a pin-hole projection, thus "uncovering" the occlusion.
Journal ArticleDOI

Confocal Stereo

TL;DR: The confocal constancy property is introduced, which states that as the lens aperture varies, the pixel intensity of a visible in-focus scene point will vary in a scene-independent way, that can be predicted by prior radiometric lens calibration.
Journal ArticleDOI

Image restoration using digital inpainting and noise removal

TL;DR: The experimental results show the effective performance of the combination of these two procedures in restoring scratched photos, disocclusion (or removal of entire objects from the image) in vision analysis and text removal from images.
Proceedings ArticleDOI

Depth from defocus in presence of partial self occlusion

TL;DR: The proposed algorithm on how to take care of the occlusion while recovering the depth using the defocus as the cue is tested and the estimates are found to be better than the earlier schemes where such subtle effects were ignored.
Related Papers (5)