Use of color image correlation in the retrieval of gastric surface topography by endoscopic stereopair matching
TL;DR: A pseudo-3-D surface reconstruction of the gastric surface by mapping the endoscopic image onto the retrieved elevation information is proposed, and some results of stereopair matching with color image correlation are presented.
Abstract: We propose finding an optimal generalized color plane to carry out digital color image correlation. We seek the optimization of the correlation peak’s sharpness and, for the purpose of analysis, we make some assumptions regarding the statistical properties of images to be considered. The analysis leads to a simple solution involving a projection onto the Karhunen-Loeve vectors corresponding to the smallest eigenvalues of the interprimary colors covariance matrix. We use our results in the retrieval of the gastric mucosal surface structure from stereopairs taken through an endoscope. Study of the statistics of the endoscope images shows that the assumptions used earlier can be applied to this type of image. We present some results of stereopair matching with color image correlation. We conclude by proposing a pseudo-3-D surface reconstruction of the gastric surface by mapping the endoscopic image onto the retrieved elevation information.
Citations
More filters
Patent•
18 Dec 2008
TL;DR: An endoscope including a rigid section having opposed first and second ends and an opening situated between the first and the second ends, the rigid section defining a longitudinal axis, a handle portion coupled to a first end and second scissor-type handles suitable for grasping by a user as mentioned in this paper.
Abstract: An endoscope including a rigid section having opposed first and second ends and an opening situated between the first and second ends, the rigid section defining a longitudinal axis; a handle portion coupled to a first end of the rigid section and having first and second scissor-type handles suitable for grasping by a user; and a base part situated at the second end of the rigid section and coupled to the first handle of the scissor-type handles such that displacement of the first handle causes a rotation of the base part
325 citations
Patent•
14 Mar 2015
TL;DR: An endoscopic microinstrument (100) may include a substantially rigid body (102) having first (101) and second ends (103), a channel (109) between the first and second end; a substantially-rigid end portion (106) movably coupled to the body and having first-and second ends; a tool (108) located at the first end of the end portion and including first and Second anvils (124); first andsecond handles (112, 116) coupled to a tool and configured to control actuation of at least one of the first-
Abstract: An endoscopic microinstrument (100) may include a substantially rigid body (102) having first (101) and second ends (103), a channel (109) between the first and second ends; a substantially rigid end portion (106) movably coupled to the body and having first and second ends; a tool (108) located at the first end of the end portion and including first and second anvils (124); first and second handles (112, 116) coupled to the body, at least one of the handles further coupled to the tool and configured to control actuation of at least one of the first and second anvils; a camera (110) coupled to, and situated to a side of, the substantially rigid end portion, the camera configured to obtain images of a region-of-interest; and an end portion controller (120) coupled to the body and configured angulate and/or rotate the substantially rigid end portion relative to the substantially rigid body.
294 citations
TL;DR: A new method to correct the barrel distortion of an electronic endoscope image with a correction model assuming circularly symmetric distortion with the advantage of not needing a careful placement of the standard pattern for calibration.
Abstract: A new method to correct the barrel distortion of an electronic endoscope image is presented. A correction model assuming circularly symmetric distortion is introduced with the following model parameters: the center of distortion and the coefficients of polynomials representing the distortion correction in the radial direction. If the imaging system is distortion-free, straight lines in the object space should be imaged as straight lines. Based on this criterion, a distorted image of a standard pattern consisting of a grid of several straight lines is recorded, and the model parameters are then estimated as a basis for straightening distorted lines. This method has the advantage of not needing a careful placement of the standard pattern for calibration. Correction results are presented for the grid pattern chart to verify a sufficient degree of correction. Examples of distortion correction of real intestinal images and physicians' comments are also presented. >
101 citations
Patent•
12 Nov 2010
TL;DR: In this paper, a dual-objective endoscope is inserted into a body cavity for providing a stereoscopic image of a region of interest inside of the body including an imaging device at the distal end for obtaining optical images of the ROI, and processing the optical images for forming video signals for wired and/or wireless transmission and display of 3D images on a rendering device.
Abstract: A dual objective endoscope for insertion into a cavity of a body for providing a stereoscopic image of a region of interest inside of the body including an imaging device at the distal end for obtaining optical images of the region of interest (ROI), and processing the optical images for forming video signals for wired and/or wireless transmission and display of 3D images on a rendering device. The imaging device includes a focal plane detector array (FPA) for obtaining the optical images of the ROI, and processing circuits behind the FPA. The processing circuits convert the optical images into the video signals. The imaging device includes right and left pupil for receiving a right and left images through a right and left conjugated multi-band pass filters. Illuminators illuminate the ROI through a muti-band pass filter having three right and three left pass bands that are matched to the right and left conjugated multi-band pass filters. A full color image is collected after three or six sequential illuminations with the red, green and blue lights.
54 citations
TL;DR: This work treats two different problems in the recognition of polychromatic images: (1) recognition of an object with a given shape and color combination; (2) recognitionof an object regardless of its color combination.
Abstract: We treat two different problems in the recognition of polychromatic images: (1) recognition of an object with a given shape and color combination; (2) recognition of an object regardless of its color combination. To solve each problem we propose different strategies. The number of filters and the objects to which the filters are matched vary with the strategy. Phase-only filters have been used to achieve recognition of both problems. Computer results are given for different targets and scenes to show the behavior of the proposed strategies.
48 citations
References
More filters
TL;DR: It is shown that the scene amplitude spectra follow an approximate reciprocal variation with frequency, and that the correlation function can be described by a one-step autoregressive model.
Abstract: Digitized records of terrain scenes were produced using a technique of photographic colorimetry. Each record consisted of three tristimulus images (X,Y, and Z) which were analyzed for their color statistics, spatial frequency content, and image correlation. Interactions between color and space were examined using a cone receptor transformation. It is shown that the scene amplitude spectra follow an approximate reciprocal variation with frequency, and that the correlation function can be described by a one-step autoregressive model. The results are discussed in terms of methods for optimum image coding in human and machine vision.
495 citations
TL;DR: A formulation for color image correlation is proposed, which is capable of discriminating between images according to their color as well as their spatial information.
39 citations
TL;DR: A digital method is proposed for the restoration of images color-shifted by the object motion that makes use of phase-only matching followed by a resampling operation to compensate for a space-variant shift between different primary color images.
Abstract: Color CCD endoscopes with sequential three-color illuminations have the advantage of high spatial resolution but are sensitive to object motion. A digital method is proposed for the restoration of images color-shifted by the object motion. The method makes use of phase-only matching followed by a resampling operation to compensate for a space-variant shift between different primary color images. Restored images are suitable for further image processing such as color emphasis and structure enhancement.
9 citations
TL;DR: In this paper, a 2D achromatic correlator working in polychromatic light or with broadband illumination is demonstrated, which consists of two AOC Fourier transformers combining zone plates set in cascade in order to cancel out chromatic blurring effects introduced by the use of several wavelengths.
Abstract: A 2D achromatic correlator working in polychromatic light or with broadband illumination is demonstrated. It consists of two achromatic Fourier transformers combining zone plates set in cascade in order to cancel out chromatic blurring effects introduced by the use of several wavelengths. Each of the spectral bands resolved in the source spectrum by the zone plates works as an independent channel. At the output of the set-up, the achromatic correlation peak results from the intensity superposition of monochromatic correlation peaks generated by each wavelength. The redundancy thus obtained yields a significant increase in the SNR, compared with that obtained when a single wavelength is used. Experimental results indicate that the SNR is increased by 3 dB and 8 dB as 5 channels (Ar+ multiwavelength laser) and 40 channels (Xe arc lamp) are used, respectively. Practically, in pattern recognition, such a multichannel processor permits false alarms to be reduced; its discrimination capability is evaluated to be 1.25 greater than when using a monochromatic correlator.
8 citations
TL;DR: A technique of generating a broad spectral band matched filter for complex signal detection with a white-light optical processor is described, which is very suitable for color image correlation.
Abstract: A technique of generating a broad spectral band matched filter for complex signal detection with a white-light optical processor is described. Since the filter construction and signal detection utilize primarily a white-light source, the technique is very suitable for color image correlation. Experimental results are also provided.
7 citations