An image sensor for capturing a color image is disclosed having a two-dimensional array having first and second groups of pixels wherein pixels from the first group of pixels have narrower spectral photoresponses than pixels from the second group of pixels and wherein the first group of pixels has individual pixels that have spectral photoresponses that correspond to a set of at least two colors, with the placement of the first and second groups of pixels defining a pattern that has a minimal repeating unit including at least six pixels with at least some rows or columns of the minimal repeating unit composed only of pixels from the second group of pixels, and including ways to combine similarly positioned pixels from at least two adjacent minimal repeating units.

Image sensor with improved light sensitivity

We present a novel approach to detect and track independently moving regions in a 3D scene observed by a moving camera in the presence of strong parallax. Detected moving pixels are classified into independently moving regions or parallax regions by analyzing two geometric constraints: the commonly used epipolar constraint, and the structure consistency constraint. The second constraint is implemented within a "plane+parallax" framework and represented by a bilinear relationship which relates the image points to their relative depths. This newly derived relationship is related to trilinear tensor, but can be enforced into more than three frames. It does not assume a constant reference plane in the scene and therefore eliminates the need for manual selection of reference plane. Then, a robust parallax filtering scheme is proposed to accumulate the geometric constraint errors within a sliding window and estimate a likelihood map for pixel classification. The likelihood map is integrated into our tracking framework based on the spatio-temporal joint probability data association filter (JPDAF). This tracking approach infers the trajectory and bounding box of the moving objects by searching the optimal path with maximum joint probability within a fixed size of buffer. We demonstrate the performance of the proposed approach on real video sequences where parallax effects are significant.

Detection and tracking of moving objects from a moving platform in presence of strong parallax

In various embodiments, methods, systems, and computer program products for processing digital images captured by a mobile device are disclosed. Myriad features enable and/or facilitate processing of such digital images using a mobile device that would otherwise be technically impossible or impractical, and furthermore address unique challenges presented by images captured using a camera rather than a traditional flat-bed scanner, paper-feed scanner or multifunction peripheral.

Systems and methods for mobile image capture and processing

Systems and methods are described for generating restricted depth of field depth maps. In one embodiment, an image processing pipeline application configures a processor to: determine a desired focal plane distance and a range of distances corresponding to a restricted depth of field for an image rendered from a reference viewpoint; generate a restricted depth of field depth map from the reference viewpoint using the set of images captured from different viewpoints, where depth estimation precision is higher for pixels with depth estimates within the range of distances corresponding to the restricted depth of field and lower for pixels with depth estimates outside of the range of distances corresponding to the restricted depth of field; and render a restricted depth of field image from the reference viewpoint using the set of images captured from different viewpoints and the restricted depth of field depth map.

Systems and Methods for Synthesizing Images from Image Data Captured by an Array Camera Using Restricted Depth of Field Depth Maps in which Depth Estimation Precision Varies

Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

Establishing a Video Conference During a Phone Call

A system and method of recognizing characters in a captured image, includes selecting a portion of the image encompassing a string of characters in the captured image to be recognized. The selected portion is examined to identify segments that potentially include the characters of the string. During the examining multiple tests on pixels in the selected portion are performed. The identified segments are then examined to recognize the string of characters.

Method and system for recognizing a candidate character in a captured image

A method of estimating three-dimensional camera position information from a series of two-dimensional images that form a panorama employs common features in adjoining image pairs in the series to estimate a transform between the images in the pairs. The common features are subsequently employed to adjust an estimated rotational component of each transform by reducing error between coordinates corresponding to the common features in three-dimensional space in image pairs, on a pair-by-pair basis. A global optimization of the position estimation, used for long sequences of images such as 360 degree panoramas, refines the estimates of the rotational and focal length components of the transforms by concurrently reducing error between all 3D common feature coordinates for all adjoining pairs.

Method for determining camera position from two-dimensional images that form a panorama

The technique of the invention converts an object RGB image into an image in a YIQ color space, calculates a luminance variation at each target pixel from Y channel values of the target pixel and an adjacent pixel adjoining to the target pixel, and computes a smoothness degree of luminance variation at the target pixel as summation of absolute values of differences between luminance variations at the target pixel and adjacent pixels. A block noise evaluation value B is obtained as a ratio of an average smoothness degree ave(psx), ave(psy) of luminance variation for boundary pixels located on each block boundary to an average smoothness degree ave(nsx), ave(nsy) of luminance variation for inner pixels not located on the block boundary. The block noise evaluation value B closer to 1 gives an evaluation result of a lower level of block noise, whereas the block noise evaluation value B closer to 10 gives an evaluation result of a higher level of block noise.

Block noise level evaluation method for compressed images and control method of imaging device utilizing the evaluation method

A system and method of creating a panorama image from a series of source images includes registering adjoining pairs of images in the series based on common features within the adjoining pairs of images. A transform between each adjoining pair of images is estimated using the common features. Each image is projected onto a designated image in the series using the estimated transforms associated with the image and with images between the image in question and the designated image. Overlapping portions of the projected images are blended to form the panorama image.

System and method for creating a panorama image from a plurality of source images

An adequate solution for computer vision applications is arrived at more efficiently and, with more automation, enables users with limited or no special image processing and pattern recognition knowledge to create reliable vision systems for their applications. Computer rendering of CAD models is used to automate the dataset acquisition process and labeling process. In order to speed up the training data preparation while maintaining the data quality, a number of processed samples are generated from one or a few seed images.

Ian Clarke

Papers

Method and system for recognizing a candidate character in a captured image

Method for determining camera position from two-dimensional images that form a panorama

Block noise level evaluation method for compressed images and control method of imaging device utilizing the evaluation method

System and method for creating a panorama image from a plurality of source images

Method and apparatus for improved training of object detecting system