The present invention discloses methods of digitally converting 2D motion pictures or any other 2D image sequences to stereoscopic 3D image data for 3D exhibition. In one embodiment, various types of image data cues can be collected from 2D source images by various methods and then used for producing two distinct stereoscopic 3D views. Embodiments of the disclosed methods can be implemented within a highly efficient system comprising both software and computing hardware. The architectural model of some embodiments of the system is equally applicable to a wide range of conversion, re-mastering and visual enhancement applications for motion pictures and other image sequences, including converting a 2D motion picture or a 2D image sequence to 3D, re-mastering a motion picture or a video sequence to a different frame rate, enhancing the quality of a motion picture or other image sequences, or other conversions that facilitate further improvement in visual image quality within a projector to produce the enhanced images.

Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition

Depth maps are generated from a monoscopic source images and asymmetrically smoothed to a near-saturation level. Each depth map contains depth values focused on edges of local regions in the source image. Each edge is defined by a predetermined image parameter having an estimated value exceeding a predefined threshold. The depth values are based on the corresponding estimated values of the image parameter. The depth map is used to process the source image by a depth image based rendering algorithm to create at least one deviated image, which forms with the source image a set of monoscopic images. At least one stereoscopic image pair is selected from such a set for use in generating different viewpoints for multiview and stereoscopic purposes, including still and moving images.

Generating a depth map from a two-dimensional source image for stereoscopic and multiview imaging

Methods, systems, and computer program products for selecting image capture positions to generate three-dimensional images are disclosed herein. According to one aspect, a method includes determining a plurality of first guides associated with a first still image of a scene. The method can also include displaying a real-time image of the scene on a display. Further, the method can include determining a plurality of second guides associated with the real-time image. The method can also include displaying the first and second guides on the display for guiding selection of a position of an image capture device to capture a second still image of the scene for pairing the first and second still images as a stereoscopic pair of a three-dimensional image.

Methods, systems, and computer-readable storage media for selecting image capture positions to generate three-dimensional images

Methods and arrangements involving portable user devices such smartphones and wearable electronic devices are disclosed, as well as other devices and sensors distributed within an ambient environment. Some arrangements enable a user to perform an object recognition process in a computationally- and time-efficient manner. Other arrangements enable users and other entities to, either individually or cooperatively, register or enroll physical objects into one or more object registries on which an object recognition process can be performed. Still other arrangements enable users and other entities to, either individually or cooperatively, associate registered or enrolled objects with one or more items of metadata. A great variety of other features and arrangements are also detailed.

Methods for object recognition and related arrangements

This paper gives an overview of the state-of-the-art in 3-D video postproduction and processing as well as an outlook to remaining challenges and opportunities. First, fundamentals of stereography are outlined that set the rules for proper 3-D content creation. Manipulation of the depth composition of a given stereo pair via view synthesis is identified as the key functionality in this context. Basic algorithms are described to adapt and correct fundamental stereo properties such as geometric distortions, color alignment, and stereo geometry. Then, depth image-based rendering is explained as the widely applied solution for view synthesis in 3-D content creation today. Recent improvements of depth estimation already provide very good results. However, in most cases, still interactive workflows dominate. Warping-based methods may become an alternative for some applications in the future, which do not rely on dense and accurate depth estimation. Finally, 2-D to 3-D conversion is covered, which is an important special area for reuse of existing legacy 2-D content in 3-D. Here various advanced algorithms are combined in interactive workflows.

Three-Dimensional Video Postproduction and Processing

An exemplary method of reconstructing a hidden surface area in an image includes the steps of: identifying a separation pixel gap in an image resulting from a repositioning of image pixels to create a three-dimensional image; identifying pixels from one or more images; and filling the separation pixel gap with the pixels. Replacement pixels can be retrieved from a single image in a search sequence of images, or from a plurality of images in the sequence. One or more pixel fill techniques can be employed to determine replacement pixels for the separation pixel gap which best match adjacent background pixels.

Method of hidden surface reconstruction for creating accurate three-dimensional images converted from two-dimensional images

An image processing method and system for converting two-dimensional images into realistic reproductions, or recreations of three-dimensional images are embodied in a variety of interactive image processing tools that allow a user to apply any number or combination of image pixel repositioning depth contouring effects, algorithms or the like to create three-dimensional images with smooth realistic appearing surface contours.

Method and system for creating realistic smooth three-dimensional depth contours from two-dimensional images

A method for converting two-dimensional images into three-dimensional images includes: tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and creating object outlines in subsequent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame.

Method for minimizing visual artifacts converting two-dimensional motion pictures into three-dimensional motion pictures

A method for providing a three-dimensional image includes selecting a screen size or range of screen sizes for a three-dimensional image and scaling depth information associated with objects in a three-dimensional image to preserve perceived depths of the objects when the three-dimensional image is presented at the screen size or within the range of screen sizes selected.

Method for creating and presenting an accurate reproduction of three-dimensional images converted from two-dimensional images

Methods for converting two-dimensional images into three-dimensional images employing various interactive image processing tools that allow a user to apply any number or combination of image pixel repositioning depth contouring effects, algorithms or the like to create three-dimensional images.

Charles J. L. Best

Papers

Method of hidden surface reconstruction for creating accurate three-dimensional images converted from two-dimensional images

Method and system for creating realistic smooth three-dimensional depth contours from two-dimensional images

Method for minimizing visual artifacts converting two-dimensional motion pictures into three-dimensional motion pictures

Method for creating and presenting an accurate reproduction of three-dimensional images converted from two-dimensional images

Method for conforming objects to a common depth perspective for converting two-dimensional images into three-dimensional images