A method for navigating concurrently and from point-to-point through multiple reality models is described. The method includes: generating, at a processor, a first navigatable virtual view of a first location of interest, wherein the first location of interest is one of a first virtual location and a first non-virtual location; and concurrently with the generating the first navigatable virtual view of the first location of interest, generating, at the processor, a second navigatable virtual view corresponding to a current physical position of an object, such that real-time sight at the current physical position is enabled within the second navigatable virtual view.

Coherent presentation of multiple reality and interaction models

There is provided an information processing device including a display section configured to display a first object in a virtual three-dimensional space having a depth direction of a display screen, an operation section configured to acquire an operation for moving the first object in at least the depth direction, and a controller configured to move the first object on the display screen in accordance with the acquired operation, to execute, when a region of the first object overlaps a first overlap determination region, a first process to one or both of the first and second objects, and to execute, when the region of the first object overlaps a second overlap determination region, a second process to one or both of the first and second objects. The first overlap determination region may be a region obtained by extending the second overlap determination region in at least the depth direction.

Information processing device, information processing method, and program

A region of space may be monitored for the presence or absence of one or more control objects, and object attributes and changes thereto may be interpreted as control information provided as input to a machine or application. In some embodiments, the region is monitored using a combination of scanning and image-based sensing.

Systems and methods for machine control

Enhanced contrast between an object of interest and background surfaces visible in an image is provided using controlled lighting directed at the object. Exploiting the falloff of light intensity with distance, a light source (or multiple light sources), such as an infrared light source, can be positioned near one or more cameras to shine light onto the object while the camera(s) capture images. The captured images can be analyzed to distinguish object pixels from background pixels.

Enhanced contrast for object detection and characterization by optical imaging

Techniques are disclosed for processing a video stream to reduce platform power by employing a stepped and distributed pipeline process, wherein CPU-intensive processing is selectively performed. The techniques are particularly well-suited for efficient hand-based navigational gesture processing of a video stream, in accordance with some embodiments. The stepped and distributed nature of the process allows for a reduction in power needed to transfer image data from a given camera to memory prior to image processing. In one example case, for instance, the techniques are implemented in a user's computer system wherein initial threshold detection (image disturbance) and optionally user presence (hand image) processing components are proximate to or within the system's camera, and the camera is located in or proximate to the system's primary display. The computer system may be any mobile or stationary computing system having a display and camera that are internal and/or external to the system.

Gesture pre-processing of video stream to reduce platform power

Ahead mountable display (HMD) has an upward facing camera associated with a wide angle (such as a fisheye) lens arranged to capture images of the environment of the HMD, and an image comparator arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time.

Head-mountable apparatus and systems

A method of user interaction in augmented reality comprises the steps of capturing a video image of a scene, and for each pixel in at least a sub-region of the captured video, classifying the pixel as either a skin or non-skin pixel responsive to whether the colour of the pixel exceeds a predetermined threshold purity of red; and generating a mask based upon the classification of the pixels of the captured video, generating an augmentation image layer to superpose on the captured video image, and limiting a mode of combination of the captured video and the augmentation image layer, responsive to the mask

System and method of user interaction for augmented reality

An image processing method comprises receiving, from a camera, a camera captured image comprising a user drawn image. At least part of the user drawn image is within a field of view of the camera. The method comprises applying an image processing operation to the camera captured image so as to generate an image feature within the camera captured image which corresponds to the user drawn image, and thinning the image feature to a line width which is smaller than a line width associated with the image feature so as to generate a modified width image feature. The method further comprises generating vector data from pixels associated with the modified width image feature so that the vector data substantially represents the modified width image feature.

Image processing method, apparatus and system

A method of input processing for augmented reality comprises the steps of capturing a video image, generating an augmented image layer for superposition over the captured video image, and for a region of the augmented image layer, detecting for each pixel in the region a property of a corresponding pixel in the captured video image, and mapping with a first mapping the property detected for each pixel of the region back to a reference two-dimensional array of pixels; and generating an input based upon the property values as mapped to the reference two-dimensional array of pixels.

System and method of input processing for augmented reality

A method generates an image for display by deriving an expected depth of field for the image and by generating the image for display by the display device by applying a blurring function. The expected depth of field is derived with respect to a point of focus in the image, in response to lighting conditions of the environment represented by the image. The blurring function is applied to simulate the expected depth of field of the image by blurring as a function of apparent spatial depth within the image. The degree of blurring applied to a closer depth region, in an apparent depth direction, to the point of focus is lower than the degree applied to a further depth region from the point of focus. Variation of the blurring function with respect to depth separation from the point of focus depends upon the expected depth of field.

Sharwin Winesh Raghoebardajal

Papers

Head-mountable apparatus and systems

System and method of user interaction for augmented reality

Image processing method, apparatus and system

System and method of input processing for augmented reality

Image processing method and apparatus