A head mounted device provides an immersive virtual or augmented reality experience for viewing data and enabling collaboration among multiple users. Rendering images in a virtual or augmented reality system may include capturing an image and spatial data with a body mounted camera and sensor array, receiving an input indicating a first anchor surface, calculating parameters with respect to the body mounted camera and displaying a virtual object such that the virtual object appears anchored to the selected first anchor surface. Further operations may include receiving a second input indicating a second anchor surface within the captured image that is different from the first anchor surface, calculating parameters with respect to the second anchor surface and displaying the virtual object such that the virtual object appears anchored to the selected second anchor surface and moved from the first anchor surface.

Anchoring virtual images to real world surfaces in augmented reality systems

A method is provided for modifying an image. The method comprises displaying an image, the image comprising a portion of an object; and determining if an edge of the object is in a location within the portion. The method further comprises detecting movement, in a member direction, of an operating member with respect to the edge. The method still further comprises moving, if the edge is not in the location, the object in an object direction corresponding to the detected movement; and modifying, if the edge is in the location, the image in response to the detected movement, the modified image comprising the edge in the location.

Information processing apparatus, information processing method and program

A self-contained interactive video display system. A projector projects a visual image onto a screen for displaying the visual image, wherein the projector projects the visual image onto a back side of the screen for presentation to a user on a front side of the screen. An illuminator illuminates an object near the front side of the screen. A camera detects interaction of an illuminated object with the visual image, wherein the screen is at least partially transparent to light detectable to the camera, allowing the camera to detect the illuminated object through the screen. A computer system directs the projector to change the visual image in response to the interaction.

Computer vision based touch screen

Devices, methods, and software are disclosed for determining dimensions of a physical object using a mobile computer equipped with a motion sensing device. In an illustrative embodiment, the mobile computer can comprise a microprocessor, a memory, a user interface, a motion sensing device, and a dimensioning program executable by the microprocessor. The processor can be in communicative connection with executable instructions for enabling the processor for various steps. One step includes initiating a trajectory tracking mode responsive to receiving a first user interface action. Another step includes tracking the mobile computer's trajectory along a surface of a physical object by storing in the memory a plurality of motion sensing data items outputted by the motion sensing device. Another step includes exiting the trajectory tracking mode responsive to receiving a second user interface action. Another step includes calculating three dimensions of a minimum bounding box corresponding to the physical object.

Measuring object dimensions using mobile computer

Systems and methods for volume dimensioning packages are provided. A method of operating a volume dimensioning system may include the receipt of image data of an area at least a first three-dimensional object to be dimensioned from a first point of view as captured using at least one image sensor. The system can determine from the received image data a number of features in three dimensions of the first three-dimensional object. Based at least on part on the determined features of the first three-dimensional object, the system can fit a first three-dimensional packaging wireframe model about the first three-dimensional object. The system can display of an image of the first three-dimensional packaging wireframe model fitted about an image of the first three-dimensional object on a display device.

Volume dimensioning systems and methods

Systems and methods for processing gesture-based user interactions with an interactive display.

Processing of Gesture-Based User Interactions

Systems and methods for processing gesture-based user interactions within an interactive display area are provided The display of one or more virtual objects and user interactions with the one or more virtual objects may be further provided Multiple interactive areas may be created by partitioning an area proximate a display into multiple volumetric spaces or zones The zones may be associated with respective user interaction capabilities A representation of a user on the display may change as the ability of the user to interact with one or more virtual object changes

Gesture-based user interactions with status indicators for acceptable inputs in volumetric zones

Systems and methods for processing gesture-based user interactions within an interactive display area are provided. The display of one or more virtual objects and user interactions with the one or more virtual objects may be further provided. Multiple interactive areas may be created by partitioning an area proximate a display into multiple volumetric spaces or zones. The zones may be associated with respective user interaction capabilities. A representation of a user on the display may change as the ability of the user to interact with one or more virtual object changes.

Tipatat Chennavasin

Papers

Processing of Gesture-Based User Interactions

Gesture-based user interactions with status indicators for acceptable inputs in volumetric zones

Processing of gesture-based user interactions using volumetric zones

Processing of gesture-based user interactions activation levels