Planar waveguide apparatus with diffraction element(s) and system employing same

Systems and methods for augmented and virtual reality

Method and system for determining user input based on gesture

Some representative embodiments are directed to creating a 'virtual world' by processing a series of two dimensional images to generate a representation of the physical world depicted in the series of images. The virtual world representation includes models of objects that specify the locations of the objects within the virtual world, the geometries of the objects, the dimensions of the objects, the surface representation of the objects, and/or other relevant information. By developing the virtual world representation, a number of image processing effects may be applied such as generation of stereoscopic images, object insertion, object removal, object translation, and/or other object manipulation operations.

System and method for processing video images

A method of displaying augmented reality comprises identifying an object as a totem having at least one user input element, capturing at least one image of an interaction of at least one finger of a user of an augmented reality system with the at least one user input element of the totem, detecting at least one characteristic pertaining to the interaction of the finger(s) of the user with the user input element(s) of the totem based on the capture image(s), and determining a user input based at least in part on the at least one determined characteristic.

Utilizing totems for augmented or virtual reality systems

Control panels of a simulated complex system are displayed as a texture mask over a three-dimensional visual representation of an environment in which the complex system is operating. The three-dimensional visual representation is displayed in an inactive window to a user practicing or training on the simulated system. An active window underlying the visual display is used to track user inputs to the control panels. Smart graphics translate the user inputs into data elements that are sent to a full-scope simulation, and simulation conditions are returned and used to update the display of the control panels and the visual representation of the environment.

System for providing a high-fidelity visual display coordinated with a full-scope simulation of a complex system and method of using same for training and practice

Control panels of a simulated complex system are displayed as a texture mask (94) over a three-dimensional visual representation of an environment in which the complex system is operating. The three-dimensional visual representation is displayed in an inactive window (90) to a user practicing or training on the simulated system. An active window (92) underlying a display window (100) is used to track user inputs to the control panels. Smart graphics processing (42) translates the user inputs into data elements that are sent to a full-scope simulation (48), and simulation conditions are returned and used to update the display of the control panels and the visual representation of the environment.

Jean Daigle

Papers

System for providing a high-fidelity visual display coordinated with a full-scope simulation of a complex system and method of using same for training and practice

Graphical user interface for a flight simulator based on a client-server architecture