To provide methods and systems for creating virtual and augmented reality.SOLUTION: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The systems may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform normalization on the set of map points.SELECTED DRAWING: Figure 1

Methods and systems for creating virtual and augmented reality

Head-worn adaptive display

A display apparatus includes an image processor which processes an image to display an image content; a display unit which displays thereon an image content that is processed by the image processor; and a controller which displays a user interface (UI) menu including a plurality of UI items to search the image content, as one of a two-dimensional (2D) layout by which the plurality of UI items are arranged in a 2D manner, and a three-dimensional (3D) layout by which the plurality of UI items are arranged in a 3D manner , and changes displaying the one of the layouts to display the other of the layouts according to a user's command while maintaining a continuity of the arrangement of the plurality of UI items. Accordingly, search for an image content can be efficiently performed by using a UI menu.

Display apparatus and control method thereof

AR glasses with predictive control of external device based on event input

There is disclosed a method, an apparatus, a server, a client and a non-transitory computer readable medium comprising a computer program stored therein for motion compensated video coding and decoding. Texture block motion information is used to derive disparity/depth motion information. Alternatively, disparity/depth motion information is used to derive texture block motion information.

An apparatus, a method and a computer program for video coding and decoding

Technology is described for reducing display update time for a near-eye display (NED) device. A point of focus in the NED field of view is identified, often based on natural user input data. A communication module of a computer system communicatively coupled to the NED device transmits lossless priority data, an example of which is user focal region image data, using one or more communication techniques for satisfying lossless transmission criteria. Allowed loss image data is identified based at least in part on its distance vector from a point of focus in the display field of view. An example of allowed loss image data is image data to be displayed outside the user focal region. The allowed loss image data is transmitted and extracted from received image data allowing for lossy transmission.

Display update time reduction for a near-eye display

A system and related methods for a resource management in a head-mounted display device are provided. In one example, the head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. A resource management program is configured to operate a selected sensor in a default power mode to achieve a selected fidelity. The program receives user-related information from one or more of the sensors, and determines whether target information is detected. Where target information is detected, the program adjusts the selected sensor to operate in a reduced power mode that uses less power than the default power mode.

Head-mounted display resource management

A system and method are disclosed for determining a depth map using TOF with low power consumption. In order to disambiguate, or de-alias, the returned distance(s) for a given phase shift, the system may emit n different frequencies of light over n successive image frames. After n frames of data are collected, the distances may be correlated by a variety of methodologies to determine a single distance to the object as measured over n image frames. As one frequency may be emitted per image frame, the depth map may be developed while consuming low power.

Single frequency time of flight de-aliasing

Wireless communication techniques are described. In one or more implementations, techniques are described that involve active power control such that a device may bypass use of a power amplifier to communicate wirelessly. In one or more additional implementations, wireless communication techniques are described in which multiple bands may be leveraged to provide wireless communication. In one or more further implementations, wireless communication techniques are described in which a frame buffer on a receiving device is leveraged by a sending device. Yet further, in one or more implementations wireless communication techniques are described in which a sending device employs codec adaptation. Still yet further, in one or more implementations, wireless communication techniques are described which may be used to change characteristics of a channel used to communicate data. Yet further again, in one or more implementations, a receiving device is configured to adjust a display based on wireless communications received from a plurality of devices, such as to leverage a display by multiple wireless sources.

Wireless communication techniques

Various different techniques are used to determine a location of a device, including 3-dimensional (3D) mapping techniques as well as one or more of Global Navigation Satellite System (GNSS) techniques, wireless signal detection techniques, and inertial sensor techniques. The locations determined by these various techniques are combined to determine the location of the device and/or user of the device. In addition to the location of the device, an orientation or direction of view of the device and/or user of the device can optionally be determined as well.

Jedd A. Perry

Papers

Display update time reduction for a near-eye display

Head-mounted display resource management

Single frequency time of flight de-aliasing

Wireless communication techniques

Hybrid device location determination system