A method for controlling a head mounted display (HMD) includes detecting an external device, displaying an augmented reality image as a first mode, changing the first mode to a second mode when the gaze of the user to the augmented reality image is detected in the first mode, and executing a function corresponding to the augmented reality image when the augmented reality image and the external device are aligned in the second mode. The first mode is a mode in which a display position of the augmented reality image depends on a position of the external device the second mode is a mode in which the display position of the augmented reality image remains fixed even when the position of the external device is changed.

Head mounted display and method for controlling the same

Systems and methods for using reduced hops to generate an augmented virtual reality scene in a head mounted display. The head mounted display is used for game play via a game cloud system. The head mounted display includes a communications circuit for sending real-world media associated with a game program via a network. The real-world media is processed by the game cloud system and streamed directly from the communications circuit to the game cloud system. The head mounted display further includes a game processing circuit coupled to the communications circuit. The game processing circuit is used for decoding computer-generated interactive media received from the game cloud system via the network. The game processing circuit drives a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media. The computer-generated interactive media is generated based on the real-world media.

Systems and methods for using reduced hops to generate an augmented virtual reality scene within a head mounted system

In one embodiment, a method of providing visual feedback to a user in a virtual reality environment is disclosed. The method may comprise: capturing position and depth information of the user using a depth sensor; determining a potential interaction point between the user and a 3D virtual object associated with the virtual reality environment based on the position and depth information of the user; determining, using a virtual depth camera, depth of the 3D virtual object at the potential interaction point; calculating a distance between the user and the 3D virtual object based on the position and depth information of the user and the depth of the 3D virtual object; and rendering a soft shadow of the user on the 3D virtual object based on the distance between the user and the 3D virtual object.

Method and system for providing visual feedback in a virtual reality environment

Aspects of the present invention provide computer systems, apparatuses, computer-executable methods and one or more non-transitory computer-readable media for receiving gesture input via virtual controls. Examples include a computer-implemented method that includes receiving data indicating a physical environment state, processing the data to determine a physical position of at least one user, determining at least one physical anchor position within the physical environment state, mapping the physical anchor position to a virtual anchor position within a virtual environment state, wherein the virtual environment state includes a plurality of virtual coordinate positions that map to at least a portion of the physical environment state, determining a particular virtual coordinate position for at least one virtual control from the plurality of virtual coordinate positions, and instructing a display device configured to display the virtual environment state to display the virtual control at the particular virtual coordinate position.

Method and System for Receiving Gesture Input Via Virtual Control Objects

Age-related changes in the human brain functioning crucially affect the motor system, causing increased reaction time, low ability to control and execute movements, difficulties in learning new motor skills. The lifestyle and lowered daily activity of elderly adults, along with the deficit of motor and cognitive brain functions, might lead to the developed ambidexterity, i.e., the loss of dominant limb advances. Despite the broad knowledge about the changes in cortical activity directly related to the motor execution, less is known about age-related differences in the motor initiation phase. We hypothesize that the latter strongly influences the behavioral characteristics, such as reaction time, the accuracy of motor performance, etc. Here, we compare the neuronal processes underlying the motor initiation phase preceding fine motor task execution between elderly and young subjects. Based on the results of the whole-scalp sensor-level electroencephalography (EEG) analysis, we demonstrate that the age-related slowing down in the motor initiation before the dominant hand movements is accompanied by the increased theta activation within sensorimotor area and reconfiguration of the theta-band functional connectivity in elderly adults.

/pdf/age-related-slowing-down-in-the-motor-initiation-in-elderly-4zm1hyqliq.pdf

Age-related slowing down in the motor initiation in elderly adults.

Embodiments that relate to providing a low-latency interaction in a virtual environment are provided. In one embodiment an initial image of a hand (74) and initial depth information representing (76) an initial actual position are received (350). The initial image is projected into the virtual environment (38) to an initial virtual position (78). A segmented version (80) of the initial image (74) is provided for display (312) in the virtual environment (308) at the initial virtual position (78). A subsequent image (82) of the hand and depth information (84) representing a subsequent actual position (370) are received. The subsequent image (82) is projected into the virtual environment (308) to a subsequent virtual position (86). A segmented version (92) of the subsequent image (82) is provided for display at the subsequent virtual position (86). A collision is detected between a three-dimensional representation of the hand and a virtual or physical object.

Virtual interaction with image projection

Embodiments that relate to displaying holographic keyboard and hand images in a holographic environment are provided. In one embodiment depth information of an actual position of a user's hand is received. Using the depth information, a holographic hand image representing the user's hand is displayed in a virtual hand plane in the holographic environment. In response to receiving a keyboard activation input from the user and using the depth information, the holographic keyboard image is adaptively displayed in a virtual keyboard plane in the holographic environment at a virtual distance under the holographic hand image representing the user's hand.

Holographic keyboard display

A movie browsing system may use a combination of long term and session based preferences to help a user browse movies using microcategories. The user preferences may be stored as microcategory weights, where the session based weights may change during a session as the system learns the types of movies a user wishes to see at that time. The long term microcategory weights may change at a slower rate than the session weights. The system may present a diverse set of microcategories to a user in an effort to diverge the search and learn the user's current interest, and may refine the weights as the user browses to converge to a desired movie. A user interface may operate on a television screen with a minimum of user input controls to navigate the browsing system while still collecting user preferences.

Movie discovery system

Human motor response time (RT) is determined by the matureness of the preceding neural motor planning process. In the current study, we characterize the temporal boundaries required for the motor planning process, and its impact on the overall motor RT. In particular, we contrasted short and long planning times by measuring the resulting differences in motor RTs, in an attempt to find whether an optimal planning time for minimal RT exists. Using a "Timed Response" paradigm, we presented participants with varying planning intervals prior to a requested motor response and studied their effect on the timing of initiation of the following movement. We found that, as expected, reaction time shortens as more planning time is provided, yet only until reaching a minimal RT, after which additional planning time increases the motor RT, thus creating a U-shaped behavioral function. Furthermore, since the minimal RT was found to be an individual characteristic, we suggest that there is an individual time window for motor planning.

/pdf/how-long-is-too-long-an-individual-time-window-for-motor-ymz4azcqev.pdf

How Long Is Too Long: An Individual Time-Window for Motor Planning.

We propose a novel approach to the analysis of synchronized three-dimensional motion in dyads. Motion recorded at high time resolution, as with a gaming device, is preprocessed in each of the three...

Rotem Bennet

Papers

Virtual interaction with image projection

Holographic keyboard display

Movie discovery system

How Long Is Too Long: An Individual Time-Window for Motor Planning.

A Time-Varying Measure of Dyadic Synchrony for Three-Dimensional Motion.