Newness and distinctiveness is claimed in the features of ornamentation as shown inside the broken line circle in the accompanying representation.

Display screen or portion thereof with graphical user interface

To provide methods and systems for creating virtual and augmented reality.SOLUTION: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The systems may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform normalization on the set of map points.SELECTED DRAWING: Figure 1

Methods and systems for creating virtual and augmented reality

A mobile terminal and a control method thereof, which can obtain an image, are provided. A mobile terminal (100) includes a camera unit (121), a pictogram extraction unit (182) and a controller (180). The camera unit (121) obtains image information corresponding to at least one of a still image and a moving image. The pictogram extraction unit (182) extracts at least one pictogram from the obtained image information. The controller (180) detects information related to the extracted pictogram, and displays the detected information to be overlapped with the obtained image information. In the mobile terminal, the controller (180) includes, as the detected information, at least one of previously recorded information and currently searched information related to the extracted pictogram.

Mobile terminal and control method thereof

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Voice trigger for a digital assistant

A mobile terminal including a wireless communication unit configured to perform wireless communication; a main body having first and second cameras facing in different directions; a display unit configured to display an image captured by the first camera; and a controller configured to activate the second camera when an image compensation mode is set on the mobile terminal, compensate the image using an amount of light entering the first and second cameras, and display the compensated image on the display unit

A user can make a symbol with their hand, or other such gesture, at a distance from a computing device that can be captured by at least one imaging element of the device. The captured information can be analyzed to attempt to determine the location of distinguishing features of the symbol in the image information. The image information is then compared to hand gesture information stored in, for example, a library of hand gestures for the user. Upon identifying a match, an input to an application executing on the computing device is provided when the image information contains information matching at least one hand gesture with at least a minimum level of certainty. The hand gesture could include a single “static” gesture, such as a specific letter in sign language, for example, or include two or more “static” gestures. The gesture could also include motion, such as hand movement.

Gesture recognition for device input

A low distraction interface can be provided for an electronic device by monitoring information such as a gaze direction of a user. A device can be configured to only display information to a user when the user is looking substantially toward the device, and can be configured to present that information in a way that is of minimal distraction to others nearby. The user can control aspects of the display by looking away from the device, continuing to look at the device for a period of time, or otherwise providing input without physically interacting with the device. Such an approach can be beneficial for settings such as business meetings where a user might want to obtain information from the device but does not want to appear inconsiderate by picking up and checking information on the device.

Low distraction interfaces

Image information displayed on an electronic device can be modified based at least in part upon a relative position of a user with respect to a device. Mapping, topological or other types of positional data can be used to render image content from a perspective that is consistent with a viewing angle for the current relative position of the user. As that viewing angle changes, as a result of movement of the user and/or the device, the content can be re-rendered or otherwise updated to display the image content from a perspective that reflects the change in viewing angle. Simulations of effects such as parallax and occlusions can be used with the change in perspective to provide a consistent user experience that provides a sense of three-dimensional content even when that content is rendered on a two-dimensional display. Lighting, shading and/or other effects can be used to enhance the experience.

Simulating three-dimensional features

An electronic device performs functionality adjustments based on a determined attention level of a user of the device. In some embodiments, the device automatically enters a sleep mode upon determining that the user has fallen asleep. The device may automatically modify functionality of the device such that disturbances to the user is minimized or power consumption is reduced. For example, the device may lower the volume of a ring tone or deactivate a communication channel. In some instances, the device may determine that the user is half-awake or paying an intermediate level of attention and activate an intermediate mode where at least some functionality is modified or adjusted. A device subsequently determining that the user is fully awake or actively engaged with the device causes the device to return to a standard mode of operation, where functionality of the device is adjusted to one appropriate for the user's attention level.

Dynamic device adjustments based on determined user sleep state

Systems and approaches are provided for presenting incoming notifications to a computing device based on a determined context of the computing device. Various sensors of the device can be used to determine the context of the device with respect to a user, the state of the device itself, or the context of the device with respect to the environment in which the device is situated. The user can then be informed of received notifications in a manner likely to get the user's attention while not being overly obtrusive to the user or others within the vicinity of the user.

Isaac S. Noble

Papers

Gesture recognition for device input

Low distraction interfaces

Simulating three-dimensional features

Dynamic device adjustments based on determined user sleep state

Context-aware notifications