Video images are rendered in viewports of content viewers. Each content viewer views video images through a respective viewport in the viewports. Spatial locations in the video images to which foveal visions of the content viewers are directed are determined. ROIs in the video images are identified based on the spatial locations in the video images.

Predicting and verifying regions of interest selections

Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

Sphere projected motion estimation/compensation and mode decision

Techniques are disclosed for coding and decoding video captured as cube map images. According to these techniques, padded reference images are generated for use during predicting input data. A reference image is stored in a cube map format. A padded reference image is generated from the reference image in which image data of a first view contained in reference image is replicated and placed adjacent to a second view contained in the cube map image. When coding a pixel block of an input image, a prediction search may be performed between the input pixel block and content of the padded reference image. When the prediction search identifies a match, the pixel block may be coded with respect to matching data from the padded reference image. Presence of replicated data in the padded reference image is expected to increase the likelihood that adequate prediction matches will be identified for input pixel block data, which will increase overall efficiency of the video coding.

Video coding techniques for multi-view video

Disclosed are various embodiments for simulating one or more virtual objects (e.g., renders) based on characteristics of detected surfaces. Mask data may be generated which can be used to delineate borders depicted in a given image. The mask data can be refined based on a quantity of depicted image features (e.g., edges). The mask data can be used to generate one or more planes on which virtual items can be applied and rendered.

Virtual item simulation using detected surfaces

A display arrangement for a motor vehicle includes a camera capturing images of a scene in front of the motor vehicle The camera transmits first video signals indicative of the captured images A video processor is communicatively coupled to the camera and receives the first video signals The video processor processes the first video signals to make objects in the first video signals easier to see, thereby producing second video signals The video processor transmits the second video signals A head up display system is communicatively coupled to the video processor and receives the second video signals The head up display system reflects a light field off of a windshield of the motor vehicle such that the reflection is visible to a driver of the vehicle as a virtual image The light field is dependent upon the second video signals

High visibility head up display (hud)

Often when there is a glare on a display screen the user may be able to mitigate the glare by tilting or otherwise moving the screen or changing their viewing position. However, when driving a car there are limited options for overcoming glares on the dashboard, especially when you are driving for a long distance in the same direction. Embodiments are directed to eliminating such glare. Other embodiments are related to mixed reality (MR) and filling in occluded areas.

Glare and occluded view compensation for automotive and other applications

An embodiment of an electronic processing system may include a 2D frame which corresponds to a projection of a 360 video space, and a component predictor to predict an encode component for a first block of a 2D frame based on encode information from a neighboring block which is neighboring to the first block of the 2D frame only in the 360 video space, a prioritizer to prioritize transmission for a second block of the 2D frame based on an identified region of interest, and/or a format detector to detect a 360 video format of the 2D frame based on image content. A 360 video capture device may include a contextual tagger to tag 360 video content with contextual information which is contemporaneous with the captured 360 video content. Other embodiments are disclosed and claimed.

Mv/mode prediction, roi-based transmit, metadata capture, and format detection for 360 video

A system of reducing power consumed by a large screen display panel may comprise a display divided into a plurality of segments. A gaze tracker identifies a gaze region where a viewer(s) is looking to increase a refresh rate for segments identified in the gaze region with relation to segments outside of the gaze region. The shading rate of segments outside of the gaze region may also be lowered to save even more power.

Ya-Ti Peng

Papers

Glare and occluded view compensation for automotive and other applications

Mv/mode prediction, roi-based transmit, metadata capture, and format detection for 360 video

Supporting multiple refresh rates in different regions of panel display