Position tracking subsystems and onboard sensors enable a mobile device to navigate virtually a location in panoramic imagery. Physically moving the device through space provides translation data that can be used to move up or down a virtual street or other navigation actions. In some implementations, forward and backward translation enables the user to enter a structure (e.g., a commercial venue) or enter an intersection and navigate a turn onto another street at the intersection. In some implementations, information or an information layer can be displayed when translating. In some implementations, distance data can be used to move up or down a street a particular distance. Distance data can be obtained from motion and/or image sensors onboard the device. The distance data can be scaled to a virtual distance in the panoramic scene.

3d position tracking for panoramic imagery navigation

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Voice-based video tagging

This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.

Defining, displaying and interacting with tags in a three-dimensional model

A playback speed effect is applied to a video using a playback speed template. The playback speed template specifies playback speed ratios (i.e., ratios between playback duration and capture duration) at the highlight moment, at a template start time, and at a template end time. A video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video is accessed. An input portion of the video including the highlight moment is identified. The duration of the input portion has a duration depending on the template start time and the template end time. A playback speed template is applied to the input portion. A modified video including a modified video portion is generated from the input portion of the video according to the applied playback speed template and is provided for subsequent playback.

Variable playback speed template for video editing application

Scene and activity identification in video summary generation

A capability for guided navigation in an interactive virtual three-dimensional environment is provided. Such a capability may enhance user experience by providing the feeling of free- form navigation to a user. It may be necessary to constrain the user to certain areas of good visual quality, and subtly guide the user towards viewpoints with better rendering results without disrupting the metaphor of freeform navigation. Additionally, such a capability may enable users to "drive" down a street, follow curving roads, and turn around intersections within the interactive virtual three-dimensional environment. Further, this capability may be applicable to image-based rendering techniques in addition to any three-dimensional graphics system that incorporates navigation based on road networks and/or paths.

Guided Navigation Through Geo-Located Panoramas

The capability to render and navigate three-dimensional panoramic images in a virtual three-dimensional environment so as to create an immersive three-dimensional experience is provided. Such a capability can present a three-dimensional photographic experience of the real world that is seamlessly integrated with the virtual three-dimensional environment. Depth values associated with the panoramic images may be used to create three-dimensional geometry, which can be rendered as part of the virtual three-dimensional environment. Further, such a capability can enable a user to roam freely through the environment while providing a more natural free-form exploration of the environment than existing systems.

Rendering and Navigating Photographic Panoramas with Depth Information in a Geographic Information System

The present invention relates to panning a virtual camera in a three dimensional environment. In an embodiment of the present invention, a computer-implemented method pans a virtual camera in a three dimensional environment. In the method embodiment, a first point is determined on a three dimensional model in the three dimensional environment. According to the first point, the three dimensional model, and a position of a virtual camera in the three dimensional environment, a virtual surface is determined. A second point is determined on the virtual surface. Finally, a location of the three dimensional model is changed according to the first point and the second point.

Panning using virtual surfaces

Embodiments relate to navigating through a three dimensional environment on a mobile device using a single gesture. A first user input is received, indicating that two or more objects have touched a view of the mobile device. Two or more target locations on a surface of the three-dimensional environment corresponding to the two or more objects touching the view of the mobile device are determined. A second user input indicating that the two objects have performed a motion while touching the view of the mobile device is received. Camera parameters for the virtual camera, based on the received second user input, are determined. The virtual camera is moved within the three dimensional environment according to the determined camera parameters, such that the two or more target locations remain corresponding to the two or more objects touching the view of the mobile device. Moving the virtual camera may include zooming, rotating, tilting, and panning the virtual camera.

Zoom, Rotate, and Translate or Pan In A Single Gesture

A visualization system and method allow moving objects to be visualized in a GIS system as an interactive animation by moving an icon or 3D graphical model in an interactive virtual environment of the GIS A line may also be drawn behind the icon/3D model representing the path traveled during a window of time Additionally, the evolution of time-dependent data associated with the moving object may be encoded and visualized in the GIS

Daniel Barcay

Papers

Guided Navigation Through Geo-Located Panoramas

Rendering and Navigating Photographic Panoramas with Depth Information in a Geographic Information System

Panning using virtual surfaces

Zoom, Rotate, and Translate or Pan In A Single Gesture

Generating cinematic flyby sequences following paths and GPS tracks