An interactive video display system. A display screen is for displaying a visual image for presentation to a user. A camera is for detecting an object in an interactive area located in front of the display screen, the camera operable to capture three-dimensional information about the object. A computer system is for directing the display screen to change the visual image in response to the object.

Interactive video display system

A haptic device having a plurality of operational modes, including a first operational mode and a second operational mode is provided. The first operational mode is associated with a frequency range. The second operational mode is associated with a frequency range that is different from the frequency range of the first operational mode. A controller is coupled to the haptic device, and is configured to send the haptic device a plurality of control schemes. Each control scheme is uniquely associated with an operational mode from the plurality of operational modes. Another embodiment provides a method that includes providing power to a haptic device configured to cause the haptic device to provide a haptic sensation above a pre-determined sensation threshold. A voltage pulse that is configured to change the haptic sensation output by the haptic device by a pre-determined amount within a pre-determined time period is also applied to the haptic device.

System and method for controlling haptic devices having multiple operational modes

A self-contained interactive video display system. A projector projects a visual image onto a screen for displaying the visual image, wherein the projector projects the visual image onto a back side of the screen for presentation to a user on a front side of the screen. An illuminator illuminates an object near the front side of the screen. A camera detects interaction of an illuminated object with the visual image, wherein the screen is at least partially transparent to light detectable to the camera, allowing the camera to detect the illuminated object through the screen. A computer system directs the projector to change the visual image in response to the interaction.

Self-contained interactive video display system

An interactive directed beam system is provided. In one implementation, the system includes a projector, a computer and a camera. The camera is configured to view and capture information in an interactive area. The captured information may take various forms, such as, an image and/or audio data. The captured information is based on actions taken by an object, such as, a person within the interactive area. Such actions include, for example, natural movements of the person and interactions between the person and an image projected by the projector. The captured information from the camera is then sent to the computer for processing. The computer performs one or more processes to extract certain information, such as, the relative location of the person within the interactive area for use in controlling the projector. Based on the results generated by the processes, the computer directs the projector to adjust the projected image accordingly. The projected image can move anywhere within the confines of the interactive area.

Interactive directed light/sound system

Computer vision based touch screen

A technique for representing a visual scene as a directed acyclic graph of data and operators that generates a sequence of image frames over specified time intervals. The graph specifies temporal and spatial values for associated visual elements of the scene. Time is modeled in the inheritance properties explicitly defined within the scene graph hierarchy, by assigning temporal attributes to each media element. Branch nodes of the graph specify transforms for the temporal and spatial coordinate systems. To evaluate the appearance or behavior of the scene and in particular the global time values of particular elements at a given time instant, the graph is traversed in a direction from a root node down toward the leaf nodes, thereby causing temporal transformations specified along the branches of the graph to modify time parameters of the scene data at the nodes. Child nodes are preferably evaluated after being transformed, to determine the extent to which they contribute the data to the final scene. Temporal transformations may include translation operations that offset temporal event times; scaling operations that change the rate at which time passes; or clipping operations, that restrict the range of time parameters to exclude the evaluation of parts of the graph.

Time inheritance scene graph for representation of media content

An integrated media production technique for refining a finish quality media content. The technique permits a media production to be defined as a computerized choreography model of a virtual stage containing data objects representing live/recorded image elements as well as synthetic-abstract elements and multiple versions thereof. Elements of the choreography model are iteratively rendered, blended, adjusted, and selected until a desired quality result is achieved.

Iterative three-dimensional process for creating finished media content

In a media production system, two-dimensional images captured from physical objects are analyzed to create three-dimensional representations of the physical objects within a virtual stage Representations of physical and synthetic objects are manipulated and choreagraphed in the virtual stage within an integrated system which also generates a media product in the form of a two-dimensional image stream of the physical and synthetic objects with optional synchronized audio tracks A correlation is maintained between object models in the virtual stage and the original two-dimensional images so that information from those images can be included in the final product To facilitate direction of combined media products, a composite display of the three-dimensional virtual stage and a two-dimensional preview are provided Also provided are a score display providing temporal representations of elements within the scene and an object catalog of object oriented representations of elements within the scene

Media production with correlation of image stream and abstract objects in a three-dimensional virtual stage

A technique for displaying a visual representation of an estimated three-dimensional scene structure and the values of various parameters associated with the scene, together with a visual representation of at least one two-dimensional image used in the scene structure estimation algorithm. A user inputs information by adjusting parameters and/or specifying an element or region of the visual representations and supplies mark-ups and other information such as attributes for the element or region to be applied during a next iteration of the scene structure estimation algorithm. The scene structure estimation algorithm is then re-executed and the process repeats until the user is satisfied with the resulting visual scene structure.

Computer assisted mark-up and parameterization for scene analysis

In a media production system, two-dimensional images captured from physical objects are analyzed to create three-dimensional representations of the physical objects within a virtual stage. The physical objects are manipulated as abstract representations in the unified virtual stage. Representations of physical and synthetic objects are choreographed in the virtual stage within an integrated system which can also generate a media product in the form of a two-dimensional image stream of the physical and synthetic objects with optional synchronized audio tracks. To facilitate choreography, a composite display of the three-dimensional virtual stage and a two-dimensional preview are provided. Also provided are a display showing temporal representations of elements within the scene and an object catalog of object oriented representations of elements within the scene.

John S. Robotham

Papers

Time inheritance scene graph for representation of media content

Iterative three-dimensional process for creating finished media content

Media production with correlation of image stream and abstract objects in a three-dimensional virtual stage

Computer assisted mark-up and parameterization for scene analysis

Integrating live/recorded sources into a three-dimensional environment for media productions