A method for detecting direction when interfacing with a computer program is provided. The method includes capturing an image presented in front of an image capture device. The image capture device has a capture location in a coordinate space. When a person is captured in the image, the method includes identifying a human head in the image and assigning the human head a head location in the coordinate space. The method also includes identifying an object held by the person in the image and assigning the object an object location in coordinate space. The method further includes identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location. The relative position includes a dimension of depth. The method may be practiced on a computer system, such as one used in the gaming field.

Methods and systems for enabling depth and direction detection when interfacing with a computer program

An invention is provided for affording a real-time three-dimensional interactive environment using a three-dimensional camera. The invention includes obtaining two-dimensional data values for a plurality of pixels representing a physical scene, and obtaining a depth value for each pixel of the plurality of pixels using a depth sensing device. Each depth value indicates a distance from a physical object in the physical scene to the depth sensing device. At least one computer-generated virtual object is inserted into the scene, and an interaction between a physical object in the scene and the virtual object is detected based on coordinates of the virtual object and the obtained depth values.

System and method for providing a real-time three-dimensional interactive environment

Game interface tracks the position of one or more game controllers in 3-dimensional space using hybrid video capture and ultrasonic tracking system. The captured video information is used to identify a horizontal and vertical position for each controller within a capture area. The ultrasonic tracking system analyzes sound communications to determine the distances between the game system and each controller and to determine the distances among the controllers. The distances are then analyzed by the game interface to calculate the depths within the capture area for each controller.

Determination of controller three-dimensional location using image analysis and ultrasonic communication

A capsule tracking system (160) is provided for tracking a capsule's (110) location along the length of an intestinal tract as various treatment and/or sensing modalities are employed In one variation, an acoustic signal is used to determine the location of the capsule (110) The method of use is also set forth

Capsule and method for treating or diagnosing the intestinal tract

A method for determining an intensity value of an interaction with a computer program is described. The method and device includes capturing an image of a capture zone, identifying an input object in the image, identifying an initial value of a parameter of the input object, capturing a second image of the capture zone, and identifying a second value of the parameter of the input object. The parameter identifies one or more of a shape, color, or brightness of the input object and is affected by human manipulation of the input object. The extent of change in the parameter is calculated, which is the difference between the second value and the first value. An activity input is provided to the computer program, the activity input including an intensity value representing the extent of change of the parameter. A method for detecting an intensity value from sound generating input objects, and a computer video game are also described. A game controller having LEDs, sound capture and generation, or an accelerometer is also described.

Computer image and audio processing of intensity and input devices for interfacing with a computer program

Apparatus for creating an image indicating distances to objects in a scene, comprising: a modulated source of radiation, which directs radiation toward a scene; telecentric optics, which receive and collimate radiation reflected from the scene; a modulator, which modulates the collimated radiation; a detector which detects an image formed from the modulated collimated radiation; and a processor, which forms an image having an intensity value distribution indicative of the distance of objects from the apparatus, responsive to the intensity distribution of the detected image.

Giora Yahav

Papers

Telecentric 3d camera and method