Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Gestures for touch sensitive input devices

A user interface method is disclosed. The method includes detecting a touch and then determining a user interface mode when a touch is detected. The method further includes activating one or more GUI elements based on the user interface mode and in response to the detected touch.

Mode-based graphical user interfaces for touch sensitive input devices

Proximity based systems and methods that are implemented on an electronic device are disclosed. The method includes sensing an object spaced away and in close proximity to the electronic device. The method also includes performing an action in the electronic device when an object is sensed.

Proximity detector in handheld device

Methods and systems for implementing gestures with sensing devices are disclosed. More particularly, methods and systems related to gesturing with multipoint sensing devices are disclosed.

Gesturing with a multipoint sensing device

Although Augmented Reality technology was first developed over forty years ago, there has been little survey work giving an overview of recent research in the field. This paper reviews the ten-year development of the work presented at the ISMAR conference and its predecessors with a particular focus on tracking, interaction and display research. It provides a roadmap for future augmented reality research which will be of great value to this relatively young field, and also for helping researchers decide which topics should be explored when they are beginning their own studies in the area.

/pdf/trends-in-augmented-reality-tracking-interaction-and-display-1juiru9a4u.pdf

Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR

A position and orientation measurement apparatus has a subjective-view-index detection unit which detects indices on a physical space from an image captured by a subjective-view camera, an additional subjective-view-index detection unit which detects indices on the physical space from an image captured by an additional subjective-view camera having a spatial resolution different from the subjective-view camera, and a position and orientation estimation unit which calculates the position and orientation of the subjective-view camera using information associated with the image coordinates of the detected indices.

Position and orientation measurement method and apparatus

This paper describes a platform package, called "MR Platform," which we have been implementing for research and development of augmented reality technology and applications. This package includes a parallax-less stereo video see-through HMD and a software development kit (SDK) for a Linux PC environment. The SDK is composed of a C++ class library for making runtime MR applications and related utilities such as a camera calibration tool. By using the SDK, the following functions are available: capturing video, handling a six degree-of-freedom (DOF) sensor, image processing such as color detection, estimating head position and orientation, displaying the real world image, and calibrating sensor placement and camera parameters of two cameras mounted on the HMD.

/pdf/mr-platform-a-basic-body-on-which-mixed-reality-applications-22aos2ygm4.pdf

MR Platform: a basic body on which mixed reality applications are built

A stereoscopic vision parameter is determined on the basis of the 3D space data to be displayed and the disparity distance at which the left- and right-eye images look displaced from each other in a predetermined 2D rendering space. In determining a parameter, the disparity distance between left and right image data of an object point in the 3D space is set in advance, which appears when the image data are rendered in the 2D rendering space, and the position of a displaced point which is separated from the coordinates of the object point in the 2D rendering space in the base line length direction of the observer by the disparity distance is computed. The coordinates of this displaced point in a 3D space are computed. In addition, the base line length is determined on the basis of the distance between the 3D coordinates of the displaced point and the object point.

Stereoscopic image processing apparatus and method, stereoscopic vision parameter setting apparatus and method and computer program storage medium information processing method and apparatus

The present invention provides a method and apparatus for inputting a signal indicating a change in position of an image sensing apparatus to predict present position and orientation of the image sensing apparatus using previously obtained position and orientation, by identifying corresponding pairs of indicators detected from an image in real space sensed by the image sensing apparatus and indicators contained in an image when sensed from a predicted position and orientation and using a correction method determined by the number of identified indicator pairs either to correct all or some of the degrees of freedom of the predicted camera position and orientation or to use the predicted camera position and orientation directly as is. As a result, highly accurate detection results can be obtained using a simple structure in the detection of the position and orientation of the image sensing apparatus.

Position and orientation detection method and apparatus

In a method of calibrating an image capture environment based on a captured image obtained by capturing an image of a physical space by an image capturing unit that captures the image of the physical space, an image of the physical space is captured using the image capturing unit, an index serving as a reference for calibration is detected from the captured image of the physical space, the position and orientation of the image capturing unit are calculated from the detected index, and image capturing unit unique information, geometric information associated with the physical space, or the relationship between the image capturing unit and the physical space is calibrated using the obtained data

Shinji Uchiyama

Papers

Position and orientation measurement method and apparatus

MR Platform: a basic body on which mixed reality applications are built

Stereoscopic image processing apparatus and method, stereoscopic vision parameter setting apparatus and method and computer program storage medium information processing method and apparatus

Position and orientation detection method and apparatus

Image capture environment calibration method and information processing apparatus