Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Gestures for touch sensitive input devices

Apparatus and methods are disclosed for simultaneously tracking multiple finger (202-204) and palm (206, 207) contacts as hands approach, touch, and slide across a proximity-sensing, compliant, and flexible multi-touch surface (2). The surface consists of compressible cushion (32), dielectric electrode (33), and circuitry layers. A simple proximity transduction circuit is placed under each electrode to maximize the signal-to-noise ratio and to reduce wiring complexity. Scanning and signal offset removal on electrode array produces low-noise proximity images. Segmentation processing of each proximity image constructs a group of electrodes corresponding to each distinguishable contacts and extracts shape, position and surface proximity features for each group. Groups in successive images which correspond to the same hand contact are linked by a persistent path tracker (245) which also detects individual contact touchdown and liftoff. Classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Method and apparatus for integrating manual input

Disclosed herein is a multi-functional hand-held device capable of configuring user inputs based on how the device is to be used. Preferably, the multifunctional hand-held device has at most only a few physical buttons, keys, or switches so that its display size can be substantially increased. The multifunctional hand-held device also incorporates a variety of input mechanisms, including touch sensitive screens, touch sensitive housings, display actuators, audio input, etc. The device also incorporates a user-configurable GUI for each of the multiple functions of the devices.

Multi-functional hand-held device

An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A user interface method is disclosed. The method includes detecting a touch and then determining a user interface mode when a touch is detected. The method further includes activating one or more GUI elements based on the user interface mode and in response to the detected touch.

Mode-based graphical user interfaces for touch sensitive input devices

An interactive graphics system includes a touch-sensitive controller having a number of semi-transparent light-diffusing panels imaged by a rear mounted imaging device such as a video camera. The imaging device is arranged to detect the shadows of objects, such as fingers, touching any of the panels. The camera can simultaneously to detect multiple touch points on the panels resulting from the touch of multiple fingers, which facilitates the detection of input gestures. The panel and the position on the panel touched can be determined by the position of the shadow on the video image. As the imaging device is only required to detect the existence of shadows on the panels, only a two-dimensional image must be processed. However, since the imaging device can image multiple panels simultaneously, a multi-dimensional input signal can be provided. Further, as this image is of high contrast, only light/dark areas must be differentiated for greatly simplified image processing.

Graphical input controller and method with rear screen image detection

Disclosed is a multiple coordinate controller device having a three-dimensional body with a first surface portion and a second surface portion where the second surface portion is not coplanar with the first surface. A first transducer with a first sensing surface is coupled to the first surface portion of the body and capable of detecting both positions and a range of pressure forces at positions on the first sensing surface. The first transducer is further capable of providing a first range of z coordinates at a detected x,y coordinate in response to the range of pressure forces on said first sensing surface. A second transducer having a second sensing surface is coupled to the second surface portion of the body and capable of detecting both positions and a range of pressure forces at the positions on the second sensing surface. The second transducer is further capable of providing a second range of z coordinates of opposite polarity to the first range of z coordinates in response to the range of forces on second sensing surface.

Methods and apparatus for providing touch-sensitive input in multiple degrees of freedom

A multidimensional input device is disclosed. In one embodiment, the multidimensional mouse comprises three sensors and a chassis. Each sensor is suitable for finger operation and capable of generating two control signals which represent motion in two degrees of freedom. The three sensors are coupled to the chassis which is suitable for a user to grasp with one hand. Thus, a user can generate six control input signals representing motion in six degrees of freedom with one hand.

Multidimensional input device

A system and method for generating a multi-touch command using a single-touch sensor pad and an imaging sensor is disclosed. The imaging sensor is disposed adjacent to the single-touch sensor pad and captures images of a user's fingers on or above the single-touch sensor pad. The system includes firmware that acquires data from the single-touch sensor pad and uses that data with the one or more images from the imaging sensor to generate a multi-touch command.

Multi-touch input apparatus and its interface method using data fusion of a single touch sensor pad and an imaging sensor

A method is disclosed for mapping finger movements on a touch pad to a display screen. The method includes receiving touch data from a touch pad. The touch data identifies the absolute coordinates of one or more finger touch points on the touch pad. The method also designates a portion of the display screen as a portion mapping area. The size of the portion mapping area is less than the size of the entire display screen area. The method then maps the coordinates of the one or more finger touch points of the touch data to the coordinates of the portion mapping area. The method includes use of a primary touch pad and a secondary touch pad to generate multi-touch finger gestures.

Taizo Yasutake

Papers

Graphical input controller and method with rear screen image detection

Methods and apparatus for providing touch-sensitive input in multiple degrees of freedom

Multidimensional input device

Multi-touch input apparatus and its interface method using data fusion of a single touch sensor pad and an imaging sensor

Multi-touch input apparatus and its interface method using hybrid resolution based touch data