Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Gestures for touch sensitive input devices

Apparatus and methods are disclosed for simultaneously tracking multiple finger (202-204) and palm (206, 207) contacts as hands approach, touch, and slide across a proximity-sensing, compliant, and flexible multi-touch surface (2). The surface consists of compressible cushion (32), dielectric electrode (33), and circuitry layers. A simple proximity transduction circuit is placed under each electrode to maximize the signal-to-noise ratio and to reduce wiring complexity. Scanning and signal offset removal on electrode array produces low-noise proximity images. Segmentation processing of each proximity image constructs a group of electrodes corresponding to each distinguishable contacts and extracts shape, position and surface proximity features for each group. Groups in successive images which correspond to the same hand contact are linked by a persistent path tracker (245) which also detects individual contact touchdown and liftoff. Classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Method and apparatus for integrating manual input

A method of generating a signal comprising providing a capacitive touch sensor pad including a matrix of X and Y conductors, developing capacitance profiles in one of an X direction and a Y direction from the matrix of X and Y conductors, determining an occurrence of a single gesture through an examination of the capacitance profiles, the single gesture including an application of at least two objects on the capacitive touch sensor pad, and generating a signal indicating the occurrence of the single gesture.

Object position detector with edge motion feature and gesture recognition

An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

Method and apparatus for detecting an operative coupling between one or more fingers or other appropriate objects and a touch pad includes processes for detection of multiple maxima with intermediate minima in appropriate sequences to emulate the operations of cursor control and button actuations in a pointing and control device.

Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad

An advanced user interface for use with a computer system operating on an integrated operating environment. The integrated operating environment allows a plurality of application programs to be running simultaneously, one of which is designated the active application program to which all input data is directed. The advanced user interface allows a user to select among user-friendly input devices to operate any application program according to his individual preferences without change to the application program code. The advanced user interface includes alternate input modules which translate the input signals transmitted from the various input devices into input messages useable by the rest of the interface. The advanced user interface also includes interface profiles which contain mappings of the input messages against corresponding commands useable by the application programs, the integrated operating environment or other modules of the advanced user interface itself. An environment link module refers to the interface profiles and matches the input message against the corresponding command for the application program active at the time the input signal was transmitted and send the corresponding command to that application program. The environment link module matches the input message against a corresponding command for an application which owns a window in which a key feature of a gesture is made.

Graphical user interface with gesture recognition in a multiapplication environment

An advanced user interface for use with a computer system operating on an integrated operating environment. The integrated operating environment allows a plurality of application programs to be running simultaneously, one of which is designated the active application program to which all input data is directed. The advanced user interface allows a user to select among user-friendly input devices to operate any application program according to his individual preferences without change to the application program code. The advanced user interface includes alternate input modules which translate the input signals transmitted from the various input devices into input messages useable by the rest of the interface. The advanced user interface also includes interface profiles which contain mappings of the input messages against corresponding commands useable by the application programs, the integrated operating environment or other modules of the advanced user interface itself. An environment link module refers to the interface profiles and matches the input message against the corresponding command for the application program active at the time the input signal was transmitted and send the corresponding command to that application program.

Advanced user interface

A computer system enables a user to design touch activated keyboards for use on a display surface without writing code. The computer system enables the user to resize and move the keyboard image anywhere on the display to allow the concurrent display of other applications running in an integrated operating environment. Computer system actions can be assigned by the user to each key. An execution unit displays the selected keyboard, determines whether a key has been touched and executes the appropriate action for each key touch.

User defined keyboard entry system

A method, an apparatus, a system, and a computer program product are presented for managing availability status values in an instant messaging application. A user of the instant messaging application is able to select a “do not disturb” status that is to be associated with the user, thereby preventing most users from being able to initiate an instant messaging session with the user. In addition, the user of the instant messaging application can selectively authorize a subset of users to have the privilege of being able to start instant messaging sessions with the user while maintaining an indication to all other users that the user is in a “do not disturb” status.

Method and system for authorizing a restricted callable status in an instant messaging system

A method and system in a multimedia computer system for automatically retrieving and presenting data associated with an audio recording having unique identifying indicia therein. In response to playing an audio recording in a multimedia computer system, a unique identifying indicia associated with the audio recording is identified. A listing of codes within the multimedia computer system is automatically searched to find a code corresponding to the unique identifying indicia. In response to finding the code corresponding to the unique identifying indicia, multimedia data is retrieved which corresponds to the unique identifying indicia. The multimedia data can be retrieved from local storage or from a remote network site. The multimedia data corresponding to the unique identifying indicia is then presented in the multimedia computer system, while playing the audio recording in the multimedia computer system.

Alan Richard Tannenbaum

Papers

Graphical user interface with gesture recognition in a multiapplication environment

Advanced user interface

User defined keyboard entry system

Method and system for authorizing a restricted callable status in an instant messaging system

Method and system for network delivery of content associated with physical audio media