Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Gestures for touch sensitive input devices

Apparatus and methods are disclosed for simultaneously tracking multiple finger (202-204) and palm (206, 207) contacts as hands approach, touch, and slide across a proximity-sensing, compliant, and flexible multi-touch surface (2). The surface consists of compressible cushion (32), dielectric electrode (33), and circuitry layers. A simple proximity transduction circuit is placed under each electrode to maximize the signal-to-noise ratio and to reduce wiring complexity. Scanning and signal offset removal on electrode array produces low-noise proximity images. Segmentation processing of each proximity image constructs a group of electrodes corresponding to each distinguishable contacts and extracts shape, position and surface proximity features for each group. Groups in successive images which correspond to the same hand contact are linked by a persistent path tracker (245) which also detects individual contact touchdown and liftoff. Classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Method and apparatus for integrating manual input

A method of generating a signal comprising providing a capacitive touch sensor pad including a matrix of X and Y conductors, developing capacitance profiles in one of an X direction and a Y direction from the matrix of X and Y conductors, determining an occurrence of a single gesture through an examination of the capacitance profiles, the single gesture including an application of at least two objects on the capacitive touch sensor pad, and generating a signal indicating the occurrence of the single gesture.

Object position detector with edge motion feature and gesture recognition

Disclosed herein is a multi-functional hand-held device capable of configuring user inputs based on how the device is to be used. Preferably, the multifunctional hand-held device has at most only a few physical buttons, keys, or switches so that its display size can be substantially increased. The multifunctional hand-held device also incorporates a variety of input mechanisms, including touch sensitive screens, touch sensitive housings, display actuators, audio input, etc. The device also incorporates a user-configurable GUI for each of the multiple functions of the devices.

Multi-functional hand-held device

A user interface method is disclosed. The method includes detecting a touch and then determining a user interface mode when a touch is detected. The method further includes activating one or more GUI elements based on the user interface mode and in response to the detected touch.

Mode-based graphical user interfaces for touch sensitive input devices

A system features a data input scheme in which the nature of the entered data is irrelevant until the requirement made to perform a function with respect to that data. It is only when it becomes necessary to perform a function with respect to the data that the determination of the nature of the data become important. The desired function, which may include editing, rearranging, moving, etc., then results in a determination of the nature of the data in order to enable implementation of that specific function. The nature of the data can be determined to be in the form of a list, table, or diagram. To this end, a screen oriented display processing system is provided for the entry of informational data including a display means, a data entry means for entering informational data on the display means, a gesture entering means for entering handwritten gestural data on the display, the gestural data representing a gesture associated with at least a portion of the informational data on the display, an assignment means responsive to the entry of the gesture for assigning a function representative of the gesture to the portion of the informational data, and an implementing means responsive to the assignment means for implementing the function on the said portion of the informational data.

Apparatus and method for supporting the implicit structure of freeform lists, outlines, text, tables, and diagrams in a gesture-based input system and editing system.

A system for creating and manipulating groups of graphic objects using enclosures. A persistent graphic object, such as a closed loop is drawn around a set of graphic objects as an enclosure. When the enclosure is selected the enclosure and the set of graphic objects within are grouped. Besides moving graphic objects into and out of the enclosure, the contents of a group can then be modified by 1) graphically altering the enclosure loop to include or remove graphic objects, 2) fusing groups by moving one of them so that their enclosure loops overlap (i.e., they "fuse" into one), 3) fusing groups through gestures which "touch" enclosure loops of the groups to be fused or 4) splitting the group into multiple groups through a splitting gesture.

Method and apparatus for grouping graphic objects on a computer based system having a graphical user interface

Meeting support objects for supporting meeting objectives for use in a freeform graphics system. Meeting support objects are representations of dynamic information that is used to support various common activities performed in meetings, such as decision making, assigning action items, agenda tracking, etc. Meeting support objects are defined by a domain object class. The domain object class defines attributes, a set of action rules and layouts. The attributes describe the information or data associated with the meeting support object. Further, the underlying attribute values represented by the icon may change, based on predefined spatial parameters, as the result of user actions performed on the icon (e.g. via a gesture) or upon the occurrence of a system event. The set of action rules map user actions and system events to operations that may be performed on the meeting support object. The layouts define how meeting support object information is displayed as an icon.

A freeform graphics system having meeting objects for supporting meeting objectives

A method and apparatus for representing a group of graphic objects so as to maximize usage of a display area on a computer controlled graphics display system. The present invention provides a means for "collapsing" a group of graphic objects so that the group is represented by a container icon. The container icon occupies a smaller amount of display area than the group of objects. The group is recallable (i.e. expanded) by "tapping" on the container icon. Alternatively, the group may be located on a separate accessible area of the display space. The container icon is itself a graphical object and can be moved, copied or deleted. Any change of attributes, e.g. color, of the graphical object causes a corresponding change to the group of graphic objects.

Method and apparatus for collapsing and expanding selected regions on work space on a computer controlled display system

Domain objects for use in a freeform graphics system. Domain objects are context specific representations of information that are used in a freeform graphics system. Domain objects are represented in a freeform graphics system by a graphic object (icon) representing an instance of the domain object. The icon representing a domain object may be manipulated like any other graphic object. Domain objects are defined by a domain object class which define attributes, a set of action rules and layouts. The attributes describe the information or data associated with the domain object. The set of action rules map user actions and system events to operations that may be performed on the domain object. The layouts define how domain object information is displayed as an icon.

Melle William J Van

Papers

Apparatus and method for supporting the implicit structure of freeform lists, outlines, text, tables, and diagrams in a gesture-based input system and editing system.

Method and apparatus for grouping graphic objects on a computer based system having a graphical user interface

A freeform graphics system having meeting objects for supporting meeting objectives

Method and apparatus for collapsing and expanding selected regions on work space on a computer controlled display system

Domain objects for use in a freeform graphics system