John M. Zetts

Bio: John M. Zetts is an academic researcher from IBM. The author has contributed to research in topics: Input device & Pointing device. The author has an hindex of 19, co-authored 29 publications receiving 1900 citations.

Graphical user interface with gesture recognition in a multiapplication environment

Abstract: An advanced user interface for use with a computer system operating on an integrated operating environment. The integrated operating environment allows a plurality of application programs to be running simultaneously, one of which is designated the active application program to which all input data is directed. The advanced user interface allows a user to select among user-friendly input devices to operate any application program according to his individual preferences without change to the application program code. The advanced user interface includes alternate input modules which translate the input signals transmitted from the various input devices into input messages useable by the rest of the interface. The advanced user interface also includes interface profiles which contain mappings of the input messages against corresponding commands useable by the application programs, the integrated operating environment or other modules of the advanced user interface itself. An environment link module refers to the interface profiles and matches the input message against the corresponding command for the application program active at the time the input signal was transmitted and send the corresponding command to that application program. The environment link module matches the input message against a corresponding command for an application which owns a window in which a key feature of a gesture is made.

Distinguishing gestures from handwriting in a pen based computer by stroke analysis

Abstract: Pre-recognition analysis on stroke characteristics such as the count, size and position of each stroke in real-time as it is drawn improves recognition accuracy. After each stroke, the set of strokes is weighted toward handwriting or gesture. The system uses a gesture threshold size to distinguish between gestures and handwriting. The system also uses the stroke count to distinguish between the two inputs, relying on the knowledge of the allowable number of strokes in a gesture. The count information may also be used in conjunction with the stroke size information to weight the set of strokes between gestures handwriting. Once the stroke size crosses a gesture vs. text size threshold, the result is weighted toward gestures. By examining the `white space` between strokes and the juxtaposition of the strokes, a gesture vs. text determination can be made with high accuracy.

Recognizing the cessation of motion of a pointing device on a display by comparing a group of signals to an anchor point

Abstract: A method and apparatus for efficiently distinguishing between different types of input signals simulated by a pointing device coupled to a multi-tasking computer system. The pointing device may be a stylus, finger or other device that moves across the surface of a touch screen or the like to generate positional information. Depending on the response of a delay timer, the motion of the pointing device is recognized by software application programs as input information either from a mouse or from a gesture or a handwriting input mode. If motion cessation across the screen is detected with a predetermined time-delay period, the system accepts the input information in a mouse-emulating mode. If motion is detected within the predetermined time-delay period, the timer is reset. Thus, the system overhead associated with managing the timer can be reduced because the timer is periodically reset and need not be reset after each movement of the pointing device as in the prior art. The periodic resetting can be based on intervals of n points generated by a moving pointing device, or n real-time units relative to a given point generated by the pointing device.

Distinguishing gestures from handwriting in a pen based computer by size discrimination

Abstract: To distinguish between gestures and handwriting, the pen subsystem examines the size of the user's writing. The user may set the gesture versus text size according to his/her handwriting style. In this manner, the user knows exactly how large to make the gestures. If the user declines to customize the setting, the pen subsystem can query other user settings that indicate approximate size of the user's handwriting. A third choice available the system dynamically determine and track the size of handwriting. This would allow multiple users to serially use the computer without having to change settings.

Computer based pen system and method for automatically cancelling unwanted gestures and preventing anomalous signals as inputs to such system

Abstract: A method and system for a pen-based computer system allow a user to automatically cancel a gesture in progress under several different conditions and terminate the operation of the system in a gesture recognition motion. In a first condition, a gesture cancel timeout period is stored in a memory of the system. The cancel timeout period is definitive of holding the input device in a motionless condition. When the timeout period is exceeded, a software application program recognize the excessive time period, terminates the operation of the system in gesture recognition mode. In another condition, a motion area is defined in the program for the input device. When the gesture executed by the input device exceeds the pre-defined motion area, the application program recognizes the excessive motion and terminates the operation of the system in the gesture recognition mode. In another condition, each input device is identified and stored in memory. When a gesture is being performed and a change in input devices occurs, the program recognizes the difference in the identifications of the input devices and terminates the operation of the system in a gesture recognition mode. The system also automatically terminates the gesture mode of operation when anomalous signals, such as hand trembling or false or unwanted gestures are inputted to the system.

Gestures for touch sensitive input devices

Abstract: Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Method and apparatus for integrating manual input

Abstract: Apparatus and methods are disclosed for simultaneously tracking multiple finger (202-204) and palm (206, 207) contacts as hands approach, touch, and slide across a proximity-sensing, compliant, and flexible multi-touch surface (2). The surface consists of compressible cushion (32), dielectric electrode (33), and circuitry layers. A simple proximity transduction circuit is placed under each electrode to maximize the signal-to-noise ratio and to reduce wiring complexity. Scanning and signal offset removal on electrode array produces low-noise proximity images. Segmentation processing of each proximity image constructs a group of electrodes corresponding to each distinguishable contacts and extracts shape, position and surface proximity features for each group. Groups in successive images which correspond to the same hand contact are linked by a persistent path tracker (245) which also detects individual contact touchdown and liftoff. Classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Object position detector with edge motion feature and gesture recognition

Abstract: A method of generating a signal comprising providing a capacitive touch sensor pad including a matrix of X and Y conductors, developing capacitance profiles in one of an X direction and a Y direction from the matrix of X and Y conductors, determining an occurrence of a single gesture through an examination of the capacitance profiles, the single gesture including an application of at least two objects on the capacitive touch sensor pad, and generating a signal indicating the occurrence of the single gesture.

Intelligent Automated Assistant

Abstract: An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad

Abstract: Method and apparatus for detecting an operative coupling between one or more fingers or other appropriate objects and a touch pad includes processes for detection of multiple maxima with intermediate minima in appropriate sequences to emulate the operations of cursor control and button actuations in a pointing and control device.