An intelligent electronic appliance preferably includes a user interface, data input and/or output port, and an intelligent processor. A preferred embodiment comprises a set top box for interacting with broadband media streams, with an adaptive user interface, content-based media processing and/or media metadata processing, and telecommunications integration. An adaptive user interface models the user, by observation, feedback, and/or explicit input, and presents a user interface and/or executes functions based on the user model. A content-based media processing system analyzes media content, for example audio and video, to understand the content, for example to generate content-descriptive metadata. A media metadata processing system operates on locally or remotely generated metadata to process the media in accordance with the metadata, which may be, for example, an electronic program guide, MPEG 7 data, and/or automatically generated format. A set top box preferably includes digital trick play effects, and incorporated digital rights management features.

Intelligent electronic appliance system and method

An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence. Applications of the interface and system include a VCR, medical device, vehicle control system, audio device, environmental control system, securities trading terminal, and smart house. The system optionally includes an actuator for effecting the environment of operation, allowing closed-loop feedback operation and automated learning.

Ergonomic man-machine interface incorporating adaptive pattern recognition based control system

An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation that may be efficiently processed to determine correspondence. Applications of the interface and system include a video cassette recorder (VCR), medical device, vehicle control system, audio device, environmental control system, securities trading terminal, and smart house. The system optionally includes an actuator for effecting the environment of operation, allowing closed-loop feedback operation and automated learning.

Adaptive pattern recognition based control system and method

A system and a method for providing content, management and interactivity for client devices are provided. Digital data based on user specified preferences is automatically obtained and transferred from a wide area network to a computer. The digital data is then automatically sent from the computer to a client device using a wireless data transceiver. In one embodiment, the client device is a television.

System and method for providing content, management, and interactivity for client devices

An intelligent media device, comprising a packet data communications interface; a media communication interface for receiving audio and/or video data; a digital memory for persistently storing received audio and/or video data; and an intelligent server for generating a virtual interface for controlling the media communication interface and the digital memory through said packet data communications interface. The intelligent server may be adaptive. A variety of devices may be interfaced through the packet data communications interface, including telephony, imaging, videoconferencing, security, alarm, environmental control, vehicular, illumination system, domestic appliance; fluid and handling systems, as well as consumer electronic devices. A digital rights manager for enforcing a set of externally supplied restrictions associated with the received audio and/or video data may be incorporated, with a cryptographic processor for selectively cryptoprocessing audio and/or video data in dependence on said rights manager being provided to limit access to the audio and/or video data content.

Media recording device with packet data interface

In summary there is disclosed a document browser for electronic filing systems, which supports pen-based markup and annotation. The user may electronically write notes (60-64) anywhere on a page (32, 38) and then later search for those notes using the approximate ink matching (AIM) technique. The technique segments (104) the user-drawn strokes, extracts (108) and vector quantizes (112) features contained in those strokes. An edit distance comparison technique (118) is used to query the database (120), rendering the system capable of performing approximate or partial matches to achieve fuzzy search capability.

Document search and retrieval system with partial match searching of user-drawn annotations

The user communicates through a digitizing writing surface with the audio/video control apparatus. An on-screen display is generated, providing the user with a user environment in which a wide range of different tasks and functions can be performed. The digitizing writing surface can be incorporated into a hand-held remote control unit and the audio/video control apparatus may likewise be incorporated into existing home entertainment or computer equipment. By tapping on the writing surface a command bar is presented on the screen, allowing the user to select among various functions. Included in these functions is an on-screen programming feature, allowing the user to select programs for viewing or recording by entry of user-drawn annotations or commands via the writing surface.

Video user's environment

PROBLEM TO BE SOLVED: To control plural audio and video systems without increasing the number of push buttons on a remote controller by incorporating a digital writing face for inputting instruction handwritten by a user to the push button remote controller of a hand held type and communicating with audio and video controller to control the operation of a video display device according to the handwritten instruction. SOLUTION: The user inputs a handwritten instruction on the digital writing face 26 incorporated in the remote controller 24 through the use of a pen 28 to communicate with an audio and video control unit installed on a television receiver 22 through L infrared link 30. The television receiver 22 is provided with a command bar 32 and a user bi-directional panel 34 at a video user interface to display a command from the user. At the time of writing a large 'X', e.g. on the face 26, it is interpreted to be a command for putting off the power source of the television receiver 22 to be displayed.

Audio and video system

PROBLEM TO BE SOLVED: To easily search for and retrieve a handwritten annotation by retrieving a document for copying a document and displaying a user's handwritten annotation on a display screen where an annotation of the document is written initially by hand. SOLUTION: A pen 22 and a digital tablet 24 with which a computer work station 16 is equipped are coupled through a user interface of a client document browser application 20. When a user draws an annotation on the tablet 24 by using the pen 22, the handwritten annotation appears on a client document browser display screen 18. A browser application 20 run on the workstation 16 makes a communication through a network 14 and retrieves and displays documents stored in a data base 12. The user can interact with those documents by using the pen 22 and tablet 24.

Jian Zhou

Papers

Document search and retrieval system with partial match searching of user-drawn annotations

Video user's environment

Audio and video system

Document retrieval and retrieval system