An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Method and apparatus for building an intelligent automated assistant

The method includes automatically, without user input and without regard to whether a digital assistant application has been separately invoked by a user, determining that the electronic device is in a vehicle. In some implementations, determining that the electronic device is in a vehicle comprises detecting that the electronic device is in communication with the vehicle (e.g., via a wired or wireless communication techniques and/or protocols). The method also includes, responsive to the determining, invoking a listening mode of a virtual assistant implemented by the electronic device. In some implementations, the method also includes limiting the ability of a user to view visual output presented by the electronic device, provide typed input to the electronic device, and the like.

Automatically adapting user interfaces for hands-free interaction

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Voice trigger for a digital assistant

In a voice over IP system, an IP telephone includes an LED lamp that indicates a voice message has been stored in a remote voice mail system. The IP telephone can then access that voice message. The message can also be moved from one remote site to another.

Voice mail in a voice over IP telephone system

An information handling system comprises a TCP/IP network connecting a hub to a multimedia server and the hub to a data server, and the hub to an IP telephony device that is then coupled to a network device Data sent from the network device is addressed for transmission to the data server and is transmitted through the IP telephony device to the TCP/IP network The present invention allows a user, such as a supervisor, to monitor the audio conversations of users on the system and current display information of another station This can be done between remote systems so that the monitoring individual does not have to be in the same system as the user who is being monitored

Service observing in a voice over IP telephone system

A telephone and voice mail (voice processing) system, which is implemented using only a single processing system for controlling operation of both the telephone system and the voice mail system, permits a user to call back a party using caller ID data stored with a voice mail message left by the party calling into the system. This is accomplished by storing caller ID information associated with an incoming call along with the message placed by the incoming caller and stored within the mailbox associated with the called party. Additionally, the caller ID information may be used to create a speed dial list within the telephone and voice mail system for later use by the user. Such caller ID information may be retrieved from a voice mail message left by the calling party, or may be retrieved while conducting a conversation with the incoming call.

Dialing using caller ID

A telephone and voice mail (voice processing) system is implemented using only a single processing means for controlling operations of both the telephone system and the voice mail system. The single processing means communicates with a hard disk, which stores programs for running the various operations of the system, voice prompts and all voice mail messages. The single processing means is coupled to signal processing circuitry, which emulates analog electronics that would be used for filters, tone decoder, generators, etc. The single processing means and signal processing circuitry are coupled to central office lines and station lines by a digital cross-point matrix, which can connect any voice path to another voice path. The system integrates call processing and voice processing into one system controlled by one set of software and a single processing means.

Telephone call/voice processing system

An information handling system comprises a TCP/IP network connecting a hub to a multimedia server and the hub to a data server, and the hub to an IP telephony device that is then coupled to a network device. Data sent from the network device is addressed for transmission to the data server and is transmitted through the IP telephony device to the TCP/IP network. The IP telephony device monitors when an amount of data being received over the network falls below a predetermined threshold. If this occurs, the IP telephony device will send a signal to the multimedia server, which will then generate a congestion signal to send to all or selected IP telephony devices in the network to throttle data being received by the IP telephony devices from their respective connected network devices.

Eric G. Suder

Papers

Voice mail in a voice over IP telephone system

Service observing in a voice over IP telephone system

Dialing using caller ID

Telephone call/voice processing system

Quality of service in a voice over IP telephone system