An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A system and method for filtering and organizing items from computer memories based on common elements. In accordance with one aspect of the invention, filters are provided for manipulating the items. The filters are essentially tools for narrowing down a set of items. In one embodiment, the filters are dynamically generated based on the properties of the separate items. The system utilizes virtual folders. The virtual folders expose regular files and folders to users in different views based on their metadata instead of the actual physical underlying file system structure on the disk. In accordance with another aspect of the invention, quick links are provided. In one embodiment, quick links are a set of predefined links (e.g., located on the left side of the display) that can be clicked on to generate useful views of the sets of items. In accordance with another aspect of the invention, libraries are provided. Libraries consist of large groups of usable types of items that can be associated together.

System and method for filtering and organizing items based on common elements

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Method and apparatus for building an intelligent automated assistant

The method includes automatically, without user input and without regard to whether a digital assistant application has been separately invoked by a user, determining that the electronic device is in a vehicle. In some implementations, determining that the electronic device is in a vehicle comprises detecting that the electronic device is in communication with the vehicle (e.g., via a wired or wireless communication techniques and/or protocols). The method also includes, responsive to the determining, invoking a listening mode of a virtual assistant implemented by the electronic device. In some implementations, the method also includes limiting the ability of a user to view visual output presented by the electronic device, provide typed input to the electronic device, and the like.

Automatically adapting user interfaces for hands-free interaction

A performance gauge for use in conjunction with a transcription system including a speech processor linked to at least one speech recognition engine and at least one transcriptionist. The speech processor includes an input for receiving speech files and storage means for storing the received speech files until such a time that they are forwarded to a selected speech recognition engine or transcriptionist for processing. The system includes a transcriptionist text file database in which manually transcribed transcriptionist text files are stored, each stored transcriptionist text file including time stamped data indicative of position within an original speech file. The system further includes a recognition engine text file database in which recognition engine text files transcribed via the at least one speech recognition engine are stored, each stored recognition engine text file including time stamped data indicative of position within an original speech file. The system further includes a comparator comparing the time stamped recognition engine text files with time stamped transcriptionist text files based upon the same speech file so as to determine differences between the recognition engine text file and the transcriptionist text file and a report generator compiling the identified differences so as to issue a report for evaluation by administrators of the transcription system.

Performance gauge for a distributed speech recognition system

A distributed speech recognition system includes a speech processor linked to a plurality of speech recognition engines. The speech processor includes an input for receiving speech files from a plurality of users and storage means for storing the received speech files until such a time that they are forwarded to a selected speech recognition engine for processing. Each of the speech recognition engines includes a plurality of servers selectively performing different functions. The system further includes means for selectively activating or deactivating the plurality of servers based upon usage of the distributed speech recognition system.

Distributed speech recognition system with speech recognition engines offering multiple functionalities

An object oriented Explorer type environment (10) includes a first pane (12) and a second pane (14) linked such that one may interact with the first pane (12) to call up data within the second pane (14). The first pane (12) includes a plurality of objects, each object including a control object defined to call up a static method upon activation of the object. The static method calls up data in the second pane (14) for viewing by an operator of the Explorer type environment (10).

Object oriented explorer type environment

A distributed speech recognition system includes a speech processor linked to a plurality of speech recognition engines. The speech processor includes an input for receiving speech files from a plurality of users and storage means for storing the received speech files until such a time that they are forwarded to a selected speech recognition engine for processing (Fig. 1). The speech processor further includes a dispatch system linked to the storage means for controlling the transmission of speech files to the plurality of speech recognition engines in a controlled manner.

Distributed speech recognition system

A distributed speech recognition system (Fig. 1) provides for the convenient and expedited insertion of a new speech recognition engine. The system includes a speech processor linked to at least one speech recognition engine. The at least one speech recognition engine includes means for addressing the central speech processor upon installation within the system. The means for addressing transmits to the central speech processor a message indicating its operating protocol and location to permit the central speech processor to identify and begin transmitting work thereto.

James Cyr

Papers

Performance gauge for a distributed speech recognition system

Distributed speech recognition system with speech recognition engines offering multiple functionalities

Object oriented explorer type environment

Distributed speech recognition system

Dynamic insertion of a speech recognition engine within a distributed speech recognition system