An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

Systems and methods are provided for receiving speech and non-speech communications of natural language questions and/or commands, transcribing the speech and non-speech communications to textual messages, and executing the questions and/or commands. The invention applies context, prior information, domain knowledge, and user specific profile data to achieve a natural environment for one or more users presenting questions or commands across multiple domains. The systems and methods creates, stores and uses extensive personal profile information for each user, thereby improving the reliability of determining the context of the speech and non-speech communications and presenting the expected results for a particular question or command.

Systems and methods for responding to natural language speech utterance

The invention provides user configurable and reconfigurable scripting, methods of scripting, and systems for scripting for use by call centers, technical support centers, and marketers. Scripts are interactive tools that guide a telemarketer, a sales person, or a technical support technician through a telephone call with a customer. Scripts are characterized by going on to particular subsequent questions as a function of the customer's answer to a previous question.

System and method for smart scripting call centers and configuration thereof

A mobile system is provided that includes speech-based and non-speech-based interfaces for telematics applications. The mobile system identifies and uses context, prior information, domain knowledge, and user specific profile data to achieve a natural environment for users that submit requests and/or commands in multiple domains. The invention creates, stores and uses extensive personal profile information for each user, thereby improving the reliability of determining the context and presenting the expected results for a particular question or command. The invention may organize domain specific behavior and information into agents, that are distributable or updateable over a wide area network.

Mobile systems and methods of supporting natural language human-machine interactions

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A method of using at least one natural language query to retrieve information from one or more data resources and further performing a requested action using the retrieved information is disclosed. At least one natural language query directed to retrieving particular information is received. At least one object from the natural language query is extracted. The relationship between each of the at least one extracted objects is determined. A semantic representation is created from the at least one extracted objects. The semantic representation is compared to a knowledge structure. The knowledge structure is comprised of one or more grammars which are extracted from a plurality of data resources. The semantic representations are matched to the grammar. A database query is generated based on the matched objects. The query is applied to one or more of the data resources and information is retrieved. The requested action is then performed using the retrieved information.

Method of using a natural language interface to retrieve information from one or more data resources

A pre-registration procedure is utilized to create a user profile for a user of a multi-factor authentication (“MFA”) service. A client application installation procedure is utilized to install a client application on a computing device that is to be utilized as an authentication factor for the MFA service. A computing device enrollment procedure is utilized to enroll the computing device on which the client application was installed for the MFA service. A voice enrollment procedure is utilized to create a voice print for the user of the computing device that is to be utilized as an authentication factor for the MFA service. An authentication procedure is utilized to provide multi-factor authenticated access to a service, such as an online service that provides access to sensitive account information.

Authentication Techniques Utilizing a Computing Device

Systems and methods for creating and using geo-centric language models are provided herein. An exemplary method includes assigning each of a plurality of listings to a local service area, determining a geographic center for the local service area, computing a listing density for the local service area, and selecting a desired number of listings for a geo-centric listing set. The geo-centric listing set includes a subset of the plurality of listings. The exemplary method further includes dividing the local service area into regions based upon the listing density and the number of listings in the geo-centric listing set, and building a language model for the geo-centric listing set.

Systems and methods for creating and using geo-centric language models

The invention concerns method and system for pre-processing entries in a directory listings. An automated attendant or automated directory listings assistant may use the pre-processed entries. A first directory listings including one or more fields may be received. The one or more fields may be populated with entries including one or more symbol strings. A second directory listings including one or more fields may be received. The one or more fields of the second directory listings may be populated with entries including one or symbol strings. Entries in the one or more fields of the first directory listings may be correlated with entries in the corresponding one or more fields of the second directory listings. Entries, in the one or more fields of the first directory listings, which do not correlate with entries in the corresponding one or more fields of the second directory listings may be identified. The identified entries may be processed using a rule set corresponding to the field in which the entry is located. Based on the rule set, a corresponding confidence level for the processed entries may be determined. The processed entries having the corresponding confidence level meeting or exceeding a threshold may be automatically modified. The automatically modified entries may be outputted for processing. In alternative embodiments of the present invention, the processed entries having the corresponding confidence level below the threshold may be marked for operator confirmation.

System and method for pre-processing information used by an automated attendant

A method and apparatus for defining an interface for a system using voice commands to connect a first user to a second user over a network. The interface receives a request to define the interface for a particular user. The interface receives a first information item, and searches at least one database for a second information item indexed by the first information item. Another search is performed for a third information item indexed by the second information item. This process is continued until the interface has gathered sufficient information items to construct a natural language grammar for use by the interface. The interface uses the natural language grammar to parse commands given by the user for future communications connections.

Ilija Zeljkovic

Papers

Method of using a natural language interface to retrieve information from one or more data resources

Authentication Techniques Utilizing a Computing Device

Systems and methods for creating and using geo-centric language models

System and method for pre-processing information used by an automated attendant

Interface for a voice-activated connection system