An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A method and apparatus that dynamically adjust operational parameters of a text-to-speech engine in a speech-based system are disclosed. A voice engine or other application of a device provides a mechanism to alter the adjustable operational parameters of the text-to-speech engine. In response to one or more environmental conditions, the adjustable operational parameters of the text-to-speech engine are modified to increase the intelligibility of synthesized speech.

Systems and methods for dynamically improving user intelligibility of synthesized speech in a work environment

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Method and apparatus for building an intelligent automated assistant

An electronic device may capture a voice command from a user. The electronic device may store contextual information about the state of the electronic device when the voice command is received. The electronic device may transmit the voice command and the contextual information to computing equipment such as a desktop computer or a remote server. The computing equipment may perform a speech recognition operation on the voice command and may process the contextual information. The computing equipment may respond to the voice command. The computing equipment may also transmit information to the electronic device that allows the electronic device to respond to the voice command.

Electronic Devices with Voice Command and Contextual Data Processing Capabilities

A system and method are provided for improved speech synthesis, wherein text data is pre-processed according to updated grammar rules or a selected group of grammar rules. In one embodiment, the TTS system comprises a first memory adapted to store a text information database, a second memory adapted to store grammar rules, and a receiver adapted to receive update data regarding the grammar rules. The system also includes a TTS engine adapted to retrieve at least one text entry from the text information database, pre-process the at least one text entry by applying the updated grammar rules to the at least one text entry, and generate speech based at least in part on the least one pre-processed text entry.

Text pre-processing for text-to-speech generation

A mobile device communicates with an in-vehicle system to provide a network-based calendar and related features for viewing and/or editing within a vehicle The mobile device executes a specialized application that retrieves calendar data from one or more calendar sources in a native calendar format, and converts the calendar data to a customized vehicle format designed specifically for convenient transfer and viewing within the vehicle The user may record spoken voice notes that can be processed to automatically create new calendar entries An alert feature schedules visual and/or audio alerts to notify the user in advance of scheduled calendar events When a scheduled calendar event time is reached, the in-vehicle system may automatically place a call to an event invitee or generating a route to an event destination

Calendar sharing for the vehicle environment using a connected cell phone

An in-vehicle system may detect an occurrence of a triggering event, detect a short-range communication connection between the in-vehicle system and a mobile communication device, send a prompt, including a request for information, to the mobile communication device, and receive a response, including the requested information, from the mobile communication device via the short-range communication module. In some embodiments, a business review, an advertisement, or a redeemable electronic coupon may be sent to the mobile communication device after the requested information is provided. Furthermore, destination information may be shared between the in-vehicle system and the mobile communication device in response to the triggering event.

Destination information sharing for the automobile environment

A system and method for connection management between a consumer device and a vehicle. The connection management is performed automatically using a computing device, e.g., an application executing on a smartphone. The system and method configure the vehicle and consumer device in a manner that optimizes the vehicle and consumer device connections based on a variety of factors such as available connections/ports and protocols to be used.

Connected phone system and method with associated bandwidth connections in a vehicle environment

A computer-implemented method for dynamic vehicle control affecting sleep states of vehicle occupants includes connecting a wearable computing device associated with a vehicle occupant to a vehicle, and determining a state of the vehicle occupant based on physiological data received from at least one of the wearable computing device and the vehicle. The method includes determining a target sleep state of the vehicle occupant based on at least one of the state of the vehicle occupant, the physiological data and vehicle system data, and controlling a vehicle system of the vehicle based on the state of the vehicle occupant in relation to the target sleep state. The method includes monitoring the state of the vehicle occupant including monitoring the physiological data of the vehicle occupant in response to controlling the vehicle system and controlling the vehicle system according to the monitoring in relation to the target sleep state.

David Michael Kirsch

Papers

Text pre-processing for text-to-speech generation

Calendar sharing for the vehicle environment using a connected cell phone

Destination information sharing for the automobile environment

Connected phone system and method with associated bandwidth connections in a vehicle environment

System and method for dynamic vehicle control affecting sleep states of vehicle occupants