An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

Systems and methods are provided for receiving speech and non-speech communications of natural language questions and/or commands, transcribing the speech and non-speech communications to textual messages, and executing the questions and/or commands. The invention applies context, prior information, domain knowledge, and user specific profile data to achieve a natural environment for one or more users presenting questions or commands across multiple domains. The systems and methods creates, stores and uses extensive personal profile information for each user, thereby improving the reliability of determining the context of the speech and non-speech communications and presenting the expected results for a particular question or command.

Systems and methods for responding to natural language speech utterance

A mobile system is provided that includes speech-based and non-speech-based interfaces for telematics applications. The mobile system identifies and uses context, prior information, domain knowledge, and user specific profile data to achieve a natural environment for users that submit requests and/or commands in multiple domains. The invention creates, stores and uses extensive personal profile information for each user, thereby improving the reliability of determining the context and presenting the expected results for a particular question or command. The invention may organize domain specific behavior and information into agents, that are distributable or updateable over a wide area network.

Mobile systems and methods of supporting natural language human-machine interactions

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A mobile terminal and a control method thereof, which can obtain an image, are provided. A mobile terminal (100) includes a camera unit (121), a pictogram extraction unit (182) and a controller (180). The camera unit (121) obtains image information corresponding to at least one of a still image and a moving image. The pictogram extraction unit (182) extracts at least one pictogram from the obtained image information. The controller (180) detects information related to the extracted pictogram, and displays the detected information to be overlapped with the obtained image information. In the mobile terminal, the controller (180) includes, as the detected information, at least one of previously recorded information and currently searched information related to the extracted pictogram.

Mobile terminal and control method thereof

A system for a vehicle and for conducting a transaction with a remote system includes a circuit configured to wirelessly obtain data from a payment mechanism brought into the vehicle and to wirelessly transmit the data to the remote system.

Systems and methods for conducting commerce in a vehicle

A method is provided for extracting meta data from a digital media storage device in a vehicle over a communication link between a control module of the vehicle and the digital media storage device. The method includes establishing a communication link between control module of the vehicle and the digital media storage device, identifying a media file on the digital media storage device, and retrieving meta data from a media file, the meta data including a plurality of entries, wherein at least one of the plurality of entries includes text data. The method further includes identifying the text data in an entry of the media file and storing the plurality of entries in a memory.

System and method for extraction of meta data from a digital media storage device for media selection in a vehicle

A control system (106) for mounting to a vehicle (100) and for providing information to an occupant of the vehicle from a first source device (116) is provided. The vehicle includes an audio system (130) and/or a display system (100). The control system includes a first interface (120) for communicating with the first source device (116). The control system further includes a second interface for providing a signal to the audio system and/or the display system. The control system yet further includes a processor (122). A memory unit (122) is communicably connected to the processor and includes a first transport (2112) configured to send a control signal to the interface. The memory unit (132) further includes a first manager (2304) configured to receive a command from an application (2104) and to translate the command from the application (2104) into a command for the transport (2112).

Mobile device gateway systems and methods

A control system in a vehicle for extracting meta data from a digital media storage device over a communication link. The system includes a communication module for establishing a communication link with the digital media storage device. The system also includes a processing module coupled to the communication module. The processing module is configured to retrieve, via the communication module, meta data associated with a media file from the digital media storage device. The meta data includes a plurality of entries, wherein at least one of the plurality of entries includes text data. The processing module is also configured to compare the text data of the entries with a set of data files stored in a database. The system also includes a memory module configured to store the plurality of entries retrieved from the digital media storage device.

Text to grammar enhancements for media files

A voice recognition system includes a microphone for receiving speech from a user and processing electronics. The processing electronics are in communication with the microphone and are configured to use a plurality of rules to evaluate user interactions with the voice recognition system. The processing electronics automatically determine and set an expertise level in response to and based on the evaluation. The processing electronics are configured to automatically adjust at least one setting of the voice recognition system in response to the set expertise level.

Brian L. Douthitt

Papers

Systems and methods for conducting commerce in a vehicle

System and method for extraction of meta data from a digital media storage device for media selection in a vehicle

Mobile device gateway systems and methods

Text to grammar enhancements for media files

Adaptive voice recognition systems and methods