An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

An electronic device may capture a voice command from a user. The electronic device may store contextual information about the state of the electronic device when the voice command is received. The electronic device may transmit the voice command and the contextual information to computing equipment such as a desktop computer or a remote server. The computing equipment may perform a speech recognition operation on the voice command and may process the contextual information. The computing equipment may respond to the voice command. The computing equipment may also transmit information to the electronic device that allows the electronic device to respond to the voice command.

Electronic Devices with Voice Command and Contextual Data Processing Capabilities

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Voice trigger for a digital assistant

A device can be configured to receive speech input from a user. The speech input can include a command for accessing a restricted feature of the device. The speech input can be compared to a voiceprint (e.g., text-independent voiceprint) of the user's voice to authenticate the user to the device. Responsive to successful authentication of the user to the device, the user is allowed access to the restricted feature without the user having to perform additional authentication steps or speaking the command again. If the user is not successfully authenticated to the device, additional authentication steps can be request by the device (e.g., request a password).

Device access using voice authentication

Systems and processes are disclosed for handling a multi-part voice command for a virtual assistant. Speech input can be received from a user that includes multiple actionable commands within a single utterance. A text string can be generated from the speech input using a speech transcription process. The text string can be parsed into multiple candidate substrings based on domain keywords, imperative verbs, predetermined substring lengths, or the like. For each candidate substring, a probability can be determined indicating whether the candidate substring corresponds to an actionable command. Such probabilities can be determined based on semantic coherence, similarity to user request templates, querying services to determine manageability, or the like. If the probabilities exceed a threshold, the user intent of each substring can be determined, processes associated with the user intents can be executed, and an acknowledgment can be provided to the user.

Multi-command single utterance input method

Because a voice recognition device in accordance with the present invention can adjust the output of a voice recognition result according to the priority of a display of the recognition result with respect to display information other than the voice recognition result at all times while recognizing an uttered voice, the voice recognition device prevents the acquisition of other information important for the user from being blocked due to the display of the recognition result, and improves the user's convenience.

Voice recognition device and display method

A voice recognition device includes a voice recognition dictionary in which a word which is recognized as a result of voice recognition on an inputted voice is registered, a reply voice data storage unit for storing recorded voice data about words registered in the voice recognition dictionary, a dialog control unit for, when a word registered in the voice recognition dictionary is recognized, acquiring recorded voice data corresponding to the word from the reply voice data storage unit, a reproduction noise reduction unit for carrying out a process of reducing noise included in the recorded voice data, an amplitude adjusting unit for adjusting an amplitude of the recorded voice data in which the noise has been reduced to a predetermined amplitude level, and a voice reproduction unit for reproducing a voice from the amplitude-adjusted recorded voice data.

Voice recognition device

A navigation device or method is configured to identify location information and a route setting method from a recognition result obtained by constantly recognizing user's utterance contents, and set a route based on the location information and the route setting method.

Navigation device and method

An on-vehicle guidance apparatus is characterized in including an output sound control means for acquiring a sound volume setting of onboard equipment, a sound volume determining means for determining whether or not the sound volume setting is smaller than a predetermined threshold, and a guidance output control means for issuing a command for carrying out voice guidance in response to a determination signal from the sound volume determining means at a time when the sound volume setting becomes smaller than the above-mentioned threshold.

On-vehicle guidance apparatus

A voice recognition system, when deciding that a user is about to select a voice recognition result displayed on a screen while the system continuously recognizes a voice uttered, stops a display update of the recognition result on the display unit, thereby being able to prevent the recognition result from disappearing or from changing to other recognition result at the moment when the user is about to select the recognition result. This makes it possible to prevent a user from carrying out an unwanted operation, and to improve the convenience of the user.

Yuki Furumoto

Papers

Voice recognition device and display method

Voice recognition device

Navigation device and method

On-vehicle guidance apparatus

Voice recognition system and recognition result display apparatus