A mobile terminal including a body; a touchscreen provided to a front and extending to side of the body and configured to display content; and a controller configured to detect one side of the body comes into contact with one side of an external terminal, display a first area on the touchscreen corresponding to a contact area of the body and the external terminal and a second area including the content, receive an input of moving the content displayed in the second area to the first area, display the content in the first area, and share the content in the first area with the external terminal.

Mobile terminal and method for controlling the same

According to some aspects, a method of monitoring an acoustic environment of a mobile device, at least one computer readable medium encoded with instructions that, when executed, perform such a method and/or a mobile device configured to perform such a method is provided. The method comprises receiving, by the mobile device, acoustic input from the environment of the mobile device, detecting whether the acoustic input includes a voice command from a user without requiring receipt of an explicit trigger from the user, and initiating responding to the detected voice command.

Methods and apparatus for detecting a voice command

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Voice trigger for a digital assistant

A computer-implemented method comprising: providing a transcription of an utterance for presentation in an area of a display of a computing device; receiving a user selection of at least one word of the transcription of the utterance; in response to receiving the user selection of the at least one word of the transcription of the utterance, presenting at the display of the computing device one or more of: (i) one or more alternate words for the user-selected at least one word of the transcription of the utterance and (ii) a remove control to remove the user-selected at least one word of the transcription of the utterance from the transcription of the utterance; receiving a user selection of the remove control or an alternate word from among the one or more alternate words; and updating the transcription of the utterance presented in the area of the display of the computing device based at least on the user selection. A system and computer program are also described.

Word-level correction of speech input

Systems and processes are disclosed for handling a multi-part voice command for a virtual assistant. Speech input can be received from a user that includes multiple actionable commands within a single utterance. A text string can be generated from the speech input using a speech transcription process. The text string can be parsed into multiple candidate substrings based on domain keywords, imperative verbs, predetermined substring lengths, or the like. For each candidate substring, a probability can be determined indicating whether the candidate substring corresponds to an actionable command. Such probabilities can be determined based on semantic coherence, similarity to user request templates, querying services to determine manageability, or the like. If the probabilities exceed a threshold, the user intent of each substring can be determined, processes associated with the user intents can be executed, and an acknowledgment can be provided to the user.

Multi-command single utterance input method

Power consumption for a computing device may be managed by one or more keywords. For example, if an audio input obtained by the computing device includes a keyword, a network interface module and/or an application processing module of the computing device may be activated. The audio input may then be transmitted via the network interface module to a remote computing device, such as a speech recognition server. Alternately, the computing device may be provided with a speech recognition engine configured to process the audio input for on-device speech recognition.

Speech recognition power management

Devices, methods, and systems for detecting wake words and audio commands that should be disregarded are disclosed. In some instances, a local device may receive a wake word or audible command transmitted or uttered in a television or radio advertisement, program, broadcast, etc. In these instances, the local device should disregard such wake words and audible commands, as they are not from a user of the local device. To detect such wake words and commands, audio fingerprinting and speech recognition techniques may be used to determine whether the wake word and/or command substantially matches the audio of a known television or radio advertisement, program, broadcast, etc. If the wake word and/or command substantially matches, the local device may then disregard the command.

Audible command filtering

Features are disclosed for detecting words in audio using environmental information and/or contextual information in addition to acoustic features associated with the words to be detected. A detection model can be generated and used to determine whether a particular word, such as a keyword or “wake word,” has been uttered. The detection model can operate on features derived from an audio signal, contextual information associated with generation of the audio signal, and the like. In some embodiments, the detection model can be customized for particular users or groups of users based usage patterns associated with the users.

Keyword detection modeling using contextual and environmental information

A system matches text-to-speech (TTS) or other output to a quality of an input spoken utterance. The system uses trained models to detect a speech quality and generates an indicator of the speech quality. The speech quality may be determined from audio or non-audio data. The indicator is sent to downstream components of the system such as a command processor or TTS system. The output of the system is then determined using the indicator of speech quality, thus customizing an output of the system to the manner in which the utterance was spoken.

Input speech quality matching

A method for transcribing a spoken communication includes acts of receiving a spoken first communication from a first sender to a first recipient, obtaining information relating to a second communication, which is different from the first communication, from a second sender to a second recipient, using the obtained information to obtain a language model, and using the language model to transcribe the spoken first communication.

Kenneth John Basye

Papers

Speech recognition power management

Audible command filtering

Keyword detection modeling using contextual and environmental information

Input speech quality matching

Methods and systems for obtaining language models for transcribing communications