A mobile terminal including a body; a touchscreen provided to a front and extending to side of the body and configured to display content; and a controller configured to detect one side of the body comes into contact with one side of an external terminal, display a first area on the touchscreen corresponding to a contact area of the body and the external terminal and a second area including the content, receive an input of moving the content displayed in the second area to the first area, display the content in the first area, and share the content in the first area with the external terminal.

Mobile terminal and method for controlling the same

According to some aspects, a method of monitoring an acoustic environment of a mobile device, at least one computer readable medium encoded with instructions that, when executed, perform such a method and/or a mobile device configured to perform such a method is provided. The method comprises receiving, by the mobile device, acoustic input from the environment of the mobile device, detecting whether the acoustic input includes a voice command from a user without requiring receipt of an explicit trigger from the user, and initiating responding to the detected voice command.

Methods and apparatus for detecting a voice command

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Voice trigger for a digital assistant

Systems and processes are disclosed for handling a multi-part voice command for a virtual assistant. Speech input can be received from a user that includes multiple actionable commands within a single utterance. A text string can be generated from the speech input using a speech transcription process. The text string can be parsed into multiple candidate substrings based on domain keywords, imperative verbs, predetermined substring lengths, or the like. For each candidate substring, a probability can be determined indicating whether the candidate substring corresponds to an actionable command. Such probabilities can be determined based on semantic coherence, similarity to user request templates, querying services to determine manageability, or the like. If the probabilities exceed a threshold, the user intent of each substring can be determined, processes associated with the user intents can be executed, and an acknowledgment can be provided to the user.

Multi-command single utterance input method

To allow for detecting hotwords on multiple devices.SOLUTION: A method, system and apparatus including a computer program encoded on a computer storage medium, for hotword detection on multiple devices are disclosed. In one aspect, a method includes receiving, by a first computing device, audio data corresponding to an utterance. The method also includes determining a first value corresponding to a likelihood that the utterance includes a hotword. The method further includes receiving a second value corresponding to a likelihood that the utterance includes the hotword, the second value being determined by a second computing device. The method further includes comparing the first value and the second value. The method further includes initiating speech recognition processing on the audio data based on the comparison between the first value and the second value.SELECTED DRAWING: Figure 1

Hotword detection on multiple devices

Power consumption for a computing device may be managed by one or more keywords. For example, if an audio input obtained by the computing device includes a keyword, a network interface module and/or an application processing module of the computing device may be activated. The audio input may then be transmitted via the network interface module to a remote computing device, such as a speech recognition server. Alternately, the computing device may be provided with a speech recognition engine configured to process the audio input for on-device speech recognition.

Speech recognition power management

Techniques are described for grouping multiple computing devices into a device set to enable shared audio functionality, or other types of shared functionality, between the devices in the device set. The devices may provide audio output, audio input, or both audio output and input. The devices may discover each other via transmitted radio signals, and the devices may be organized into one or more device sets based on location, supported functions, or other criteria. A voice command received at one device in the device set may be employed to control operations of other device(s) in the device set. Shared audio functionality between devices in a device set may also enable synchronized audio output through using multiple devices in the device set.

Device grouping for audio based interactivity

Voice-controlled devices that include one or more speakers for outputting audio. In some instances, the device includes at least one speaker within a cylindrical housing, with the speaker aimed or pointed away from a microphone coupled to the housing. For instance, if the microphone resides at or near the top of the cylindrical housing, then the speaker may point downwards along the longitudinal axis of the housing and away from the microphone. By pointing the speaker away from the microphone, the microphone will receive less sound from the speaker than if the speaker were pointed toward the microphone). Because the voice-controlled device may perform speech recognition on audio signals generated by the microphone, less sound from the speaker represented in the audio signal may result in more accurate speech recognition, and/or a lesser need to perform acoustic echo cancelation (AEC) on the generated audio signals.

Audio assemblies for electronic devices

Techniques are described for shared audio functionality between multiple computing devices, based on grouping the multiple computing devices into a device set. The devices may provide audio output, audio input, or both audio output and input. The devices may discover each other via transmitted radio signals, and the devices may be organized into one or more device sets based on location, supported functions, or other criteria. The shared audio functionality may enable a voice command received at one device in the device set to be employed for controlling audio output or other operations of other device(s) in the device set. Shared audio functionality between devices in a device set may also enable synchronized audio output through using multiple devices in the device set.

Shared audio functionality based on device grouping

A voice interaction architecture has a hands-free, electronic voice controlled assistant that permits users to verbally request information from cloud services. Since the assistant relies primarily, if not exclusively, on voice interactions, configuring the assistant for the first time may pose a challenge, particularly to a novice user who is unfamiliar with network settings (such as wife access keys). The architecture supports several approaches to configuring the voice controlled assistant that may be accomplished without much or any user input, thereby promoting a positive out-of-box experience for the user. More particularly, these approaches involve use of audible or optical signals to configure the voice controlled assistant.

Tony David

Papers

Speech recognition power management

Device grouping for audio based interactivity

Audio assemblies for electronic devices

Shared audio functionality based on device grouping

Configuration of voice controlled assistant