Newness and distinctiveness is claimed in the features of ornamentation as shown inside the broken line circle in the accompanying representation.

Display screen or portion thereof with graphical user interface

Systems and processes are disclosed for handling a multi-part voice command for a virtual assistant. Speech input can be received from a user that includes multiple actionable commands within a single utterance. A text string can be generated from the speech input using a speech transcription process. The text string can be parsed into multiple candidate substrings based on domain keywords, imperative verbs, predetermined substring lengths, or the like. For each candidate substring, a probability can be determined indicating whether the candidate substring corresponds to an actionable command. Such probabilities can be determined based on semantic coherence, similarity to user request templates, querying services to determine manageability, or the like. If the probabilities exceed a threshold, the user intent of each substring can be determined, processes associated with the user intents can be executed, and an acknowledgment can be provided to the user.

Multi-command single utterance input method

This is directed to processing voice inputs received by an electronic device. In particular, this is directed to receiving a voice input and identifying the user providing the voice input. The voice input can be processed using a subset of words from a library used to identify the words or phrases of the voice input. The particular subset can be selected such that voice inputs provided by the user are more likely to include words from the subset. The subset of the library can be selected using any suitable approach, including for example based on the user's interests and words that relate to those interests. For example, the subset can include one or more words related to media items selected by the user for storage on the electronic device, names of the user's contacts, applications or processes used by the user, or any other words relating to the user's interactions with the device.

User profiling for voice input processing

This relates to systems and processes for using a virtual assistant to control electronic devices. In one example process, a user can speak an input in natural language form to a user device to control one or more electronic devices. The user device can transmit the user speech to a server to be converted into a textual representation. The server can identify the one or more electronic devices and appropriate commands to be performed by the one or more electronic devices based on the textual representation. The identified one or more devices and commands to be performed can be transmitted back to the user device, which can forward the commands to the appropriate one or more electronic devices for execution. In response to receiving the commands, the one or more electronic devices can perform the commands and transmit their current states to the user device.

Intelligent assistant for home automation

Systems and processes for generating a speaker profile for use in performing speaker identification for a virtual assistant are provided. One example process can include receiving an audio input including user speech and determining whether a speaker of the user speech is a predetermined user based on a speaker profile for the predetermined user. In response to determining that the speaker of the user speech is the predetermined user, the user speech can be added to the speaker profile and operation of the virtual assistant can be triggered. In response to determining that the speaker of the user speech is not the predetermined user, the user speech can be added to an alternate speaker profile and operation of the virtual assistant may not be triggered. In some examples, contextual information can be used to verify results produced by the speaker identification process.

Speaker identification and unsupervised speaker adaptation techniques

Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display are disclosed herein. In one aspect, the method includes executing, on the electronic device, an application in response to an instruction from a user of the electronic device. While executing the application, the method further includes collecting usage data. The usage data at least includes one or more actions performed by the user within the application. The method also includes: automatically, without human intervention, obtaining at least one trigger condition based on the collected usage data and associating the at least one trigger condition with a particular action of the one or more actions performed by the user within the application. Upon determining that the at least one trigger condition has been satisfied, the method includes providing an indication to the user that the particular action associated with the trigger condition is available.

Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device

Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display are disclosed herein. In one aspect, a method includes executing, on the device, an application in response to an instruction from a user of the electronic device. While executing the application, the method further includes collecting usage data. The usage data at least includes one or more actions performed by the user within the application. The method also includes: automatically, without human intervention, obtaining at least one trigger condition based on the collected usage data and associating the at least one trigger condition with a particular action of the one or more actions performed by the user within the application. Upon determining that the at least one trigger condition has been satisfied, the method includes providing an indication to the user that the particular action associated with the trigger condition is available.

Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display

터치 감응형 디스플레이를 갖는 전자 디바이스 상의 관련 콘텐츠를 사전행동적으로 식별 및 표면화하기 위한 시스템들 및 방법들이 본 명세서에 개시된다. 일 태양에서, 본 방법은, 전자 디바이스 상에서, 전자 디바이스의 사용자로부터의 지시에 응답하여 애플리케이션을 실행하는 단계를 포함한다. 애플리케이션을 실행하는 동안, 본 방법은 사용 데이터를 수집하는 단계를 추가로 포함한다. 사용 데이터는 적어도, 애플리케이션 내에서 사용자에 의해 수행된 하나 이상의 액션들을 포함한다. 본 방법은 또한, 자동으로, 인간의 개입 없이, 수집된 사용 데이터에 기초하여 적어도 하나의 트리거 조건을 획득하는 단계, 및 적어도 하나의 트리거 조건을, 애플리케이션 내에서 사용자에 의해 수행된 하나 이상의 액션들 중 특정 액션과 연관시키는 단계를 포함한다. 적어도 하나의 트리거 조건이 만족되었다고 결정할 시에, 본 방법은 사용자에게 트리거 조건과 연관된 특정 액션이 이용가능하다는 표시를 제공하는 단계를 포함한다.

Kevin D. Clark

Papers

Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device

Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display

터치 감응형 디바이스 상의 관련 콘텐츠를 사전행동적으로 식별 및 표면화하기 위한 시스템 및 방법