An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

The various methods and devices described herein relate to devices which, in at least certain embodiments, may include one or more sensors for providing data relating to user activity and at least one processor for causing the device to respond based on the user activity which was determined, at least in part, through the sensors. The response by the device may include a change of state of the device, and the response may be automatically performed after the user activity is determined.

Automated Response to and Sensing of User Activity in Portable Devices

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Method and apparatus for building an intelligent automated assistant

Among other things, techniques and systems are disclosed for implementing contextual voice commands. On a device, a data item in a first context is displayed. On the device, a physical input selecting the displayed data item in the first context is received. On the device, a voice input that relates the selected data item to an operation in a second context is received. The operation is performed on the selected data item in the second context.

Contextual voice commands

A computer program for execution on a computing device is provided to cross-train students in language development skills such as letter-word correspondence, word recognition, vocabulary, and sentence and paragraph comprehension. A set of programs provide an adaptive methodology for training a student in decoding (semantic, syntactic, phonological, and morphological relationships), knowledge of rhymes, synonyms, antonyms, and homophones, spelling, letter-word correspondences, sentence comprehension, grammatical comprehension, working memory, vocabulary, paragraph comprehension, and improved reading comprehension. In each program, students are presented with an animated scene that poses a question, and a set of answers. The set of answers contain a correct response, and a number of incorrect responses or foils. The student advances to more complex levels by satisfying predetermined correct thresholds. Through repetition and intensity, the student's language skills are developed.

Method and apparatus for automated training of language learning skills

Methodologies for improving a student's phonemic awareness, decoding, spelling, oral and written comprehension are described herein. The method is embodied in a suite of twelve exercises operable on a computing device. The exercises are geared towards training of 1st and 2nd grade students but are not limited to that. The methods present an entertaining screen environment, with target stimulus, and foil or distracter stimulus presented visually, textually, and aurally. The student is required to identify the target stimulus from the distracter stimulus within the context of each exercise. Progress from easier trials to more difficult trials is made as the student successfully completes particular difficulty levels.

Method for developing cognitive skills in reading

System and method for developing cognitive skills in a student, utilizing a computing device to present stimuli and to record responses. A stimulus may be graphically presented to the student via the computing device, and the student may be required to respond to the stimulus. A determination may then be made as to the correctness of the student's response. The graphically presenting, requiring, and determining may be performed for each of a plurality of stimuli. Additionally, the graphically presenting, requiring, determining, and performing may be performed in an iterative manner to improve the cognitive skills of the student. Various exercises directed to different cognitive skills and learning approaches may utilize this basic framework, and may be performed in an iterative manner to build cognitive skills in the student.

Logan E. De Ley

Papers

Method and apparatus for automated training of language learning skills

Method for developing cognitive skills in reading

Method and apparatus for building skills in constructing and organizing multiple-paragraph stories and expository passages

Method for developing cognitive skills using spelling and word building on a computing device

Method and apparatus for developing cognitive skills