An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A method and apparatus for displaying the evolution of an electronic document (e.g. word-processing document, portable-document-format file, spreadsheet, drawing, and the like), containing tracked changes, is disclosed. In accordance with the disclosed method and apparatus, the revisions of an electronic document may be treated as parent frames. In between the parent frames, child frames may be constructed from the combined images of their parent frames. To form a child frame, an image of a parent frame has a degree of translucency as it is combined with the translucent image of the other parent frame, such that every child frame contains traces of the images of both its parent frames. An input device (e.g. keyboard, mouse, touchpad, stylus, voice activation, and the like) may be used to control the frame visible to the user at any one time. The user may use the input device to traverse the frames at various speeds and in either direction, creating the visual illusion that a certain revision of the document is being morphed into its future revisions—or stripped off its changes as it is morphed into previous revisions—depending on the direction chosen by the user.

Method for presentation of revisions of an electronic document

Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Smartphone-based methods and systems

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Method and apparatus for building an intelligent automated assistant

A method, operating model, system, data structure, computer program and computer program product for analyzing and categorizing unstructured information is provided such that conventional structured data access techniques can be utilized over unstructured objects A analysis and categorization engine builds a set of concept groupings, each grouping consisting of related words and phrases The concept groupings are augmented by user input A set of categories is built The analysis and categorization engine generates a vector representation of each object based on concepts and utilizes a statistical analysis to select concepts that represent each object and assign objects to categories Information about users, objects, and categories is stored in an open architecture, such as a relational database An object concept based search is provided to efficiently locate meaningful objects and to provide for updating of the object categorization based on search entries

Concept-based method and system for dynamically analyzing unstructured information

A method, operating model, system, data structure, computer program and computer program product for analyzing and categorizing and exploring or querying unstructured information and for tracking trends and exceptions. Method for analytical processing of unstructured objects in a dimensional space. Method for tracking trends in concepts. Method for tracking exceptions in concepts. Tools and interface for displaying concepts, query results, tracked trends and exceptions.

Method, system, and computer program product for concept-based multi-dimensional analysis of unstructured information

Concept-based categorization of unstructured objects

A method and system for analyzing and categorizing unstructured information and for tracking trends and exceptions by using a user's selection of a key concept, wherein the key concept is one or more words or phrases present in the content of an unstructured object that represent an unstructured object.

Rengaswamy Mohan

Papers

Concept-based method and system for dynamically analyzing unstructured information

Method, system, and computer program product for concept-based multi-dimensional analysis of unstructured information

Concept-based categorization of unstructured objects

Concept-based trends and exceptions tracking

Concept-based searching of unstructured objects