An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.

Intuitive computing methods and systems

A system, method, and computer program product for processing data are described herein. The system maintains first databases of patents, and second databases of non-patent information of interest to a corporate entity. The system also maintains one or more groups. Each of the groups comprises any number of the patents from the first databases. The system, upon receiving appropriate operator commands, automatically processes the patents in one of the groups in conjunction with non-patent information from the second databases. Accordingly, the system performs patent-centric and group-oriented processing of data. A group can also include any number of non-patent documents. The groups may be product based, person based, corporate entity based, or user-defined. Other types of groups are also covered, such as temporary groups. The processing automatically performed by the system relates to (but is not limited to) patent mapping, document mapping, patent citation (both forward and backward), patent aging, patent bracketing/clustering (both forward and backward), inventor patent count, inventor employment information, patent claim tree analysis, and finance. Other functions and capabilities are also covered, including the ability to utilize hyperbolic trees to visualize data generated by the system, method, and computer program product.

Using hyperbolic trees to visualize data generated by patent-centric and group-oriented data processing

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A method is provided for modifying an image. The method comprises displaying an image, the image comprising a portion of an object; and determining if an edge of the object is in a location within the portion. The method further comprises detecting movement, in a member direction, of an operating member with respect to the edge. The method still further comprises moving, if the edge is not in the location, the object in an object direction corresponding to the detected movement; and modifying, if the edge is in the location, the image in response to the detected movement, the modified image comprising the edge in the location.

Information processing apparatus, information processing method and program

Aspects of the present disclosure relate to the sharing of synchronization information corresponding to content among devices in a communication network. An originating device collects synchronization information related to the presentation of content to a user via the originating device. The synchronization information is defined according to reference points related to the presentation of the content to the user via the originating device, including a current state of the presentation of the content and/or additional information obtained during the presentation of the content. Based on detection of a synchronization event, the originating device transmits the collected synchronization information, resulting in the receipt of the synchronization information by one or more receiving devices. Thereafter, the presentation of the content to the user on one of the receiving devices can incorporate the synchronization information collected and transmitted by the originating device.

Synchronization of digital content

A robotic device can provide power management and other functionality for various electronic devices. An electronic device and the robotic device can communicate information such as device charge level, relative position and rate of power consumption and can determine an appropriate time at which the robotic device should cause the electronic device to be charged, either by charging the device directly or transporting the device to an appropriate charger. The robotic device can also cause other functions to be performed as well, such as to enable high-bandwidth data transfer or perform resource-intensive activities when in communication with the electronic device. The robotic device can transport the electronic device to specific locations or to specific users, or as otherwise appropriate.

Charging an electronic device including traversing at least a portion of a path with an apparatus

A system and method for facilitating transactions utilizing phrase tokens are provided. Individual entities can be associated with unambiguous transaction phrase tokens, such as multiple word phrases. The transaction phrase tokens are associated with transaction accounts by a service provider such that the entities can complete a transaction without having to exchange transaction account information. In a transaction, a transaction phrase token is offered to an accepting party, which tenders the offered transaction phrase token to the service provider. The service provider processes the offered transaction phrase token according to configuration information specified for the transaction phrase token. The service provider can automatically process the transaction request or request additional information.

Utilizing phrase tokens in transactions

Techniques for navigating through a user interface with a force-sensitive touch sensor are described. In some implementations, the force-sensitive touch sensor is also a display that presents the user interface. Touches on the force-sensitive touch sensor may be interpreted as indicating a vector direction based on the location of the touch and a vector magnitude based on the force of the touch. For instance, when a user navigates through a collection of photographs on a device having a force-sensitive touch sensor, the vector direction may determine if the user is scrolling forwards or backwards through the photographs and the vector magnitude may determine how rapidly the scrolling occurs. The user may also navigate through a hierarchy of folders and files using touch and force. Selection of a folder and application of force exceeding a threshold may result in display of the contents of a most commonly accessed subfolder or file.

Touch and force user interface navigation

A computing device can monitor the gaze direction of people around the device to determine whether any unintended viewers are viewing content displayed on the device. A user can activate a privacy mode of the device, such that when an unintended viewer is detected the device can take an appropriate action. In some cases the device can notify the primary user of the device using audible, visual, or tactile alerts. In other cases, the device can modify the display of content such that the unintended viewer is unable to decipher or view the content, or is otherwise notified of the detection.

Ian W. Freed

Papers

Synchronization of digital content

Charging an electronic device including traversing at least a portion of a path with an apparatus

Utilizing phrase tokens in transactions

Touch and force user interface navigation

Viewer-based device control