An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A system includes a processor which has access to a representation of model of activity, which includes workspaces. Each workspace includes domain hierarchies for representing an organizational structure of the collaborating users using the system, and initiatives hierarchies representing process structures for accomplishing goals. An interface permits users to view and modify the workspaces for which the user has access. Each user can have different access permissions in different workspaces. The domain and initiative hierarchies provide two views of the workspace objects without duplicating resources. A resource is a collection of shared elements defined by the users that give users associated with the workspace access to information sources. Users can define knowledge boards for creating reports based on information fields of the resources. The knowledge board is associated with a resource template from which the resource is created.

System for supporting collaborative activity

A portable electronic device displays a plurality of icons (e.g., graphical objects) in a region in a touch-sensitive display; detects a predefined user action, with respect to the touch-sensitive display, for initiating a predefined user interface reconfiguration process; and varies positions of one or more icons in the plurality of icons in response to detecting the predefined user action. The varying includes varying the positions of the one or more icons about respective average positions.

Portable electronic device with interface reconfiguration mode

An Internet appliance, comprising, within a single housing, packet data network interfaces, adapted for communicating with the Internet and a local area network, at least one data interface selected from the group consisting of a universal serial bus, an IEEE-1394 interface, a voice telephony interface, an audio program interface, a video program interface, an audiovisual program interface, a camera interface, a physical security system interface, a wireless networking interface; a device control interface, smart home interface, an environmental sensing interface, and an environmental control interface, and a processor, for controlling a data transfer between the local area network and the Internet, and defining a markup language interface communicated through a packet data network interface, to control a data transfer or control a remote device.

Internet appliance system and method

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

Methods, systems, and computer program products are provided for creating an audio menu describing media content of a media player. Embodiments include retrieving metadata describing the media files managed by the media player; converting at least a portion of the metadata to speech; creating one or more media files for the audio menu; and saving the speech in the audio portion of the one or more the media files for the audio menu.

Audio menus describing media contents of media players

Methods, systems, and computer program products are provided for RSS content administration for rendering RSS content on a digital audio player. Embodiments include retrieving, through an RSS feed, RSS content; extracting text from the RSS content; creating a media file; and storing the extracted text of the RSS content as metadata associated with the media file. Embodiments also typically include extracting one or more images from the RSS content; and storing the extracted images as metadata associated with the media file. Embodiments also typically include extracting text from the RSS content for audio rendering on the digital audio player; converting the text to speech; and recording the speech in the audio portion of the media file. Many embodiments also include storing the media file on a digital audio player; displaying the metadata describing the media file; and playing the audio portion containing the speech.

RSS content administration for rendering RSS content on a digital audio player

Methods, systems, and computer program products are provided for navigating a UAV that include piloting the UAV, under control of a navigation computer, in accordance with a navigation algorithm. While piloting the UAV, embodiments include reading from the GPS receiver a sequence of GPS data, anticipating a future position of the UAV, identifying an obstacle in dependence upon the future position, selecting an obstacle avoidance algorithm, and piloting the UAV in accordance with an obstacle avoidance algorithm. Identifying an obstacle in dependence upon the future position may include comprises retrieving obstacle data from a database in dependence the future position. Identifying an obstacle in dependence upon the future position may also include depicting an anticipated flight of the UAV with 3D computer graphics in dependence upon the future position and identifying an obstacle in dependence upon the depiction of the anticipated flight.

Navigating a uav with obstacle avoidance algorithms

Methods, systems, and products are disclosed for management and rendering of calendar data, including receiving aggregated calendar data in native form, synthesizing the aggregated native form calendar data into a synthesized calendar document including one or more synthesized calendar events, and presenting at least one synthesized calendar event. Synthesizing the aggregated native form calendar data into a synthesized calendar document including one or more synthesized calendar events includes translating aspects of the aggregated native form calendar data into text and markup. Aspects of the aggregated native form calendar data include a calendar event. A calendar event includes date and time information and an event description.

Management and rendering of calendar data

Diagnostic codes from a vehicle or other system in transit are transmitted to an opportunity server, which forwards the codes to a supplemental diagnostic service provider. The diagnostic service provider determines if supplemental diagnostics software functions are available, and if so, downloads them to the vehicle. After executing the supplemental diagnostics, the vehicle reports updated codes to the opportunity server. Multiple cycles of selection, downloading and execution of supplemental diagnostics may be performed until fault isolation is achieved, following which the opportunity server issues requests for bids to potential repair service provides. Responding offers are received, coalesced and presented to the operator. The operator of the vehicle is presented with one or more coalesced offers, upon selection of which, a service is scheduled.

Derral C. Thorson

Papers

Audio menus describing media contents of media players

RSS content administration for rendering RSS content on a digital audio player

Navigating a uav with obstacle avoidance algorithms

Management and rendering of calendar data

Supplemental diagnostic and services resource planning for mobile systems