An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A digital image of the object is captured and the object is recognized from plurality of objects in a database. An information address corresponding to the object is then used to access information and initiate communication pertinent to the object.

Image Capture and Identification System and Process

Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Smartphone-based methods and systems

A system and method for automatically providing content associated with captured information is described. In some examples, the system receives input by a user, and automatically provides content or links to content associated with the input. In some examples, the system receives input via text entry or by capturing text from a rendered document, such as a printed document, an object, an audio stream, and so on.

Automatically providing content associated with captured information, such as information captured in real-time

Aspects of the present invention relate to a compact optics module for a head mounted display including a DLP image source comprising a polarized light source providing illumination light, a flat reflective polarizer to reflect the illumination light toward the DLP image source and transmit image light, wherein the illumination light is provided at an angle to the DLP, a quarter wave retarder to change the polarization state of the illumination light as it is reflected by the DLP image source thereby providing image light, at least one light trap to absorb a portion of off-state image light, a lens element to provide a viewable field of view of on-state image light in an image displayed by the DLP image source, and a combiner to reflect the on-state image light toward a user's eye and provide a see-through view of a surrounding environment.

See-through computer display systems

A system and method for associating rendered advertisements with digital content is described. In some examples, the system receives an image of a rendered advertisement, information associated with digital content, and information associating the rendered advertisement with the digital content via a web portal.

Associating rendered advertisements with digital content

Disclosed herein are methods and systems that involve monitoring presence of items based on context. An exemplary method involves: (i) determining a context for a given user; (ii) determining a proximity framework between a monitoring device and one or more items, based on the determined context, wherein the proximity framework comprises (a) one or more proximity requirements, each proximity requirement indicating a required proximity between the monitoring device and at least one of the items and (b) a notification process corresponding to each proximity requirement; (iii) monitoring proximity of each of the items relative to the monitoring device, based on a presence signal from each of the items, in order to determine when one of the proximity requirements is not met; and (iv) responsive to determining that one of the proximity requirements is not met, initiating the corresponding notification process.

Device and method for monitoring the presence of items and issuing an alert if an item is not detected

Disclosed herein are methods, devices, and systems that may enable a touch-based interface to receive dynamic user inputs based on pressure. An exemplary method may involve: (a) detecting a touch interaction including an increase in pressure greater than a first threshold pressure-increase followed by a reduction in pressure greater than a threshold pressure-reduction; and (b) responsive to detecting the touch interaction, initiating an operation based on a region of the touch-based interface that corresponds to the touch interaction, wherein the operation is associated with the touch interaction.

Dynamic Input At A Touch-Based Interface Based On Pressure

A system and method for authorizing access to computing resources, access to services, software and so on, based on capturing information associated with a request is described.

Claes-Fredrik Mannby

Papers

Automatically providing content associated with captured information, such as information captured in real-time

Associating rendered advertisements with digital content

Device and method for monitoring the presence of items and issuing an alert if an item is not detected

Dynamic Input At A Touch-Based Interface Based On Pressure

Accessing resources based on capturing information from a rendered document