A digital image of the object is captured and the object is recognized from plurality of objects in a database. An information address corresponding to the object is then used to access information and initiate communication pertinent to the object.

Image Capture and Identification System and Process

Head-worn adaptive display

Context-aware and location-aware cellular phones and methods are described. In one embodiment, cellular phones are configured to wirelessly receive information that pertains to their current context or location. The phones then automatically use the information to modify one or more cellular phone behaviors, e.g. by turning the phone off, changing the ringer's pitch, or placing the phone in a vibrate mode. In one particular embodiment, various location types are defined and have associated attributes that define a desired cellular phone behavior. One or more transmitters at a location for which a behavior is desired transmit information that pertains to the location's class type. The cell phones can carry an association of class types and their behaviors so that when the phones receive the class type information, they can automatically adjust their behavior.

Context-aware and location-aware cellular phones and methods

An eyepiece includes a mechanical frame adapted to secure a lens and an image source facility above the lens. The image source facility includes an LED, a planar illumination facility and a reflective display. The planar illumination facility converts a light beam from the LED received on a side of the planar illumination facility into a top emitting planar light source, uniformly illuminates the reflective display, and is substantially transmissive to allow reflected light to pass through towards a beam splitter. The beam splitter is positioned to receive the image light and to reflect a portion onto a mirrored surface. The mirrored surface is positioned and shaped to reflect the image light into an eye of a user of the eyepiece thereby providing an image within a field of view, the mirrored surface further adapted to be partially transmissive within an area of image reflectance.

Eyepiece with uniformly illuminated reflective display

A device can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video. An information layer can be generated related to the objects. In some implementations, the information layer can include annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device. Data can be received from one or more onboard sensors indicating that the device is in motion. The sensor data can be used to synchronize the live video and the information layer as the perspective of video camera view changes due to the motion. The live video and information layer can be shared with other devices over a communication link.

Synchronized, interactive augmented reality displays for multifunction devices

The present invention is generally concerned with electronic vision devices and methods, and is specifically concerned with image augmentation in combination with navigation, position, and attitude devices. In the simplest form, devices of the invention can be envisioned to include six major components: A 1) camera to collect optical information about a real scene and present that information as an electronic signal to; a 2) computer processor; a 3) device to measure the position of the camera; and a 4) device to measure the attitude of the camera (direction of the optic axis), thus uniquely identifying the scene being viewed, and thus identifying a location in; a 5) data base where information associated with various scenes is stored, the computer processor combines the data from the camera and the data base and perfects a single image to be presented at; a 6) display whose image is continuously aligned to the real scene as it is viewed by the user. The present invention is a vision system including devices and methods of augmented reality wherein an image of some real scene is altered by a computer processor to include information from a data base having stored information of that scene in a storage location that is identified by the real time position and attitude of the vision system. It is a primary function of the vision system of the invention, and a contrast to the prior art, to present augmented real images and data that is continuously aligned with the real scene as that scene is naturally viewed by the user of the vision system. An augmented image is one that represents a real scene but has deletions, additions and supplements.

Electro-optic vision system which exploits position and attitude

The systems combine images of a real scene with computer generated imagery where the computer generated imagery is particular to the position and pointing attitude of the device. Being useful to spectators of the game baseball, the device can produce images showing where a strike zone is relative to the position of the players; can produce images of ball tracks; of replays and many other forms of information having characteristics dependent on a viewer's position and attitude.

Vision system for viewing a sporting event

The present invention is generally concerned with electronic vision devices (1) and methods, and is specifically concerned with image augmentation in combination with navigation, position, and attitude devices. In the simplest form, devices (1) of the invention include six major components: a camera, a computer processor, devices to measure the position and attitude of the camera, a data base for storing information associated with various scenes, and a display (1) where an image (3) is continuously aligned to a real scene as viewed by a user (2). In the present invention, an image of some real scene is altered by a computer processor to include stored information of a scene in a storage location identified by real time position and attitude of the vision system (1). The primary function of the invention is to present augmented real images (3), or images that represent a real scene but have deletions, additions, and supplements, and data that is continuously aligned with the real scene as naturally viewed by the user (2) of the system.

Electro-optic vision systems which exploit position and attitude

Vision systems having knowledge of position and attitude can reliably determine what scenes are being addressed by the system. Real images of the scene can then be augmented with computer generated information which relates to the known scene. A determination of position and attitude of the device identifies which scene is being addressed. A computer recalls information regarding the scene and generates imagery according to that recalled information. The computer generated imagery is then combined with an image of the scene to form an augmented image which is presented to the user aligned to the viewing direction of the device.

John Ellenby

Papers

Electro-optic vision system which exploits position and attitude

Vision system for viewing a sporting event

Electro-optic vision systems which exploit position and attitude

Vision imaging devices and methods exploiting position and attitude