Showing papers by "Hartwig Adam published in 2013"

Associating classifications with images

Abstract: One or more devices may receive multiple images; determine one or more classifications for each of the multiple images; generate a confidence score for each classification of the one or more classifications for each of the multiple images. The confidence score may include a value between two numbers and may identify the likelihood that that a particular classification, of the one or more classifications, correctly corresponds to a particular image, of the multiple images. The confidence score may be based on information, associated with a user, and pixel-based classification information. The one or more devices may sort the multiple images by the one or more classifications and by corresponding confidence scores to form sorted multiple images; and provide the sorted multiple images.

Scene classification for place recognition

Abstract: Aspects of the invention pertain to identifying whether or not an image from a user's device is of a place. Before undertaking time and resource consuming analysis of an image using specialized image analysis modules, pre-filtering classification is conducted based on image data and metadata associated with the image. The metadata may include geolocation information. One classification procedure analyzes the metadata to perform a high level determination as to whether the image is of a place. If the results indicate that it is of a place, then a further classification procedure may be performed, where the image information is analyzed, with or without the metadata. This process may be done concurrently with a place match filtering procedure. The results of the further classification will either find a match with a given place or not. The output is a place match either with or without geolocation information.

Systems and Methods for Visual Object Matching

Abstract: Systems and methods for improving visual object recognition by analyzing query images are disclosed. In one example, a visual object recognition module may determine query images matching objects of a training corpus utilized by the module. Matched query images may be added to the training corpus as training images of a matched object to expand the recognition of the object by the module. In another example, relevant candidate image corpora from a pool of image data may be automatically selected by matching the candidate image corpora against user query images. Selected image corpora may be added to a training corpus to improve recognition coverage. In yet another example, objects unknown to a visual object recognition module may be discovered by clustering query images. Clusters of similar query images may be annotated and added into a training corpus to improve recognition coverage.

Using sensor inputs from a computing device to determine search query

Abstract: An image input is obtained from a computing device when an image sensor of the computing device is directed to a scene. At least an object of interest in the scene is determined, and a label is determined for the object of interest. A search input is received from the computing device, where the search input is obtained from a mechanism other than the image sensor. An ambiguity is determined from the search input. A search query is determined that augments or replaces the ambiguity based at least in part on the label. A search result is based on the search query.

System and method for associating images with semantic entities

Abstract: A system and computer-implemented method for associating images with semantic entities and providing search results using the semantic entities. An image database contains one or more source images associated with one or more images labels. A computer may generate one or more documents containing the labels associated with each image. Analysis may be performed on the one or more documents to associate the source images with semantic entities. The semantic entities may be used to provide search results. In response to receiving a target image as a search query, the target image may be compared with the source images to identify similar images. The semantic entities associated with the similar images may be used to determine a semantic entity for the target image. The semantic entity for the target image may be used to provide search results in response to the search initiated by the target image.

Presenting image search results

Abstract: A system and computer-implemented method is provided for organizing multiple user submitted results responsive to an image query. A plurality of content submissions may be received from a variety of submitting users, each content submission including an image and an associated label. An image query may provide an image of an object as a request to identify the object. In response to receiving the image query, one or more results of the plurality of content submissions may be identified. A similarity between the labels for each of the one or more results may be determined and used to group the one or more results. Grouped results may be ranked and sorted for accurate and concise presentation to a querying user.

Determining location information for images using landmark, caption, and metadata location data

Abstract: Methods, systems, and apparatus are provided for determining location information for images In one aspect, a method includes obtaining landmark location data from content depicted in an image and corresponding confidence scores Also, the method includes obtaining caption location data from user input and corresponding confidence scores, and obtaining metadata location data from data provided by an image capturing device Further, the method includes identifying location pairs from the landmark, caption, and metadata location data, and generating, for each location pair, a geographic consistency score Additionally, the method includes selecting a location pair based on the geographic consistency scores, and selecting an image location for the image from the selected location pair Moreover, the method includes determining an image location score based on a confidence score for one of the locations in the selected location pair, and associating the image location and image location score with the image

Scoring images related to entities

Abstract: Methods, systems, and apparatus for scoring images related to entities. In one aspect, a method includes identifying images associated with a person, each image being included in one or more resources; obtaining, for each resource that includes one of the images, a quality score that represents a quality of the resource; for each of the images: generating an image resource quality score from the quality scores of the resources that include the image; identifying a set of similar images from the images, each similar image having a measure of similarity to the image that meets a similarity measure threshold; generating an image score based on image resource quality scores of the resources that include the similar images relative to image resource quality scores of the resources that include each of the images; and generating an image authority score based on the image resource quality score and the image score.