SYSTEM AND METHOD FOR PROVIDING OBJECTIFIED IMAGE RENDERINGS USING RECOGNITION INFORMATION FROM IMAGES

• US 20110026853A1
• Filed: 06/21/2010
• Published: 02/03/2011
• Est. Priority Date: 05/09/2005
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Shah, Munjal, Vu, Diem, Khan, Azhar, Yang, Danny, Lee, Kuang-Chih, Gokturk, Salih Burak, Anguelov, Dragomir, Vanhoucke, Vincent
• Granted Patent: US 8,139,900 B2
• Time in Patent Office: Days
• US Class Current: 382/305
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/70 Labelling scene content, e.g. deriving syntactic or semantic representations
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.

Claims

1. A method for displaying images to a user, the method comprising:

for stored data corresponding to a captured image, supplementing the stored data with metadata that identifies one or more objects in the captured image; and

rendering the captured image using the stored data and the metadata so that the one or more objects are each selectable; and

performing an action in response to detecting a selection of a given one of the one or more objects.

2. The method of claim 1, wherein performing an action includes displaying a content in response to detecting the selection.

3. The method of claim 2, wherein displaying the content includes displaying information corresponding to the metadata.

4. The method of claim 1, wherein performing an action includes performing a search of other images using a search criteria corresponding to the given one of the one or more objects.

5. The method of claim 4, wherein the search criteria is based on text data associated with the given one of the one or more objects.

6. The method of claim 4, wherein the search criteria is based on recognition information determined from the given one of the one or more objects.

7. The method of claim 1, further comprising storing the data in a header of a file of the captured image.

8. The method of claim 1, wherein supplementing the stored data includes providing the metadata in a separate file in association with a file of the captured image.

9. The method of claim 2, wherein displaying a content in response to detecting the selection includes displaying additional information about the selected object, wherein the additional information is identified from the metadata.

10. The method of claim 2, wherein displaying a content in response to detecting the selection includes identifying other captured images that contain the selected object.