System and method for use of images with recognition analysis

• US 9,678,989 B2
• Filed: 04/10/2015
• Issued: 06/13/2017
• Est. Priority Date: 05/09/2005
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Khan, Azhar, Gokturk, Salih Burak, Shah, Munjal
• Primary Examiner(s): Strege, John
• Application Number:
  US14/683,763
• Publication Number:
  US 20150213062A1
• Time in Patent Office: 795 Days
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06Q 30/0225 Avoiding frauds
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

An index is provided that holds information about each image content item in a collection of items, For each image content item, a first information item identifying the image content item and its location on a network, and at least one of (i) a second information item identifying a signature value of an object in the image content, or (ii) identification of a recognized object in the image content.

Claims

1. A method performed by a system of one or more computers for selecting image content, the method comprising:

performing image analysis on a collection of image content items to obtain information about each image content item, including one or more of (i) identification of one or more objects in one or more image content items, and (ii) identification of a feature for each identified object;

detecting content that is to be used for image selection;

providing, to a user, one or more image selection results from the collection of image content items based on (i) the detected content and (ii) the information obtained from the image analysis;

receiving, from the user, user-input associated with an user-interactable interface element associated with a first image selection result of the one or more image selection results, the user input specifying selection of a parameter indicated by the user-interactable interface element and referring to one or more properties of first image content of the first image selection result; and

providing, to the user, one or more additional image selection results based on (i) the detected content, (ii) the information obtained from the image analysis, and (iii) the selected parameter associated with the first image selection result.

2. The method of claim 1, wherein:

receiving the user input comprises causing a color picker user interface element to be displayed with the first image content and receiving, as a result of the user interacting with the color picker, a particular color; and

providing the one or more additional image selection results comprises performing a search operation to identify one or more additional image content items containing color that matches the particular color.

3. The method of claim 1, wherein:

receiving the user input comprises receiving, from the user, an identification of a key region within the first image content and determining one or more local features within the key region; and

providing the one or more additional image selection results comprises performing a search operation using the local features.

4. The method of claim 1, wherein detecting content for image selection comprises:

receiving a user image content item from the user for selection;

identifying an object of the user image content item; and

forming a criteria for providing the image selection results based on the identified object.

5. The method of claim 4, wherein forming the criteria includes forming a text string criteria that is based on identification of the object.

6. The method of claim 1, wherein detecting content for image selection comprises:

receiving a user text content for selecting image content items from the user; and

forming a criteria for providing the image selection results based on the text content.

7. The method of claim 1, wherein detecting content for image selection comprises:

receiving a user image content item from the user for selection;

identifying text data associated with the image content item; and

forming a criteria for providing the image selection results based on the text data associated with the image content item.

8. The method of claim 1, wherein detecting content for image selection comprises receiving an identifier of image content of a particular merchandise object, and wherein providing the image selection results comprises providing image selection results of different image content items of different merchandise objects based on a determination that the different image content items are similar to the particular merchandise object.

9. The method of claim 1, further comprising providing a link with each of the different image content items of different merchandise objects, wherein the link is selectable to enable the user to purchase the merchandise objects from a network site operated by a merchant.

10. A system comprising:

a computing device; and

a computer-readable medium coupled to the computing device and having instructions stored thereon which, when executed by the computing device, cause the computing device to perform operations comprising

performing image analysis on a collection of image content items to obtain information about each image content item, including one or more of (i) identification of one or more objects in one or more image content items, and (ii) identification of a feature for each identified object;

detecting content that is to be used for image selection;

providing, to a user, one or more image selection results from the collection of image content items based on (i) the detected content and (ii) the information obtained from the image analysis;

receiving, from the user, user-input associated with an user-interactable interface element associated with a first image selection result of the one or more image selection results, the user input specifying selection of a parameter indicated by the user-interactable interface element and referring to one or more properties of first image content of the first image selection result; and

providing, to the user, one or more additional image selection results based on (i) the detected content, (ii) the information obtained from the image analysis, and (iii) the selected parameter associated with the first image selection result.

11. The system of claim 10, wherein:

receiving the user input comprises causing a color picker user interface element to be displayed with the first image content and receiving, as a result of the user interacting with the color picker, a particular color; and

providing the one or more additional image selection results comprises performing a search operation to identify one or more additional image content items containing color that matches the particular color.

12. The system of claim 10, wherein:

receiving the user input comprises receiving, from the user, an identification of a key region within the first image content and determining one or more local features within the key region; and

providing the one or more additional image selection results comprises performing a search operation using the local features.

13. The system of claim 10, wherein detecting content for image selection comprises:

receiving a user image content item from the user for selection;

identifying an object of the user image content item; and

forming a criteria for providing the image selection results based on the identified object.

14. The system of claim 13, wherein forming the criteria includes forming a text string criteria that is based on identification of the object.

15. The system of claim 10, wherein detecting content for image selection comprises receiving an identifier of image content of a particular merchandise object, and wherein providing the image selection results comprises providing image selection results of different image content items of different merchandise objects based on a determination that the different image content items are similar to the particular merchandise object.

16. Non-transitory computer storage media encoded with one or more computer programs, the one or more computer programs comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

performing image analysis on a collection of image content items to obtain information about each image content item, including one or more of (i) identification of one or more objects in one or more image content items, and (ii) identification of a feature for each identified object;

detecting content that is to be used for image selection;

providing, to a user, one or more image selection results from the collection of image content items based on (i) the detected content and (ii) the information obtained from the image analysis;

receiving, from the user, user-input associated with an user-interactable interface element associated with a first image selection result of the one or more image selection results, the user input specifying selection of a parameter indicated by the user-interactable interface element and referring to one or more properties of first image content of the first image selection result; and

providing, to the user, one or more additional image selection results based on (i) the detected content, (ii) the information obtained from the image analysis, and (iii) the selected parameter associated with the first image selection result.

17. The non-transitory computer storage media of claim 16, wherein:

receiving the user input comprises causing a color picker user interface element to be displayed with the first image content and receiving, as a result of the user interacting with the color picker, a particular color; and

providing the one or more additional image selection results comprises performing a search operation to identify one or more additional image content items containing color that matches the particular color.

18. The non-transitory computer storage media of claim 16, wherein:

receiving the user input comprises receiving, from the user, an identification of a key region within the first image content and determining one or more local features within the key region; and

providing the one or more additional image selection results comprises performing a search operation using the local features.

19. The non-transitory computer storage media of claim 16, wherein detecting content for image selection comprises:

receiving a user image content item from the user for selection;

identifying an object of the user image content item; and

forming a criteria for providing the image selection results based on the identified object.

20. The non-transitory computer storage media of claim 16, wherein forming the criteria includes forming a text string criteria that is based on identification of the object.