Method and system for mining image searches to associate images with concepts

• US 9,563,646 B1
• Filed: 11/21/2011
• Issued: 02/07/2017
• Est. Priority Date: 05/10/2004
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Chan, Wesley T., Agarwal, Sumit, Ranganath, Rama, Wiseman, Leora Ruth, Jindal, Deepak
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): Ludwig, Matthew
• Application Number:
  US13/301,532
• Time in Patent Office: 1,905 Days
• Field of Search: 715/253, 715/273, 715/203, 705/14.25, 705/14.49
• US Class Current: 1/1
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/90335 Query processing
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06Q 30/0224 based on user history
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0256 User search
• CPC Class Codes: G06Q 30/0271 Personalized advertisement
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

A system and method for associating a document with a concept are provided. One or more idea-electronic document associations is identified, wherein each idea-electronic document association is based on a user performance criteria relative to the electronic document and the idea. At least one of the one or more electronic documents is identified with a concept based on the one or more idea-electronic document associations, wherein the concept is related to the one or more ideas.

Claims

1. A computer-implemented method, comprising:

providing a database of images and a textual description of the contents of a given image;

receiving a search query from a user for retrieving an image associated with a subject matter of interest to the user from the database;

evaluating the database including comparing the search query to the textual description of the contents of a given image including automatically providing a plurality of images from the database to the user based on the query;

receiving a selection of one of the plurality of images from the user;

creating, using at least one processor, an association between the selected image and a concept including storing the association, wherein the concept is related to the subject matter of interest;

after creating the association, receiving a request from another user for creating an image advertisement;

determining that the request is related to the concept;

suggesting the selected image for the image advertisement using the stored association and based at least in part on determining that the request is related to the concept;

creating the image advertisement using the selected image; and

storing the created image advertisement including storing the created image advertisement in association with the concept.

2. The computer-implemented method of claim 1, further comprising:

creating, using the at least one processor and in response to receiving the selection of the one of the plurality of images from the user, a second association between the concept and an electronic document to which the selected image is linked; and

storing the second association.

3. The computer-implemented method of claim 1, wherein receiving the selection of the one of the plurality of images from the user comprises identifying that a user input selected the one of the plurality of images from a presentation of a web page that includes at least some of the plurality of images as search results that are determined to be responsive to the query.

4. The computer-implemented method of claim 1, further comprising determining the concept based at least on one or more terms that are included in the search query.

5. The computer-implemented method of claim 1, wherein a first image among the plurality of images comprises an animated image.

6. The computer-implemented method of claim 1, wherein:

the textual description of the contents of the given image in the database comprises a title of the given image; and

comparing the search query to the textual description of the contents of the given image comprises comparing the search query to the title of the given image.

7. The computer-implemented method of claim 1, further comprising receiving the textual description of the contents of the given image in the database from an advertiser that provided the given image to be stored in the database.

8. A system comprising:

one or more processors; and

one or more computer-readable media having instructions stored thereon that, when executed by the one or more processors, cause performance of operations comprising;

providing a database of images and a textual description of the contents of a given image;

receiving a search query from a user for retrieving an image associated with a subject matter of interest to the user from the database;

evaluating the database including comparing the search query the textual description of the contents of a given image including automatically providing a plurality of images from the database to the user based on the query;

receiving a selection of one of the plurality of images from the user;

creating an association between the selected image and a concept including storing the association, wherein the concept is related to the subject matter of interest;

after creating the association, receiving a request from another user for creating an image advertisement;

determining that the request is related to the concept;

suggesting the selected image for the image advertisement using the stored association and based at least in part on determining that the request is related to the concept;

creating the image advertisement using the selected image; and

storing the created image advertisement including storing the created image advertisement in association with the concept.

9. The system of claim 8, wherein the operations further comprise:

creating, in response to receiving the selection of the one of the plurality of images from the user, a second association between the concept and an electronic document to which the selected image is linked; and

storing the second association.

10. The system of claim 8, wherein receiving the selection of the one of the plurality of images from the user comprises identifying that a user input selected the one of the plurality of images from a presentation of a web page that includes at least some of the plurality of images as search results that are determined to be responsive to the query.

11. The system of claim 8, wherein the operations further comprise determining the concept based at least on one or more terms that are included in the search query.

12. The system of claim 8, wherein a first image among the plurality of images comprises an animated image.

13. The system of claim 8, wherein:

the textual description of the contents of the given image in the database comprises a title of the given image; and

comparing the search query to the textual description of the contents of the given image comprises comparing the search query to the title of the given image.

14. The system of claim 8, wherein the operations further comprise receiving the textual description of the contents of the given image in the database from an advertiser that provided the given image to be stored in the database.

15. A computer-implemented system, comprising:

an input device enabled to generate an idea-image association that associates an image with an idea based on data that indicates user interaction with the image in a presentation of search results that correspond to a first search query, wherein the idea is determined to be related to the first search query;

a database enabled to store the idea-image association and other idea-image associations; and

a processor enabled to provide the image for display in a presentation of search results that correspond to a different, second search query, wherein the processor is enabled to select the image for display in the presentation of search results that correspond to the second search query based on (i) determining that the second search query relates to the idea and (ii) identifying from the stored idea-image association that a match exists between the idea that the second search query relates to and the idea to which the image is associated.

16. The system of claim 15, wherein the processor is further enabled to determine that the second search query relates to the idea by correlating the idea with a concept described by the search query.

17. The system of claim 15, wherein the system is further enabled to provide the image in the presentation of search results based at least on a determined relevance of a textual description of the image to the first search query.

18. The system of claim 15, wherein the input device is further enabled to:

compare the image with a second image to determine whether the image and the second image depict similar content; and

in response to determining that the image and the second image depict similar content, generate a second idea-image association that associates the second image with the idea.