Dynamic definitive image service

• US 9,449,028 B2
• Filed: 12/30/2011
• Issued: 09/20/2016
• Est. Priority Date: 12/30/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hamilton, Justin, Ma, Troy, Wu, Kun, Lang, Bing, Sheng, Xiaowei, Vemuluru, Avinash, Borza, Paul
• Primary Examiner(s): Mahmoudi, Tony
• Assistant Examiner(s): NGUYEN, MERILYN P
• Application Number:
  US13/340,721
• Publication Number:
  US 20130173603A1
• Time in Patent Office: 1,726 Days
• Field of Search: 707/723, 707/749
• US Class Current: 1/1
• CPC Class Codes: G06F 16/20 of structured data, e.g. relational data
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information

Abstract

Systems and methods for identifying a representative image for any given search query are provided. In response to a search for a query term (or terms), the system accesses an inverted index to identify images associated with that term. The system then receives a ranked list of images. The ranked list includes image identifiers, and once an item in the list is selected the system can use the associated image identifier to retrieve the image from a server. If an editor has overridden the default image for the present search query, then the system returns the image identifier for the overridden image, which can be used to access the image from the server. Thus, the representative image system provides a reliable and universal mechanism for retrieving representative images for any given topic dynamically in real time.

Claims

1. A computer system for providing a dynamic definitive image service, the system comprising:

a processor and memory configured to execute software instructions embodied within the following components;

an image data store that stores one or more images or references to images stored in other data stores;

an image request component that receives a request during a query for a definitive image that is representative of a topic of the query;

an inverted index component that maintains an inverted index that maps one or more query terms to one or more images that are related to those terms;

an image ranking component that ranks one or more images identified in the index that potentially match the query terms to sort identified images by a relative likelihood of being a definitive image for the topic of the query;

an editorial override component that provides an interface through which a human editor can manually override the definitive image selected by other components of the system to identify an editor-chosen definitive image;

an image selection component that selects a definitive image based on images returned from the index, any overridden editor-chosen definitive image, and ranking input from the image ranking component;

a thumbnail retrieval component that retrieves an image binary associated with the selected definitive image based on a definitive image identifier provided by the image selection component; and

an image response component that responds to the received image request with the retrieved image binary.

2. The system of claim 1 wherein the image request component receives the request and invokes the inverted index component to find one or more images potentially matching the request, the image ranking component to rank potentially matching images based on relevance and quality, the editorial override component to identify any additional images provided by editors, the image selection component to select one among the potentially matching images as a definitive image, and the thumbnail retrieval component to access the selected image from the image data store.

3. The system of claim 1 wherein the image request component operates on top of an existing search engine to service requests for definitive images in addition to requests for image or other types of searches already handled by the search engine.

4. The system of claim 1 wherein the inverted index component is updated by crawling a network and identifying metadata near images that provides context information related to the image.

5. The system of claim 1 wherein the inverted index component provides an index shared between a search engine service for finding multiple images in response to a search query and a search engine service for finding a single definitive image related to a search query.

6. The system of claim 1 wherein the image ranking component applies a neural net ranker that factors in information on an authoritativeness of a source of the image and quality of the image to identify which of the images among all of the potential images is most likely to be a definitive image for the topic of the query.

7. The system of claim 1 wherein the image selection component provides as output a single definitive image that represents the topic of the query received in the image request.

8. A computer-implemented method to access a definitive image, the method comprising:

storing, in an image data store, one or more images or references to images stored in other data stores;

receiving a request during a query for the definitive image that is representative of a topic of the query;

maintaining an inverted index of images that maps one or more query terms to one or more images that are related to the one or more query terms;

ranking one or more images identified in the inverted index that potentially match the query terms to sort the identified one or more images by a relative likelihood of being the definitive image for the topic of the query;

selecting the definitive image based on one or more images returned from the inverted index, any overridden editor-chosen definitive image, and the ranking, wherein the editor-chosen definitive image is identified by manually overriding a system selected definitive image from a human editor;

retrieving an image binary associated with the selected definitive image based on an image identifier associated with the selected definitive image; and

sending the retrieved image binary associated with the selected definitive image in response to the received request;

wherein the preceding steps are performed by at least one processor.

9. The method of claim 8 wherein receiving the request comprises receiving a query string associated with the topic.

10. The method of claim 8 wherein receiving the request comprises receiving information indicating a requested quality level of the requested definitive image.

11. The method of claim 8 further comprising accessing a hash table of a store of editorial overrides according to the topic for efficiently looking up editorial overrides for definitive images.

12. The method of claim 8 wherein maintaining the inverted index of images comprises leveraging an existing inverted index used for responding to general image search requests that identify multiple matching images for a particular query.

13. The method of claim 8 wherein ranking one or more images identified in the inverted index comprises ranking based on each image'"'"'s resolution and authority information associated with a source of the image.

14. The method of claim 8 wherein ranking one or more images identified in the inverted index comprises applying neural net ranking to determine a most relevant match among the one or more identified images.

15. The method of claim 8 wherein selecting the definitive image comprises identifying the image identifier that corresponds to the selected definitive image.

16. The method of claim 8 wherein retrieving the image binary comprises submitting a request to the image data store with the image identifier of the selected definitive image and receiving a response from the image data store with the image binary.

17. The method of claim 8 wherein retrieving the image binary comprises providing image quality level information so that the image data store can return a matching stored version of the selected definitive image.

18. The method of claim 8 wherein sending the retrieved image binary comprises sending the retrieved image binary with other non-definitive images that are responsive to a general image search request for the topic.

19. Computer-readable media encoded with computer-readable instructions which, when executed by a processor on a computing system, carry out a method for providing a definitive image, the method comprising:

storing, in an image data store, one or more images or references to images stored in other data stores;

receiving a request during a query for the definitive image that is representative of a topic of the query;

maintaining an inverted index of images that maps one or more query terms to one or more images that are related to the one or more query terms;

ranking one or more images identified in the inverted index that potentially match the query terms to sort the identified one or more images by a relative likelihood of being the definitive image for the topic of the query;

selecting the definitive image based on one or more images returned from the inverted index, any overridden editor-chosen definitive image, and the ranking, wherein the editor-chosen definitive image is identified by manually overriding a system selected definitive image from a human editor;

retrieving an image binary associated with the selected definitive image based on an image identifier associated with the selected definitive image; and

sending the retrieved image binary associated with the selected definitive image in response to the received request.

20. The computer-readable media of claim 19, wherein receiving the request comprises receiving a query string associated with the topic.