Ranking content based on relevance and quality

• US 7,836,050 B2
• Filed: 01/25/2006
• Issued: 11/16/2010
• Est. Priority Date: 01/25/2006
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ma, Wei-Ying, Zhang, Lei, Jing, Feng
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): Bullock; Joshua
• Application Number:
  US11/339,295
• Publication Number:
  US 20070174872A1
• Time in Patent Office: 1,756 Days
• Field of Search: 707/3, 707/728, 382/305
• US Class Current: 707/728
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/538 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4826 using recommendation lists, e.g. of programs or channels sorted out according to their score
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

A method and system for ranking content and providing a user interface for viewing the content is provided. The content system ranks content in a search result based on a combination of relevance of the content to a query and quality of the content. The content system may derive the quality of content by analyzing ratings provided by various content forums. The content system may use metadata provided by a content forum when searching for content that matches a query. The content system generates a rank score that combines the relevance and quality of the content and ranks the content according to the rank scores.

Claims

1. A computing system for ranking items of results, the items being images stored at a plurality of image forums that allow users to upload images and to provide ratings of the images, comprising:

a result store providing an indication of the items of a result of a query of words, the items of the result having been identified as matching the query after the query was received;

a relevance store providing a relevance for each item of the result, the relevance being based on comparison of the words of the query to words associated with the items, the relevance of the items indicating a ranking of the items;

a quality store providing a quality for each item of the result, the quality being independent of the query, being determined before the query was received, and being based on a rating of the items provided by users of the image forums who reviewed the items, the quality being derived from a normalization of the ratings of images of the image forums to account for differences in rating scales and rating criteria of the image forums; and

a generate score component that generates a score for each item based on a combination of the relevance and the quality for the item, the generated scores indicating a re-ranking of the items to factor in the quality of the items as derived from the image forums.

2. The system of claim 1 wherein the items of the result are selected based on a user query and the relevance of an item is based on relatedness of the item to the user query.

3. The system of claim 1 including a display component that displays an indication of the items in an order based on the generated scores.

4. The system of claim 3 wherein the items are images and the indication of an image is a thumbnail of the image and wherein the display component displays a fisheye view of the images when a user selects an image.

5. The system of claim 1 wherein the ratings of duplicate images from different image forums are used to generate a transform for ratings of different image forums.

6. A computer-readable medium containing instructions for controlling a computing system to rank images of a result of a query, by a method comprising:

for each of a plurality of image forums that allow users to upload images and reviewers to provide ratings of the images, collecting metadata associated with images of the image forum, an image forum being a web server that allows users to upload images and reviewers to provide ratings of the uploaded images, the metadata of an image including a rating of quality of the image and information describing the image, the rating of the quality of an image being provided by a reviewer of the image;

normalizing the ratings of quality across the plurality of image forums to account for differences in rating scales and rating criteria of the image forums; and

after collecting the metadata,

receiving a query having words;

identifying images of the plurality of image forums as the result of the query based on comparison of words of the query to the information describing the images;

determining relevance of each identified image to the query based on similarity between words of the query and the information describing the identified image;

determining a quality for each image of the result of the query based on the normalized ratings of quality across the plurality of image forums;

generating a score for each image based on the quality for the image and relevance of the image to the query; and

outputting an indication of identified images in an order based on the generated score

such that the images are ordered based on a relevance that is query dependent and a quality that is query independent so that images of higher quality are ordered higher than images of lower quality with the same relevance.

7. The computer-readable medium of claim 6 wherein the rating of an image is adjusted based on the ratings differences between image forums as indicated by ratings of duplicate images.