Method and system for ranking search results based on category demand normalized using impressions

• US 9,355,153 B2
• Filed: 03/24/2015
• Issued: 05/31/2016
• Est. Priority Date: 02/15/2011
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Rehman, Muhammad Faisal
• Primary Examiner(s): THAI, HANH B
• Application Number:
  US14/667,347
• Publication Number:
  US 20150199362A1
• Time in Patent Office: 434 Days
• Field of Search: 707/706, 707/710, 707/723, 707/736, 707/748
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing

Abstract

Described herein are methods and systems for promoting item listings that satisfy a query based on the item listings being assigned to certain categories that have, based on historical click data, exhibited high demand characteristics for the query. Consistent with some embodiments, a certain number of leaf-level categories are identified based on demand data for those categories, and the item listings assigned to those categories are promoted through a normalized weighting factor derived in part based on the click probability score associated with the category, clicks per impression rate, and weighted clicks per impression by ranking rate.

Claims

1. A computer-implemented method comprising:

receiving, at a server, a query to identify a set of item listings;

identifying a sub-category for each item listing satisfying the query;

obtaining a click probability score for each identified sub-category;

determining sub-categories from the identified sub-categories with click probability scores exceeding a threshold score common to the identified sub-categories; and

generating, at the server, a search results page with the item listings ordered based in part on the sub-categories with click probability scores exceeding the threshold score common to the identified sub-categories.

2. The computer-implemented method of claim 1, further comprising:

for each of the determined sub-categories, calculating a category boost score for use in determining the order in which the item listings are to be presented in the search results page;

normalizing the category boost score for one or more determined sub-categories; and

presenting the search results page with the item listings ordered based in part on the normalized category boost score for the sub-category to which each item listing is assigned.

3. The computer-implemented method of claim 1, wherein normalizing further comprises:

calculating a constant boost score for the one or more determined sub-categories.

4. The computer-implemented method of claim 1, wherein normalizing further comprises:

determining a respective number of clicks per impression for each sub-category; and

calculating the normalized category boost score of a sub-category based on the respective number of clicks per impression.

5. The computer-implemented method of claim 1, wherein normalizing further comprises:

determining a weighted impression by rank for each sub-category;

determining a respective weighted number of clicks per impression by rank for each sub-category; and

calculating the normalized category boost score of each sub-category based on the respective weighted number of clicks per impression by rank.

6. The computer-implemented method of claim 1, wherein the threshold score is derived as a percentage of the click probability score of the sub-category with a highest click probability score.

7. The computer-implemented method of claim 1, wherein the threshold score is derived by dividing the click probability score of the sub-category with a highest click probability score by one less than the predetermined number.

8. The computer-implemented method of claim 1, wherein the category boost score for each determined sub-category is derived based in part on the click probability score of each identified sub-category.

9. The computer-implemented method of claim 1, wherein the item listings are ordered based on a ranking score derived with an algorithm utilizing the category boost score as a factor.

10. The computer-implemented method of claim 1, wherein obtaining a click probability score for each sub-category to which an item listing satisfying the query has been assigned includes dividing a number of clicks for a particular sub-category by the total number of clicks for all sub-categories to which an item listing satisfying the query has been assigned.

11. A system for an item listing presentation management, the system comprising:

at least one processor comprising;

a listing identifier module configured to process a query to identify a set of item listings, each item listing associated with an item or service being offered and assigned to a sub-category, and to identify a sub-category for each item listing satisfying the query;

a probability score module configured to obtain for the query a click probability score for each sub-category to which an item listing satisfying the query has been assigned, and

identifying up to a predetermined number of sub-categories from all sub-categories from the set of item listings identified with the query with click probability scores exceeding a threshold score common to all sub-categories; and

a listing generator module configured to generate a search results page with the item listings ordered based in part on the sub-categories with click probability scores exceeding the threshold score common to the identified sub-categories.

12. The system of claim 11, further comprising:

a category boost module configured to calculate a category boost score, for each of the identified sub-categories, for use in determining the order in which the item listings are to be presented in the search results page;

a normalizing module configured to normalize the category boost score for one or more identified sub-categories; and

a listing generator module configured to present a search results page with the item listings ordered based in part on the normalized category boost score for the sub-category to which each item listing is assigned.

13. The system of claim 11, wherein the normalizing module comprises:

a constant boost module configured to calculate a constant boost score for the one or more identified sub-categories.

14. The system of claim 11, wherein the normalizing module comprises:

a click through rate module configured to determine a respective number of clicks per impression for each sub-category, and to calculate the normalized category boost score of a sub-category based on the respective number of clicks per impression.

15. The system of claim 11, wherein the normalizing module comprises:

a weight click through rate by rank module configured to determine a weighted impression by rank for each sub-category, to determine a respective weighted number of clicks per impression by rank for each sub-category, and to calculate the normalized category boost score of each sub-category based on the respective weighted number of clicks per impression by rank.

16. The system of claim 11, wherein the item listing presentation management module is to derive the threshold score as a percentage of the click probability score of the sub-category with a highest click probability score.

17. The system of claim 11, wherein the item listing presentation management module is to derive the threshold score by dividing the click probability score of the sub-category with a highest click probability score by one less than the predetermined number.

18. The system of claim 11, wherein the click probability score for each category represents a probability, for a particular query, that an item listing assigned to the category will be selected from a search results page, the click probability score for each category derived based on analysis of historical click data.

19. The system of claim 11, wherein obtaining a click probability score for each sub-category to which an item listing satisfying the query has been assigned includes dividing a number of clicks for a particular sub-category by the total number of clicks for all sub-categories to which an item listing satisfying the query has been assigned.

20. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by a processor, cause the processor to perform operations, comprising:

receiving, at a server, a query to identify a set of item listings;

identifying a sub-category for each item listing satisfying the query;

obtaining a click probability score for each identified sub-category;

determining sub-categories from the identified sub-categories with click probability scores exceeding a threshold score common to the identified sub-categories; and

generating, at the server, a search results page with the item listings ordered based in part on the sub-categories with click probability scores exceeding the threshold score common to the identified sub-categories.