Systems and methods for dynamically updating relevance of a selected item

• US 8,065,301 B2
• Filed: 07/11/2007
• Issued: 11/22/2011
• Est. Priority Date: 12/30/2003
• Status: Expired due to Fees

• Current Assignee: eBay Inc.
• Original Assignee: Shopping.com Ltd. (eBay Inc.)
• Inventors: Glickman, Oren, Ginsburg, Adam, Ashkenazi, Amir
• Primary Examiner(s): Jalil; Neveen Abel
• Assistant Examiner(s): Veillard; Jacques
• Application Number:
  US11/776,342
• Publication Number:
  US 20080016101A1
• Time in Patent Office: 1,595 Days
• Field of Search: None
• US Class Current: 707/736
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

Systems and methods for dynamically updating ranking of items retrieved in response to a search query are provided. Specifically, systems and methods according to the invention preferably decrease a value associated with a selected item and increase a value of non-selected items that, prior to the selection, had a lesser weight than the selected item. Alternatively, if the list was ranked from higher value to lowest value, the selected item would be rewarded by an increase in its score and the non-selected items that previously had a higher value would have their respective values decreased. It should be noted than any and all values and weights described herein may be normalized to ensure appropriate results. Alternative embodiments of the invention are directed to methods and systems for classifying groups of items into meta-products and then updating the rankings of the items based at least in part on the meta-product classification.

Claims

1. A system for updating relevance of each of a first plurality of items to a particular search query, the system comprising:

a web server coupled to a computer network, the web server to receive the particular search query from the computer network, retrieve a search result comprising the first plurality of items, present a ranked list of the first plurality of items to a user in response to the particular search query, and receive a user selection of a particular item of the first plurality of items from the ranked list, wherein;

each of the items of the first plurality of items is associated with a current weight for ordering the first plurality of items in the ranked list by relevance to the particular search query, and

the first plurality of items includes one or more items displayed in the ranked list above the particular item selected by the user from the ranked list;

a click log that receives information relating to the user selection of the particular item of the first plurality of items from the ranked list presented to the user in response to the particular search query;

a ranking server coupled to the click log that, based on information received from the click log, dynamically updates the current weight associated with the particular item selected by the user from the ranked list, dynamically updates each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list, and creates a meta-product tree by calculating feature weights for the search result, choosing a first feature with the highest weight, partitioning the search result into two groups, wherein a first group contains all items with the first feature and a second group contains all items without the first feature, selecting within the first group a second feature with the highest weight, partitioning the first group into two groups, wherein a third group contains all items with the second feature and a fourth group contains all items without the second feature, selecting within the second group a third feature with the highest weight, partitioning the second group into two groups, wherein a fifth group contains all items with the third feature and a sixth group contains all items without the third feature, wherein;

the information received from the click log includes a position in the ranked list of each non-selected item of the first plurality of items with respect to the particular item selected by the user from the ranked list,

each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list below the particular item selected by the user from the ranked list stays the same,

the current weight associated with the particular item selected by the user from the ranked list is adjusted according to a reward scaling factor, and

each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list is adjusted according to a punishment scaling factor; and

a ranking database coupled to the ranking server that stores updated weights associated with the first plurality of items for updating the relevance of the particular item selected by the user from the ranked list and each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list to the particular search query.

2. The system of claim 1 further comprising a request server coupled to the ranking database that provides ranking information to a query integrator in order to rank a second plurality of items retrieved in response to a second query, the ranking information being based on an updated weight associated with one or more items of the first plurality of items.

3. The system of claim 2 wherein the first plurality of items is the same as the second plurality of items.

4. The system of claim 2 wherein the search query is the same as the second query.

5. The system of claim 1 wherein the ranking server increases the current weight associated with the particular item selected by the user from the ranked list and decreases each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

6. The system of claim 1 wherein the ranking server decreases the current weight associated with the particular item selected by the user from the ranked list and increases each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

7. The system of claim 1 wherein ordering of the first plurality of items within the ranked list is dynamically updated based on an adjusted weight associated with the particular item selected by the user from the ranked list and each adjusted weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

8. The system of claim 1, wherein the ranking server is further operative to add a new item to the first plurality of items.

9. The system of claim 8, wherein the ranking server adds the new item by attributing a value to the new item that causes the new item to be displayed in the first plurality of items.

10. The system of claim 1, wherein the ranking server is further operative to normalize a plurality of different search queries wherein in response to each of the plurality of normalized search queries the same plurality of items is returned.

11. The method of claim 10, wherein adding the new item includes attributing a value to the new item that causes the new item to be displayed in the first plurality of items.

12. A method for updating a relevance of each of a first plurality of items to a particular search query, the method comprising:

receiving the particular search query from the computer network;

retrieving a search result comprising the first plurality of items;

presenting a ranked list of the first plurality of items to a user in response to the particular search query;

receiving a user selection of a particular item of the first plurality of items from the ranked list, wherein;

each of the items of the first plurality of items is associated with a current weight for ordering the first plurality of items in the ranked list by relevance to the particular search query, and

the first plurality of items includes one or more items displayed in the ranked list above the particular item selected by the user from the ranked list;

receiving information from a web server, said information from the web server relating to the user selection of the particular item of the first plurality of items from the ranked list presented to the user in response to the particular search query;

receiving information from a click log, said information from the click log including a position in the ranked list of each non-selected item of the first plurality of items with respect to the particular item selected by the user from the ranked list;

dynamically updating, based on the information received from the click log, the current weight associated with the particular item selected by the user from the ranked list and each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list, wherein;

each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list below the particular item selected by the user from the ranked list stays the same,

the current weight associated with the particular item selected by the user from the ranked list is adjusted according to a reward scaling factor, and

each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list is adjusted according to a punishment scaling factor;

creating a meta-product tree by calculating feature weights for the search result, choosing a first feature with the highest weight, partitioning the search result into two groups, wherein a first group contains all items with the first feature and a second group contains all items without the first feature, selecting within the first group a second feature with the highest weight, partitioning the first group into two groups, wherein a third group contains all items with the second feature and a fourth group contains all items without the second feature, selecting within the second group a third feature with the highest weight, partitioning the second group into two groups, wherein a fifth group contains all items with the third feature and a sixth group contains all items without the third feature; and

storing updated weights associated with the first plurality of items for updating the relevance of the particular item selected by the user from the ranked list and each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list to the particular search query.

13. The method of claim 12 further comprising providing ranking information to a query integrator in order to rank a second plurality of items retrieved in response to a second query, the ranking information being based on an updated weight associated with one or more items of the first plurality of items.

14. The method of claim 13 wherein the first plurality of items is the same as the second plurality of items.

15. The method of claim 13 wherein the search query is the same as the second query.

16. The method of claim 12 wherein:

the current weight associated with the particular item selected by the user from the ranked list is increased, and

each weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list is decreased.

17. The method of claim 12 wherein:

the current weight associated with the particular item selected by the user from the ranked list is decreased, and

each weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list is increased.

18. The method of claim 12 further comprising dynamically updating ordering of the first plurality of items within the ranked list based on an adjusted weight associated with the particular item selected by the user from the ranked list and each adjusted weight of each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

19. The method of claim 12, further comprising adding a new item to the first plurality of items.

20. The method of claim 12, further comprising normalizing a plurality of different search queries wherein in response to each of the plurality of normalized search queries the same plurality of items is returned.

21. The computer memory storage device of claim 20, wherein the computer program instructions to add a new item includes computer program instructions to attribute a value to the new item that causes the new item to be displayed in the first plurality of items.

22. A computer memory storage device comprising executable computer program instructions stored therein that, when executed, cause a computer to update a relevance of each of a first plurality of items to a particular search query, the computer memory storage device comprising computer program instructions to:

receive the particular search query from the computer network;

automatically provide related narrower search queries to retrieve a larger number of historical merchant click data when the search query results in a group of results insufficiently large to accurately represent historical user interest;

retrieve a search result comprising the first plurality of items;

presenting a ranked list of the first plurality of items to a user in response to the particular search query;

receive a user selection of a particular item of the first plurality of items from the ranked list, wherein;

each of the items of the first plurality of items is associated with a current weight for ordering the first plurality of items in the ranked list by relevance to the particular search query, and

the first plurality of items includes one or more items displayed in the ranked list above the particular item selected by the user from the ranked list;

receive information from a web server, said information from the web server relating to the user selection of the particular item of the first plurality of items from the ranked list presented to the user in response to the particular search query;

receive information from a click log, said information from the click log including a position in the ranked list of each non-selected item of the first plurality of items with respect to the particular item selected by the user from the ranked list;

dynamically update, based on the information received from the click log, the current weight associated with the particular item selected by the user from the ranked list and each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list, wherein;

each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list below the particular item selected by the user from the ranked list stays the same,

the current weight associated with the particular item selected by the user from the ranked list is adjusted according to a reward scaling factor, and

each current weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list is adjusted according to a punishment scaling factor; and

store updated weights associated with the first plurality of items for updating the relevance of the particular item selected by the user from the ranked list and each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list to the particular search query.

23. The computer memory storage device of claim 22 further comprising computer program instructions to provide ranking information to a query integrator in order to rank a second plurality of items retrieved in response to a second query, the ranking information being based on an updated weight associated with one or more items of the first plurality of items.

24. The computer memory storage device of claim 23 wherein the first plurality of items is the same as the second plurality of items.

25. The computer memory storage device of claim 23 wherein the search query is the same as the second query.

26. The computer memory storage device of claim 22 further comprising computer program instructions to increase the current weight associated with the particular item selected by the user from the ranked list and decrease each weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

27. The computer memory storage device of claim 22 further comprising computer program instructions to decrease the current weight associated with the particular item selected by the user from the ranked list and increase each weight associated with each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

28. The computer memory storage device of claim 22 further comprising computer program instructions to dynamically update ordering of the first plurality of items within the ranked list based on an adjusted weight associated with the particular item selected by the user from the ranked list and each adjusted weight of each non-selected item of the first plurality of items displayed in the ranked list above the particular item selected by the user from the ranked list.

29. The computer memory storage device of claim 22, further comprising computer program instructions to add a new item to the first plurality of items.

30. The computer memory storage device of claim 22, wherein further comprising computer program instructions to normalize a plurality of different search queries wherein in response to each of the plurality of normalized search queries the same plurality of items is returned.