Time based ranking

• US 9,152,678 B1
• Filed: 12/08/2014
• Issued: 10/06/2015
• Est. Priority Date: 10/11/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: McDonnell, Philip A.
• Primary Examiner(s): DWIVEDI, MAHESH H
• Application Number:
  US14/563,911
• Time in Patent Office: 302 Days
• Field of Search: 707/748, 707/751
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/2477 Temporal data queries
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Apparatus, systems and methods for content ranking are disclosed. Historical click-through rates of first and second content items for a query are determined from an analysis of click logs and query logs. Temporal changes in the historical click-through rate of the first and second content items are identified. The rankings of the first and second content items are adjusted based on the temporal change.

Claims

1. A method comprising:

determining historical click-through rates over a plurality of time periods for a first search result responsive to a query and for a second search result responsive to the query wherein the first and second search results refer to different respective web pages;

calculating click-fractions for one or more of the plurality of time periods based on the determined historical click-through rates of the first and second search results;

determining that a particular click-fraction of the calculated click-fractions in a first time period of the plurality of time periods exceeds a minimum change threshold;

receiving the query from a user during a second time period that chronologically follows the plurality of time periods;

obtaining search results responsive to the query;

adjusting a ranking of the first search result in the obtained search results during the second time period; and

providing the search results including the adjusted ranking of the first search result to the user.

2. The method of claim 1, wherein the adjustment of the ranking of the first search result is in proportion to a magnitude of a change of the historical click-through rate of the first search result relative to a change of the historical click-through rate of the second search result during the first time period.

3. The method of claim 1, further comprising:

identifying a keyword related to the first search result; and

adding the keyword to the query when the query is submitted to a search engine during the second time period.

4. The method of claim 1, wherein the determined historical click-through rates are for a first geographic region.

5. The method of claim 4, wherein adjusting the ranking of the first search result further comprises determining that a region from which the query is received is the first geographic region.

6. The method of claim 1, wherein a click-fraction of the calculated click fractions is a ratio of the determined historical click-through rate of the first search result in the time period to the determined historical click-through rate of the second search result in the time period.

7. The method of claim 1, wherein the first time period and the second time period are corresponding periods based on a lunar calendar or a Gregorian calendar.

8. The method of claim 1, wherein the first time period and the second time period are each a same day of a week, same days of a week, same annual holidays, same weeks of a month, same weeks of a year, same biweekly periods of a year, same months of a year, or same seasons of a year.

9. The method of claim 1, wherein the minimum change threshold is a standard deviation of the calculated click-fractions.

10. The method of claim 1, wherein the obtained search results include the first search result.

11. A system comprising at least one:

data processing apparatus programmed to perform operations comprising;

determining historical click-through rates over a plurality of time periods for a first search result responsive to a query and for a second search result responsive to the query wherein the first and second search results refer to different respective web pages;

calculating click-fractions for one or more of the plurality of time periods based on the determined historical click-through rates of the first and second search results;

determining that a particular click-fraction of the calculated click-fractions in a first time period of the plurality of time periods exceeds a minimum change threshold;

receiving the query from a user during a second time period that chronologically follows the plurality of time periods;

obtaining search results responsive to the query;

adjusting a ranking of the first search result in the obtained search results during the second time period; and

providing the search results including the adjusted ranking of the first search result to the user.

12. The system of claim 11, wherein the adjustment of the ranking of the first search result is in proportion to a magnitude of a change of the historical click-through rate of the first search result relative to a change of the historical click-through rate of the second search result during the first time period.

13. The system of claim 11, wherein the operations further comprise:

identifying a keyword related to the first search result; and

adding the keyword to the query when the query is submitted to a search engine during the second time period.

14. The system of claim 11, wherein the determined historical click-through rates are for a first geographic region.

15. The system of claim 14, wherein adjusting the ranking of the first search result further comprises determining that a region from which the query is received is the first geographic region.

16. The system of claim 11, wherein a click-fraction of the calculated click fractions is a ratio of the determined historical click-through rate of the first search result in the time period to the determined historical click-through rate of the second search result in the time period.

17. The system of claim 11, wherein the first time period and the second time period are corresponding periods based on a lunar calendar or a Gregorian calendar.

18. The system of claim 11, wherein the first time period and the second time period are each a same day of a week, same days of a week, same annual holidays, same weeks of a month, same weeks of a year, same biweekly periods of a year, same months of a year, or same seasons of a year.

19. The system of claim 11, wherein the minimum change threshold is a standard deviation of the calculated click-fractions.

20. The system of claim 11, wherein the obtained search results include the first search result.

21. A non-transitory machine-readable storage device having instructions stored thereon which, when executed by at least one data processing apparatus, cause the at least one data processing apparatus to perform operations comprising:

determining historical click-through rates over a plurality of time periods for a first search result responsive to a query and for a second search result responsive to the query wherein the first and second search results refer to different respective web pages;

calculating click-fractions for one or more of the plurality of time periods based on the determined historical click-through rates of the first and second search results;

determining that a particular click-fraction of the calculated click-fractions in a first time period of the plurality of time periods exceeds a minimum change threshold;

receiving the query from a user during a second time period that chronologically follows the plurality of time periods;

obtaining search results responsive to the query;

adjusting a ranking of the first search result in the obtained search results during the second time period; and

providing the search results including the adjusted ranking of the first search result to the user.

22. The storage device of claim 21, wherein the adjustment of the ranking of the first search result is in proportion to a magnitude of a change of the historical click-through rate of the first search result relative to a change of the historical click-through rate of the second search result during the first time period.

23. The storage device of claim 21, wherein the operations further comprise:

identifying a keyword related to the first search result; and

adding the keyword to the query when the query is submitted to a search engine during the second time period.

24. The storage device of claim 21, wherein the determined historical click-through rates are for a first geographic region.

25. The storage device of claim 24, wherein adjusting the ranking of the first search result further comprises determining that a region from which the query is received is the first geographic region.

26. The storage device of claim 21, wherein a click-fraction of the calculated click fractions is a ratio of the determined historical click-through rate of the first search result in the time period to the determined historical click-through rate of the second search result in the time period.

27. The storage device of claim 21, wherein the first time period and the second time period are corresponding periods based on a lunar calendar or a Gregorian calendar.

28. The storage device of claim 21, wherein the first time period and the second time period are each a same day of a week, same days of a week, same annual holidays, same weeks of a month, same weeks of a year, same biweekly periods of a year, same months of a year, or same seasons of a year.

29. The storage device of claim 21, wherein the minimum change threshold is a standard deviation of the calculated click-fractions.

30. The storage device of claim 21, wherein the obtained search results include the first search result.