Demotion of repetitive search results

• US 8,051,076 B1
• Filed: 12/13/2007
• Issued: 11/01/2011
• Est. Priority Date: 12/13/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Garg, Ashutosh, Dhamdhere, Kedar
• Primary Examiner(s): Vo; Tim T
• Assistant Examiner(s): OWYANG, MICHELLE N
• Application Number:
  US11/955,975
• Time in Patent Office: 1,419 Days
• Field of Search: 707/705, 707722-735
• US Class Current: 707/723
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

Apparatus, systems and methods for demoting repetitive search results are disclosed. Search results that are identified in both first set of search results and a second set of search results are determined to be repetitive search results. One or more of the repetitive search results can be demoted in the second set of search results. The demotion can be based on a relevancy threshold for the second set of search results.

Claims

1. A computer implemented method for demoting search results, comprising:

identifying a first set of search results responsive to a first query during a search session, each search result of the first set of search results having a corresponding relevancy score, and the first set of search results being ranked according to relevancy scores;

identifying a second set of search results responsive to a second query during the search session, each search result of the second set of search results having a corresponding relevancy score, and the second set of search results being ranked according to relevancy scores, wherein the second query is different from the first query;

identifying one or more repetitive search results, each of the one or more repetitive search results being a search result in both the first set of search results and the second set of search results;

determining a relevancy threshold for the second set of search results;

identifying one or more candidate search results, candidate search results being repetitive search results that have a relevancy score greater than the relevancy threshold, the candidate search results comprising a first candidate search result, the first candidate search result having a ranking in the second set of search results according to relevancy scores;

demoting the first candidate search result in the second set of search results by lowering the ranking of the first candidate search result in the second set of search results; and

after demoting the first candidate search result in the second set of search results, providing the second set of search results in a response to the second query;

wherein the identifying, determining, demoting and providing are performed by data processing apparatus.

2. The method of claim 1, wherein determining a relevancy threshold comprises:

determining whether a relevancy difference measure based on the relevancy scores of two or more search results of the second set of search results equals or exceeds a relevancy difference threshold;

identifying a highest relevancy score of the relevancy scores of the two or more search results for which the relevancy difference measure equals or exceeds the relevancy difference threshold; and

setting the relevancy threshold to a value that is based on the highest relevancy score.

3. The method of claim 2, wherein setting the relevancy threshold to a value that is based on the highest relevancy score comprises setting the relevancy threshold equal to or less than the highest relevancy score.

4. The method of claim 2, wherein the relevancy difference threshold is a maximum change in percentage differential between two or more relevancy scores.

5. The method of claim 1, further comprising:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

6. The method of claim 1, wherein determining a relevancy threshold comprises:

identifying a relevancy score of a highest ranked search result responsive to an optimized second query in the second set of search results, wherein the optimized second query includes keywords derived from the keywords included in the second query; and

setting the relevancy threshold to a value that is based on the highest relevancy score.

7. The method of claim 6, further comprising:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

8. The method of claim 1, wherein determining a relevancy threshold comprises:

identifying a ranking of a lowest selected search result from the first set of search results;

identifying a threshold repetitive search result from the one or more repetitive search results, wherein the threshold repetitive search result is a highest ranked repetitive search result that is ranked lower than the lowest selected search result in the first set of search results; and

setting the relevancy threshold to a value that is based on the ranking of the threshold repetitive search result in the second set of search results.

9. The method of claim 8, further comprising:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

10. The method of claim 1, wherein the search session is defined by queries received from a user device over a time period.

11. The method of claim 1, wherein the search session is defined by queries received from a user device that is logged into a user account.

12. The method of claim 1, further comprising providing the second set of search results in re-ranked order.

13. Software stored in a computer readable storage device and comprising instructions executable by a processing system and that upon such execution cause the processing system to perform operations comprising:

identifying a first set of search results responsive to a first query during a search session, each search result of the first set of search results having a corresponding relevancy score, and the first set of search results being ranked according to relevancy scores;

identifying a second set of search results responsive to a second query during the search session, each search result of the second set of search results having a corresponding relevancy score, and the second set of search results being ranked according to relevancy scores, wherein the second query is different from the first query;

identifying one or more repetitive search results, each of the one or more repetitive search results being a search result in both the first set of search results and the second set of search results;

determining a relevancy threshold for the second set of search results;

identifying one or more candidate search results, candidate search results being repetitive search results that have a relevancy score greater than the relevancy threshold, the candidate search results comprising a first candidate search result, the first candidate search result having a ranking in the second set of search results according to relevancy scores;

demoting the first candidate search result in the second set of search results by lowering the ranking of the first candidate search result in the second set of search results; and

after demoting the first candidate search result in the second set of search results, providing the second set of search results in a response to the second query.

14. The software of claim 13, comprising further instructions executable by the processing system and that upon such execution cause the processing system to perform operations comprising:

determining whether a relevancy difference measure based on the relevancy scores of two or more search results of the second set of search results equals or exceeds a relevancy difference threshold;

identifying a highest relevancy score of the relevancy scores of the two or more search results for which the relevancy difference measure equals or exceeds the relevancy difference threshold; and

setting the relevancy threshold to a value that is based on the highest relevancy score.

15. The software of claim 13, comprising further instructions executable by the processing system and that upon such execution cause the processing system to perform operations comprising:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

16. The software of claim 13, comprising further instructions executable by the processing system and that upon such execution cause the processing system to perform operations comprising:

identifying a relevancy score of a highest ranked search result responsive to an optimized second query in the second set of search results, wherein the optimized second query includes keywords derived from the keywords included in the second query; and

setting the relevancy threshold to a value that is based on the highest relevancy score.

17. The software of claim 13, comprising further instructions executable by the processing system and that upon such execution cause the processing system to perform operations comprising:

identifying a ranking of a lowest selected search result from the first set of search results;

identifying a threshold repetitive search result from the one or more repetitive search results, wherein the threshold repetitive search result is a highest ranked repetitive search result that is ranked lower than the lowest selected search result in the first set of search results; and

setting the relevancy threshold to a value that is based on the ranking of the threshold repetitive search result in the second set of search results.

18. The software of claim 13, comprising further instructions executable by the processing system and that upon such execution cause the processing system to perform operations comprising providing the second set of search results in re-ranked order.

19. A system comprising:

means for determining a relevancy threshold for a set of search results to be provided in response to a query; and

means for demoting a repetitive search result in the set of search results below the relevancy threshold of the set of search results, the repetitive search result remaining in the set of search results to be provided in response to the query.

20. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

identifying a first set of search results responsive to a first query during a search session, each search result of the first set of search results having a corresponding relevancy score, and the first set of search results being ranked according to relevancy scores;

identifying a second set of search results responsive to a second query during the search session, each search result of the second set of search results having a corresponding relevancy score, and the second set of search results being ranked according to relevancy scores, wherein the second query is different from the first query;

identifying one or more repetitive search results, each of the one or more repetitive search results being a search result in both the first set of search results and the second set of search results;

determining a relevancy threshold for the second set of search results;

identifying one or more candidate search results, candidate search results being repetitive search results that have a relevancy score greater than the relevancy threshold, the candidate search results comprising a first candidate search result, the first candidate search result having a ranking in the second set of search results according to relevancy scores; and

demoting the first candidate search result in the second set of search results by lowering the ranking of the first candidate search result in the second set of search results; and

after demoting the first candidate search result in the second set of search results, providing the second set of search results in a response to the second query.

21. The system of claim 20, wherein determining a relevancy threshold comprises:

determining whether a relevancy difference measure based on the relevancy scores of two or more search results of the second set of search results equals or exceeds a relevancy difference threshold;

identifying a highest relevancy score of the relevancy scores of the two or more search results for which the relevancy difference measure equals or exceeds the relevancy difference threshold; and

setting the relevancy threshold to a value that is based on the highest relevancy score.

22. The system of claim 21, wherein setting the relevancy threshold to a value that is based on the highest relevancy score comprises setting the relevancy threshold equal to or less than the highest relevancy score.

23. The system of claim 21, wherein the relevancy difference threshold is a maximum change in percentage differential between two or more relevancy scores.

24. The system of claim 20, wherein demoting the first candidate search result in the second set of search results comprises:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

25. The system of claim 20, wherein determining a relevancy threshold comprises:

identifying a relevancy score of a highest ranked search result responsive to an optimized second query in the second set of search results, wherein the optimized second query includes keywords derived from the keywords included in the second query; and

setting the relevancy threshold to a value that is based on the highest relevancy score.

26. The system of claim 25, wherein demoting the first candidate search result in the second set of search results comprises:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

27. The system of claim 20, wherein determining a relevancy threshold comprises:

identifying a ranking of a lowest selected search result from the first set of search results;

identifying a threshold repetitive search result from the one or more repetitive search results, wherein the threshold repetitive search result is a highest ranked repetitive search result that is ranked lower than the lowest selected search result in the first set of search results; and

setting the relevancy threshold to a value that is based on the ranking of the threshold repetitive search result in the second set of search results.

28. The system of claim 27, wherein demoting the first candidate search result in the second set of search results comprises:

identifying a search result ranked at the relevancy threshold; and

lowering the ranking of the first candidate search result to a ranking lower than the ranking of the search result ranked at the relevancy threshold.

29. The system of claim 20, wherein the search session is defined by queries received from a user device over a time period.

30. The system of claim 20, wherein the search session is defined by queries received from a user device that is logged into a user account.

31. The system of claim 20, wherein the operations further comprise providing the second set of search results in re-ranked order.