Using web ranking to resolve anaphora

• US 9,183,257 B1
• Filed: 03/14/2013
• Issued: 11/10/2015
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Buchanan, Michael, Paskin, Mark Andrew, Gupta, Pravir Kumar
• Primary Examiner(s): Pham, Hung Q
• Application Number:
  US13/803,410
• Time in Patent Office: 971 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24522 Translation of natural language queries to structured queries
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/3325 Reformulation based on results of preceding query
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

The specification relates to a method of receiving a first query and a second query. The method analyzes the second query for a presence of anaphora. If anaphora is present, the method analyzes the first query for a presence of an entity that can be associated with the anaphora. If the analysis analyzing the first query returns two or more associated entities, the method forms a third query wherein the anaphora of the second query is replaced with one of the associated entities and forms a fourth query wherein the anaphora is replaced with the other of the associated entities. The third query and the fourth query are sent to a query-ranking engine. The third query and the fourth query receive a ranking and the higher-ranked query is sent to a search engine.

Claims

1. A method comprising:

receiving a first query;

receiving a second, follow-up query;

determining that an anaphora is present in the second, follow-up query by determining that the second, follow-up query includes a pronoun that refers to an entity that is not present in the second, follow-up query;

in response to determining that the anaphora is present in the second, follow-up query, determining that the first query is associated with a plurality of possible entities;

generating a plurality of candidate queries, wherein each candidate query of the plurality of candidate queries is generated by replacing the pronoun in the second, follow-up query with a corresponding possible entity;

obtaining a ranking for the plurality of candidate queries from a ranking engine;

determining that a corresponding possible entity in a highest-ranked candidate query of the plurality of candidate queries is an entity associated with the anaphora from the second, follow-up query, wherein the entity associated with the anaphora from the second, follow-up query is the entity that is not present in the second, follow-up query and is referred to by the pronoun in the second, follow-up query; and

based on determining that the corresponding possible entity in the highest-ranked candidate query is the entity associated with the anaphora, providing the highest-ranked candidate query to a search engine and obtaining search results for the highest-ranked candidate query from the search engine.

2. The method of claim 1 wherein determining that the first query is associated with a plurality of possible entities further comprises the step of:

analyzing results of the first query for a presence of an entity associated with the anaphora.

3. The method of claim 1, wherein the ranking engine ranks the plurality of candidate queries using a data repository containing past query logs, and wherein the past query logs are associated with metadata describing one of a popularity of queries in the past query logs, a frequency of use of queries in the past query logs, and a commonality of queries in the past query logs.

4. The method of claim 1, further comprising:

modifying one or more of the plurality of candidate queries before sending the plurality of candidate queries to the ranking engine.

5. The method of claim 4 wherein modifying one or more of the plurality of candidate queries comprises one or more of dropping search terms, replacing search terms with synonyms, or introducing new terms.

6. The method of claim 1 wherein the ranking engine ranks the plurality of candidate queries by ranking n-grams contained within the candidate queries.

7. The method of claim 1, further comprising:

sending the second, follow-up query to the ranking engine, wherein determining that the corresponding possible entity in the highest-ranked candidate query is the entity associated with the anaphora comprises determining that the highest-ranked query is ranked higher than the second, follow-up query.

8. A system comprising:

one or more processors;

one or more computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations comprising;

receiving a first query;

receiving a second, follow-up query;

determining that an anaphora is present in the second, follow-up query by determining that the second, follow-up query includes a pronoun that refers to an entity that is not present in the second, follow-up query;

in response to determining that the anaphora is present in the second, follow-up query, determining that the first query is associated with a plurality of possible entities;

generating a plurality of candidate queries, wherein each candidate query of the plurality of candidate queries is generated by replacing the pronoun in the second, follow-up query with a corresponding possible entity;

obtaining a ranking for the plurality of candidate queries from a ranking engine;

determining that a corresponding possible entity in a highest-ranked candidate query of the plurality of candidate queries is an entity associated with the anaphora from the second, follow-up query, wherein the entity associated with the anaphora from the second, follow-up query is the entity that is not present in the second, follow-up query and is referred to by the pronoun in the second, follow-up query; and

based on determining that the corresponding possible entity in the highest-ranked candidate query is the entity associated with the anaphora, providing the highest-ranked candidate query to a search engine and obtaining search results for the highest-ranked candidate query from the search engine.

9. The system of claim 8 wherein determining that the first query is associated with a plurality of possible entities further comprises the step of:

analyzing results of the first query for a presence of an entity associated with the anaphora.

10. The system of claim 8, wherein the ranking engine ranks the plurality of candidate queries using a data repository containing past query logs, and wherein the past query logs are associated with metadata describing one of a popularity of queries in the past query logs, a frequency of use of queries in the past query logs, and a commonality of queries in the past query logs.

11. The system of claim 8, the operations further comprising:

modifying one or more of the plurality of candidate queries before sending the plurality of candidate queries to the ranking engine.

12. The system of claim 11 wherein modifying one or more of the plurality of candidate queries comprises one or more of dropping search terms, replacing search terms with synonyms, or introducing new terms.

13. The system of claim 8 wherein the ranking engine ranks the plurality of candidate queries by ranking n-grams contained within the candidate queries.

14. The system of claim 8, the operations further comprising:

sending the second, follow-up query to the ranking engine, wherein determining that the corresponding possible entity in the highest-ranked candidate query is the entity associated with the anaphora comprises determining that the highest-ranked query is ranked higher than the second, follow-up query.

15. A computer-program product, the product tangibly encoded on a machine-readable storage medium, including instructions configured to cause one or more data processing apparatus to:

receiving a first query;

receiving a second, follow-up query;

determining that an anaphora is present in the second, follow-up query by determining that the second, follow-up query includes a pronoun that refers to an entity that is not present in the second, follow-up query;

in response to determining that the anaphora is present in the second, follow-up query, determining that the first query is associated with a plurality of possible entities;

generating a plurality of candidate queries, wherein each candidate query of the plurality of candidate queries is generated by replacing the pronoun in the second, follow-up query with a corresponding possible entity;

obtaining a ranking for the plurality of candidate queries from a ranking engine;

determining that a corresponding possible entity in a highest-ranked candidate query of the plurality of candidate queries is an entity associated with the anaphora from the second, follow-up query, wherein the entity associated with the anaphora from the second, follow-up query is the entity that is not present in the second, follow-up query and is referred to by the pronoun in the second, follow-up query; and

based on determining that the corresponding possible entity in the highest-ranked candidate query is the entity associated with the anaphora, providing the highest-ranked candidate query to a search engine and obtaining search results for the highest-ranked candidate query from the search engine.

16. The product of claim 15 wherein determining that the first query is associated with a plurality of possible entities further comprises the step of:

analyzing results of the first query for a presence of an entity associated with the anaphora.

17. The product of claim 15, wherein the ranking engine ranks the plurality of candidate queries using a data repository containing past query logs, and wherein the past query logs are associated with metadata describing one of a popularity of queries in the past query logs, a frequency of use of queries in the past query logs, and a commonality of queries in the past query logs.

18. The product of claim 15, the operations further comprising

modifying one or more of the plurality of candidate queries before sending the plurality of candidate queries to the ranking engine.

19. The product of claim 18 wherein modifying one or more of the plurality of candidate queries comprises one or more of dropping search terms, replacing search terms with synonyms, or introducing new terms.

20. The product of claim 15 wherein the ranking engine ranks the plurality of candidate queries by ranking n-grams contained within the candidate queries.

21. The product of claim 15, the operations further comprising:

sending the second, follow-up query to the ranking engine, wherein determining that the corresponding possible entity in the highest-ranked candidate query is the entity associated with the anaphora comprises determining that the highest-ranked query is ranked higher than the second, follow-up query.