Factual query pattern learning

• US 9,037,568 B1
• Filed: 03/15/2013
• Issued: 05/19/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Sahin, Engin Cinar, Blitzer, John, Xian, Junli, Persky, Emma S.
• Primary Examiner(s): Stevens, Robert
• Application Number:
  US13/841,759
• Time in Patent Office: 795 Days
• Field of Search: 707/713
• US Class Current: 707/713
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/90332 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a statement that references a particular attribute of a particular topic, in response to providing the statement, obtaining one or more query patterns that each include one or more query terms that are used in queries submitted to a search system in obtaining a value for the particular attribute of the particular topic, generalizing one or more of the query patterns, and associating the one or more generalized query patterns with one or more other topics that include the particular attribute.

Claims

1. A computer-implemented method comprising:

providing, to a plurality of users of a search system, a statement that references a particular attribute of a particular topic;

in response to providing the statement to the plurality of users of the search system, obtaining, from the plurality of users, a collection of candidate query patterns that each include one or more query terms that are indicated by the plurality of users as terms that are useful for obtaining a value for the particular attribute of the particular topic referenced in the statement;

selecting a subset of the candidate query patterns of the collection;

generalizing one or more of the query patterns to generate one or more generalized query patterns that are useful for obtaining a value for the particular attribute of other topics in addition to the particular topic; and

associating the one or more generalized query patterns with the particular topic as well as one or more other topics that include the particular attribute.

2. The method of claim 1, further comprising:

receiving a query from a user;

determining that the query includes a first portion that matches a particular, generalized query pattern; and

based on determining that the query includes the first portion that matches the particular, generalized query pattern, retrieving a value of the particular attribute of one of the other topics referenced by the query.

3. The method of claim 1, wherein obtaining one or more query patterns comprises:

receiving queries relating to the statement; and

normalizing the received queries.

4. The method of claim 3, further comprising:

filtering the received queries to remove queries that occur with a frequency that does not satisfy a predetermined threshold.

5. The method of claim 1, wherein generalizing one or more of the query patterns comprises replacing a first portion of each of the one or more query patterns that match the particular topic with one or more identifiers.

6. The method of claim 1, wherein the statement is selected to cause one or more query patterns to be obtained that include the particular attribute for which associations for the one or more generalized query patterns that include the particular attribute are needed.

7. The method of claim 6, wherein the statement is provided to a plurality of human users.

8. A system comprising:

one or more processors;

an interface that is configured to i) provide, to a plurality of users of a search system, a statement that references a particular attribute of a particular topic and ii) in response to providing the statement to the plurality of users of the search system, obtain, from the plurality of users, a collection of candidate query patterns, the query patterns including one or more query terms that are indicated by the plurality of users as terms that are useful for obtaining a value for the particular attribute of the particular topic referenced in the statement;

a query pattern processor that is configured to select a subset of the candidate query patterns of the collection, generalize the one or more received query patterns to generate one or more generalized query patterns that are useful for obtaining a value for the particular attribute of other topics in addition to the particular topic and to associate the one or more generalized query patterns with the particular topic as well as one or more other topics that include the particular attribute; and

the search system that is configured to obtain the value for the particular attribute of the particular topic in response to the submitted question.

9. The system of claim 8, wherein the search system is further configured to:

receive a query from a user;

determine that the query includes a first portion that matches a particular, generalized query pattern; and

based on determining that the query includes the first portion that matches the particular, generalized query pattern, retrieving a value of the particular attribute of one of the other topics referenced by the query.

10. The system of claim 9, wherein the interface is further configured to filter the received queries to remove queries that occur with a frequency that does satisfy a predetermined threshold.

11. The system of claim 8, wherein obtaining one or more query patterns comprises:

receiving one or more queries; and

normalizing the received queries.

12. The system of claim 8, wherein the query pattern processor is further configured to replacing a first portion of each of the one or more query patterns that match the particular topic with one or more identifiers.

13. The system of claim 8, wherein the statement is selected to cause one or more query patterns to be obtained by the interface that include the particular attribute for which associations for the one or more generalized query patterns that include the particular attribute are needed.

14. The system of claim 13, wherein the interface is configured to provide the statement to a plurality of human users.

15. A non-transitory computer storage device encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more programs to perform operations comprising:

providing, to a plurality of users of a search system, a statement that references a particular attribute of a particular topic;

in response to providing the statement to the plurality of users of the search system, obtaining, from the plurality of users, a collection of candidate query patterns that each include one or more query terms that are indicated by the plurality of users as terms that are useful for in obtaining a value for the particular attribute of the particular topic referenced in the statement;

selecting a subset of the candidate query patterns of the collection;

generalizing one or more of the query patterns to generate one or more generalized query patterns that are useful for obtaining a value for the particular attribute of other topics in addition to the particular topic; and

associating the one or more generalized query patterns with the particular topic as well as one or more other topics that include the particular attribute.