Inducing command inputs from high precision and high recall data
First Claim
Patent Images
1. A computer-implemented method performed by a data processing apparatus, the method comprising:
- receiving a first query provided to a first search service having a first recall and a first precision and a response from the first search service to the query, wherein the first query references a first entity of a first entity type;
determining a first value specified in the response from the first search service;
generating a query for a particular attribute value of the first entity, wherein the query is generated using the first value specified in the response from the first search service and using the first entity referenced in the first query;
querying a second search service using the query for the particular attribute value of the first entity to identify the particular attribute value of the first entity that matches the first value in the response from the first search service, wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision;
receiving a response from the second search service, and that specifies the particular attribute value that corresponds to the attribute of the first entity;
determining, based on the particular attribute value specified in the response from the second search service that matches the first value, an attribute type of the first value, the attribute type corresponding to the attribute value of the first entity; and
generating, based on the determined attribute type and at least the first query, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for an entity referenced in at least the first query.
2 Assignments
0 Petitions
Accused Products
Abstract
A language processing system collects similar queries and respective responses and aggregated by responses. Incorrect responses are determined and filtered by the aggregation. The remaining responses are then used to query a high precision system for attributes of entities specified by the queries. The attribute type is determined from the responses of the high precision system, and corresponding parse rules are generated. The parse rules are then associated with an operation that yields a response that specifies an attribute of the attribute type.
23 Citations
15 Claims
-
1. A computer-implemented method performed by a data processing apparatus, the method comprising:
-
receiving a first query provided to a first search service having a first recall and a first precision and a response from the first search service to the query, wherein the first query references a first entity of a first entity type; determining a first value specified in the response from the first search service; generating a query for a particular attribute value of the first entity, wherein the query is generated using the first value specified in the response from the first search service and using the first entity referenced in the first query; querying a second search service using the query for the particular attribute value of the first entity to identify the particular attribute value of the first entity that matches the first value in the response from the first search service, wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision; receiving a response from the second search service, and that specifies the particular attribute value that corresponds to the attribute of the first entity; determining, based on the particular attribute value specified in the response from the second search service that matches the first value, an attribute type of the first value, the attribute type corresponding to the attribute value of the first entity; and generating, based on the determined attribute type and at least the first query, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for an entity referenced in at least the first query. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer-implemented method, comprising:
-
selecting a group of queries and corresponding responses, each corresponding response specifying respective first values and having been served by a first search service having a first recall and a first precision, and each query in the group of queries referencing an entity of a first entity type and that meet a similarity threshold that measure a similarity of the query to other queries in the group; determining, from the queries, a first proper subset of the queries, each query in the first proper subset of queries referencing a first entity of the first entity type and each corresponding response for the query being a first response type; generating a query for a particular attribute value of the first entity, wherein the query is generated using at least one respective first value specified in at least one response served by the first search service and using the first entity referenced by each query in the first proper subset of queries; querying a second search service using the generated query to identify the first entity referenced in the first proper subset of queries and for the particular attribute value matching respective first values specified by the corresponding responses, wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision; determining, from a response of the second search service, an attribute of the response type, the attribute of the response type corresponding to the attribute of the first entity; and generating, based on the determined attribute of the response type and at least the first proper subset of queries, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for the entity referenced in at least the selected group of queries. - View Dependent Claims (7, 8, 9, 10, 11)
-
-
12. A non-transitory computer readable storage medium storing instructions executable by a data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising:
-
receiving a first query provided to a first search service having a first recall and a first precision and a response from the first search service to the query, wherein the first query references a first entity of a first entity type; determining a first value specified in the response from the first search service; generating a query for a particular attribute value of the first entity, wherein the query is generated using the first value specified in the response from the first search service and using the first entity referenced in the first query; querying a second search service using the query for the particular attribute value of the first entity to identify the particular attribute value of the first entity that matches the first value in the response from the first search service, and wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision; receiving a response from the second search service, and that specifies the particular attribute value that corresponds to the attribute of the first entity; determining, based on the particular attribute value specified in the response from the second search service, an attribute type of the first value, the attribute type corresponding to the attribute value of the first entity; and generating, based on the determined attribute type and at least the first query, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for an entity referenced in at least the first query.
-
-
13. A system, comprising:
-
a data processing apparatus; and a non-transitory computer readable storage medium in data communication with the data processing apparatus storing instructions executable by the data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising; receiving a first query provided to a first search service having a first recall and a first precision and a response from the first search service to the query, wherein the first query references a first entity of a first entity type; determining a first value specified in the response from the first search service; generating a query for a particular attribute value of the first entity, wherein the query is generated using the first value specified in the response from the first search service and using the first entity referenced in the first query; querying a second search service using the query for the particular attribute value of the first entity to identify the particular attribute value of the first entity that matches the first value in the response from the first search service, wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision; receiving a response from the second search service, and that specifies the particular attribute value that corresponds to the attribute of the first entity; determining, based on the particular attribute value specified in the response from the second search service, an attribute type of the first value, the attribute type corresponding to the attribute value of the first entity; and generating, based on the determined attribute type and at least the first query, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for an entity referenced in at least the first query.
-
-
14. A non-transitory computer readable storage medium storing instructions executable by a data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising:
-
selecting a group of queries and corresponding responses, each corresponding response specifying respective first values and having been served by a first search service having a first recall and a first precision, and each query in the group of queries referencing an entity of a first entity type and that meet a similarity threshold that measure a similarity of the query to other queries in the group; determining, from the queries, a first proper subset of the queries, each query in the first proper subset of queries referencing a first entity of the first entity type and each corresponding response for the query being a first response type; generating a query for a particular attribute value of the first entity, wherein the query is generated using at least one respective first value specified in at least one response served by the first search service and using the first entity referenced by each query in the first proper subset of queries; querying a second search service using the generated query to identify the first entity referenced in the first proper subset of queries and for the particular attribute value matching respective first values specified by the corresponding responses, wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision; determining, from a response of the second search service, an attribute of the response type, the attribute of the response type corresponding to the attribute of the first entity; and generating, based on the determined attribute of the response type and at least the first proper subset of queries, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for the entity referenced in at least the selected group of queries.
-
-
15. A system, comprising:
-
a data processing apparatus; and a non-transitory computer readable storage medium in data communication with the data processing apparatus storing instructions executable by the data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising; selecting a group of queries and corresponding responses, each corresponding response specifying respective first values and having been served by a first search service having a first recall and a first precision, and each query in the group of queries referencing an entity of a first entity type and that meet a similarity threshold that measure a similarity of the query to other queries in the group; determining, from the queries, a first proper subset of the queries, each query in the first proper subset of queries referencing a first entity of the first entity type and each corresponding response for the query being a first response type; generating a query for a particular attribute value of the first entity, wherein the query is generated using at least one respective first value specified in at least one response served by the first search service and using the first entity referenced by each query in the first proper subset of queries; querying a second search service using the generated query to identify the first entity referenced in the first proper subset of queries and for the particular attribute value matching respective first values specified by the corresponding responses, wherein the particular attribute value is for one of a plurality of attributes that is descriptive of the first entity and that corresponds to an attribute of the first entity, the second search service is distinct from the first search service and has a second recall less than the first recall and a second precision greater than the first precision; determining, from a response of the second search service, an attribute of the response type, the attribute of the response type corresponding to the attribute of the first entity; and generating, based on the determined attribute of the response type and at least the first proper subset of queries, a parsing rule that parses one or more queries, the parsing rule being associated with an action to provide the particular attribute value of the attribute for the entity referenced in at least the selected group of queries.
-
Specification