Exceptions to action invocation from parsing rules
First Claim
1. A computer-implemented method performed by a data processing apparatus, the method comprising:
- accessing command input logs storing;
data defining received input sentences, each input sentence being one or more n-grams;
data indicating a first action performed by user devices from which input sentences were received, the first action having been performed, in part, in response to an input sentence being successfully parsed by a first parsing rule that is associated with the first action;
identifying first input sentences that are successfully parsed by the parsing rule;
identifying a second input sentence having a signal indicative of user satisfaction, wherein the second input sentence is identified from among the first input sentences, and the signal is derived from data that is independent of performance of the first action, the identifying comprising, for each first input sentence;
determining that a second action for which the first input sentence was received as input was performed, the second action being different from the first action;
determining that data responsive to the second action meets a quality threshold; and
in response to the data responsive to the second action meeting the quality threshold determining that the first input sentence is a second input sentence having a signal indicative of user satisfaction; and
generating data that precludes invocation of the first action for the second input sentence.
2 Assignments
0 Petitions
Accused Products
Abstract
A language processing system identifies, from log data, command inputs that parsed to a parsing rule associated with an action. If the command input has a signal indicative of user satisfaction, where the signal is derived from data that is not generated from performance of the action (e.g., user interactions with data provided in response to the performance of another, different action; resources identified in response to the performance of another, different action having a high quality score; etc.), then exception data is generated for the parsing rule. The exception data specifies the particular instance of the sentence parsed by the parsing rule, and precludes invocation of the action associated with the rule.
10 Citations
15 Claims
-
1. A computer-implemented method performed by a data processing apparatus, the method comprising:
-
accessing command input logs storing; data defining received input sentences, each input sentence being one or more n-grams; data indicating a first action performed by user devices from which input sentences were received, the first action having been performed, in part, in response to an input sentence being successfully parsed by a first parsing rule that is associated with the first action; identifying first input sentences that are successfully parsed by the parsing rule; identifying a second input sentence having a signal indicative of user satisfaction, wherein the second input sentence is identified from among the first input sentences, and the signal is derived from data that is independent of performance of the first action, the identifying comprising, for each first input sentence; determining that a second action for which the first input sentence was received as input was performed, the second action being different from the first action; determining that data responsive to the second action meets a quality threshold; and in response to the data responsive to the second action meeting the quality threshold determining that the first input sentence is a second input sentence having a signal indicative of user satisfaction; and generating data that precludes invocation of the first action for the second input sentence. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A non-transitory computer readable storage medium storing instructions executable by a data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising:
-
accessing command input logs storing; data defining received input sentences, each input sentence being one or more n-grams; data indicating a first action performed by user devices from which input sentences were received, the first action having been performed, in part, in response to an input sentence being successfully parsed by a first parsing rule that is associated with the first action; identifying first input sentences that are successfully parsed by the parsing rule; identifying a second input sentence having a signal indicative of user satisfaction, wherein the second input sentence is identified from among the first input sentences, and the signal is derived from data that is independent of performance of the first action, the identifying comprising, for each first input sentence; determining that a second action for which the first input sentence was received as input was performed, the second action being different from the first action; determining that data responsive to the second action meets a quality threshold; and in response to the data responsive to the second action meeting the quality threshold, determining that the first input sentence is a second input sentence having a signal indicative of user satisfaction; and generating data that precludes invocation of the first action for the second input sentence. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A system, comprising:
-
a data processing apparatus; and a non-transitory computer readable storage medium in data communication with the data processing apparatus storing instructions executable by the data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising; accessing command input logs storing; data defining received input sentences, each input sentence being one or more n-grams; data indicating a first action performed by user devices from which input sentences were received, the first action having been performed, in part, in response to an input sentence being successfully parsed by a first parsing rule that is associated with the first action; identifying first input sentences that are successfully parsed by the parsing rule; identifying a second input sentence having a signal indicative of user satisfaction, wherein the second input sentence is identified from among the first input sentences, and the signal is derived from data that is independent of performance of the first action, the identifying comprising, for each first input sentence; determining that a second action for which the first input sentence was received as input was performed, the second action being different from the first action; determining that data responsive to the second action meets a quality threshold; and in response to the data responsive to the second action meeting the quality threshold, determining that the first input sentence is a second input sentence having a signal indicative of user satisfaction; and generating data that precludes invocation of the first action for the second input sentence. - View Dependent Claims (12, 13, 14, 15)
-
Specification