Inducing command inputs from property sequences

• US 9,330,195 B1
• Filed: 06/25/2013
• Issued: 05/03/2016
• Est. Priority Date: 06/25/2013
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Uszkoreit, Jakob D., Blitzer, John, Sahin, Engin Cinar, Gupta, Rahul, Lin, Dekang, Pereira, Fernando, Chelba, Ciprian I.
• Primary Examiner(s): Vo, Truong
• Application Number:
  US13/926,836
• Time in Patent Office: 1,043 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 40/205 Parsing

Abstract

A method identifies pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of a first operation failure and a second operation success. The first operation data indicate a first operation performed on data from a first resource property in response to the first command input, and the second operation data indicate a second operation performed on data from a second resource property in response to the second command input. They system determines, from the identified pairs of first and second command inputs, command inputs for which a parsing rule that is associated with the second operation is to be generated.

Claims

1. A computer-implemented method performed by a data processing apparatus, the method comprising:

accessing command input logs storing data defining user device sessions;

identifying, from the command input logs, user device sessions that each respectively store;

a sequence of two or more command inputs, each command input specifying one or more parameter values, and each command input having a respective ordinal position in the sequence, and wherein the sequence includes at least one pair of a first command input that precedes a second command input in ordinal position in the sequence;

first operation data indicating a first operation performed on data from a first resource property in response to the first command input;

second operation data indicating a second operation performed on data from a second resource property in response to the second command input;

identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of a first operation failure and a second operation success; and

determining, from the identified pairs of first and second command inputs, command inputs for which a parsing rule that is associated with the second operation is to be generated.

2. The computer-implemented method of claim 1, wherein identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of and first operation failure and a second operation success comprises, for each pair of first and second command inputs:

determining that the first command input included a parameter value specified by a user; and

determining that the second command input included the same parameter value specified by the user.

3. The computer-implemented method of claim 1, wherein identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of and first operation failure and a second operation success comprises:

for each pair of first and second command inputs;

determining that the first command input included a parameter value specified by a user, the parameter value being of a parameter type; and

determining that the second command input included the same parameter value specified by the user; and

grouping the pairs of first and second command inputs according to corresponding parameter types of the parameter values specified by the pairs, each group corresponding to a particular parameter type.

4. The computer-implemented method of claim 3, wherein identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of and first operation failure and a second operation success further comprises:

determining a cardinality of each group of pairs of first and second command inputs; and

identifying only pairs of first and second command inputs from groups that meet a cardinality threshold as pairs of first and second command inputs for which the first and second operation data are indicative of and first operation failure and a second operation success.

5. The computer-implemented method of claim 4, wherein determining command inputs for which a parsing rule that is associated with the second operation is to be generated comprises determining a parsing rule that is associated with the second operation is to be generated from the first command inputs of the identified pairs of first and second command inputs.

6. The computer-implemented method of claim 1, wherein determining command inputs for which a parsing rule that is associated with the second operation is to be generated comprises determining a parsing rule that is associated with the second operation is to be generated from the first command inputs of the identified pairs of first and second command inputs.

7. The computer-implemented method of claim 1, wherein the parsing rule is a grammar based rule.

8. The computer-implemented method of claim 1, wherein the first command inputs are generated from voice command inputs.

9. The computer-implemented method of claim 1, wherein the first resource property is a search engine property for searching a plurality of corpora and the second resource property is a resource property that is different from the search engine property and for one particular corpus.

10. The computer-implemented method of claim 1, wherein the first and second resource properties are first and second corpora.

11. A non-transitory computer readable storage medium storing instructions executable by a data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising:

accessing command input logs storing data defining user device sessions;

identifying, from the command input logs, user device sessions that each respectively store;

a sequence of two or more command inputs, each command input specifying one or more parameter values, and each command input having a respective ordinal position in the sequence, and wherein the sequence includes at least one pair of a first command input that precedes a second command input in ordinal position in the sequence;

first operation data indicating a first operation performed on data from a first resource property in response to the first command input;

second operation data indicating a second operation performed on data from a second resource property in response to the second command input;

identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of a first operation failure and a second operation success; and

determining, from the identified pairs of first and second command inputs, command inputs for which a parsing rule that is associated with the second operation is to be generated.

12. The non-transitory computer readable storage medium of claim 11, wherein identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of and first operation failure and a second operation success comprises, for each pair of first and second command inputs:

determining that the first command input included a parameter value specified by a user; and

determining that the second command input included the same parameter value specified by the user.

13. The non-transitory computer readable storage medium of claim 11, wherein identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of and first operation failure and a second operation success comprises:

for each pair of first and second command inputs;

determining that the first command input included a parameter value specified by a user, the parameter value being of a parameter type; and

determining that the second command input included the same parameter value specified by the user; and

grouping the pairs of first and second command inputs according to corresponding parameter types of the parameter values specified by the pairs, each group corresponding to a particular parameter type.

14. The non-transitory computer readable storage medium of claim 13, wherein identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of and first operation failure and a second operation success further comprises:

determining a cardinality of each group of pairs of first and second command inputs; and

identifying only pairs of first and second command inputs from groups that meet a cardinality threshold as pairs of first and second command inputs for which the first and second operation data are indicative of and first operation failure and a second operation success.

15. The non-transitory computer readable storage medium of claim 14, wherein determining command inputs for which a parsing rule that is associated with the second operation is to be generated comprises determining a parsing rule that is associated with the second operation is to be generated from the first command inputs of the identified pairs of first and second command inputs.

16. The non-transitory computer readable storage medium of claim 11, wherein determining command inputs for which a parsing rule that is associated with the second operation is to be generated comprises determining a parsing rule that is associated with the second operation is to be generated from the first command inputs of the identified pairs of first and second command inputs.

17. The non-transitory computer readable storage medium of claim 11, wherein the parsing rule is a grammar based rule.

18. The non-transitory computer readable storage medium of claim 11, wherein the first command inputs are generated from voice command inputs.

19. The non-transitory computer readable storage medium of claim 11, wherein the first resource property is a search engine property for searching a plurality of corpora and the second resource property is a resource property that is different from the search engine property and for one particular corpus.

20. A system, comprising:

a data processing apparatus; and

a non-transitory computer readable storage medium in data communication with the data processing apparatus storing instructions executable by the data processing apparatus and that upon such execution causes the data processing apparatus to perform operations comprising;

accessing command input logs storing data defining user device sessions;

identifying, from the command input logs, user device sessions that each respectively store;

a sequence of two or more command inputs, each command input specifying one or more parameter values, and each command input having a respective ordinal position in the sequence, and wherein the sequence includes at least one pair of a first command input that precedes a second command input in ordinal position in the sequence;

first operation data indicating a first operation performed on data from a first resource property in response to the first command input;

second operation data indicating a second operation performed on data from a second resource property in response to the second command input;

identifying pairs of first and second command inputs from respective user device sessions for which the first and second operation data are indicative of a first operation failure and a second operation success; and

determining, from the identified pairs of first and second command inputs, command inputs for which a parsing rule that is associated with the second operation is to be generated.