Performing machine actions in response to voice input

• US 9,684,721 B2
• Filed: 02/23/2015
• Issued: 06/20/2017
• Est. Priority Date: 09/07/2006
• Status: Active Grant

• Current Assignee: Wolfram Alpha LLC (Wolfram Research Incorporated)
• Original Assignee: Wolfram Alpha LLC (Wolfram Research Incorporated)
• Inventors: Wolfram, Stephen
• Primary Examiner(s): Chen, Qing
• Application Number:
  US14/629,398
• Publication Number:
  US 20150169769A1
• Time in Patent Office: 848 Days
• Field of Search: 717100, 717104-113, 717125, 717136, 717137, 704231, 704246-250, 704257, 704275, 707706-712, 707723, 707769-780, 715255, 715256, 715267
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 40/111 Mathematical or scientific formatting; Subscripts; Superscripts
• CPC Class Codes: G06F 8/30 Creation or generation of source code
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G16C 20/70 Machine learning, data mining or chemometrics

Abstract

In a method for determining an answer to a query expressed in an imprecise syntax, a formula for computing an answer to the query is determined. An answer is calculated using the formula, and the answer is then presented to the user.

Claims

1. A computer-implemented method, comprising:

receiving, at one or more computer processors, a user input in an imprecise syntax, wherein;

the user input in the imprecise syntax includes at least (i) a word, or a phrase, that corresponds to a formula having a plurality of mathematical or scientific parameters, and (ii) one or more words, and/or one or more phrases, that correspond to one or more parameter values corresponding to the formula,

the user input in the imprecise syntax is expressed using natural language and/or informal terminology spoken by a user, and

the user input in the imprecise syntax corresponds to a digital representation of an audio signal corresponding to speech spoken by the user, the digital representation of the audio signal corresponding to the speech spoken by the user having been generated by a voice recognition system;

analyzing, at the one or more computer processors, the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula;

calculating, at the one or more computer processors, a numerical result using the determined formula with the one or more parameter values integrated into the determined formula; and

generating, at the one or more computer processors, an output, using the numerical result, to perform a physical machine action.

2. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula further comprises:

determining a plurality of possible formulas that correspond to the user input in the imprecise syntax; and

at least one of (i) ranking the plurality of possible formulas, and (ii) eliminating one or more possible formulas of the plurality of possible formulas.

3. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula further comprises:

analyzing the user input in the imprecise syntax to identify a first parameter corresponding to a first parameter value in the one or more parameter values; and

determining the formula based, at least in part, on the identified first parameter.

4. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula further comprises:

identifying the formula from the user input in the imprecise syntax at least by;

parsing the user input in the imprecise syntax into a plurality of tokens,

re-arranging the plurality of tokens into a plurality of expressions in a precise syntax, and

analyzing the plurality of expressions in the precise syntax.

5. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula further comprises:

partitioning the user input in the imprecise syntax into a plurality of tokens, wherein each token of the plurality of tokens comprises a word, a phrase, or a numerical expression;

generating one or more expressions in a precise syntax using the plurality of tokens; and

providing the one or more expressions in the precise syntax to a plurality of modules, wherein each module of the plurality of modules is configured to at least one of i) determine formulas corresponding to a respective subject matter category, among a plurality of different subject matter categories of formulas, by analyzing the one or more expressions in the precise syntax provided to the module, and ii) evaluate formulas corresponding to the respective subject matter category, and wherein each module of the plurality of modules is implemented using software executed by the one or more computer processors.

6. The computer-implemented method of claim 5, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula further comprises:

for each module of the plurality of modules, providing an output of the module as one or more inputs to one or more other modules of the plurality of modules.

7. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula further comprises:

analyzing the user input in the imprecise syntax to determine a correspondence between (i) the one or more parameter values corresponding to the user input in the imprecise syntax and (ii) one or more mathematical or scientific parameters of the formula.

8. The computer-implemented method of claim 1, further comprising:

determining, at the one or more computer processors, that one or more additional parameter values are required to calculate the numerical result; and

electronically prompting, at the one or more computer processors, the user to provide additional information corresponding to the one or more additional parameter values.

9. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises displaying the numerical result on a display device.

10. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises electronically inserting the numerical result into an electronic document.

11. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises transmitting the numerical result to a computing device via a communication network.

12. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises sending the numerical result to a software application being executed by the one or more computer processors.

13. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises generating an audio signal indicative of the numerical result.

14. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises using the numerical result to control a motor.

15. The computer-implemented method of claim 1, wherein generating the output, using the numerical result, to perform the physical machine action further comprises using the numerical result to control a light.

16. The computer-implemented method of claim 1, further comprising:

displaying, at the one or more computer processors, on a display device, a graphical user interface mechanism for facilitating adjustment, by the user, of one or more mathematical or scientific parameters of the formula.

17. The computer-implemented method of claim 1, further comprising:

receiving, at the one or more computer processors, one or more respective indications of one or more respective adjustments of one or more respective parameter values corresponding to the formula;

calculating, at the one or more computer processors, an updated numerical result using i) the determined formula and ii) the one or more respective adjustments of the one or more respective parameter values corresponding to the formula; and

using, at the one or more computer processors, the updated numerical result to perform a subsequent physical machine action.

18. The computer-implemented method of claim 17, wherein receiving the one or more respective indications of the one or more respective adjustments of the one or more respective parameter values corresponding to the formula further comprises:

receiving a first indication of a first adjustment of a first parameter value corresponding to the formula;

wherein the first indication of the first adjustment of the first parameter value corresponding to the formula corresponds to a digital representation of an audio signal corresponding to subsequent speech spoken by the user, the digital representation of the audio signal corresponding to the subsequent speech spoken by the user having been generated by the voice recognition system.

19. The computer-implemented method of claim 17, wherein receiving the one or more respective indications of the one or more respective adjustments of the one or more respective parameter values corresponding to the formula further comprises:

receiving a first indication of a first adjustment of a first parameter value corresponding to the formula via a graphical user interface mechanism displayed on a display device.

20. The computer-implemented method of claim 17, wherein receiving the one or more respective indications of the one or more respective adjustments of the one or more respective parameter values corresponding to the formula further comprises:

receiving a first indication of a first adjustment of a first parameter value corresponding to the formula via a mechanical user interface device.

21. A system, comprising:

one or more memory devices; and

one or more processors coupled to the one or more memory devices;

wherein the one or more memory devices store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

receive a user input in an imprecise syntax, wherein;

the user input in the imprecise syntax includes at least (i) word, or a phrase, that corresponds to a formula having a plurality of mathematical or scientific parameters, and (ii) one or more words, and/or one or more phrases, that correspond to one or more parameter values corresponding to the formula,

the user input in the imprecise syntax is expressed using natural language and/or informal terminology spoken by a user, and

the user input in the imprecise syntax corresponds to a digital representation of an audio signal corresponding to speech spoken by the user, the digital representation of the audio signal corresponding to the speech spoken by the user having been generated by a voice recognition system;

wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

analyze the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula;

calculate a numerical result using the determined formula with the one or more parameter values integrated into the determined formula; and

generate an output, using the numerical result, to perform a physical machine action.

22. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

determine a plurality of possible formulas that correspond to the user input in the imprecise syntax; and

at least one of (i) ranking the plurality of possible formulas, and (ii) eliminating one or more possible formulas of the plurality of possible formulas.

23. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

identify the formula from the user input in the imprecise syntax at least by;

parsing the user input in the imprecise syntax into a plurality of tokens,

re-arranging the plurality of tokens into a plurality of expressions in a precise syntax, and

analyzing the plurality of expressions in the precise syntax.

24. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

partition the user input in the imprecise syntax into a plurality of tokens, wherein each token of the plurality of tokens comprises a word, a phrase, or a numerical expression;

generate one or more expressions in a precise syntax using the plurality of tokens; and

provide the one or more expressions in the precise syntax to a plurality of modules, wherein each module of the plurality of modules is configured to at least one of i) determine formulas corresponding to a respective subject matter category, among a plurality of different subject matter categories of formulas, by analyzing the one or more expressions in the precise syntax provided to the module, and ii) evaluate formulas corresponding to the respective subject matter category, and wherein each module of the plurality of modules is implemented using machine readable instructions, stored in the one or more memory devices, that are executed by the one or more processors.

25. The system of claim 24, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

for each module of the plurality of modules, provide an output of the module as one or more inputs to one or more other modules of the plurality of modules.

26. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

analyze the user input in the imprecise syntax to determine a correspondence between (i) the one or more parameter values corresponding to the user input in the imprecise syntax and (ii) one or more mathematical or scientific parameters of the formula.

27. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

determine that one or more additional parameter values are required to calculate the numerical result; and

electronically prompt the user to provide additional information corresponding to the one or more additional parameter values.

28. The system of claim 21, further comprising:

a display device coupled to the one or more processors;

wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to display the numerical result on the display device.

29. The system of claim 28, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

display, on the display device, a graphical user interface mechanism for facilitating adjustment, by the user, of one or more mathematical or scientific parameters of the formula.

30. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

electronically insert the numerical result into an electronic document.

31. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

transmit the numerical result to a computing device via a communication network.

32. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

send the numerical result to a software application being executed by the one or more processors.

33. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

use the numerical result to generate an audio signal.

34. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

use the numerical result to control a motor.

35. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

use the numerical result to control a light.

36. The system of claim 21, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

receive one or more respective indications of one or more respective adjustments of one or more respective parameter values corresponding to the formula;

calculate an updated numerical result using i) the determined formula and ii) the one or more respective adjustments of the one or more respective parameter values corresponding to the formula; and

use the updated numerical result to perform a subsequent physical machine action.

37. The system of claim 36, wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

receive a first indication of a first adjustment of a first parameter value corresponding to the formula;

wherein the first indication of the first adjustment of the first parameter value corresponding to the formula corresponds to a digital representation of an audio signal corresponding to subsequent speech spoken by the user, the digital representation of the audio signal corresponding to the subsequent speech spoken by the user having been generated by the voice recognition system.

38. The system of claim 36, further comprising:

a display device coupled to the one or more processors;

wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

receive a first indication of a first adjustment of a first parameter value corresponding to the formula via a graphical user interface mechanism displayed on the display device.

39. The system of claim 36, further comprising:

a mechanical user interface device;

wherein the one or more memory devices store further machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

receive a first indication of a first adjustment of a first parameter value corresponding to the formula via the mechanical user interface device.

40. The system of claim 21, further comprising:

the voice recognition system, coupled to the one or more processors.