Method and system for determining an answer to a query

• US 10,380,201 B2
• Filed: 06/16/2017
• Issued: 08/13/2019
• Est. Priority Date: 09/07/2006
• Status: Active Grant

• Current Assignee: Wolfram Alpha LLC (Wolfram Research Incorporated)
• Original Assignee: Wolfram Alpha LLC (Wolfram Research Incorporated)
• Inventors: Wolfram, Stephen
• Primary Examiner(s): Chen, Qing
• Application Number:
  US15/625,769
• Publication Number:
  US 20170286543A1
• Time in Patent Office: 788 Days
• Field of Search: 717100, 717104-113, 717125, 717136, 717137, 704231, 704246-250, 704257, 704275, 707706-712, 707769-780, 715255, 715256, 715267
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 40/111 Mathematical or scientific formatting; Subscripts; Superscripts
• CPC Class Codes: G06F 8/30 Creation or generation of source code
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G16C 20/70 Machine learning, data mining or chemometrics

Abstract

User input in an imprecise syntax (e.g., expressed using natural language and/or informal terminology) is received, the user input including a query requesting information determinable by a formula and one or more indications of parameter values corresponding to the formula. The user input is analyzed to determine the formula with the one or more parameter values integrated into the formula. An answer to the query is calculated using the determined formula, and electronic display information is generated that, when displayed by a display device, renders an indication of the answer.

Claims

1. A computer-implemented method comprising:

receiving, at one or more computer processors, a user input in an imprecise syntax, wherein the user input in the imprecise syntax includes at least (i) a query requesting information determinable by a formula having a plurality of mathematical or scientific parameters, and (ii) one or more indications of one or more parameter values corresponding to the formula, wherein the user input in the imprecise syntax is expressed using natural language and/or informal terminology provided by a user, and wherein receiving the user input in the imprecise syntax includes at least one of;

a) receiving the user input in the imprecise syntax via a communication network, and

b) receiving the user input in the imprecise syntax via a user interface device;

analyzing, at one or more computer processors, the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula;

calculating, at one or more computer processors, an answer to the query using the determined formula with the one or more parameter values integrated into the formula; and

wherein analyzing the user input in the imprecise syntax and calculating the answer to the query includes;

generating a plurality of expressions in a precise syntax based on the user input in the imprecise syntax,

providing the plurality of expressions in the precise syntax to a plurality of inputs of a plurality of modules, and

selecting the answer as one of a plurality of results generated by the plurality of modules, wherein the plurality of modules are coupled together such that a respective output of each of at least some of the plurality of modules is coupled to one or more respective inputs of one or more other modules, and such that at least some of the plurality of results generated by the plurality of modules are evaluations of outputs of the plurality of modules fed back as inputs to the plurality of modules;

wherein each of at least some of the plurality of modules is configured to at least one of i) determine formulas corresponding to a respective subject matter category, among a plurality of different subject matter categories of formulas, by analyzing expressions provided to the module, and ii) evaluate formulas corresponding to the respective subject matter category;

wherein each of the plurality of modules is implemented using software executed by the one or more computer processors;

wherein the computer-implemented method further comprises generating, at one or more computer processors, electronic display information that, when displayed by a display device, renders an indication of the answer; and

wherein the computer-implemented method further comprises at least one of;

i) transmitting the electronic display information via the communication network to a computer including, or coupled to, the display device, and

ii) displaying the electronic display information on the display device.

2. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax and calculating the answer to the query includes:

at least one of (i) ranking the plurality of results generated by the plurality of modules, and (ii) eliminating one or more results of the plurality of results generated by the plurality of modules to generate a subset of results; and

determining the formula using at least one of i) the ranking of the plurality of results, and ii) the subset of results.

3. The computer-implemented method of claim 1, further comprising:

analyzing, at one or more computer processors, the user input in the imprecise syntax to determine a correspondence between (i) the one or more parameter values in the user input in the imprecise syntax and (ii) one or more parameters of the formula; and

determining, at one or more computer processors, the formula with the one or more parameter values integrated into the formula using the determined correspondence.

4. The computer-implemented method of claim 1, wherein receiving the user input in the imprecise syntax comprises receiving a digital representation, generated by a voice recognition system, of a query spoken by the user.

5. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula comprises:

analyzing the user input in the imprecise syntax to identify a first parameter corresponding to a first parameter value in the one or more parameter values; and

determining the formula based, at least in part, on the identified first parameter.

6. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula comprises:

identifying, at one or more computer processors, the formula from the user input in the imprecise syntax at least by;

parsing the user input in the imprecise syntax into a plurality of tokens, and

re-arranging the plurality of tokens into the plurality of expressions in the precise syntax;

wherein calculating the answer to the query comprises providing the plurality of expressions in the precise syntax to the plurality of inputs of the plurality of modules.

7. The computer-implemented method of claim 1, wherein analyzing the user input in the imprecise syntax to determine the formula with the one or more parameter values integrated into the formula comprises:

partitioning the user input in the imprecise syntax into a plurality of tokens, wherein each token of the plurality of tokens comprises a word, a phrase, or a numerical expression; and

generating the plurality of expressions in the precise syntax using the plurality of tokens.

8. The computer-implemented method of claim 1, further comprising:

determining, at one or more processors, that one or more additional parameter values are required to calculate the answer to the query; and

causing, at one or more processors, a request, represented as electronic information, for the one or more additional parameter values to be, at least one of;

i) transmitted via the communication network, and

ii) displayed on the display device.

9. The computer-implemented method of claim 1, further comprising generating, at one or more processors, an output that is (i) mathematically related to the formula and (ii) separate from the answer;

wherein generating the electronic display information includes generating the electronic display information such that, when the electronic display information is displayed by the display device, an indication of the output, separate from the answer, is also shown.

10. The computer-implemented method of claim 1, wherein generating the electronic display information comprises:

generating the electronic display information to include a graphical user interface control for facilitating adjustment of one or more parameters of the formula such that, when the electronic display information is displayed by the display device, the graphical user interface control is also shown.

11. The computer-implemented method of claim 1, further comprising:

dynamically generating, at one or more computer processors, software programming language code, in a precise syntax, for evaluating the formula; and

at least one of;

i) transmitting the software programming language code via the communication network, and

ii) displaying the software programming language code on the display device.

12. The computer-implemented method of claim 11, wherein the software programming language code includes code that can be evaluated by a spreadsheet software application.

13. The computer-implemented method of claim 11, wherein:

the electronic display information is generated to include the software programming language code; and

at least one of;

i) transmitting the electronic display information via the communication network includes transmitting the software programming language code, and

ii) displaying the electronic display information on the display device includes displaying the software programming language code on the display device.

14. The computer-implemented method of claim 11, further comprising at least one of:

i) transmitting a graphical user interface via the communication network, and

ii) displaying the graphical user interface on the display device;

wherein the graphical user interface is configured to insert the software programming language code in a file in response to user manipulation of the graphical user interface.

15. The computer-implemented method of claim 14, wherein:

the electronic display information is generated to include the graphical user interface; and

at least one of;

i) transmitting the electronic display information via the communication network includes transmitting the graphical user interface, and

ii) displaying the electronic display information on the display device includes displaying the graphical user interface on the display device.

16. The computer-implemented method of claim 14, wherein:

the software programming language code includes code that can be evaluated by a spreadsheet software application; and

the graphical user interface is configured to insert the software programming language code in a spreadsheet file in response to user manipulation of the graphical user interface.

17. The computer-implemented method of claim 16, wherein the graphical user interface is configured to insert the software programming language code in a spreadsheet cell selected by the user.

18. A system comprising:

a computing system having one or more processors communicatively coupled to at least one of;

i) a communication network, and ii) a user interface device and a display device;

one or more memory devices coupled to the computing system, wherein the one or more memory devices store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

implement a plurality of modules that are coupled together such that a respective output of each of at least some of the plurality of modules is coupled to one or more respective inputs of one or more other modules, and such that at least some results generated by the plurality of modules are evaluations of outputs of the plurality of modules fed back as inputs to the plurality of modules;

wherein each of at least some of the plurality of modules is configured to at least one of i) determine formulas corresponding to a respective subject matter category, among a plurality of different subject matter categories of formulas, by analyzing expressions provided to the module, and ii) evaluate formulas corresponding to the respective subject matter category;

wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

analyze a user input in an imprecise syntax to determine a formula with one or more parameter values, corresponding to the formula, integrated into the formula, wherein;

the user input in the imprecise syntax includes at least (i) a query requesting information determinable by the formula having a plurality of mathematical or scientific parameters, and (ii) one or more indications of the one or more parameter values corresponding to the formula,

the user input in the imprecise syntax is expressed using natural language and/or informal terminology provided by a user,

analyzing the user input in the imprecise syntax includes generating a plurality of expressions in a precise syntax based on the user input in the imprecise syntax, and

at least one of;

a) the user input in the imprecise syntax was received via the communication network, and

b) the user input in the imprecise syntax was received via the user interface device;

wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

calculate an answer to the query using the determined formula with the one or more parameter values integrated into the formula, including i) providing the plurality of expressions in the precise syntax to a plurality of inputs of a plurality of modules, and ii) select the answer as one of a plurality of results generated by the plurality of modules, and

generate electronic display information that, when displayed by the display device, renders an indication of the answer; and

wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to, at least one of;

i) prompt the one or more processors to transmit the electronic display information via the communication network, and

ii) control the display device to display the electronic display information on the display device.

19. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

at least one of (i) rank the plurality of results generated by the plurality of modules, and (ii) eliminate one or more results of the plurality of results generated by the plurality of modules to generate a subset of results; and

determine the formula using at least one of i) the ranking of the plurality of results, and ii) the subset of results.

20. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

analyze the user input in the imprecise syntax to determine a correspondence between (i) the one or more parameter values in the user input in the imprecise syntax and (ii) one or more parameters of the formula; and

determine the formula with the one or more parameter values integrated into the formula using the determined correspondence.

21. The system of claim 18, wherein the user input in the imprecise syntax includes a digital representation, generated by a voice recognition system, of a query spoken by the user.

22. The system of claim 21, wherein the computing system includes the voice recognition system.

23. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

identify the formula from the user input in the imprecise syntax at least by;

parsing the user input in the imprecise syntax into a plurality of tokens, and

re-arranging the plurality of tokens into the plurality of expressions in the precise syntax.

24. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

partition the user input in the imprecise syntax into a plurality of tokens, wherein each token of the plurality of tokens comprises a word, a phrase, or a numerical expression; and

generate the plurality of expressions in the precise syntax using the plurality of tokens.

25. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

determine that one or more additional parameter values are required to calculate the answer to the query; and

at least one of;

i) transmit a request, represented as electronic information, for the one or more additional parameter values via the communication network, and

ii) control the display device to display the request.

26. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

generate the electronic display information to include a graphical user interface control for facilitating adjustment of one or more parameters of the formula such that, when the electronic display information is displayed by the display device, the graphical user interface control is also shown.

27. The system of claim 18, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

dynamically generate software programming language code, in a precise syntax, for evaluating the formula; and

at least one of;

i) transmit the software programming language code via the communication network, and

ii) control the display device to display the software programming language code.

28. The system of claim 27, wherein the software programming language code includes code that can be evaluated by a spreadsheet software application.

29. The system of claim 27, wherein:

the electronic display information is generated to include the software programming language code.

30. The system of claim 27, wherein the one or more memory devices further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to at least one of:

i) transmit a graphical user interface via the communication network, and

ii) control the display device to display the graphical user interface;

wherein the graphical user interface is configured to insert the software programming language code in a file in response to user manipulation of the graphical user interface.

31. The system of claim 30, wherein:

the electronic display information is generated to include the graphical user interface.

32. The system of claim 30, wherein:

the software programming language code includes code that can be evaluated by a spreadsheet software application; and

the graphical user interface is configured to insert the software programming language code in a spreadsheet file in response to user manipulation of the graphical user interface.

33. The system of claim 32, wherein the graphical user interface is configured to insert the software programming language code in a spreadsheet cell selected by the user.

34. The system of claim 18, further comprising:

the user interface device; and

the display device;

wherein;

the user input in the imprecise syntax was received via the user interface device, and

the one or more memory devices store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to control the display device to display the electronic display information on the display device.

35. The system of claim 34, further comprising:

a remote computer communicatively coupled to the communication network;

wherein the remote computer includes, or is coupled to, i) the user interface device, and ii) the display device;

wherein the one or more processors include i) a first set of one or more processors, and ii) a second set of one or more processors;

wherein the one or more memory devices include i) a first set of one or more memory devices coupled to the first set of one or more processors, and ii) a second set of one or more memory devices coupled to the second set of one or more processors;

wherein the remote computer includes;

the second set of one or more processors, and

the second set of one or more memory devices;

wherein the first set of one or more memory devices store machine readable instructions that, when executed by the first set of one or more processors, cause the first set of one or more processors to;

receive the user input in the imprecise syntax via the communication network, and

transmit the electronic display information via the communication network; and

wherein the second set of one or more memory devices store machine readable instructions that, when executed by the second set of one or more processors, cause the second set of one or more processors to;

receive the user input in the imprecise syntax via the user interface device,

transmit the user input in the imprecise syntax to the first set of one or more processors via the communication network,

receive the electronic display information from the first set of one or more processors via the communication network, and

control the display device to display the electronic display information on the display device.

36. One or more tangible non-transitory computer readable media storing machine readable instructions that, when executed by one or more processors, cause the one or more processors to:

implement a plurality of modules that are coupled together such that a respective output of each of at least some of the plurality of modules is coupled to one or more respective inputs of one or more other modules, and such that at least some results generated by the plurality of modules are evaluations of outputs of the plurality of modules fed back as inputs to the plurality of modules;

wherein each of at least some of the plurality of modules is configured to at least one of i) determine formulas corresponding to a respective subject matter category, among a plurality of different subject matter categories of formulas, by analyzing expressions provided to the module, and ii) evaluate formulas corresponding to the respective subject matter category;

wherein the one or more tangible non-transitory computer readable media further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

analyze a user input in an imprecise syntax to determine a formula with one or more parameter values, corresponding to the formula, integrated into the formula, wherein;

the user input in the imprecise syntax includes at least (i) a query requesting information determinable by the formula having a plurality of mathematical or scientific parameters, and (ii) one or more indications of the one or more parameter values corresponding to the formula,

the user input in the imprecise syntax is expressed using natural language and/or informal terminology provided by a user,

analyzing the user input in the imprecise syntax includes generating a plurality of expressions in a precise syntax based on the user input in the imprecise syntax, and

at least one of;

a) the user input in the imprecise syntax was received via a communication network, and

b) the user input in the imprecise syntax was received via a user interface device;

wherein the one or more tangible non-transitory computer readable media further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to;

calculate an answer to the query using the determined formula with the one or more parameter values integrated into the formula, including i) providing the plurality of expressions in the precise syntax to a plurality of inputs of a plurality of modules, and ii) selecting the answer as one of a plurality of results generated by the plurality of modules, and

generate electronic display information that, when displayed by a display device, renders an indication of the answer; and

wherein the one or more tangible non-transitory computer readable media further store machine readable instructions that, when executed by the one or more processors, cause the one or more processors to, at least one of;

i) prompt the one or more processors to transmit the electronic display information via the communication network, and

ii) control the display device to display the electronic display information on the display device.

37. The one or more tangible non-transitory computer readable media of claim 36, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

analyze the user input in the imprecise syntax to determine a correspondence between (i) the one or more parameter values in the user input in the imprecise syntax and (ii) one or more parameters of the formula; and

determine the formula with the one or more parameter values integrated into the formula using the determined correspondence.

38. The one or more tangible non-transitory computer readable media of claim 36, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

analyze the user input in the imprecise syntax to identify a first parameter corresponding to a first parameter value in the one or more parameter values; and

determine the formula based, at least in part, on the identified first parameter.

39. The one or more tangible non-transitory computer readable media of claim 36, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

parse the user input in the imprecise syntax into a plurality of tokens; and

re-arrange the plurality of tokens into the plurality of expressions in the precise syntax.

40. The one or more tangible non-transitory computer readable media of claim 36, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

partition the user input in the imprecise syntax into a plurality of tokens, wherein each token of the plurality of tokens comprises a word, a phrase, or a numerical expression; and

generate the plurality of expressions in the precise syntax using the plurality of tokens.

41. The one or more tangible non-transitory computer readable media of claim 36, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

generate the electronic display information to include a graphical user interface control for facilitating adjustment of one or more parameters of the formula such that, when the electronic display information is displayed by the display device, the graphical user interface control is also shown.

42. The one or more tangible non-transitory computer readable media of claim 36, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to:

dynamically generate software programming language code, in a precise syntax, for evaluating the formula; and

at least one of;

i) prompt the one or more processors to transmit the software programming language code via the communication network, and

ii) control the display device to display the software programming language code on the display device.

43. The one or more tangible non-transitory computer readable media of claim 42, further storing machine readable instructions that, when executed by the one or more processors, cause the one or more processors to, at least one of:

i) transmit a graphical user interface via the communication network, and

ii) control the display device to display the graphical user interface;

wherein the graphical user interface is configured to insert the software programming language code in a file in response to user manipulation of the graphical user interface.