Machine interface

• US 7,043,439 B2
• Filed: 03/27/2001
• Issued: 05/09/2006
• Est. Priority Date: 03/29/2000
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Jost, Uwe Helmut, Hogenhout, Wide Roeland
• Primary Examiner(s): ABEBE, DANIEL DEMELASH
• Application Number:
  US09/817,342
• Publication Number:
  US 20020055916A1
• Time in Patent Office: 1,869 Days
• Field of Search: 704/270, 704/275, 379/88.23, 345/727
• US Class Current: 704/275
• CPC Class Codes: G06F 16/90332 Natural language query formulation or dialogue systems

Abstract

A machine interface allows a user to select a machine operation. A plurality of questions are stored for output to a user. A score indicating the likelihood that the user will select a machine operation is stored for each corresponding machine operation. A next question for output to the user is selected from the stored questions by determining, for each of a plurality of the questions, an average of the least number of questions required to be answered by the user to arrive at each machine operation weighted by the respective scores, and selecting the question having the lowest average number. The selected question is output and an answer is received from the user. In response to the input answer a machine operation is carried out and/or the stored scores for each of the plurality of machine operations is adjusted. At least one further selection of a next question is then carried out for output to the user using the adjusted stored scores. A set of data determined from at least one input answer may be stored identified by a bookmark so that it can be retrieved when the bookmark identifier is determined from an input answer.

Claims

1. A machine having a machine interface to allow a user to select a machine operation, the machine interface comprising:

outputting means for outputting questions to the user;

inputting means for receiving input answers to the questions; and

processing means for determining a set of data from at least one said input answer and for using the set of data to execute a said machine operation and for determining a question for output by said outputting means, said processing means being adapted to store a set of data determined from at least one said input answer identified as a bookmark and to retrieve said set of data when the bookmark identifier is determined from a said input answer;

keyword determining means for determining keywords using the said at least one input answer, wherein said set of data comprises at least one keyword and said bookmark identifier comprises said at least one keyword;

score storage means for storing a score for each of a plurality of machine operations, the score indicating the likelihood that the user will select a corresponding machine operation keyword; and

storage means for storing said at least one keyword and scores for said at least one keyword for each machine operation, said scores indicating the likelihood that a user wishes to select a machine operation having caused a said keyword to be input,

said processing means being adapted to use the determined keywords and said keyword storage means to adjust said scores in said score storage means, to use the adjusted scores to identify said machine operation to be executed, and to adjust the scores for kevwords stored in said keyword storage means using said at least one keyword of said bookmark identifier.

2. A machine according to claim 1, wherein said processing means is adapted to automatically determine said bookmark identifier using the response to an initial question when a said machine operation is selected to be executed.

3. A machine according to claim 1, wherein said inputting means is adapted to input a bookmark instruction and a said bookmark identifier, said processing means being responsive to said bookmark instruction to store the current set of data determined from said at least one input answer identified by said bookmark identifier.

4. A machine according to claim 1, wherein said processing means is adapted to execute a said machine operation when said set of data uniquely identifies said machine operation.

5. A machine according to claim 1, wherein said processing means is adapted to determine said set of data from pieces of input information.

6. A machine according to claim 5, wherein said processing means is adapted to execute a said machine operation when said set of data is complete.

7. A machine according to claim 1, wherein said processing means is adapted to determine said set of data by looking up data associated with an output question using the input answer.

8. A machine according to claim 1, wherein said processing means is adapted to select a question for outputting by said outputting means in dependence upon previous answers received.

9. A machine according to claim 1, wherein said processing means is adapted to select a question for outputting by said outputting means from a list of questions.

10. A method of providing a machine interface to allow a user to select a machine operation, the method comprising:

outputting questions to the user;

receiving input answers to the questions;

determining a set of data from at least one said input answer;

using the set of data to execute a machine operation or determining and outputting a question to the user,

wherein a set of data determined from at least one input answer identified as a bookmark is stored and said set of data is retrieved when the bookmark identifier is determined from a said input answer;

determining keywords using the input answers, wherein the set of data comprises at least one keyword and the bookmark identifier comprises the at least one keyword;

providing a store with scores for a plurality of machine operations, each score indicating the likelihood that the user will select a corresponding machine operation;

providing a store of the at least one keyword and scores for the at least one keyword for each machine operation, the scores indicating the likelihood that a user wishes to select a machine operation having caused a said keyword input;

using the determined keywords to look up scores stored for keywords to adjust the scores for each machine operation;

using the adjusted scores to identify the machine operation to be executed; and

adjusting the scores for stored keywords using the at least one keyword of the bookmark identifier.

11. A method according to claim 10, wherein the bookmark identifier is automatically determined using the response to an initial question when a said machine operation is selected to be executed.

12. A method according to claim 10, including inputting a bookmark instruction and a said bookmark identifier, wherein the current set of data determined from the at least one input answer identified by the bookmark identifier is stored in response to the input of the bookmark instruction.

13. A method according to claim 10, wherein a said machine operation is executed when the set of data uniquely identifies the machine operation.

14. A method according to claim 10, wherein the set of data is determined from pieces of input information.

15. A method according to claim 14, wherein a said machine operation is executed when the set of data is complete.

16. A method according to claim 10, wherein the set of data is determined by looking up data associated with an output question using the input answer.

17. A method according to claim 10, wherein a question is selected for outputting in dependence upon previous answers received.

18. A method according to claim 10, wherein a question is selected for outputting from a list of questions.

19. A program code stored on a computer readable medium for controlling a processor to implement the method claim 10.

20. A machine having a machine interface to allow a user to select a machine operation, the machine interface comprising:

question storage means for storing a plurality of questions for output to the user;

score storage means for storing a score for each of a plurality of machine operations, said score indicating the likelihood that the user will select a corresponding machine operation;

question selection means for selecting a next question for output to the user from said question storage means by determining, for each of a plurality of said questions, an average of the least number of questions required to be answered by the user to arrive at each said machine operation weighted by the respective scores, and selecting a question having the lowest average number;

outputting means for outputting the selected question to the user;

inputting means for receiving an input answer to the question from the user; and

processing means for responding to the input answer by carrying out a said machine operation and/or by adjusting the scores for each of the plurality of machine operations stored in said operation storage means,

said question selection means being adapted to carry out at least one further selection of a said next question using the adjusted scores stored in said operation storage means for output by said outputting means.

21. A machine according to claim 20, wherein said question storage means is adapted to store, for a specified answer, for each of a plurality of the questions, an identifier for a corresponding machine operation to be carried out in response to input of the specified answer, and said processing means is responsive to a said specified answer to a said question to carry out the machine operation identified by a corresponding the identifier for the specified answer.

22. A machine according to claim 20, wherein said processing means is responsive to the input answer to carry out a said machine operation having the most significant score stored in said operation storage means.

23. A machine according to claim 20, wherein said question storage means is adapted to store expected answers to the questions from the user, and said question selection means is adapted to determine the least number of questions by predicting the expected answers input by the user to select each of the machine operations.

24. A machine according to claim 20, including word storage means for storing keywords for each of said plurality of machine operations;

and keyword determining means for determining keywords using said input answer;

wherein said processing means is adapted to match the determined keywords to the keywords stored in said word storage means, and to adjust the scores for each of the plurality of machine operations in dependence upon the matching.

25. A machine according to claim 24, wherein said word storage means is adapted to store scores for the keywords for each of the plurality of machine operations, and said processing means is adapted to determine scores for determined keywords for each of the plurality of machine operations by matching the determined keywords to the keywords stored in said word storage means, and to adjust the scores for each of the plurality of machine operations using the determined scores for keywords.

26. A machine according to claim 24, wherein said question storage means is adapted to store keywords associated with expected answers to at least some of the questions, and said keyword determining means is adapted to determine keywords from the association with an input answer using said question storage means.

27. A machine according to claim 20, wherein said question selection means is adapted to use a recursive process for the determining process to identify sequences of questions to select each the machine operation.

28. A machine according to claim 27, wherein said question selection means is adapted to carry out the recursive process for each sequence until the sequence length reaches a threshold length.

29. A machine according to claim 20, wherein said question selection means is adapted to perform the determining for each of a plurality of questions, by determining an average of the least number of questions required to be answered to arrive at only the machine operations having the highest scores weighted by the respective scores.

30. A machine according to claim 20, wherein said question selection means is adapted to perform the determining only for questions the answers to which can cause the score of a most likely machine operation to increase.

31. A machine according to claim 20, wherein said question selection means is adapted to select a plurality of the questions for use as the plurality of questions in the determining process by selecting a plurality of questions assigned the highest score, and to determine scores for the questions by using at least one of three techniques, namely;

I. taking the score of the machine instruction having the highest score after asking the question and predicting an answer;

II. assigning a high score to questions relating to the same topic as a previous input answer, and

III. assigning a high score to questions relating to the same topic as any previous answers.

32. A machine according to claim 31, wherein said question selection means is adapted to determine scores for the questions by using all three techniques and taking a weighted average of the determined scores.

33. A machine according to claim 20, wherein said score storage means is adapted to store scores for hierarchical classifications of the machine operations, each hierarchical classification comprising a topic to which the machine operations in the hierarchy below relate and having a score comprising the sum of the scores for the machine operations in the hierarchy below, the machine interface including uncertainty means for indicating uncertainty to a user if the score for any of the hierarchical classifications at predetermined level of hierarchical classification is below a threshold.

34. A machine according to claim 20, including means for uniformly decaying the scores for each said machine operation stored in said score storage means by a predetermined amount after a question has been answered.

35. A machine according to claim 20, including means to allow questions to be entered into or adjusted in said question storage means.

36. A machine according to claim 20, including means to allow scores to be entered into or adjusted in said score storage means.

37. A machine according to claim 24, including means to allow words to be entered into or adjusted in said word storage means.

38. A machine according to claim 20, wherein said outputting means is adapted to generate speech and said inputting means is adapted to recognise speech.

39. A method of providing a machine interface to allow a user to select a machine operation, the method comprising:

providing a stored plurality of questions for output to the user;

providing a stored score for each of a plurality of machine operations, each score indicating the likelihood that the user will select a corresponding machine operation;

selecting a next question for output to the user from the stored questions by determining, for each of a plurality of said questions, an average of the least number of questions required to be answered by the user to arrive at each said machine operation weighted by the respective scores, and selecting a question having the lowest average number;

outputting the selected question to the user;

receiving an input answer from the user; and

responding to the input answer by carrying out a said machine operation and/or by adjusting the stored scores for each of the plurality of machine operations; and

repeating the selecting step using the adjusted scores and subsequently repeating the outputting, receiving and responding steps.

40. A method according to claim 39, wherein for a specified answer, for each of a plurality of said questions, an identifier for a corresponding machine operation to be carried out in response to input of said specified answer is stored, and in response to said specified answer being received from the user to a said question, the machine operation identified by a corresponding said identifier for a specified answer is executed.

41. A method according to claim 39, wherein a said machine operation having a stored score which is of a threshold significance is executed in response to the input answer.

42. A method according to claim 39, wherein expected answers to said questions from the user are stored with the questions, and in said selecting step, the least number of questions is determined by predicting the expected answers input by the user to select each of the machine operations.

43. A method according to claim 39, including providing stored keywords for each of the plurality of machine operations, and determining keywords using the input answer, wherein the input answers are responded to by matching the determined keywords to the stored keywords and adjusting the scores for each of the plurality of machine operations in dependence upon the matching step.

44. A method according to claim 43, wherein scores for the keywords for each of the plurality of machine operations is stored, scores for determined keywords for each of the plurality of machine operations are determined by matching the determined keywords to the stored keywords, and the scores for each of said plurality of machine operations are adjusted using the determined scores for keywords.

45. A method according to claim 43, wherein keywords associated with expected answers to at least some of the questions are stored, and the step of determining keywords comprises determining keywords from the association of stored keywords with an input answer.

46. A method according to claim 39, wherein the selecting step comprises a recursive process to identify sequences of questions to select each said machine operation.

47. A method according to claim 46, wherein the selecting step carries out the recursive process for each sequence until the sequence length reaches a threshold length.

48. A method according to claim 39, wherein in the selecting step the determination for each of a plurality of questions is carried out by determining an average of the least number of questions required to be answered to arrive at only the machine operations having the highest scores weighted by the respective scores.

49. A method according to claim 39, wherein the selecting step performs the determination only for questions the answer to which can cause the score for a most likely machine operation to increase.

50. A method according to claim 39, wherein said selection step selects a plurality of said questions for use as the plurality of questions in the determination by selecting a plurality of questions assigned the highest score, and determines scores for the questions by using at least one of three techniques, namely:

(i) taking the score of the machine instruction having the highest score after asking the questions and predicting an answer,

(ii) assigning a high score to questions relating to the same topic as a previous input answer, and

(iii) assigning a high score to questions relating to the same topic as any previous input answers.

51. A method according to claim 50, wherein said selecting step determines scores for the questions by using all three techniques and taking a weighted average of the determined scores.

52. A method according to claim 39, wherein scores for hierarchical classifications of the machine operations are stored, each hierarchical classification comprising a topic to which the machine operations in the hierarchy below relate and having a score comprising the sum of the scores for the machine operations in the hierarchy below;

the method including indicating uncertainty to a user if the score for any of the hierarchical classifications at a predetermined level of hierarchical classification is below a threshold.

53. A method according to claim 39, including uniformly decaying the scored scores for each said machine operation by a predetermined amount after a question has been answered.

54. A method according to claim 39, including receiving and storing new questions, or receiving instructions to adjust stored questions.

55. A method according to claim 39, including receiving and storing new scores for new machine operations, or instructions to adjust stored scores for current machine operations.

56. A method according to claim 43, including receiving and storing new keywords or receiving instructions to adjust stored keywords.

57. A method according to claim 39, wherein the outputting step includes the generation of speech and the inputting step includes the recognition of speech.

58. A program code stored on a computer readable medium for controlling a processor to carry out the method claim 39.

59. A machine having a machine interface to allow a user to select a machine operation, the machine interface comprising:

score storage means for storing a score for each of a plurality of machine operations, said score indicating the likelihood that the user will select a corresponding machine operation;

question selection means for selecting a next question for output to the user from a question storage means by determining, for each of a plurality of said questions, an average of the least number of questions required to be answered by the user to arrive at each said machine operation weighted by the respective scores, and selecting a question having the lowest average number;

outputting means for outputting the selected question to the user;

inputting means for receiving an input answer to the question from the user; and

processing means for responding to the input answer by carrying out a said machine operation and/or by adjusting the scores for each of the plurality of machine operations stored in said operation storage means;

said question selection means being adapted to carry out at least one further selection of a said next question using the adjusted scores stored in said operation storage means for output by said outputting means; and

said processing means further being adapted to store a set of data determined from at least one said input answer identified as a bookmark and to retrieve said set of data when the bookmark identifier is determined from a said input answer.

60. A method of providing a machine interface to allow a user to select a machine operation, the method comprising:

providing a stored score for each of a plurality of machine operations, each score indicating the likelihood that the user will select a corresponding machine operation;

selecting a next question for output to the user from a plurality of stored questions by determining, for each of a plurality of said questions, an average of the least number of questions required to be answered by the user to arrive at each said machine operation weighted by the respective scores, and selecting a question having the lowest average number;

outputting the selected question to the user;

receiving an input answer from the user;

responding to the input answer by carrying out a said machine operation and/or by adjusting the stored scores for each of the plurality of machine operations; and

repeating the selecting step using the adjusted scores and subsequently repeating the outputting, receiving and responding steps, which method further comprises identifying whether an input answer corresponds to a stored bookmark and when the input answer is identified as corresponding to a stored bookmark, retrieving a set of data corresponding to that bookmark.

61. A program code stored on a computer readable medium for controlling a processor to carry out the method claim 60.