Voice processing apparatus

• US 6,601,029 B1
• Filed: 03/21/2000
• Issued: 07/29/2003
• Est. Priority Date: 12/11/1999
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Pickering, John Brian
• Primary Examiner(s): Abebe, Daniel
• Application Number:
  US09/532,103
• Time in Patent Office: 1,225 Days
• Field of Search: 704/275, 704/200, 704/231, 704/235, 704/246, 704/251, 704/256, 704/257, 704/261, 379/67.1, 379/75, 379/88.01, 379/88.04
• US Class Current: 704/257
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A voice processing system receives spoken input from a user, which is then subjected to speech recognition to convert the spoken input into a text equivalent. At least two information elements are identified in the text equivalent, each having an associated uncertainty. The system selects a prompt according to which information element has the greatest uncertainty, and this is then played out to the user. Typically the outgoing prompt is arranged to emphasise, via word order, volume, or some other mechanism, the information element in greatest doubt, thereby bringing it to the particular attention of the user, should correction be required.

Claims

1. A method of operating a voice processing system comprising the steps of:

receiving spoken input from a user;

performing speech recognition to convert said spoken input into a digital equivalent;

identifying at least two information elements in said digital equivalent, each having an uncertainty associated therewith;

selecting a prompt containing said at least two information elements and emphasizing one of said at least two information elements that has the greatest uncertainty associated therewith; and

playing out said selected prompt to the user.

2. The method of claim 1, wherein said prompt is selected from a set of two or more possible prompts, each possible prompt containing the same information but having different emphasis.

3. The method of claim 2, wherein the different emphasis is achieved by varying prompt word order.

4. The method of claim 2, wherein the different emphasis is achieved by varying the volume of one or more words in the prompt.

5. The method of claim 2, wherein the different emphasis is achieved by varying the duration of one or more words in the prompt.

6. The method of claim 2, wherein the different emphasis is achieved by varying the pitch of one or more words in the prompt.

7. The method of claim 1, wherein said uncertainty for an information element is based on the speech recognition confidence level associated with that information element.

8. The method of claim 1, further comprising the steps of:

receiving a second spoken input from said user;

performing speech recognition to convert said second spoken input into a second text equivalent;

identifying at least two information elements in said second text equivalent, each having an uncertainty associated therewith;

and reaching an error condition if the uncertainty associated with the at least two information elements in said second text equivalent is greater than that for the at least two information elements in said text equivalent.

9. The method of claim 1, in which said voice processing system and said user communicate with each other over a telephone network, whereby said spoken input is received over a telephone connection, and said prompt is played out over the telephone connection.

10. Voice processing apparatus comprising:

an input device which receives spoken input from a user;

a speech recognition unit which converts said spoken input into a digital equivalent;

a natural language understanding unit which identifies at least two information elements in said digital equivalent, each having an uncertainty associated therewith;

a prompt generator which selects a prompt containing said at least two information elements and emphasizing one of said at least two information elements that has the greatest uncertainty associated therewith; and

an output device which plays out said selected prompt to the user.

11. The apparatus of claim 10, wherein said prompt is selected from a set of two or more possible prompts, each possible prompt containing the same information but having different emphasis.

12. The apparatus of claim 11, wherein the different emphasis is achieved by varying prompt word order.

13. The apparatus of claim 11, wherein the different emphasis is achieved by varying the volume of one or more words in the prompt.

14. The apparatus of claim 11, wherein the different emphasis is achieved by varying the duration of one or more words in the prompt.

15. The apparatus of claim 11, wherein the different emphasis is achieved by varying the pitch of one or more words in the prompt.

16. The apparatus of claim 10, wherein said uncertainty for an information element is based on the speech recognition confidence level associated with that information element.

17. The apparatus of claim 10, wherein said apparatus further receives a second spoken input from said user, said speech recognition unit converting said second spoken input into a second text equivalent, and said natural language unit identifying at least two information elements in said second text equivalent, each having an uncertainty associated therewith;

and wherein said apparatus reaches an error condition if the uncertainty associated with the at least two information elements in said second text equivalent is greater than that for the at least two information elements in said text equivalent.

18. The apparatus of claim 10, in which said input and output devices are connected to a telephone network to allow said apparatus to communicate with said user, whereby said spoken input is received over a telephone connection, and said prompt is played out over the telephone connection.

19. A computer readable medium containing instructions readable by a computer system operating as a voice processing system, said instructions including instructions for causing the computer system to perform the following steps:

receiving spoken input from a user;

performing speech recognition to convert said spoken input into a digital equivalent;

identifying at least two information elements in said digital equivalent, each having an uncertainty associated therewith;

selecting a prompt containing said at least two information elements and emphasizing one of said at least two information elements that has the greatest uncertainty associated therewith; and

playing out said selected prompt to the user.

20. The medium of claim 19, wherein said prompt is selected from a set of two or more possible prompts, each possible prompt containing the same information but having different emphasis.

21. The medium of claim 20, wherein the different emphasis is achieved by varying prompt word order.

22. The medium of claim 20, wherein the different emphasis is achieved by varying the volume of one or more words in the prompt.

23. The medium of claim 20, wherein the different emphasis is achieved by varying the duration of one or more words in the prompt.

24. The medium of claim 20, wherein the different emphasis is achieved by varying the pitch of one or more words in the prompt.

25. The medium of claim 19, wherein said uncertainty for an information element is based on the speech recognition confidence level associated with that information element.

26. The medium of claim 19, said instructions further including instructions for causing the computer system to perform the following steps:

receiving a second spoken input from said user;

performing speech recognition to convert said second spoken input into a second text equivalent;

identifying at least two information elements in said second text equivalent, each having an uncertainty associated therewith;

and reaching an error condition if the uncertainty associated with the at least two information elements in said second text equivalent is greater than that for the at least two information elements in said text equivalent.

27. The medium of claim 19, in which said voice processing system and said user communicate with each other over a telephone network, whereby said spoken input is received over a telephone connection, and said prompt is played out over the telephone connection.