Method and apparatus for performing dialog management in a computer conversational interface

• US 20020133355A1
• Filed: 01/10/2002
• Published: 09/19/2002
• Est. Priority Date: 01/12/2001
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Ross, Steven I., Zeller, Marijane M., Hyland, Christopher A., Howard, Kathleen A., MacAllister, Jeffrey G.
• Granted Patent: US 7,257,537 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A dialog management system functions to manage the dialog between a user of a computer system and one or more speech enabled software applications. The user provides spoken input to a microphone connected to the computer system, and hears responses from one or more applications through a speaker connected to the computer system. The dialog management system includes a dialog manager, a turn manager, a speak queue, dialog contexts, and dialog state. The dialog manager provides top-level control of the dialog and stores responses based on the user'"'"'s spoken input in a speak queue for later output to the user. The turn manager controls delivery of the responses to the user based on the dialog context and the dialog state, to provide a polite dialog with the user that enables the user to be in control of the dialog. The dialog context provides information about each dialog. The dialog state provides information about whose turn it is (computer or user) to speak.

Claims

1. A computerized interface for managing a dialog between a computer and a user of the computer, the computer having an audio input device and an audio output device, the computerized interface comprising:

a queue for retaining responses generated by the computer to spoken input from the user and received by the computer through the audio input device;

a dialog manager for placing the generated responses in the queue; and

a turn manager for managing audible rendering of the responses from the queue through the audio output device, so that the user receives each response as part of a dialog between the computer and the user, the turn manager conducting the dialog in a polite manner that is subject to control by the user.

2. The interface of claim 1, wherein the turn manager is subject to behavioral goals that include:

providing speech output including audible renditions of the responses when spoken to by the user;

asking permission of the user before providing speech output based on delayed answers and notifications; and

allowing the user to (i) change subject and/or (ii) interrupt in the dialog.

3. The interface of claim 1, wherein the turn manager provides the audible rendering of the responses in a delivery mode subject to selection by the user.

4. The interface of claim 3, wherein the delivery mode is one of an immediate delivery mode and a delayed delivery mode.

5. The interface of claim 1, wherein the turn manager manages the audible rendering of the responses based on dialog states that specify the current state of the dialog between the computer and the user.

6. The interface of claim 1, wherein the response is an announcement of an event of interest to the user as determined by the computer.

7. A method for managing a dialog between a computer and a user of the computer, the computer having an audio input device and an audio output device, the method comprising the computer-implemented steps of:

receiving responses generated by the computer to spoken input from the user and received by the computer through the audio input device;

placing the generated responses in a queue; and

managing audible rendering of the responses from the queue through the audio output device, so that the user receives each response as part of a dialog between the computer and the user, the dialog conducted in a polite manner that is subject to control by the user.

8. The method of claim 7, wherein the step of managing the audible rendering of the responses is performed subject to behavioral goals that include:

providing speech output including audible renditions of the responses when spoken to by the user;

asking permission of the user before providing speech output based on delayed answers and notifications; and

allowing the user to (i) change subject and/or (ii) interrupt in the dialog.

9. The method of claim 7, wherein the step of managing the audible rendering of responses is performed in a delivery mode subject to selection by the user.

10. The method of claim 9, wherein the delivery mode is one of an immediate delivery mode and a delayed delivery mode.

11. The method of claim 7, wherein the step of managing the audible rendering of the responses is based on dialog states that specify the current state of the dialog between the computer and the user.

12. The method of claim 7, wherein the response is an announcement of an event of interest to the user as determined by the computer.

14. The computer program product of claim 13, wherein the set of computer instructions comprises further instructions to manage the audible rendering of the responses subject to behavioral goals that include:

providing speech output including audible renditions of the responses when spoken to by the user;

asking permission of the user before providing speech output based on delayed answers and notifications; and

allowing the user to (i) change subject and/or (ii) interrupt in the dialog.

15. The computer program product of claim 13, wherein the set of computer instructions comprises further instructions to manage the audible rendering of responses based on a delivery mode subject to selection by the user.

16. The computer program product of claim 15, wherein the delivery mode is one of an immediate delivery mode and a delayed delivery mode.

17. The computer program product of claim 13, wherein the set of computer instructions comprises further instructions to manage the audible rendering of the responses based on dialog states that specify the current state of the dialog between the computer and the user.

18. The computer program product of claim 13, wherein the response is an announcement of an event of interest to the user as determined by the computer.

13. A computer program product comprising:

a computer usable medium for managing a dialog between a computer and a user of the computer; and

a set of computer program instructions embodied on the computer usable medium, including instructions to;

receive responses generated by the computer to spoken input from the user and received by the computer through the audio input device;

place the generated responses in a queue; and

manage audible rendering of the responses from the queue through the audio output device, so that the user receives each response as part of a dialog between the computer and the user, the dialog conducted in a polite manner that is subject to control by the user.

19. A computerized interface for managing a dialog between a computer and a user of the computer, the computer having an audio input device and an audio output device, the computerized interface comprising:

a queue for retaining responses generated by the computer to spoken input from the user and received by the computer through the audio input device;

means for placing the generated responses in the queue; and

means for managing audible rendering of the responses from the queue through the audio output device, so that the user receives each response as part of a dialog between the computer and the user, the dialog conducted in a polite manner that is subject to control by the user.

20. A computer program propagated signal product comprising:

a computer usable propagated medium for managing a dialog between a computer and a user of the computer; and

a set of computer program instructions embodied on the computer usable propagated medium, including instructions to;

receive responses generated by the computer to spoken input from the user and received by the computer through the audio input device;

place the generated responses in a queue; and

manage audible rendering of the responses from the queue through the audio output device, so that the user receives each response as part of a dialog between the computer and the user, the dialog conducted in a polite manner that is subject to control by the user.