Spoken Dialog System and Method

• US 20080201135A1
• Filed: 09/18/2007
• Published: 08/21/2008
• Est. Priority Date: 02/20/2007
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Yano, Takehide
• Application Number:
  US11/857,028
• Publication Number:
  US 20080201135A1
• Time in Patent Office: Days
• US Class Current: 704/201
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding

Abstract

A spoken dialog system stores a history of dialog states in a memory, outputs a system response in a current dialog state, inputs a user utterance, performs speech recognition of the user utterance, to obtain one or a plurality of recognition candidates of the user utterance and likelihoods thereof with respect to the user utterance, calculates a degree of state conformance of each of the current and the preceding dialog states stored in the memory with respect to the user utterance, selects one of the current and the preceding dialog states and one of the recognition candidates based on a combination of the degree of state conformance of each dialog state and the likelihood of each recognition candidate, and performs transition from the current dialog state to a new dialog state based on dialog state selected and recognition candidate selected.

Claims

1. A spoken dialog system comprising:

a memory to store a history of dialog states;

a response output unit configured to output a system response in a current dialog state;

an input unit configured to input a user utterance;

a speech recognition unit configured to perform speech recognition of the user utterance, to obtain one or a plurality of recognition candidates of the user utterance and likelihoods thereof with respect to the user utterance;

a calculation unit configured to calculate a degree of state conformance of each of the current and the preceding dialog states stored in the memory with respect to the user utterance;

a selection unit configured to select one of the current and the preceding dialog states and one of the recognition candidates based on a combination of the degree of state conformance of each dialog state and the likelihood of each recognition candidate, to obtain a selected dialog state and a selected recognition candidate; and

a transition unit configured to perform transition from the current dialog state to a new dialog state based on the selected dialog state and the selected recognition candidate.

2. The system according to claim 1, further comprising:

a information acquisition unit configured to acquire information accompanying the user utterance; and

wherein

the calculation unit calculates the degree of state conformance of each dialog state based on the information acquired by the information acquisition unit.

3. The system according to claim 2, wherein

the information acquisition unit acquires an input time of the user utterance, and

the calculation unit calculates the degree of state conformance of each dialog state based on a time from the instant the response output unit outputs the system response to the instant the user utterance is input.

4. The system according to claim 2, wherein

the information acquisition unit acquires information indicating a feeling of a user at the time of input of the user utterance, and

the calculation unit calculates the degree of state conformance of each dialog state based on the information indicating the feeling.

5. The system according to claim 1, further comprising:

a condition acquisition unit configured to acquire condition information, at the time of input of the user utterance, which influences a speech recognition result on the user utterance, and wherein

the calculation unit calculates the degree of state conformance of each dialog state based on the condition information.

6. The system according to claim 5, wherein the condition acquisition unit acquires a magnitude of noise at the time of input of the user utterance as the condition information.

7. The system according to claim 1, wherein

the memory stores, in correspondence with each dialog state in the history, a degree of current state conformance indicating the degree of state conformance with respect to a user utterance input when the response output unit outputs a system response in the dialog state, and

the calculation unit calculates the degree of state conformance of each dialog state based on the degree of current state conformance of each dialog state stored in the memory.

8. The system according to claim 1, wherein the selection unit selects the one of the current and the preceding dialog states and one of the recognition candidates based on a combination of the degree of state conformance of each dialog state, the likelihood of each recognition candidate, and a degree of semantic conformance indicating a degree of conformance of a meaning of each recognition candidate with respect to each dialog state.

9. A method for a spoken dialog system comprising:

storing, in a memory, a history of dialog states;

outputting a system response in a current dialog state;

inputting a user utterance;

performing speech recognition of the user utterance, to obtain one or a plurality of recognition candidates of the user utterance and likelihoods thereof with respect to the user utterance;

calculating a degree of state conformance of each of the current and the preceding dialog states stored in the memory with respect to the user utterance;

selecting one of the current and the preceding dialog states and one of the recognition candidates based on a combination of the degree of state conformance of each dialog state and the likelihood of each recognition candidate, to obtain a selected dialog state and a selected recognition candidate; and

performing transition from the current dialog state to a new dialog state based on the selected dialog state and the selected recognition candidate.

10. The method according to claim 9, further comprising:

acquiring information accompanying the user utterance; and

wherein

calculating calculates the degree of state conformance of each dialog state based on the information acquired.

11. The method according to claim 10, wherein

acquiring the information acquires an input time of the user utterance, and

calculating calculates the degree of state conformance of each dialog state based on a time from the instant the system response is output to the instant the user utterance is input.

12. The method according to claim 10, wherein

acquiring the information acquires the information indicating a feeling of a user at the time of input of the user utterance, and

calculating calculates the degree of state conformance of each dialog state based on the information indicating the feeling.

13. The method according to claim 9, further comprising:

acquiring condition information, at the time of input of the user utterance, which influences a speech recognition result on the user utterance, and wherein

calculating calculates the degree of state conformance of each dialog state based on the condition information.

14. The method according to claim 13, wherein the acquiring the condition information acquires a magnitude of noise at the time of input of the user utterance as the condition information.

15. The method according to claim 9, wherein

storing stores, in the memory, in correspondence with each dialog state in the history, a degree of current state conformance indicating the degree of state conformance with respect to a user utterance input when the system response in the dialog state is output, and

calculating calculates the degree of state conformance of each dialog state based on the degree of current state conformance of each dialog state stored in the memory.

16. The method according to claim 9, wherein selecting selects the one of the current and the preceding dialog states and one of the recognition candidates based on a combination of the degree of state conformance of each dialog state, the likelihood of each recognition candidate, and a degree of semantic conformance indicating a degree of conformance of a meaning of each recognition candidate with respect to each dialog state.

17. A computer readable storage medium storing instructions of a computer program which when executed by a computer results in performance of steps comprising:

storing, in a memory, a history of dialog states;

outputting a system response in a current dialog state;

inputting a user utterance;

performing speech recognition of the user utterance, to obtain one or a plurality of recognition candidates of the user utterance and likelihoods thereof with respect to the user utterance;

calculating a degree of state conformance of each of the current and the preceding dialog states stored in the memory with respect to the user utterance;

selecting one of the current and the preceding dialog states and one of the recognition candidates based on a combination of the degree of state conformance of each dialog state and the likelihood of each recognition candidate, to obtain a selected dialog state and a selected recognition candidate; and

performing transition from the current dialog state to a new dialog state based on the selected dialog state and the selected recognition candidate.