Distributed language processing system and method of outputting intermediary signal thereof

• US 20060190268A1
• Filed: 12/12/2005
• Published: 08/24/2006
• Est. Priority Date: 02/18/2005
• Status: Abandoned Application

• Current Assignee: Delta Electronics Incorporated
• Original Assignee: Delta Electronics Incorporated
• Inventors: Wang, Jui-Chang
• Application Number:
  US11/302,029
• Publication Number:
  US 20060190268A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

A unified speech input dialogue interface, and a distributed multiple application-dependent language processing unit system with the unified speech recognition function and the unified dialogue interface are provided. The system not only provides a convenient user'"'"'s environment, but also enhances the whole performance of speech recognition. The distributed multiple application-dependent language processing unit system uses a speech input interface so that the user can be familiar with a simple, unified interface. The system also improves the speech recognition accuracy and enhances the convenience of use by self-learning personalized dialogue model.

Claims

1. A distributed language processing system, comprising:

a speech input interface, receiving a speech signal;

a speech recognition interface, according to the speech signal received, recognizing and then generating a speech recognition result;

a language processing unit, receiving and analyzing the speech recognition result to generate a semantic signal; and

a dialogue-management unit, receiving and determining the semantic signal, and then generating a semantic information corresponding to the speech signal.

2. The distributed language processing system of claim 1, wherein the speech recognition interface comprises a model adaptation function so that a sound model recognizes the speech signal through the model adaptation function.

3. The distributed language processing system of claim 1, further comprising a mapping unit between the speech recognition interface and the language processing unit, to receive and map the speech recognition result;

according to an output intermediary signal protocol, to generate and transmit a mapping signal serving as the speech recognition result to the language processing unit.

4. The distributed language processing system of claim 3, wherein a method of transmitting the mapping signal to the language processing unit comprises a broadcast method.

5. The distributed language processing system of claim 3, wherein a method of transmitting the mapping signal to the language processing unit comprises a method through a cable communication network.

6. The distributed language processing system of claim 3, wherein a method of transmitting the mapping signal to the language processing unit comprises a method through a wireless communication network.

7. The distributed language processing system of claim 3, wherein in the output intermediary signal protocol the mapping signal is formed of a plurality of word units and a plurality of sub-word units.

8. The distributed language processing system of claim 7, wherein the sub-word unit comprises a Chinese syllable.

9. The distributed language processing system of claim 8, wherein the sub-word unit comprises an English phoneme.

10. The distributed language processing system of claim 8, wherein the sub-word unit comprises a plurality of English phonemes.

11. The distributed language processing system of claim 8, wherein the sub-word unit comprises an English syllable.

12. The distributed language processing system of claim 3, wherein the mapping signal is a sequence composed of word units and sub-word units.

13. The distributed language processing system of claim 3, wherein the mapping signal is a lattice composed of a plurality of word units and a plurality of sub-word units.

14. The distributed language processing system of claim 1, wherein if the semantic information corresponding to the speech signal generated from the dialogue-management unit is a speech command, an action corresponding to the speech command is performed.

15. The distributed language processing system of claim 14, wherein if the semantic information corresponding to the speech signal generated from the dialogue-management unit is the speech command, it is determined whether the speech command is larger than a confident command;

if so, the action corresponding to the speech command is performed.

16. The distributed language processing system of claim 1, wherein the language processing unit comprises a language understanding unit and a data base, the language understanding unit receives and then analyzes the speech recognition result, and refers to the database to obtain the semantic signal corresponding to the speech recognition result.

17. The distributed language processing system of claim 1, wherein the system is structured according to a distributed architecture;

in the distributed architecture, the speech input interface, the speech recognition interface and the dialogue-management unit are at a user terminal; and

the language processing unit is at a system application server terminal.

18. The distributed language processing system of claim 17, wherein each system application server terminal comprises a language processing unit corresponding thereto, the language processing unit receives and analyzes the speech recognition result to obtain and transmit the semantic signal to the dialogue-management unit of a speech input/dialog processing interface apparatus;

and according to semantic signal from the system application server terminal, a multiple analysis is performed.

19. The distributed language processing system of claim 1, wherein according to a distributed architecture, the speech input interface, the speech recognition interface, the language processing unit and the dialogue-management unit are at a user terminal, and the language processing unit is at a system application server terminal.

20. The distributed language processing system of claim 1, wherein the speech recognition interface enhances recognition efficiency by learning according to a user'"'"'s dialogue custom.

21. The distributed language processing system of claim 1, wherein the speech input interface comprises a greeting control mechanism, and a greeting of the speech input interface can be changed by a user.

22. The distributed language processing system of claim 2, wherein in the model adaptation function, the sound model, which is speaker-dependent and device-dependent, refers to a common model, which is speaker-independent and device-independent as an initial model parameter to adjust a parameter of the sound model.

23. The distributed language processing system of claim 2, wherein the model adaptation function comprises using a lexicon as a basis for adaptation.

24. The distributed language processing system of claim 2, wherein the model adaptation function comprises an N-gram as a basis for adaptation.

25. A distributed language processing system, comprising:

a speech input interface, receiving a speech signal;

a speech recognition interface, according to the speech signal received, recognizing and then generating a speech recognition result;

a plurality of language processing units, receiving and analyzing the speech recognition result to generate a plurality of semantic signals; and

a dialogue-management unit, receiving and determining the semantic signals, and then generating a semantic information corresponding to the speech signal.

26. The distributed language processing system of claim 25, further comprising a mapping unit between the speech recognition interface and the language processing unit to receive and map the speech recognition result;

according to an output intermediary signal protocol, to generate and transmit a mapping signal serving as the speech recognition result to the language processing unit.

27. The distributed language processing system of claim 25, wherein if the semantic information corresponding to the speech signal generated from the dialogue-management unit is a speech command, an action corresponding to the speech command is performed.

28. The distributed language processing system of claim 27, wherein if the semantic information corresponding to the speech signal generated from the dialogue-management unit is the speech command, it is determined whether the speech command is larger than a confident command;

if so, the action corresponding to the speech command is performed.

29. The distributed language processing system of claim 25, wherein the language processing unit comprises a language understanding unit and a database, the language understanding unit receives and then analyzes the speech recognition result, and refers to the database to obtain the semantic signal corresponding to the speech recognition result.

30. The distributed language processing system of claim 25, wherein the system is structured according to a distributed architecture;

in the distributed architecture, the speech input interface, the speech recognition interface and the dialogue-management unit are at a user terminal; and

the language processing unit is at a system application server terminal.

31. The distributed language processing system of claim 30, wherein each system application server terminal comprises a language processing unit corresponding thereto;

the language processing unit receives and analyzes the speech recognition result to obtain and transmit the semantic signal to the dialogue-management unit of a speech input/dialog processing interface apparatus; and

according to semantic signal from the system application server terminal, a multiple analysis is performed.

32. The distributed language processing system of claim 25, wherein the speech recognition interface enhances recognition efficiency by learning according to a user'"'"'s dialogue custom.

33. The distributed language processing system of claim 25, wherein the speech input interface comprises a greeting control mechanism, and a greeting of the speech input interface can be changed by a user.

34. A method of outputting a intermediary signal, the method using an output intermediary signal protocol and being adapted for a distributed language processing system;

wherein the distributed language processing system is structured with a distributed architecture;

the distributed architecture comprises a user terminal and a system application server terminal;

the user terminal comprises a speech recognition interface and a dialogue-management unit;

the system application server terminal comprises a language processing unit; and

the method of outputting the intermediary signal comprises;

receiving and analyzing a speech signal by the speech recognition interface to generate a speech recognition result;

transforming the speech recognition result into a signal formed by a plurality of word units and a plurality of sub-word units according to the output intermediary signal protocol; and

transmitting the signal to the language processing unit for analysis to obtain a semantic signal; and

transmitting the semantic signal to the dialogue-management unit to generate a semantic information corresponding to the speech signal.

35. The method of outputting an intermediary signal of claim 34, wherein the sub-word unit comprises a Chinese syllable.

36. The method of outputting an intermediary signal of claim 34, wherein the sub-word unit comprises an English phoneme.

37. The method of outputting an intermediary signal of claim 34, wherein the sub-word unit comprises a plurality of English phonemes.

38. The method of outputting an intermediary signal of claim 34, wherein the sub-word unit comprises an English syllable.

39. The method of outputting an intermediary signal of claim 34, wherein the mapping signal is a sequence composed of the word units and sub-word units.

40. The method of outputting an intermediary signal of claim 34, wherein the mapping signal is a lattice composed of the word units and sub-word units.