Speech recognition conversation selection device, speech recognition conversation system, speech recognition conversation selection method, and program

• US 20040162731A1
• Filed: 11/04/2003
• Published: 08/19/2004
• Est. Priority Date: 04/04/2002
• Status: Abandoned Application

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Yamada, Eiko, Hagane, Hiroshi
• Application Number:
  US10/476,638
• Publication Number:
  US 20040162731A1
• Time in Patent Office: Days
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context

Abstract

In a voice recognition dialogue system having a plurality of recognition dialogue servers, there is no framework to select and determine one recognition dialogue server. A client 10 transmits its ability information stored in a terminal information storage 140 to a recognition dialogue selecting server 20. The ability of the client 10 includes a CODEC ability (CODEC type, CODEC compression mode, etc.), a voice data format (compressed voice data, feature vector, etc.), a recorded voice I/O function, a synthesized voice I/O function (without synthesizing engine, with intermediate representation input engine, with character string input engine, etc.), and service contents. The recognition dialogue selecting server 20 receives the ability information transmitted from the client 10, and determines the optimum recognition dialogue server according to ability information of plural recognition dialogue servers which has been stored in a recognition dialogue server information storage 230 and information of the requested service contents.

Claims

1. A voice recognition dialogue apparatus comprising:

a plurality of dialogue means for performing a voice recognition dialogue;

transmitting means for transmitting voice information to the dialogue means;

a network which connects the transmitting means and the dialogue means; and

selecting means for selecting one dialogue means among the plurality of dialogue means according to an ability of the transmitting means and abilities of the plurality of dialogue means.

4. The voice recognition dialogue apparatus as claimed in claim 1 or 3, wherein the selecting means has functions of transmitting information for specifying selected dialogue means to the transmitting means and exchanging voice information necessary for performing a voice recognition dialogue between the selected dialogue means and the transmitting means.

6. The voice recognition dialogue apparatus as claimed in claim 4 or 5, wherein the selecting means has a function of changing one selected dialogue means to another selected dialogue means.

7. The voice recognition dialogue apparatus as claimed in any one of claim 1, 3, 4 or 6, wherein the selecting means has functions of comparing the ability of the transmitting means with the abilities of the plurality of dialogue means and, according to a compared result, determining such dialogue means with a desired ability that an input format of voice information input into the dialogue means and an output format of the voice information output to the transmitting means coincide with.

9. The voice recognition dialogue apparatus as claimed in claim 1, wherein the voice information output from the transmitting means may be formed of digitized voice data, compressed voice data, or feature vector data.

10. The voice recognition dialogue apparatus as claimed in claim 1, wherein data for determining the ability of the transmitting means includes data of:

a CODEC ability, a voice data format, and a recorded/synthesized voice I/O function.

11. The voice recognition dialogue apparatus as claimed in claim 1, wherein data for determining the ability of the dialogue means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice output function, a service content, a recognition ability and operational information.

2. A voice recognition dialogue apparatus comprising:

a plurality of dialogue means for performing a voice recognition dialogue;

requesting means for requesting a service to the dialogue means;

transmitting means for transmitting voice information to the dialogue means;

a network which connects the transmitting means, the requesting means and the dialogue means; and

selecting means for selecting one dialogue means among the plurality of dialogue means according to the service and abilities of the transmitting means and abilities of the plurality of dialogue means.

5. The voice recognition dialogue apparatus as claimed in claim 2, wherein the selecting means has functions of transmitting information for specifying selected dialogue means to the transmitting means and exchanging the service content and voice information between the selected dialogue means, and the requesting means and the transmitting means.

8. The voice recognition dialogue apparatus as claimed in any one of claim 2, 5 or 6, wherein the selecting means has functions of comparing the service and abilities of the transmitting means with the abilities of the plurality of dialogue means and, according to a compared result, determining such dialogue means with a desired ability that an input format of voice information input into the dialogue means and an output format of the voice information output to the transmitting means coincide with.

3. A voice recognition dialogue apparatus comprising:

a plurality of dialogue means for performing a voice recognition dialogue;

service retaining means for retaining a service content requested to the dialogue means;

transmitting means for transmitting voice information to the dialogue means;

a network which connects the service retaining means, the transmitting means and the dialogue means; and

selecting means for selecting one dialogue means among the plurality of dialogue means according to the service and abilities of the transmitting means and abilities of the plurality of dialogue means.

12. A voice recognition dialogue apparatus comprising:

a plurality of voice recognition dialogue servers for performing a voice recognition dialogue;

a client for transmitting a service content and voice information requested to the voice recognition dialogue servers;

a voice recognition dialogue selecting server for selecting one dialogue means among a plurality of dialogue means; and

a network which connects the client, the voice recognition dialogue servers and the voice recognition dialogue selecting server;

wherein

the client includes;

a data input unit for inputting data of the voice information and the service content, a terminal information storage for storing ability data of the client, a data communication unit for performing communications between the voice recognition dialogue server and the voice recognition selecting server over the network and transmitting the voice information to a selected voice recognition dialogue server, and a controller for controlling an operation of the client,

the voice recognition dialogue selecting server includes;

a data communication unit for performing communications between the client and the voice recognition dialogue server over the network, a recognition dialogue server information storage for storing an ability of each of the voice recognition dialogue servers, and a recognition dialogue server determining unit for reading out the ability data of the client stored in the terminal information storage, comparing the ability data with the ability data of the voice recognition dialogue servers stored in the recognition dialogue server information storage, determining at least one voice recognition dialogue server among the plurality of voice recognition dialogue servers, and transmitting information necessary for specifying a determined voice recognition dialogue server to the client, and

the voice recognition dialogue server includes;

a voice recognition dialogue executing unit for executing a voice recognition dialogue according to the voice information input from the client, a data communication unit for performing communications between the client and the voice recognition dialogue selecting server over the network, and a controller for controlling an operation of the voice recognition dialogue server.

13. The voice recognition dialogue apparatus as claimed in claim 12, further comprising:

a service content retaining server which is connected to the network and retains the service content requested from the client, and a reading unit which is provided in the voice recognition dialogue server and reads into the service content retained in the service content retaining server.

14. The voice recognition dialogue apparatus as claimed in claim 12 or 13, further comprising:

process transferring means, provided in the voice recognition dialogue server, for outputting to the voice recognition dialogue selecting server a request for transferring a voice recognition dialogue processing to another voice recognition dialogue server.

15. The voice recognition dialogue apparatus as claimed in claim 12, wherein the voice information output from the client may be formed of digitized voice data, compressed voice data, or feature vector data.

16. The voice recognition dialogue apparatus as claimed in claim 12, wherein data for determining the ability of the client includes data of:

a CODEC ability, a voice data format, and a recorded/synthesized voice I/O function.

17. The voice recognition dialogue apparatus as claimed in claim 12, wherein data for determining the ability of the voice recognition dialogue server includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice output function, a service content, a recognition ability and operational information.

18. A voice recognition dialogue selecting method for performing data communications between transmitting means and a plurality of dialogue means over a network and for performing a process of transmitting voice information data output from the transmitting means to specific dialogue means, the method comprising:

a first step of receiving voice information data from the transmitting means;

a second step of requesting ability data of the transmitting means to the transmitting means;

a third step of transmitting the ability data of the transmitting means from the transmitting means;

a fourth step of comparing the ability data from the transmitting means with ability data of the plurality of dialogue means, and determining specific dialogue means according to a compared result,

a fifth step of informing the transmitting means of information for specifying determined dialogue means; and

a sixth step of performing a voice recognition dialogue processing between the transmitting means and the determined dialogue means.

19. The voice recognition dialogue selecting method as claimed in claim 18, further comprising:

a seventh step of transmitting a request, during the voice recognition dialogue processing between the transmitting means and the dialogue means, for transferring a counterpart of the transmitting means from the dialogue means to another dialogue means;

an eighth step of requesting the ability data of the transmitting means to the transmitting means;

a ninth step of transmitting the ability data of the transmitting means from the transmitting means responding to a request in the eighth step;

a tenth step of comparing the ability data of the transmitting means with the ability data of the plurality of dialogue means, and determining new dialogue means according to a compared result;

an eleventh step of informing the transmitting means of information necessary for specifying dialogue means determined in the tenth step; and

a twelfth step of performing the voice recognition dialogue processing between the dialogue means determined in the tenth step and the transmitting means.

22. The voice recognition dialogue selecting method as claimed in claim 18, wherein as the voice information, voice information including digitized voice data, compressed voice data, or feature vector data is used.

23. The voice recognition dialogue selecting method as claimed in claim 18, wherein data for determining the ability of the transmitting means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice I/O function and a service content.

24. The voice recognition dialogue selecting method as claimed in claim 18, wherein data for determining the ability of the dialogue means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice output function, a service content, a recognition ability and operational information.

20. A voice recognition dialogue selecting method for performing data communications between transmitting means, a plurality of dialogue means and service retaining means over a network, and for performing a process of transmitting voice information data output from the transmitting means to specific dialogue means, the method comprising:

a first step of receiving a request for a service content including a voice recognition dialogue processing output from the transmitting means;

a second step of requesting ability data of the transmitting means to the transmitting means;

a third step of transmitting the ability data of the transmitting means from the transmitting means;

a fourth step of comparing the ability data of the transmitting means with ability data of the plurality of dialogue means and determining specific dialogue means among the plurality of dialogue means according to a compared result;

a fifth step of informing the transmitting means of information necessary for specifying dialogue means determined in the fourth step;

a sixth step of performing the voice recognition dialogue processing between the transmitting means and the dialogue means determined in the fourth step;

a seventh step of requesting the service content requested from the transmitting means, from the dialogue means determined in the fourth step to the service retaining means;

an eighth step of transmitting the service content requested in the seventh step to the dialogue means determined in the fourth step;

a ninth step of reading into the service content transmitted in the eighth step by the dialogue means determined in the fourth step; and

a tenth step of performing the voice recognition dialogue processing between the transmitting means and the dialogue means determined in the fourth step according to the service content read into.

21. The voice recognition dialogue selecting means as claimed in claim 20, further comprising:

an eleventh step of transmitting a request, during the voice recognition dialogue processing between the transmitting means and the dialogue means, for transferring a counterpart of the transmitting means from the dialogue means to another dialogue means;

a twelfth step of requesting the ability data of the transmitting means to the transmitting means;

a thirteenth step of transmitting the ability data of the transmitting means from the transmitting means;

a fourteenth step of comparing the ability data of the transmitting means with the ability data of the plurality of dialogue means, and determining new dialogue means according to a compared result;

a fifteenth step of informing the transmitting means of information necessary for specifying dialogue means determined in the fourteenth step; and

a sixteenth step of performing a voice recognition dialogue processing between the dialogue means determined in the fourteenth step and the transmitting means.

25. A voice recognition dialogue selecting apparatus for performing data communications between transmitting means and a plurality of dialogue means over a network, the apparatus comprising, selecting means for selecting specific dialogue means and transmitting voice information data output from the transmitting means to the specific dialogue means, wherein

when selecting, the selecting means specifies the dialogue means according to an ability of the transmitting means and abilities of the plurality of dialogue means.

26. A voice recognition dialogue selecting apparatus for performing data communications between transmitting means and a plurality of dialogue means over a network, and for performing a process of selecting specific dialogue means and transmitting voice information data output from the transmitting means to the specific dialogue means, the apparatus comprising:

first means for receiving voice information from the transmitting means and data indicating that the dialogue means is to be changed;

second means for requesting ability data of the transmitting means to the transmitting means;

third means for transmitting the ability data from the transmitting means responding to a request from the second means;

fourth means for comparing the ability data of the transmitting means with ability data of the plurality of the dialogue means, and determining dialogue means according to a compared result; and

fifth means for informing the transmitting means of information for specifying dialogue means determined in the fourth means.

27. The voice recognition dialogue selecting apparatus as claimed in claim 26, wherein the voice information includes digitized voice data, compressed voice data, or feature vector data.

28. The voice recognition dialogue selecting apparatus as claimed in claim 26, wherein data for determining the ability of the transmitting means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice I/O function and a service content.

29. The voice recognition dialogue selecting apparatus as claimed in claim 26, wherein data for determining the ability of the dialogue means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice output function, a service content, a recognition ability and operational information.

30. A recording medium for a voice recognition dialogue selecting program, in which a voice recognition dialogue selecting program, for performing data communications between transmitting means and a plurality of dialogue means over a network and for performing a process of transmitting voice information data output from the transmitting means to specific dialogue means, is recorded, the program comprising:

a first step of receiving the voice information data from the transmitting means;

a second step of requesting ability data of the transmitting means to the transmitting means;

a third step of transmitting the ability data of the transmitting means from the transmitting means;

a fourth step of comparing the ability data from the transmitting means with ability data of the plurality of dialogue means, and determining specific dialogue means according to a compared result;

a fifth step of informing the transmitting means of information for specifying determined dialogue means; and

a sixth step of performing a voice recognition dialogue processing between the transmitting means and the determined dialogue means.

31. The recording medium for the voice recognition dialogue selecting program as claimed in claim 30, in which the voice recognition dialogue selecting program is recorded, the program further comprising:

a seventh step of transmitting a request, during the voice recognition dialogue processing between the transmitting means and the dialogue means, for transferring a counterpart of the transmitting means from the dialogue means to another dialogue means;

an eighth step of requesting the ability data of the transmitting means to the transmitting means;

a ninth step of transmitting the ability data of the transmitting means from the transmitting means responding to a request in the eighth step;

a tenth step of comparing the ability data of the transmitting means with the ability data of the plurality of dialogue means, and determining new dialogue means according to a compared result;

an eleventh step of informing the transmitting means of information necessary for specifying dialogue means determined in the tenth step; and

a twelfth step of performing the voice recognition dialogue processing between the dialogue means determined in the tenth step and the transmitting means.

34. The recording medium for the voice recognition dialogue selecting program as claimed in claim 30, wherein as the voice information, voice information including digitized voice data, compressed voice data, or feature vector data is used.

35. The recording medium for the voice recognition dialogue selecting program as claimed in claim 30, wherein data for determining the ability of the transmitting means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice I/O function and a service content.

36. The recording medium for the voice recognition dialogue selecting program as claimed in claim 30, wherein data for determining the ability of the dialogue means includes data of:

a CODEC ability, a voice data format, a recorded/synthesized voice output function, a service content, a recognition ability and operational information.

32. A recording medium for a voice recognition dialogue selecting program, in which a voice recognition dialogue selecting program, for performing data communications between transmitting means, a plurality of dialogue means and service retaining means over a network and for performing a process of transmitting voice information data output from the transmitting means to specific dialogue means, is recorded, the program comprising:

a first step of receiving a request for a service content including a voice recognition dialogue processing output from the transmitting means;

a second step of requesting ability data of the transmitting means to the transmitting means;

a third step of transmitting the ability data of the transmitting means from the transmitting means;

a fourth step of comparing the ability data of the transmitting means with ability data of the plurality of dialogue means, and determining specific dialogue means among the plurality of dialogue means according to a compared result;

a fifth step of informing the transmitting means of information necessary for specifying dialogue means determined in the fourth step; and

a sixth step of performing the voice recognition dialogue processing between the transmitting means and the dialogue means determined in the fourth step;

a seventh step of requesting the service content requested from the transmitting means, from the dialogue means determined in the fourth step to the service retaining means;

an eighth step of transmitting the service content requested in the seventh step to the dialogue means determined in the fourth step;

a ninth step of reading into the service content transmitted in the eighth step by the dialogue means determined in the fourth step; and

a tenth step of performing the voice recognition dialogue processing between the transmitting means and the dialogue means determined in the fourth step according to the service content read into.

33. The recording medium for the voice recognition dialogue selecting program as claimed in claim 32, in which the voice recognition dialogue selecting program is recorded, the program further comprising:

an eleventh step of transmitting a request, during the voice recognition dialogue processing between the transmitting means and the dialogue means, for transferring a counterpart of the transmitting means from the dialogue means to another dialogue means;

a twelfth step of requesting the ability data of the transmitting means to the transmitting means;

a thirteenth step of transmitting the ability data of the transmitting means from the transmitting means;

a fourteenth step of comparing the ability data of the transmitting means with the ability data of the plurality of dialogue means, and determining new dialogue means according to a compared result;

a fifteenth step of informing the transmitting means of information necessary for specifying dialogue means determined in the fourteenth step; and

a sixteenth step of performing the voice recognition dialogue processing between the dialogue means determined in the fourteenth step and the transmitting means.