Speech processing system

• US 20030220794A1
• Filed: 05/20/2003
• Published: 11/27/2003
• Est. Priority Date: 05/27/2002
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Che, Chiwei
• Application Number:
  US10/441,051
• Publication Number:
  US 20030220794A1
• Time in Patent Office: Days
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

A client-server speech processing system is provided in which the client terminal transmits digitised speech data over a data network to the server terminal. The client terminal varies the way in which the speech signal is digitised in dependence upon, for example, the traffic state of the data network. The remote server receives the digitised speech signal and processes it to generate processed digitised speech data that is independent of the variation of the digitisation process carried out at the client terminal. The processed digitised speech data is then passed to a speech recognition unit in the server terminal which compares the processed digitised speech data with a set of speech recognition models. The remote server is also arranged to vary the set of speech recognition models used by the speech recognition unit in dependence upon the way in which the digitising process was varied by the client terminal.

Claims

1. A speech processing system comprising:

a data network;

a processing terminal coupled to said data network and comprising;

a first receiver operable to receive an input speech signal;

a digitiser operable to digitise the received input speech signal to generate digitised speech data representative of the input speech signal;

a first varying device operable to dynamically vary a digitising parameter of said digitiser in dependence upon an external condition to generate digitised speech data that varies with the variation of said digitising parameter; and

a transmitter operable to transmit the digitised speech data over the data network; and

a server terminal coupled to said data network and comprising;

a second receiver operable to receive the digitised speech data from the data network;

a processor operable to process the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter that is varied by said first varying device;

a speech recogniser operable to compare the processed digitised speech data with a set of speech recognition models to generate a recognition result;

a third receiver operable to receive parameter data identifying the dynamic variation of said digitising parameter performed by said first varying device; and

a second varying device operable to dynamically vary the set of speech recognition models used by said speech recogniser in dependence upon the received parameter data.

2. A system according to claim 1, wherein said first varying device is operable to dynamically vary a plurality of digitising parameters of said digitiser in dependence upon said external condition.

3. A system according to claim 2, wherein said processor is operable to process the received digitised speech data to generate processed digitised speech data that is independent of the variation of at least one of the digitising parameters that are varied by said first varying device.

4. A system according to claim 3, wherein said third receiver is operable to receive parameter data identifying the dynamic variation of said at least one of said digitising parameters performed by said first varying device.

5. A system according to claim 3, wherein said processor is operable to process the received digitised speech data to generate processed digitised speech data that is independent of the variation of all of said digitising parameters that are varied by said first varying device.

6. A system according to claim 1, wherein said digitiser is operable to sample the received input speech signal and to quantise each sample to generate said digitised speech data.

7. A system according to claim 6, wherein said first varying device is operable to dynamically vary the rate at which said digitiser samples said input speech signal in dependence upon said external condition.

8. A system according to claim 6, wherein said first varying device is operable to dynamically vary the quantisation performed by said digitiser in dependence upon said external condition.

9. A system according to claim 6, wherein said digitiser comprises an encoder which is operable to encode the quantised speech samples to generate said digitised speech data.

10. A system according to claim 9, wherein said first varying device is operable to dynamically vary the encoding performed by said encoder in dependence upon said external condition.

11. A system according to claim 10, wherein said first varying device is operable to vary whether or not said encoder encodes the quantised speech data in dependence upon said external condition.

12. A system according to claim 10, wherein said first varying device is operable to select a lossless encoding technique or a non-lossless encoding technique to be performed by said encoder in dependence upon said external condition.

13. A system according to claim 1, further comprising a traffic monitor operable to monitor a traffic state within said data network and wherein said first varying device is operable to dynamically vary said digitising parameter of said digitiser in dependence upon the monitored traffic state within said data network.

14. A system according to claim 1, wherein said transmitter is operable to transmit parameter data to said data network, which parameter data identifies the dynamic variation of said digitising parameter performed by said first varying device.

15. A system according to claim 1, wherein said processing terminal further comprises a data packet generator operable to generate data packets using said digitised speech data and wherein said transmitter is operable to transmit said data packets to said data network.

16. A system according to claim 15, wherein each data packet includes parameter data identifying the processing performed by said digitiser to generate the digitised speech data within said data packet.

17. A system according to claim 16, wherein said processor of said server terminal is operable to extract said parameter data from each data packet and to process said received digitised speech data in dependence upon the parameter data within the data packet to generate said processed digitised speech data.

18. A system according to claim 17, wherein said processor of said server terminal is operable to output said parameter data extracted from said data packet to said third receiver.

19. A system according to claim 1, wherein said processor of said server terminal is operable to process said received digitised speech data to generate processed digitised speech data that is in a predetermined format suitable for use by said speech recogniser.

20. A system according to claim 1, wherein said server terminal comprises a data store for storing a plurality of sets of speech recognition models and wherein said second varying device is operable to dynamically vary the set of speech recognition models used by said speech recogniser by selecting a set of speech recognition models in dependence upon the received parameter data.

21. A system according to claim 20, wherein said second varying device comprises a lookup table relating parameter data to a set of speech recognition models to be used by said speech recogniser.

22. A system according to claim 1, wherein said server terminal includes a data store for storing a common set of speech recognition models and wherein said second varying device is operable to dynamically vary the common set of speech recognition models in dependence upon the received parameter data.

23. A system according to claim 22, wherein said second varying device comprises a neural network which is operable to vary the common set of speech recognition models in dependence upon the received parameter data.

24. A system according to claim 1, wherein said server terminal further comprises:

a speech model store operable to store one or more speech models each associated with respective parameter data identifying a different variation of said digitising parameter or parameters which can be performed by said first varying device; and

a comparator operable to compare said processed digitised speech data with said speech models to generate parameter data identifying the dynamic variation of said digitising parameter performed by said first varying device, and operable to output the generated parameter data to said third receiver.

25. A system according to claim 1, wherein said processing terminal comprises a sensor operable to sense said external condition, a comparator operable to compare the sensed external condition with a predetermined threshold value and wherein said first varying device is operable to change said digitising parameter in dependence upon a comparison result output by said comparator.

26. A system according to claim 1, wherein said first receiver of said processing terminal is operable to receive first digitised speech data as said input speech signal;

and wherein said digitiser is operable to generate second digitised speech data representative of the input speech signal from the first digitised speech data.

27. A system according to claim 26, wherein said processing terminal forms part of said data network and said first receiver receives said first digitised speech data from a client terminal.

28. A system according to claim 1, wherein said processing terminal forms part of a client terminal coupled to said data network.

40. A server terminal according to claim 27, further comprising a data store for storing a common set of speech recognition models and wherein said varying device is operable to dynamically vary the common set of speech recognition models in dependence upon the received parameter data.

41. A server terminal according to claim 40, wherein said varying device comprises a neural network which is operable to vary the common set of speech recognition models in dependence upon the received parameter data.

29. A server terminal couplable to a data network and comprising:

a first receiver operable to receive digitised speech data representative of an input speech signal, which digitised speech data varies in dependence upon the variation of a digitising parameter used to generate the digitised speech data;

a processor operable to process the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter;

a speech recogniser operable to compare the processed digitised speech data with a set of speech recognition models to generate a recognition result;

a second receiver operable to receive parameter data identifying the dynamic variation of said digitising parameter; and

a varying device operable to dynamically vary the set of speech recognition models used by said speech recogniser in dependence upon the received parameter data.

30. A server terminal according to claim 29, wherein said digitised speech data varies in dependence upon a plurality of digitising parameters used to generate the digitised speech data and wherein said processor is operable to process the received digitised speech data to generate processed digitised speech data that is independent of the variation of at least one of the digitising parameters that are varied.

31. A server terminal according to claim 30, wherein said second receiver is operable to receive parameter data identifying the dynamic variation of said at least one of said digitising parameters.

32. A server terminal according to claim 30, wherein said processor is operable to process the received digitised speech data to generate processed digitised speech data that is independent of the variation of all of said digitising parameters that are varied.

33. A server terminal according to claim 29, wherein said first receiver is operable to receive data packets including parts of said digitised speech data.

34. A server terminal according to claim 33, wherein each data packet includes parameter data identifying the processing performed to generate the digitised speech data within said data packet.

35. A server terminal according to claim 34, wherein said processor is operable to extract said parameter data from each data packet and to process said received digitised speech data in dependence upon the parameter data within the data packet to generate said processed digitised speech data.

36. A server terminal according to claim 35, wherein said processor is operable to output said parameter data extracted from said data packet to said third receiver.

37. A server terminal according to claim 29, wherein said processor is operable to process said received digitised speech data to generate processed digitised speech data that is in a predetermined format suitable for use by said speech recogniser.

38. A server terminal according to claim 29, comprising a data store for storing a plurality of sets of speech recognition models and wherein said varying device is operable to dynamically vary the set of speech recognition models used by said speech recogniser by selecting a set of speech recognition models in dependence upon the received parameter data.

39. A server terminal according to claim 38, wherein said varying device comprises a lookup table relating parameter data to a set of speech recognition models to be used by said speech recogniser.

42. A server terminal according to claim 29, further comprising:

a store operable to store one or more speech models each associated with respective parameter data identifying a different variation of said digitising parameter or parameters; and

a comparator operable to compare said processed digitised speech data with said speech models to generate parameter data identifying the dynamic variation of said digitising parameter, and operable to output the generated parameter data to said second receiver.

43. A speech processing method using a processing terminal, a data network and a server terminal, the method comprising:

at the processing terminal;

receiving an input speech signal;

digitising the received input speech signal to generate digitised speech data representative of the input speech signal;

a first varying step of dynamically varying a digitising parameter of said digitising step in dependence upon an external condition to generate digitised speech data that varies with the variation of said digitising parameter; and

transmitting the digitised speech data over the data network; and

at the server terminal;

receiving the digitised speech data from the data network;

processing the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter that is varied in said varying step;

comparing the processed digitised speech data with a set of speech recognition models to generate a recognition result;

receiving parameter data identifying the dynamic variation of said digitising parameter performed in said first varying step; and

a second varying step of dynamically varying the set of speech recognition models used in said comparing step in dependence upon the received parameter data.

44. A method according to claim 43, wherein said first varying step dynamically varies a plurality of digitising parameters of said digitising step in dependence upon said external condition.

45. A method according to claim 44, wherein said processing step processes the received digitised speech data to generate processed digitised speech data that is independent of the variation of at least one of the digitising parameters that are varied in said first varying step.

46. A method according to claim 45, wherein said step of receiving parameter data receives parameter data identifying the dynamic variation of said at least one of said digitising parameters performed in said first varying step.

47. A method according to claim 45, wherein said processing step processes the received digitised speech data to generate processed digitised speech data that is independent of the variation of all of said digitising parameters that are varied in said first varying step.

48. A method according to claim 43, wherein said digitising step samples the received input speech signal and quantises each sample to generate said digitised speech data.

49. A method according to claim 48, wherein said first varying step dynamically varies the rate at which said digitising step samples said input speech signal in dependence upon said external condition.

50. A method according to claim 48, wherein said first varying step dynamically varies the quantisation performed in said digitising step in dependence upon said external condition.

51. A method according to claim 48, wherein said digitising step comprises the step of encoding the quantised speech samples to generate said digitised speech data.

52. A method according to claim 51, wherein said first varying step dynamically varies the encoding performed in said encoding step in dependence upon said external condition.

53. A method according to claim 52, wherein said first varying step varies whether or not said encoding step encodes the quantised speech data in dependence upon said external condition.

54. A method according to claim 52, wherein said varying step selects a lossless encoding technique or a non-lossless encoding technique to be performed in said encoding step in dependence upon said external condition.

55. A method according to claim 43, further comprising the step of monitoring a traffic state within said data network and wherein said first varying step dynamically varies said digitising parameter of said digitising step in dependence upon the monitored traffic state within said data network.

56. A method according to claim 43, wherein said transmitting step transmits parameter data to said data network, which parameter data identifies the dynamic variation of said digitising parameter performed in said first varying step.

57. A method according to claim 43, wherein said processing terminal further comprises the step of generating data packets using said digitised speech data and wherein said transmitting step transmits said data packets to said data network.

58. A method according to claim 57, wherein each data packet includes parameter data identifying the processing performed in said digitising step to generate the digitised speech data within said data packet.

59. A method according to claim 58, wherein said processing step of said server terminal extracts said parameter data from each data packet and processes said received digitised speech data in dependence upon the parameter data within the data packet to generate said processed digitised speech data.

60. A method according to claim 59, wherein said processing step of said server terminal outputs said parameter data extracted from said data packet to said parameter data receiving step.

61. A method according to claim 43, wherein said processing step of said server terminal processes said received digitised speech data to generate processed digitised speech data that is in a predetermined format suitable for use in said comparing step.

62. A method according to claim 43, wherein said server terminal comprises a data store for storing a plurality of sets of speech recognition models and wherein said second varying step dynamically varies the set of speech recognition models used in said comparing step by selecting a set of speech recognition models in dependence upon the received parameter data.

63. A method according to claim 62, wherein said selecting step uses a lookup table relating parameter data to a set of speech recognition models to be used in said comparing step.

64. A method according to claim 43, wherein said server terminal includes a data store for storing a common set of speech recognition models and wherein said second varying step dynamically varies the common set of speech recognition models in dependence upon the received parameter data.

65. A method according to claim 64, wherein said second varying step uses a neural network to vary the common set of speech recognition models in dependence upon the received parameter data.

66. A method according to claim 43, wherein said server terminal further comprises the steps of:

storing one or more speech models each associated with respective parameter data identifying a different variation of said digitising parameter or parameters which can be performed in said first varying step; and

comparing said processed digitised speech data with said speech models to generate parameter data identifying the dynamic variation of said digitising parameter performed in said first varying step, and outputting the generated parameter data to said parameter data receiving step.

67. A method according to claim 43, further comprising the steps of, at said processing terminal, sensing said external condition, comparing the sensed external condition with a predetermined threshold value and wherein said first varying step changes said digitising parameter in dependence upon a comparison result output in said comparing step.

68. A method according to claim 43, wherein said receiving step of said processing terminal receives first digitised speech data as said input speech signal;

and wherein said digitising step generates second digitised speech data representative of the input speech signal from the first digitised speech data.

69. A method according to claim 43, wherein said processing terminal forms part of said data network and said receiving step of said processing terminal receives said first digitised speech data from a client terminal.

70. A method according to claim 43, wherein said processing terminal forms part of a client terminal coupled to said data network.

71. A speech processing method comprising:

receiving digitised speech data representative of an input speech signal, which digitised speech data varies in dependence upon the variation of a digitising parameter used to generate the digitised speech data;

processing the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter;

comparing the processed digitised speech data with a set of speech recognition models to generate a recognition result;

receiving parameter data identifying the dynamic variation of said digitising parameter; and

dynamically varying the set of speech recognition models used in said comparing step in dependence upon the received parameter data.

72. A method according to claim 71, wherein said digitised speech data varies in dependence upon a plurality of digitising parameters used to generate the digitised speech data and wherein said processing step processes the received digitised speech data to generate processed digitised speech data that is independent of the variation of at least one of the digitising parameters that are varied.

73. A method according to claim 72, wherein said step of receiving parameter data receives parameter data identifying the dynamic variation of said at least one of said digitising parameters.

74. A method according to claim 72, wherein said processing step processes the received digitised speech data to generate processed digitised speech data that is independent of the variation of all of said digitising parameters that are varied.

75. A method according to claim 71, wherein said receiving step receives data packets including parts of said digitised speech data.

76. A method according to claim 75, wherein each data packet includes parameter data identifying the processing performed to generate the digitised speech data within said data packet.

77. A method according to claim 76, wherein said processing step extracts said parameter data from each data packet and processes said received digitised speech data in dependence upon the parameter data within the data packet to generate said processed digitised speech data.

78. A method according to claim 77, wherein said processing step outputs said parameter data extracted from said data packet to said parameter data receiving step.

79. A method according to claim 71, wherein said processing step processes said received digitised speech data to generate processed digitised speech data that is in a predetermined format suitable for use in said speech recognition step.

80. A method according to claim 71, further comprising the step of storing a plurality of sets of speech recognition models and wherein said varying step dynamically varies the set of speech recognition models used in said comparing step by selecting a set of stored speech recognition models in dependence upon the received parameter data.

81. A method according to claim 80, wherein said selecting step uses a lookup table relating parameter data to a set of speech recognition models to be used in said comparing step.

82. A method according to claim 71, further comprising the step of storing a common set of speech recognition models and wherein said varying step dynamically varies the common set of speech recognition models in dependence upon the received parameter data.

83. A method according to claim 82, wherein said varying step uses a neural network to vary the common set of speech recognition models in dependence upon the received parameter data.

84. A method according to claim 71, wherein said server terminal further comprises the steps of:

storing one or more speech models each associated with respective parameter data identifying a different variation of said digitising parameter or parameters; and

comparing said processed digitised speech data with said speech models to generate parameter data identifying the dynamic variation of said digitising parameter, and outputting the generated parameter data to said parameter data receiving step.

89. A computer readable medium storing computer executable instructions for causing a programmable computer apparatus to perform the method of claim 71.

90. A signal carrying processor executable instructions for causing a programmable computer apparatus to perform the method of claim 71.

91. A computer executable instructions product comprising computer executable instructions for causing a programmable computer device to carry out the method of claim 71.

85. A speech recognition apparatus comprising:

means for receiving digitised speech data representative of an utterance to be recognised;

means for storing speech recognition models;

means for comparing the received digitised speech data with the speech recognition models; and

means for generating a recognition result in dependence upon the comparisons made by said comparing means;

characterised by means for dynamically varying the speech recognition models during the comparison with said digitised speech data.

86. A speech processing system comprising:

a data network;

a processing terminal coupled to said data network and comprising;

means for receiving an input speech signal;

digitising means operable for digitising the received input speech signal to generate digitised speech data representative of the input speech signal;

first varying means for dynamically varying a digitising parameter of said digitising means in dependence upon an external condition to generate digitised speech data that varies with the variation of said digitising parameter; and

means for transmitting the digitised speech data over the data network; and

a server terminal coupled to said data network and comprising;

means for receiving operable to receive the digitised speech data from the data network;

means for processing the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter that is varied by said first varying means;

speech recognition means operable to compare the processed digitised speech data with a set of speech recognition models to generate a recognition result;

means for receiving parameter data identifying the dynamic variation of said digitising parameter performed by said first varying means; and

second varying means for dynamically varying the set of speech recognition models used by said speech recognition means in dependence upon the received parameter data.

87. A server terminal couplable to a data network and comprising:

means for receiving digitised speech data representative of an input speech signal, which digitised speech data varies in dependence upon the variation of a digitising parameter used to generate the digitised speech data;

means for processing the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter;

speech recognition means operable to compare the processed digitised speech data with a set of speech recognition models to generate a recognition result;

means for receiving parameter data identifying the dynamic variation of said digitising parameter; and

means for dynamically varying the set of speech recognition models used by said speech recognition means in dependence upon the received parameter data.

88. A computer readable medium storing computer executable instructions for causing a programmable computer device to perform the steps of:

receiving digitised speech data representative of an input speech signal, which digitised speech data varies in dependence upon the variation of a digitising parameter used to generate the digitised speech data;

processing the received digitised speech data to generate processed digitised speech data that is independent of the variation of said digitising parameter;

comparing the processed digitised speech data with a set of speech recognition models to generate a recognition result;

receiving parameter data identifying the dynamic variation of said digitising parameter; and

dynamically varying the set of speech recognition models used in said comparing step in dependence upon the received parameter data.