Speech processing system

• US 20020120447A1
• Filed: 11/05/2001
• Published: 08/29/2002
• Est. Priority Date: 11/07/2000
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Charlesworth, Jason Peter Andrew, Rajan, Jebu Jacob
• Granted Patent: US 7,337,116 B2
• Time in Patent Office: Days
• US Class Current: 704/254
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 2015/0631 Creating reference templates; Clustering

Abstract

A system is provided for allowing a user to add word models to a speech recognition system. In particular, the system allows a user to input a number of renditions of the new word and which generates from these a sequence of phonemes representative of the new word. This representative sequence of phonemes is stored in a word to phoneme dictionary together with the typed version of the word for subsequent use by the speech recognition system.

Claims

1. An apparatus for generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the apparatus comprising:

first receiving means for receiving signals representative of first and second spoken renditions of the new word;

speech recognition means for comparing the received first and second spoken renditions with pre-stored sub-word unit models to generate first and second sequences of sub-word units representative of said first and second spoken renditions of the new word respectively;

means for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units; and

means for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning means.

2. An apparatus according to claim 1, wherein said determining means is operable to determine said sequence of sub-word units by determining, for each aligned pair of sub-word units, a sub-word unit that is confusingly similar to the first and second sub-word units of the aligned pair.

3. An apparatus according to claim 1, wherein said determining means comprises:

first comparing means for comparing, for each aligned pair, the first sequence sub-word unit in the aligned pair with each of a plurality of sub-word units taken from a set of predetermined sub-word units, to provide a corresponding plurality of comparison scores representative of the similarities between the first sequence sub-word unit and the respective sub-word units of the set;

second comparing means for comparing, for each aligned pair, the second sequence sub-word unit in the aligned pair with each of said plurality of sub-word units from the set, to provide a further corresponding plurality of comparison scores representative of the similarities between said second sequence sub-word unit and the respective sub-word units of the set;

means for combining the comparison scores obtained when comparing the first and second sequence sub-word units in the aligned pair with the same sub-word unit from the set, to generate a plurality of combined comparison scores;

third comparing means for comparing, for each aligned pair, the combined comparison scores generated by said combining means for the aligned pair; and

means for determining, for each aligned pair of sub-word units, a sub-word unit representative of the sub-word units in the aligned pair in dependence upon a comparison result output by said third comparing means for the aligned pair.

4. An apparatus according to claim 3, wherein said first and second comparing means are operable to compare the first sequence sub-word unit and the second sequence sub-word unit respectively with each of the sub-word units in said set of sub-word units.

5. An apparatus according to claim 3, wherein said first and second comparing means are operable to provide comparison scores which are indicative of a probability of confusing the corresponding sub-word unit taken from the set of predetermined sub-word units as the sub-word unit in the aligned pair.

6. An apparatus according to claim 5, wherein said combining means is operable to combine the comparison scores in order to multiply the probabilities of confusing the corresponding sub-word unit taken from the set as the sub-word units in the aligned pair.

7. An apparatus according to claim 6, wherein each of said sub-word units in said set of predetermined sub-word units has a predetermined probability of occurring within a sequence of sub-word units and wherein said combining means is operable to weigh each of said combined comparison scores in dependence upon the respective probability of occurrence for the sub-word unit of the set used to generate the combined comparison score.

8. An apparatus according to claim 7, wherein said combining means is operable to combine said comparison scores by calculating:

P(d_i¹|p_r)P(d_j²|p_r)P(p_r)

where d¹_i and d²_j are an aligned pair of first and second sequence sub-word units respectively;

P(d_i|p_r) is the comparison score output by said first comparing means and is representative of the probability of confusing set sub-word unit p_r as first sequence sub-word unit d¹_i;

P(d²_j|p_r) is the comparison score output by said second comparing means and is representative of the probability of confusing set sub-word unit p_r as second sequence sub-word unit d²_j; and

P(p_r) is a weight which represents the probability of set sub-word unit p_r occurring in a sequence of sub-word units.

9. An apparatus according to claim 8, wherein said third comparing means is operable to identify the set sub-word unit which gives the maximum combined comparison score and wherein said determining means is operable to determine said sub-word unit representative of the sub-word units in the aligned pair as being the sub-word unit which provides the maximum combined comparison score.

10. An apparatus according to claim 6, wherein said comparison scores represent log probabilities and wherein said combining means is operable to multiply said probabilities by adding the respective comparison scores.

11. An apparatus according to claim 3, wherein each of the sub-word units in said first and second sequences of sub-word units belong to said set of predetermined sub-word units and wherein said first and second comparing means are operable to provide said comparison scores using predetermined data which relate the sub-word units in said set to each other.

12. An apparatus according to claim 11, wherein said predetermined data comprises, for each sub-word unit in the set of sub-word units, a probability for confusing that sub-word unit with each of the other sub-word units in the set of sub-word units.

13. An apparatus according to claim 1, wherein said aligning means comprises dynamic programming means for aligning said first and second sequences of sub-word units using a dynamic programming technique.

14. An apparatus according to claim 13, wherein said dynamic programming means is operable to determine an optimum alignment between said first and second sequences of sub-word units.

15. An apparatus according to claim 1, wherein each of said sub-word units represents a phoneme.

16. An apparatus according to claim 1, wherein said receiving means is operable to receive signals representative of a third spoken rendition of the new word, wherein said recognition means is operable to compare the third rendition of the new word with said pre-stored sub-word unit models to generate a third sequence of sub-word units representative of said third rendition of the new word, wherein said aligning means is operable to align simultaneously the sub-word units of the first, second and third sequences of sub-word units to generate a number of aligned groups of sub-word units, each aligned group comprising a sub-word unit from each of the renditions and wherein said determining means is operable to determine said representative sequence of sub-word units in dependence upon the aligned groups of sub-word units.

17. An apparatus according to claim 1, wherein said receiving means is operable to receive signals representative of a third spoken rendition of the new word, wherein said recognition means is operable to compare the third rendition of the new word with said pre-stored sub-word unit models to generate a third sequence of sub-word units representative of said third rendition of the new word and wherein said aligning means is operable to align two sequences of sub-word units at a time.

18. An apparatus according to claim 1, wherein said first receiving means is operable to receive signals representative of a plurality of spoken renditions of the new word, wherein said speech recognition means is operable to compare the received spoken renditions with pre-stored sub-word unit models to generate a sequence of sub-word units for each of the plurality of spoken renditions, wherein said aligning means is operable to align the sub-word units of the plurality of sequences of sub-word units to form a number of aligned groups of sub-word units, each group including a sub-word unit from each sequence;

wherein said determining means is operable to determine a sequence of sub-word units representative of the spoken renditions of the new word; and

wherein the apparatus further comprises (i) means for comparing each sequence of sub-word units with said representative sequence of sub-word units to determine a score representative of the similarity there between;

(ii) means for processing the scores output by the comparing means to identify clusters within the scores indicating one or more different pronunciations of the spoken rendition of the new word; and

wherein said determining means is operable to determine a sequence of sub-word units representative of the spoken renditions of the new word within each cluster.

19. An apparatus according to claim 18, wherein said comparing means, processing means and determining means operate iteratively until a predetermined convergence criteria is met.

20. An apparatus according to claim 18, further comprising means for combining the sequences of sub-word units for each of the clusters into a sub-word unit lattice.

21. An apparatus according to claim 1, wherein said generated sequence of sub-word units are representative of a new command to be added to a command dictionary of said speech recognition system.

22. An apparatus according to claim 1, wherein said generated sequence of sub-word units are representative of a new word to be added to a word dictionary of a speech recognition system together with a text rendition of the new word.

28. A method according to claim 27, wherein said determining step determines said sequence of sub-word units by determining, for each aligned pair of sub-word units, a sub-word unit that is confusingly similar to the first and second sub-word units of the aligned pair.

29. A method according to claim 27, wherein said determining step comprises the steps of:

a first comparing step of comparing, for each aligned pair, the first sequence sub-word unit in the aligned pair with each of a plurality of sub-word units taken from a set of predetermined sub-word units, to provide a corresponding plurality of comparison scores representative of the similarities between the first sequence sub-word unit and the respective sub-word units of the set;

a second comparing step of comparing, for each aligned pair, the second sequence sub-word unit in the aligned pair with each of said plurality of sub-word units from the set, to provide a further corresponding plurality of comparison scores representative of the similarities between said second sequence sub-word unit and the respective sub-word units of the set;

combining the comparison scores obtained when comparing the first and second sequence sub-word units in the aligned pair with the same sub-word unit from the set, to generate a plurality of combined comparison scores;

a third comparing step of comparing, for each aligned pair, the combined comparison scores generated by said combining step for the aligned pair; and

determining, for each aligned pair of sub-word units, a sub-word unit representative of the sub-word units in the aligned pair in dependence upon a comparison result output by said third comparing step for the aligned pair.

30. A method according to claim 29, wherein said first and second comparing steps compare the first sequence sub-word unit and the second sequence sub-word unit respectively with each of the sub-word units in said set of sub-word units.

31. A method according to claim 29, wherein said first and second comparing steps provide comparison scores which are indicative of a probability of confusing the corresponding sub-word unit taken from the set of predetermined sub-word units as the sub-word unit in the aligned pair.

32. A method according to claim 31, wherein said combining step combines the comparison scores in order to multiply the probabilities of confusing the corresponding sub-word unit taken from the set as the sub-word units in the aligned pair.

33. A method according to claim 32, wherein each of said sub-word units in said set of predetermined sub-word units has a predetermined probability of occurring within a sequence of sub-word units and wherein said combining step weighs each of said combined comparison scores in dependence upon the respective probability of occurrence for the sub-word unit of the set used to generate the combined comparison score.

34. A method according to claim 33, wherein said combining step combines said comparison scores by calculating:

P(d_i¹|p_r)P(d_j²|p_r)P(p_r)

where d¹_i and d²_j are an aligned pair of first and second sequence sub-word units respectively;

P(d_i|p_r) is the comparison score output by said first comparing step and is representative of the probability of confusing set sub-word unit p_r as first sequence sub-word unit d¹_i;

P(d²_j|p_r) is the comparison score output by said second comparing step and is representative of the probability of confusing set sub-word unit p_r as second sequence sub-word unit d²_j; and

P(p_r) is a weight which represents the probability of set sub-word unit p_r occurring in a sequence of sub-word units.

35. A method according to claim 34, wherein said third comparing step identifies the set sub-word unit which gives the maximum combined comparison score and wherein said determining step determines said sub-word unit representative of the sub-word units in the aligned pair as being the sub-word unit which provides the maximum combined comparison score.

36. A method according to claim 32, wherein said comparison scores represent log probabilities and wherein said combining step multiplies said probabilities by adding the respective comparison scores.

37. A method according to claim 29, wherein each of the sub-word units in said first and second sequences of sub-word units belong to said set of predetermined sub-word units and wherein said first and second comparing steps provide said comparison scores using predetermined data which relate the sub-word units in said set to each other.

38. A method according to claim 37, wherein said predetermined data comprises, for each sub-word unit in the set of sub-word units, a probability for confusing that sub-word unit with each of the other sub-word units in the set of sub-word units.

39. A method according to claim 27, wherein said aligning step uses a dynamic programming technique to align said first and second sequences of sub-word units.

40. A method according to claim 39, wherein said dynamic programming technique determines an optimum alignment between said first and second sequences of sub-word units.

41. A method according to claim 27, wherein each of said sub-word units represents a phoneme.

42. A method according to claim 27, wherein said receiving step receives signals representative of a third spoken rendition of the new word, wherein said comparing step compares the third rendition of the new word with said pre-stored sub-word unit models to generate a third sequence of sub-word units representative of said third rendition of the new word, wherein said aligning step simultaneously aligns the sub-word units of the first, second and third sequences of sub-word units to generate a number of aligned groups of sub-word units, each aligned group comprising a sub-word unit from each of the renditions and wherein said determining step determines said representative sequence of sub-word units in dependence upon the aligned groups of sub-word units.

43. A method according to claim 27, wherein said receiving step receives signals representative of a third spoken rendition of the new word, wherein said comparing step compares the third rendition of the new word with said pre-stored sub-word unit models to generate a third sequence of sub-word units representative of said third rendition of the new word and wherein said aligning step aligns two sequences of sub-word units at a time.

44. A method according to claim 27, wherein said first receiving step receives signals representative of a plurality of spoken renditions of the new word, wherein said comparing step compares the received spoken renditions with pre-stored sub-word unit models to generate a sequence of sub-word units for each of the plurality of spoken renditions, wherein said aligning step aligns the sub-word units of the plurality of sequences of sub-word units to form a number of aligned groups of sub-word units, each group including a sub-word unit from each sequence;

wherein said determining step determines a sequence of sub-word units representative of the spoken renditions of the new word; and

wherein the method further comprises the steps of;

(i) comparing each sequence of sub-word units with said representative sequence of sub-word units to determine a score representative of the similarity therebetween; and

(ii) processing the scores output by the comparing step to identify clusters within the scores indicating one or more different pronunciations of the spoken rendition of the new word; and

wherein said determining step determines a sequence of sub-word units representative of the spoken renditions of the new word within each cluster.

45. A method according to claim 44, wherein said comparing step, processing step and determining step operate iteratively until a predetermined convergence criteria is met.

46. A method according to claim 44, further comprising means for combining the sequences of sub-word units for each of the clusters into a sub-word unit lattice.

47. A method according to claim 27, wherein said generated sequence of sub-word units are representative of a new word to be added to a word dictionary of a speech recognition system.

48. A method according to claim 27, wherein said generated sequence of sub-word units are representative of a new word to be added to a command dictionary of a speech recognition system.

23. An apparatus for generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the apparatus comprising:

means for receiving signals representative of a plurality of spoken renditions of the new word;

speech recognition means for comparing the received spoken renditions with pre-stored sub-word unit models to generate a corresponding plurality of sequences of sub-word units representative of said plurality of spoken renditions;

means for aligning sub-word units of each rendition with sub-word units of units of other renditions to form a number of aligned groups of sub-word units, each aligned group comprising a sub-word unit from each rendition; and

means for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned groups of sub-word units determined by said aligning means.

24. An apparatus for adding a new word and sub-word representation of the new word to a word dictionary of a speech recognition system, the apparatus comprising,

means for receiving a first sequence of sub-word units representative of a first spoken rendition of the new word and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word;

means for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

means for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning means; and

means for adding the new word and the representative sequence of sub-word units to said word dictionary.

25. A speech recognition system comprising:

means for receiving speech signals to be recognised;

means for storing sub-word unit models;

means for comparing received speech with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

a word dictionary relating sequences of sub-word units to words;

a word decoder for processing the one or more sequences of sub-word units output by said comparing means using the word dictionary to generate one or more words corresponding to the received speech signals;

an apparatus for adding a new word and a sub-word representation of the new word to the word dictionary; and

means for controllably connecting the output of said comparing means to either said word decoder or said apparatus for adding the new word and a sub-word representation of the new word to the word dictionary;

characterised in that said apparatus for adding the new word and a sub-word representation of the new word to the word dictionary comprises;

means for receiving a first sequence of sub-word units representative of a first spoken rendition of the new word output by said comparing means and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word output by said comparing means;

means for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

means for determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning means;

means for receiving a text rendition of the new word; and

means for adding said text rendition of the new word and the representative sequence of sub-word units to said word dictionary.

26. A speech recognition system comprising:

means for receiving speech signals to be recognised;

means for storing sub-word unit models;

means for comparing received speech with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

a command dictionary relating sequences of sub-word units to commands; and

a command decoder for processing the one or more sequences of sub-word units output by said comparing means using the command dictionary to generate one or more commands corresponding to the received speech signals;

an apparatus for adding a new command and a sub-word representation of the new command to the command dictionary; and

means for controllably connecting the output of said comparing means to either said command decoder or said apparatus for adding the new command and a sub-word representation of the new command to the command dictionary;

characterised in that said apparatus for adding the new command and a sub-word representation of the new command to the command dictionary comprises;

means for receiving a first sequence of sub-word units representative of a first spoken rendition of the new command output by said comparing means and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new command output by said comparing means;

means for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

means for determining sequences of sub-word units representative of the spoken renditions of the new command in dependence upon the aligned pairs of sub-word units determined by said aligning means; and

means for adding said representative sequence of sub-word units to said command dictionary together with the corresponding new command.

27. A method of generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the method comprising the steps of:

a first receiving step of receiving signals representative of first and second spoken renditions of the new word;

comparing the received first and second spoken renditions with pre-stored sub-word unit models to generate a first sequence of sub-word units representative of said first spoken rendition of the new word and a second sequence of sub-word units representative of said second spoken rendition of the new word;

aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units; and

determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step.

49. A method of generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the method comprising the steps of:

receiving signals representative of a plurality of spoken renditions of the new word;

comparing the received spoken renditions with pre-stored sub-word unit models to generate a corresponding plurality of sequences of sub-word units representative of said plurality of spoken renditions;

aligning sub-word units of each rendition with sub-word units of units of other renditions to form a number of aligned groups of sub-word units, each aligned group comprising a sub-word unit from each rendition; and

determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned groups of sub-word units determined by said aligning step.

50. A method of adding a new word and sub-word representation of the new word to a word dictionary of a speech recognition system, the method comprising the steps of:

receiving a first sequence of sub-word units representative of a first spoken rendition of the new word and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word;

aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step; and

adding the new word and the representative sequence of sub-word units to said word dictionary.

51. A speech recognition method comprising the steps of:

receiving speech signals to be recognised;

storing sub-word unit models;

comparing received speech signals with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

storing a word dictionary relating sequences of sub-word units to words;

processing the one or more sequences of sub-word units output by said comparing step using the stored word dictionary to generate one or more words corresponding to the received speech signals;

the step of adding a new word and a sub-word representation of the new word to the word dictionary; and

controllably feeding the output of said comparing step to either said processing step or said adding step;

characterised in that said adding step comprises;

receiving a first sequence of sub-word units representative of a first spoken rendition of the new word output by said comparing step and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word output by said comparing step;

aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step;

receiving a text rendition of the new word; and

adding said text rendition of the new word and the representative sequence of sub-word units to said word dictionary.

52. A speech recognition method comprising the steps of:

receiving speech signals to be recognised;

storing sub-word unit models;

comparing received speech signals with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

storing a command dictionary relating sequences of sub-word units to commands;

processing the one or more sequences of sub-word units output by said comparing step using the stored command dictionary to generate one or more commands corresponding to the received speech signals;

adding a new command and a sub-word representation of the new command to the command dictionary; and

controllably feeding the output of said comparing step to either said processing step or said adding step;

characterised in that said adding step comprises;

receiving a first sequence of sub-word units representative of a first spoken rendition of the new command output by said comparing step and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new command output by said comparing step;

aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step; and

adding said sequence of sub-word units to said command dictionary together with the associated new command.

53. A storage medium storing processor implementable instructions for controlling a processor to carry out a method of generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the processor instructions comprising:

first receiving instructions for receiving signals representative of first and second spoken renditions of the new word;

instructions for comparing the received first and second spoken renditions with pre-stored sub-word unit models to generate a first sequence of sub-word units representative of said first spoken rendition of the new word and a second sequence of sub-word units representative of said second spoken rendition of the new word;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units; and

instructions for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step.

54. A storage medium storing processor implementable instructions for controlling a processor to carry out a method of generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the processor instructions comprising:

instructions for receiving signals representative of a plurality of spoken renditions of the new word;

instructions for comparing the received spoken renditions with pre-stored sub-word unit models to generate a corresponding plurality of sequences of sub-word units representative of said plurality of spoken renditions;

instructions for aligning sub-word units of each rendition with sub-word units of units of other renditions to form a number of aligned groups of sub-word units, each aligned group comprising a sub-word unit from each rendition; and

instructions for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned groups of sub-word units determined by said aligning step.

55. A storage medium storing processor implementable instructions for controlling a processor to carry out a method of adding a new word and sub-word representation of the new word to a word dictionary of a speech recognition system, the process instructions comprising:

instructions for receiving a first sequence of sub-word units representative of a first spoken rendition of the new word and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

instructions for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step; and

instructions for adding the new word and the representative sequence of sub-word units to said word dictionary.

56. A storage medium storing processor implementable instructions for controlling a processor to carry out a speech recognition method, the process instructions comprising:

instructions for receiving speech signals to be recognised;

instructions for storing sub-word unit models;

instructions for comparing received speech signals with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

instructions for storing a word dictionary relating sequences of sub-word units to words;

instructions for processing the one or more sequences of sub-word units output by said comparing step using the stored word dictionary to generate one or more words corresponding to the received speech signals;

instructions for adding a new word and a sub-word representation of the new word to the word dictionary; and

instructions for controllably feeding the output of said comparing step to either said processing step or said adding step;

characterised in that said adding instructions comprise;

instructions for receiving a first sequence of sub-word units representative of a first spoken rendition of the new word output by said comparing step and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word output by said comparing step;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

instructions for determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step;

instructions for receiving a text rendition of the new word; and

instructions for adding said text rendition of the new word and the representative sequence of sub-word units to said word dictionary.

57. A storage medium storing processor implementable instructions for controlling a processor to carry out a speech recognition method, the process instructions comprising:

instructions for receiving speech signals to be recognised;

instructions for storing sub-word unit models;

instructions for comparing received speech signals with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

instructions for storing a command dictionary relating sequences of sub-word units to commands;

instructions for processing the one or more sequences of sub-word units output by said comparing step using the stored command dictionary to generate one or more commands corresponding to the received speech signals;

instructions for adding a new command and a sub-word representation of the new command to the command dictionary; and

instructions for controllably feeding the output of said comparing step to either said processing step or said adding step;

characterised in that said adding instructions comprise;

instructions for receiving a first sequence of sub-word units representative of a first spoken rendition of the new command output by said comparing step and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new command output by said comparing step;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

instructions for determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step; and

instructions for adding said sequence of sub-word units to said command dictionary together with the associated new command.

58. Processor implementable instructions for controlling a processor to carry out a method of generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the processor instructions comprising:

first receiving instructions for receiving signals representative of first and second spoken renditions of the new word;

instructions for comparing the received first and second spoken renditions with pre-stored sub-word unit models to generate a first sequence of sub-word units representative of said first spoken rendition of the new word and a second sequence of sub-word units representative of said second spoken rendition of the new word;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units; and

instructions for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step.

59. Processor implementable instructions for controlling a processor to carry out a method of generating a sequence of sub-word units representative of a new word to be added to a dictionary of a speech recognition system, the processor instructions comprising:

instructions for receiving signals representative of a plurality of spoken renditions of the new word;

instructions for comparing the received spoken renditions with pre-stored sub-word unit models to generate a corresponding plurality of sequences of sub-word units representative of said plurality of spoken renditions;

instructions for aligning sub-word units of each rendition with sub-word units of units of other renditions to form a number of aligned groups of sub-word units, each aligned group comprising a sub-word unit from each rendition; and

instructions for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned groups of sub-word units determined by said aligning step.

60. Processor implementable instructions for controlling a processor to carry out a method of adding a new word and sub-word representation of the new word to a word dictionary of a speech recognition system, the process instructions comprising:

instructions for receiving a first sequence of sub-word units representative of a first spoken rendition of the new word and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

instructions for determining a sequence of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step; and

instructions for adding the new word and the representative sequence of sub-word units to said word dictionary.

61. A storage medium storing processor implementable instructions for controlling a processor to carry out a speech recognition method, the process instructions comprising:

instructions for receiving speech signals to be recognised;

instructions for storing sub-word unit models;

instructions for comparing received speech signals with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

instructions for storing a word dictionary relating sequences of sub-word units to words;

instructions for processing the one or more sequences of sub-word units output by said comparing step using the stored word dictionary to generate one or more words corresponding to the received speech signals;

instructions for adding a new word and a sub-word representation of the new word to the word dictionary; and

instructions for controllably feeding the output of said comparing step to either said processing step or said adding step;

characterised in that said adding instructions comprise;

instructions for receiving a first sequence of sub-word units representative of a first spoken rendition of the new word output by said comparing step and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new word output by said comparing step;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

instructions for determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step;

instructions for receiving a text rendition of the new word; and

instructions for adding said text rendition of the new word and the representative sequence of sub-word units to said word dictionary.

62. A storage medium storing processor implementable instructions for controlling a processor to carry out a speech recognition method, the process instructions comprising:

instructions for receiving speech signals to be recognised;

instructions for storing sub-word unit models;

instructions for comparing received speech signals with the sub-word unit models to generate one or more sequences of sub-word units representative of the received speech signals;

instructions for storing a command dictionary relating sequences of sub-word units to commands;

instructions for processing the one or more sequences of sub-word units output by said comparing step using the stored command dictionary to generate one or more commands corresponding to the received speech signals;

instructions for adding a new command and a sub-word representation of the new command to the command dictionary; and

instructions for controllably feeding the output of said comparing step to either said processing step or said adding step;

characterised in that said adding instructions comprise;

instructions for receiving a first sequence of sub-word units representative of a first spoken rendition of the new command output by said comparing step and for receiving a second sequence of sub-word units representative of a second spoken rendition of the new command output by said comparing step;

instructions for aligning sub-word units of the first sequence with sub-word units of the second sequence to form a number of aligned pairs of sub-word units;

instructions for determining sequences of sub-word units representative of the spoken renditions of the new word in dependence upon the aligned pairs of sub-word units determined by said aligning step; and

instructions for adding said sequence of sub-word units to said command dictionary together with the associated new command.