Method for online adaptation of pronunciation dictionaries

• US 20020095282A1
• Filed: 12/10/2001
• Published: 07/18/2002
• Est. Priority Date: 12/11/2000
• Status: Abandoned Application

• Current Assignee: Sony Deutschland GmbH (Sony Group Corp.)
• Original Assignee: Sony Deutschland GmbH (Sony Group Corp.)
• Inventors: Kompe, Ralf, Rapp, Stefan, Goronzy, Silke
• Application Number:
  US10/013,779
• Publication Number:
  US 20020095282A1
• Time in Patent Office: Days
• US Class Current: 704/10
• CPC Class Codes: G10L 15/065 Adaptation

Abstract

A method for recognizing speech is suggested wherein a lexicon (SL, CL) or a pronuniciation dictionary used for the recognition process is modified during the process of recognition starting with a starting lexicon (SL) and including after given numbers of steps of recognition (12) recognition related information (RRI) with respect to at least one recognition result (13) already obtained and wherein the process of recognition is then continued based on a modified lexicon (ML) as said current lexicon (CL).

Claims

1. Method for recognizing a speech, wherein for the process of recognition a current lexicon (CL) is used, said current lexicon (CL) at least comprising recognition enabling information (REI), characterized in

that the process of recognition is started using a starting lexicon (SL) as said current lexicon (CL),

that after given numbers of performed recognition steps and/or obtained recognition results a modified lexicon (ML) is generated based on said current lexicon (CL) by adding to said current lexicon (CL) at least recognition relevant information (RRI) with respect to at least one recognition result already obtained,

that the process of recognition is continued using said modified lexicon (ML) as said current lexicon (CL) in each case.

2. Method according to claim 1,

wherein a modified lexicon (ML) is repeatedly generated after each fixed and/or predetermined number of recognition steps and/or results, in particular after each single recognition step and/or result.

3. Method according to anyone of the preceding claims,

wherein the number of recognition steps and/or results after which a modified lexicon (ML) is generated is determined and/or changed within the current process of recognition and/or adaptation.

4. Method according to anyone of the preceding claims, further comprising the steps of:

receiving a sequence of speech phrases (SP1, . . . , SPN) and accordingly generating a sequence of corresponding representing signals (RS1, . . . , RSN) and

recognizing said received speech phrases (SP1, . . . , SPN) by generating and/or outputting at least a first sequence of words (W_j1, . . . . , W_jnj) or the like for each representing signal (RSj) as a recognized speech phrase (RSPj) for each received speech phrase (SPj),

thereby generating and/or outputting a sequence of recognized speech phrases (RSP1, . . . , RSPN).

5. Method according to anyone of the preceding claims,

wherein a lexicon is used—

in particular as said starting lexicon (SL) and/or as said current lexicon (CL) in each case—

which contains at least recognition enabling information (REI) and/or recognition relevant information (RRI) at least with respect to possible word candidates and/or possible subword candidates.

6. Method according to claim 5,

wherein phonemes, phones, syllables, subword units, a combination or sequence thereof and/or the like are used as subword candidates, in particular during each recognition process or step and/or within said starting and/or current lexicon (SL, CL).

7. Method according to anyone of the preceding claims,

wherein vocabulary information, pronunciation information, language model information, grammar and/or syntax information, additional semantic information and/or the like is used within each recognition process, in particular as a part of said recognition enabling/related information (REI, RRI) of said lexicon in particular of said starting lexicon (SL) and/or of said current lexicon (CL) in each case.

8. Method according to anyone of the preceding claims,

wherein a speaker independent starting lexicon (SL) is used.

9. Method according to anyone of the preceding claims,

wherein said modified lexicon (ML) and/or the current lexicon (CL) are built up as a decomposable composition (SL+SRL) of said starting lexicon (SL) and a speaker related lexicon (SRL),

the latter of which containing speaker specific recognition relevant information (RRI), in particular with respect to at least the recognition results already obtained for the current speaker.

10. Method according to claim 9,

wherein said speaker related lexicon (SRL) is constructed within a current recognition step or process and/or obtained from former and/or foreign recognition processes, in particular by performing an appropriate weighting process.

11. Method according to anyone of the preceding claims,

wherein the recognition related information (RRI) and in particular the speaker related lexicon (SRL) is removed from said current lexicon (CL) with the termination of the recognition process for the current speaker and/or before beginning another recognition process, in particular with a new or another speaker.

12. Method according to anyone of the preceding claims,

wherein for each specific speaker under process said speaker related lexicon (SRL) and/or speaker related signature data are obtained during the recognition process and/or are stored.

13. Method according to claim 12,

wherein in the beginning of a new recognition process it is checked—

in particular based on the set or list of speaker related lexica and/or signatures—

whether the speaker under process is a known speaker and wherein in the case of a known speaker under process the speaker related lexicon (SRL) being specific for the current speaker is recalled from the set or list of speaker-related lexica and combined into a current lexicon (CL), in particular to a starting lexicon (SL), so as to yield a speaker-adapted lexicon with high recognition efficiency.

14. Method according to anyone of the preceding claims,

wherein based on the recognition related information (RRI) of the current recognition process and/or step information which is not covered or supported by the speaking behaviour of the current speaker and/or by the recognition related information (RRI) is removed from said current lexicon (CL), in particular from the starting lexicon (SL) during the recognition process, in particular to form a modified lexicon (ML) or a current lexicon (CL) for a next recognition step.

15. Method according to anyone of the preceding claims,

wherein track is kept of the changes performed in each case on the current lexicon (CL) so as to enable restoring or resetting the recognition process in the case of a speaker change.

16. Method according to anyone of the preceding claims,

wherein the recognition relevant information (RRI) or the like is generalized throughout the whole modified (ML) and/or current lexicon (CL) and/or starting lexicon (SL), where appropriate.