Method of determining parameters of a statistical language model

• US 6,691,088 B1
• Filed: 10/20/1999
• Issued: 02/10/2004
• Est. Priority Date: 10/21/1998
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Blasig, Reinhard
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): Lerner, Martin
• Application Number:
  US09/421,646
• Time in Patent Office: 1,574 Days
• Field of Search: 704/243, 704/244, 704/245, 704/240, 704/251, 704/255, 704/236
• US Class Current: 704/240
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 15/197 Probabilistic grammars, e.g. word n-grams

Abstract

An apparatus and method of determining parameters of a statistical language model for automatic speech recognition systems using a training corpus are disclosed. To improve the perplexity and the error rate in the speech recognition, at least a proportion of the elements of a vocabulary used is combined so as to form context-independent vocabulary element categories. The frequencies of occurrence of vocabulary element sequences, and if applicable, the frequencies of occurrence of derived sequences formed from the vocabulary element sequences through the replacement of at least one vocabulary element by the associated vocabulary element class, are evaluated in the language modeling process. The parameters of the language model are then derived from the evaluated frequencies of occurence.

Claims

1. A method of determining parameters of a statistical language model for automatic speech recognition systems using a training corpus, comprising the steps of:

combining at least a portion of elements of a vocabulary to form context-independent vocabulary element classes, wherein the context-independent vocabulary elements are independent of adjoining elements of a context-independent vocabulary element class;

evaluating frequencies of occurrence of vocabulary element sequences, and any of the frequencies of occurrence of derived sequences formed from the vocabulary element sequences by replacement of at least one vocabulary element by an associated vocabulary element class; and

deriving the parameters of the language model from the evaluated frequencies of occurrence.

2. A method as claimed in claim 1, wherein both the frequency of occurrence of the vocabulary element sequence and the frequencies of occurrence of the derived sequences are used for forming a language model parameter from a sequence of vocabulary elements and associated derived sequences which each comprise at least one vocabulary element class.

3. A method as claimed in claim 1, wherein if the sequence of vocabulary elements and associated derived sequences comprise at least one vocabulary element class, then only one of the sequences is utilized to derive the language model parameter.

4. An automatic speech recognition system with a statistical language model formed in accordance with claim 1.

5. The method of claim 1, wherein, for at least one of the derived sequences, the replacement operates on a vocabulary element sequence comprising a plurality of vocabulary elements to replace fewer than all of the plural elements.