Keyword recognition system and method

• US 6,023,676 A
• Filed: 12/12/1996
• Issued: 02/08/2000
• Est. Priority Date: 12/12/1996
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: DSPC Israel Limited
• Inventors: Erell, Adoram
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): ABEBE, DANIEL DEMELASH
• Application Number:
  US08/763,999
• Time in Patent Office: 1,153 Days
• Field of Search: 704/241, 704/275, 704/251
• US Class Current: 704/241
• CPC Class Codes: G10L 15/12 using dynamic programming techniques, e.g. dynamic time warping [DTW]
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A keyword recognition system for speaker dependent, dynamic time warping (DTW) recognition systems uses all of the trained word templates in the system, (keyword and vocabulary), to determine if an utterance is a keyword utterance or not. The utterance is selected as the keyword if a keyword score indicates a significant match to the keyword template and if the keyword score indicates a better match than do the entirety of scores to the vocabulary word templates.

Claims

1. A method for recognizing an utterance as a keyword which activates a speaker dependent recognition system on a first plurality of vocabulary words, the method comprising the steps of:

prior to recognition;

storing a set of keyword templates corresponding to a second plurality of keywords and a set of vocabulary templates corresponding to said first plurality of vocabulary words, and

defining said vocabulary templates also as filler templates;

performing keyword recognition on said utterance by matching the utterance against a set of keyword templates and against said filler templates; and

if said utterance is recognized as one of said keywords, activating said speaker dependent recognition system to match at least a second utterance to said vocabulary words.

2. A method according to claim 1 and wherein said step of performing includes the steps of:

matching said utterance to one of said keyword templates and producing a corresponding keyword score indicating the quality of the match between said utterance and said matched keyword template;

matching said utterance to said filler templates and producing a corresponding plurality of filler scores each indicating the quality of the match between said utterance and one of said filler templates; and

selecting said utterance as said keyword if said keyword score indicates a significant match to said keyword template and if said keyword score indicates a better match than do the entirety of said filler scores.

3. A method according to claim 2 and wherein said steps of matching perform dynamic time warping between said utterance and the relevant one of said templates.

4. A method according to claim 2 and wherein said indication of a significant match is a keyword score less than a threshold.

5. A method according to claim 2 and wherein said better match is a keyword score less than the entirety of said vocabulary scores.

a pattern matcher for matching said input utterance to one of said keyword templates and to said filler templates and for producing a keyword score indicating the quality of the match between said utterance and said matched keyword template and a corresponding plurality of filler scores each indicating the quality of the match between said utterance and one of said filler templates;

and

a criterion determiner for selecting said utterance as said keyword if said keyword score indicates a significant match to said keyword template and if said keyword score indicates a better match than do the entirety of said filler scores and for activating said speaker dependent recognition system to match at least a second utterance to said vocabulary words, if said utterance is selected.

6. A method according to claim 1 and wherein said step of activating comprises the step of opening a listening window once said utterance is accepted as said keyword thereby to recognize said vocabulary words.

7. A method according to claim 6 and wherein said step of activating also comprises the step of matching at least said second utterance to said vocabulary templates thereby to determine which word of said vocabulary words was spoken in said second utterance.

8. A method according to claim 1 and wherein said step of defining includes the step of selecting said filler templates from among a plurality of possible vocabulary templates, wherein said filler templates are those which are different, by a predetermined criterion, from said keyword template.

9. A system for recognizing an utterance as a keyword which activates a speaker dependent recognition system on a first plurality of vocabulary words, the system comprising:

a storage unit for storing a set of keyword templates corresponding to a second plurality of keywords and a set of vocabulary templates corresponding to said first plurality of vocabulary words;

a keyword recognition unit for performing keyword recognition on said utterance using a set of keyword templates and a set of filler templates defined as said vocabulary templates.

10. A system according to claim 9 and wherein said keyword recognition unit includes:

a pattern matcher for matching said input utterance to one of said keyword templates and to said filler templates and for producing a keyword score indicating the quality of the match between said utterance and one of said filler templates; and

a criterion determiner for selecting said utterance as said keyword if said keyword score indicates a significant match to said keyword template and if said keyword score indicates a better match than do the entirety of said filler scores and for activating said speaker dependent recognition system to match at least a second utterance to said vocabulary words, if said utterance is selected.

11. A system according to claim 10 and wherein said pattern matcher includes means for performing dynamic time warping between said utterance and the relevant one of said templates.

12. A system according to claim 10 and wherein said criterion determiner includes means for opening a listening window once said utterance is accepted as said keyword thereby to recognize said vocabulary words.

13. A system according to claim 10 and wherein said pattern matcher also includes means for matching at least said second utterance to said vocabulary templates thereby to determine which word of said vocabulary words was spoken in said second utterance.

14. A system according to claim 9 and also comprising a selector for selecting said filler templates from among a plurality of possible vocabulary templates, wherein said filler templates are those vocabulary templates which are different, by a predetermined criterion, from said keyword template.

15. A method for recognizing an utterance as a keyword which activates a speaker dependent recognition system on a first plurality of vocabulary words, the method comprising the steps of:

prior to recognition;

storing a set of keyword templates corresponding to a second plurality of keywords and a set of vocabulary templates corresponding to said first plurality of vocabulary words; and

defining said vocabulary templates also as filler templates, wherein said filler templates are divided into subsets and each subset is associated with a different keyword template;

performing keyword recognition on said utterance using a set of keyword templates and said filler templates; and

if said utterance is recognized as one of said keywords, activating said speaker dependent recognition system to match at least a second utterance to said vocabulary words of the subset associated with the recognized keyword.

16. A method according to claim 15 and wherein said step of performing includes the steps of:

matching said utterance to at least two keyword templates and producing at least two corresponding keyword scores indicating the quality of the match between said utterance and one of said at least two keyword templates;

matching said utterance to said filler templates and producing a corresponding plurality of filler scores each indicating the quality of the match between said utterance and one of said filler templates; and

selecting said utterance as said keyword if the kth one of said at least two keyword scores indicates a significant match to its said keyword template and if said kth keyword score indicates a better match than do the entirety of said filler scores.

17. A method according to claim 16 and wherein said steps of matching perform dynamic time warping between said utterance and the relevant one of said templates.

18. A method according to claim 16 and wherein said indication of a significant match is a keyword score less than a threshold.

19. A method according to claim 16 and wherein said better match is a keyword score less than the entirety of said vocabulary scores.

20. A method according to claim 16 and wherein said step of activating comprises the step of opening a listening window once said utterance is accepted as said kth keyword thereby to recognize said corresponding subset of vocabulary words.

21. A method according to claim 20 and wherein said step of activating also comprises the step of matching at least said second utterance to said vocabulary templates of said corresponding subset thereby to determine which word of said vocabulary words was spoken in said second utterance.

22. A method according to claim 20 and also comprising, prior to said first step of matching, the step of selecting said vocabulary templates from among a plurality of possible vocabulary templates, wherein said selected vocabulary templates are those which are different, by a predetermined criterion, from said at least two keyword templates.

23. A system for recognizing an utterance as a keyword which activates a speaker dependent recognition system on a plurality of vocabulary words, the system comprising:

a storage unit for storing a set of keyword templates corresponding to a second plurality of keywords and a set of vocabulary templates corresponding to said first plurality of vocabulary words;

a keyword recognition unit for performing keyword recognition on said utterance using a set of keyword templates and a set of filler templates defined as said vocabulary templates, wherein said filler templates are divided into subsets and each subset is associated with a different keyword template, and for selecting the subset associated with the recognized keyword for use by said speaker dependent recognition system.

24. A system according to claim 23 and wherein said keyword recognition unit comprises:

a pattern matcher for matching an input utterance to at least two keyword templates and to a plurality of filler templates and for producing corresponding keyword scores indicating the quality of the match between said utterance and said keyword templates and a corresponding plurality of filler scores each indicating the quality of the match between said utterance and one of said filler templates;

a criterion determiner for selecting said utterance as a keyword if the kth one of said at least two keyword scores indicates a significant match to said its corresponding keyword template and if said kth keyword score indicates a better match than do the entirety of said filler scores and activating said speaker dependent recognition system to match at least a second utterance to a subset of said vocabulary words corresponding to said kth keyword.

25. A system according to claim 24 and wherein said pattern matcher includes means for performing dynamic time warping between said utterance and the relevant one of said templates.

26. A system according to claim 24 and wherein said criterion determiner includes means for opening a listening window once said utterance is accepted as said kth keyword thereby to recognize said corresponding subset of vocabulary words.

27. A system according to claim 24 and wherein said pattern matcher also includes means for matching at least said second utterance to said corresponding subset of vocabulary templates thereby to determine which word of said corresponding subset of vocabulary words was spoken in said second utterance.

28. A system according to claim 24 and also comprising a selector for selecting said vocabulary templates from among a plurality of possible vocabulary templates, wherein said selected vocabulary templates are those which are different, by a predetermined criterion, from said keyword templates.