Keyword detection in continuous speech using continuous asynchronous correlation

• US 4,081,607 A
• Filed: 11/01/1976
• Issued: 03/28/1978
• Est. Priority Date: 04/02/1975
• Status: Expired due to Term

• Current Assignee: Rockwell International Corporation
• Original Assignee: Rockwell International Corporation
• Inventors: Vitols, Visvaldis A., Paul, James E. Jr.
• Primary Examiner(s): Claffy, Kathleen H.
• Assistant Examiner(s): Kemeny, E. S.
• Application Number:
  US05/737,809
• Time in Patent Office: 512 Days
• Field of Search: 179/1 SA, 179/1 SD
• US Class Current: 704/237
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates
• CPC Class Codes: G10L 2015/088 Word spotting

Abstract

A system for detecting one or more keywords in continuous speech is disclosed wherein a speech processor extracts a plurality of analog speech parameters from the input continuous speech, an STV (Spectral Time Vector) generator circuit selectively converts the plurality of analog speech parameters into digitized spectral parameters, an asynchronous correlation circuit continuously correlates sequences of the digitized spectral parameters with stored reference mask templates representative of subelements (dyads or triads) of one or more desired keywords in order to produce continuous correlation data, and a decision function circuit is responsive to the correlation data for developing an occurrence decision output for each desired keyword that is detected.

Claims

1. A system for asynchronously detecting one or more keywords in continuous speech, said system comprising:

processor means responsive to a continuous speech signal for continuously developing a plurality of spectral estimates therefrom;

generator means responsive to the plurality of spectral estimates for periodically generating digitized spectral parameters therefrom;

first memory means for prestoring predetermined ones of dyad and triad subelement signals associated with one or more preselected keywords;

correlation means for asynchronously correlating each of the prestored dyad and triad subelement signals of one or more preselected keywords with continuous sequences of the digitized spectral parameters to asynchronously produce a plurality of continuous correlation data signals; and

a decision means for each desired keyword, each of said decision means being responsive to associated ones of the correlation data signals for developing an occurrence decision output whenever an associated keyword has been detected.

2. The system of claim 1 wherein said processor means comprises:

input means for separating the continuous speech signal into a plurality of preselected frequency components; and

parameter means responsive to the plurality of preselected frequency components for developing the plurality of spectral estimates.

3. The system of claim 2 wherein said parameter means comprises:

first means responsive to the plurality of preselected frequency components for producing a plurality of associated detected signals; and

second means responsive to the plurality of associated detected signals for developing the plurality of spectral estimates.

4. The system of claim 2 wherein said generator means comprises:

means responsive to the plurality of spectral estimates for developing time division multiplexed spectral estimates; and

conversion means for developing the digitized spectral parameters in response to the time division multiplexed spectral estimates.

5. The system of claim 4 wherein said correlation means comprises:

second memory means for storing the digitized spectral parameters during a first mode of operation and for sequentially reading out sequences of digitized spectral parameters during a second mode of operation; and

means for sequentially and asynchronously correlating each of the prestored dyad and triad subelement signals during the second mode of operation with a correspondingly long sequence of digitized spectral parameters to asynchronously develop a corresponding correlation data signal for each prestored subelement signal, the amplitude of each correlation data signal being indicative of the closeness of match between its associated prestored subelement signal and the corresponding sequence of digitized spectral parameters.

6. The system of claim 5 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

7. The system of claim 4 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

8. The system of claim 4 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing a summed output signal by summing the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the summed output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the summed output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of a summed output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

9. The system of claim 8 wherein said correlation means comprises:

second memory means for storing the digitized spectral parameters during a first mode of operation and for sequentially reading out sequences of digitized spectral parameters during a second mode of operation; and

means for sequentially and asynchronously correlating each of the prestored dyad and triad subelement signals during the second mode of operation with a correspondingly long sequence of digitized spectral parameters to asynchronously develop a corresponding correlation data signal for each prestored subelement signal, the amplitude of each correlation data signal being indicative of the closeness of match between its associated prestored subelement signal and the corresponding sequence of digitized spectral parameters.

10. The system of claim 2 wherein said correlation means comprises:

second memory means for storing the digitized spectral parameters during a first mode of operation and for sequentially reading out sequences of digitized spectral parameters during a second mode of operation; and

means for sequentially and asynchronously correlating each of the prestored dyad and triad subelement signals during the second mode of operation with a correspondingly long sequence of digitized spectral parameters to asynchronously develop a corresponding correlation data signal for each prestored subelement signal, the amplitude of each correlation data signal being indicative of the closeness of match between its associated prestored subelement signal and the corresponding sequence of digitized spectral parameters.

11. The system of claim 10 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

12. The system of claim 10 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

13. The system of claim 2 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision cutput whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

14. The system of claim 2 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

15. The system of claim 1 wherein said generator means comprises:

means responsive to the plurality of spectral parameters for developing time division multiplexed spectral estimates therefrom; and

conversion means for developing the digitized spectral parameters in response to the time division multiplexed spectral estimates.

16. The system of claim 15 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

17. The system of claim 15 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a treshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

18. The system of claim 15 wherein said correlation means comprises:

second memory means for storing the digitized spectral parameters during a first mode of operation and for sequentially reading out sequences of digitized spectral parameters during a second mode of operation; and

means for sequentially and asynchronously correlating each of the prestored dyad and triad subelement signals during the second mode of operation with a correspondingly long sequence of digitized spectral parameters to asynchronously develop a corresponding correlation data signal for each prestored subelement signal, the amplitude of each correlation data signal being indicative of the closeness of match between its associated prestored subelement signal and the corresponding sequence of digitized spectral parameters.

19. The system of claim 18 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

20. The system of claim 18 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

21. The system of claim 1 wherein said correlation means comprises:

second memory means for storing the digitized spectral parameters during a first mode of operation and for sequentially reading out sequences of digitized spectral parameters during a second mode of operation; and

means for sequentially and asynchronously correlating each of the prestored dyad and triad subelement signals during the second mode of operation with a correspondingly long sequence of digitized spectral parameters to asynchronously develop a corresponding correlation data signal for each prestored subelement signal, the amplitude of each correlation data signal being indicative of the closeness of match between its associated prestored subelement signal and the corresponding sequence of digitized spectral parameters.

22. The system of claim 21 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak value of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

23. The system of claim 21 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

24. The system of claim 1 wherein each of said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

25. The system of claim 1 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence output being indicative of the detection of the keyword associated with said decision means.

26. A system for asynchronously detecting one or more keywords in continuous speech, said system comprising:

input means for separating an input continuous speech signal into a plurality of frequency components;

parameter means for developing a plurality of spectral estimates in response to the plurality of frequency components;

generator means for periodically generating digitized spectral parameters in response to the plurality of spectral estimates;

first memory means for storing sequences of the periodically generated digitized spectral parameters;

second memory means for prestoring preselected ones of dyad and triad subelements associated with at least one preselected keyword;

means for asynchronously correlating each of the prestored dyad and triad subelements with a correspondingly long sequence of digitized spectral parameters during a read mode of operation to asynchronously develop a corresponding correlation data signal for each prestored subelement; and

a decision means for each desired keyword, each of said decision means being responsive to associated ones of the correlation data signals for developing an occurrence decision output whenever an associated keyword is detected.

27. The system of claim 26 wherein each said decision means comprises:

a plurality of storage means for storing respective sequences of predetermined ones of the correlation data signals, each of said storage means having an associated window encompassing a preselected sequence of previously stored correlation data signals associated with that said storage means;

a plurality of maximum detectors respectively coupled to said windows of said plurality of storage means for respectively developing the peak values of signals within said windows;

a combiner for combining another predetermined one of the correlation data signals with the peak values of signals from said plurality of maximum detectors to develop a final decision function; and

a threshold gate for developing an occurrence decision output whenever the amplitude of the final decision function exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

28. The system of claim 26 wherein said decision means comprises:

a preselected number N of sequentially coupled signal units, each of said signal units comprising;

a storage circuit for storing a sequence of signals, said storage circuit having a window substantially encompassing its total signal storage capacity;

a maximum detector coupled to said window of said storage circuit for detecting the peak value of the signals stored within said window; and

a combiner for developing an output signal by combining the peak value from said maximum detector with a preselected one of the correlation data signals; and

a threshold gate, the first one of said sequentially coupled signal units storing a sequence of a first preselected one of the correlation data signals, a sequence of the output signals of each said combiner in the first N-1 combiners being applied to and stored in said storage circuit in the following one of said signal units, a sequence of the output signals of the Nth one of said combiners being applied to said threshold gate, said threshold gate generating an occurrence decision output whenever the amplitude of an output signal from the Nth one of said combiners exceeds that of a decision threshold signal, said occurrence decision output being indicative of the detection of the keyword associated with said decision means.

29. A system for asynchronously detecting one or more keywords in continuous speech, said system comprising:

first means responsive to a continuous speech signal for periodically generating a plurality of digitized spectral parameters therefrom;

means for prestoring predetermined ones of dyad and triad subelement signals associated with one or more preselected element signals associated with one or more preselected keywords;

correlation means for asynchrously correlating each of the prestored dyad and triad subelement signals of one or more preselected keywords with continuous sequences of the digitized spectral parameters to asynchronously produce a plurality of continuous correlation data signals; and

a decision means for each desired keyword, each of said decision means being responsive to associated ones of the correlation data signals for developing an occurrence decision output whenever an associated keyword has been detected.

30. A system for asynchronously detecting keywords in continuous speech, said system comprising:

means for generating a continuous sequence of digitized spectral parameters from the continuous speech;

means for prestoring predetermined ones of dyad and triad subelement signals associated with one or more preselected keywords;

means for asynchronously correlating each of the prestored dyad and triad subelements of the preselected keywords with the continuous sequence of digitized spectral parameters to asynchronously produce a continuous sequence of respective correlation data signals; and

means for developing an output signal indicative of the detection of a keyword whenever an associated sequence of correlation data signals develops a function signal having an amplitude greater than a predetermined threshold level.

31. The system of claim 30 wherein said generating means comprises:

means for producing a plurality of continuous spectral estimates from the continuous speech; and

means for converting the continuous spectral estimates into the continuous sequence of digitized spectral parameters.

32. A machine method for asynchronously detecting at least one preselected keyword in an input continuous speech signal comprising the steps of:

generating periodically a plurality of digitized spectral parameters from the input continuous speech signal;

correlating asynchronously each of a plurality of preselected ones of dyad and triad subelement signals associated with said at least one preselected keyword with continuous sequences of pluralities of digitized spectral parameters to asynchronously produce a plurality of continuous correlation data signals; and

developing an occurrence decision output signal for each associated keyword that is detected in an associated sequence of correlation data signals.

33. A machine method for asynchronously detecting at least one preselected keyword in an input continuous speech signal comprising the steps of:

producing a plurality of spectral estimates continuously from the input continuous speech signal;

generating digitized spectral parameters periodically from the plurality of spectral estimates;

correlating asynchronously each of a plurality of preselected ones of dyad and triad subelements associated with said at least one preselected keyword with continuous sequences of the digitized spectral parameters to asynchronously produce a plurality of continuous correlation data signals; and

developing an occurrence decision output signal for each associated keyword that is detected in an associated sequence of correlation data signals.

34. A machine method for asynchronously detecting preselected keywords in continuous speech comprising the steps of:

producing a continuous sequence of digitized spectral parameters from the continuous speech;

correlating asynchronously each of a plurality of preselected ones of dyad and triad subelements associated with the preselected keywords with the digitized spectral parameters to asynchronously develop respective correlation data signals; and

developing an output signal indicative of the detection of a keyword whenever an associated sequence of correlation data signals develops a function signal having an amplitude greater than a predetermined threshold level.

35. The machine method of claim 34 wherein said producing step comprises the steps of:

generating a plurality of continuous analog spectral estimates from the continuous speech; and

converting the continuous analog spectral estimates into a continuous sequence of digitized spectral parameters.