Speech detection in presence of noise by determining variance over time of frequency band limited energy

• US 5,579,431 A
• Filed: 10/05/1992
• Issued: 11/26/1996
• Est. Priority Date: 10/05/1992
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Corporation Of America (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation), Panasonic Technologies, Inc. (Panasonic Holdings Corporation)
• Inventors: Reaves, Benjamin K.
• Primary Examiner(s): MacDonald, Allen R.
• Assistant Examiner(s): Sartori, Michael A.
• Application Number:
  US07/956,614
• Time in Patent Office: 1,513 Days
• Field of Search: 395/2.19, 395/2.23, 395/2.24, 395/2.4, 395/2.42, 395/2.55-2.66, 381/46
• US Class Current: 704/214
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: G10L 25/87 Detection of discrete points within a voice signal

Abstract

The device detects the beginning and ending portions of speech contained within an input signal based on the variance of frequency band limited energy within the signal. The use of the variance allows detection which is relatively independent of an absolute signal-to-noise ratio with the signal, and allows accurate detection within a wide variety of backgrounds such as music, motor noise, and background noise, such as other speakers. The device can be easily implemented using off-the-shelf hardware along with a high-speed special purpose digital signal processor integrated circuit.

Claims

1. A device for detecting speech in an input signal comprising:

first determining means for determining a plurality of values representative of a plurality of frequency band limited energy within the signal, wherein the signal is sampled at a predetermined sampling rate in a single frequency band over a first plurality of frames, wherein each frame comprises a plurality of samples;

second determining means for receiving the plurality of values from said first determining means, and determining a variance of the frequency band limited energy of the signal the single frequency band over a second plurality of frames; and

third determining means for determining beginning and ending points of speech within the signal using the variance of the frequency band limited energy, wherein the third determining means comprises;

fourth determining means for determining a beginning of speech as occurring when the variance of the frequency band limited energy exceeds an upper threshold level and for determining an ending of speech as occurring when the variance of the frequency band limited energy falls below a lower threshold level, the upper threshold level being greater than the lower threshold level.

2. The device of claim 1, wherein the first determining means comprises:

fifth determining means for determining frequencies associated with the signal;

selecting means for selecting portions of the signal having frequencies within a preselected range; and

sixth determining means for determining a total energy within the selected portions of the signal, the total energy being the frequency band limited energy.

3. The device of claim 1, wherein the first determining means comprises:

first applying means for applying a Hamming window filter to a portion of the signal to generate a filtered signal;

second applying means for applying a Fourier Transform to the filtered signal to generate a transformed signal; and

summing means for summing the transformed signal to generate a value representative of total energy in the portion of the signal, the value representative of the total energy being the frequency band limited energy.

4. The device of claim 1, wherein the device includes:

receiving means for receiving the signal;

storing means for storing a portion of the signal covering a continuous period of m seconds where m is between 0.1 and 10 seconds; and

updating means for updating the stored portion of the signal as new signals are received,

wherein the first determining means determines the value representative of the frequency band limited energy from the stored portion of the signal, the value representative of the frequency band limited energy being updated as new signals are received.

5. The device of claim 4, wherein the storing means comprises a shift register.

6. The device of claim 1, wherein the second determining means comprises:

first calculating means for calculating variance, V, wherein V is given by V=g(A,B);

where ##EQU4## BLE(f) represents the plurality of values representative of the frequency band limited energy, nv is a number of values of the frequency band limited energy, f=nv, . . . , 3, 2, 1; and

BLE(1) is an oldest BLE value.

7. The device of claim 6, wherein the second determining means further comprises:

second calculating means for calculating V=g(A'"'"', B'"'"') as new values of BLE(nv) are received,

where

space="preserve" listing-type="equation">A'"'"'=A+[BLE(nv)×

BLE(nv)]-[BLE(0)×

BLE(0)];

space="preserve" listing-type="equation">B'"'"'=B+BLE(nv)-BLE(0);

where

A'"'"' is an updated value for A, and

B'"'"' is an updated value for B, and

BLE(nv) is a newest frequency band limited energy, and

BLE(1) is the oldest frequency band limited energy.

8. The device of claim 1, wherein upper and lower threshold levels are predetermined, and wherein the beginning (B) of speech is determined at a point in time when the variance initially exceeds the lower threshold level, and the variance subsequently remains above the lower threshold level until the variance also exceeds the upper threshold level.

9. The device of claim 1, wherein the upper and lower threshold levels are predetermined, and wherein the ending of the signal is determined as a point in time when the variance falls below the lower threshold level.

10. The device of claim 9, wherein the determination of the beginning and ending points of the signal is rejected if the signal does not remain above the upper threshold level for a predetermined time period.

11. The device of claim 10, wherein the predetermined time period is 0.3 seconds.

12. In a device for recognizing speech within an input signal, with the device having means for receiving the signal, means for determining beginning and ending points of speech within the signal, and means for determining content of speech within the signal between the beginning and ending points, an improvement to the means for determining the beginning and ending points of the speech comprising:

first determining means for determining a plurality of values representative of a plurality of frequency band limited energy within the signal, wherein the signal is sampled at a predetermined sampling rate in a single frequency band over a first plurality of frames, wherein each frame comprises a plurality of samples;

second determining means for receiving the plurality of values from said first determining means, and determining a variance of the frequency band limited energy of the signal in the single frequency band over a second plurality of frames; and

third determining means for determining beginning and ending points of speech within the signal based on the variance of the frequency band limited energy, wherein the third determining means comprises;

fourth determining means for determining a beginning of speech as occurring when the variance of the frequency band limited energy exceeds an upper threshold level and for determining an ending of speech as occurring when the variance of the frequency band limited energy falls below a lower threshold level, the upper threshold level being greater than the lower threshold level.

13. A device for the detection of speech in an input signal, comprising:

first determining means for determining a variance of a frequency band limited energy of the signal; and

speech interval decision means for deciding start and end points of speech within the signal based on said variance, wherein said speech interval decision means comprises;

second determining means for determining a beginning of speech as occurring when the variance of the frequency band limited energy exceeds an upper threshold level and for determining an ending of speech as occurring when the variance of the frequency band limited energy falls below a lower threshold level, the upper threshold level being greater than the lower threshold level, wherein the first determining means for determining a variance comprises;

third means for providing a plurality of determined values representative of a plurality of frequency band limited energy at a predetermined sampling rate in a single frequency band over a first plurality of frames, wherein each frame comprises a plurality of samples; and

fourth means for calculating the variance from the plurality of determined values provided from the third means in the single frequency band over a second plurality of frames.

14. The device of claim 13, wherein the frequency band limited energy is derived from routing the signal through a Fourier transform.

15. The device of claim 13, wherein said variance is determined from the frequency band limited energy over a continuous period of m seconds, where m is between 0.1 second and 10 seconds.

16. The device of claim 13, wherein the variance of the frequency band limited energy is determined by maintaining a sum of m seconds of frequency band limited energy, wherein m is between 0.1 to 10 seconds, and a sum of squares of said m seconds of frequency band limited energy and, for a new variance determination, the sum of squares of frequency band limited energy is updated by adding a square of a newest frequency band limited energy and subtracting a square of the frequency band limited energy value m seconds past, and wherein the sum of said m seconds of frequency band limited energy is updated by adding the newest frequency band limited energy and subtracting the frequency band limited energy value m seconds past.

17. A device for detecting speech in an input signal comprising:

first determining means for determining a plurality of values representative of a plurality of frequency band limited energy within the signal, wherein the signal is sampled at a predetermined sampling rate in a single frequency band over a first plurality of frames, wherein each frame comprises a plurality of samples, the first determining means using a frequency band limiter;

second determining means for receiving the plurality of values from said first determining means, and determining a variance of the frequency band limited energy of the signal in the single frequency band over a second plurality of frames; and

third determining means for determining beginning and ending points of speech within the signal using the variance of the frequency band limited energy.