Method and apparatus for estimating harmonic information, spectral envelope information, and degree of voicing of speech signal

• US 20070288232A1
• Filed: 04/04/2007
• Published: 12/13/2007
• Est. Priority Date: 04/04/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Hyun-Soo
• Granted Patent: US 7,912,709 B2
• Time in Patent Office: Days
• US Class Current: 704/206
• CPC Class Codes: G10L 19/093 using sinusoidal excitation models
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

A degree of voicing is extracted using the characteristic of harmonic peaks existing in a constant period by converting an input speech or audio signal to a speech signal of the frequency domain, selecting the greatest peak in a first pitch period of the converted speech signal as a harmonic peak, thereafter selecting a peak having the greatest spectral value among peaks existing in each peak search range of the speech signal as a harmonic peak, extracting harmonic spectral envelope information by performing interpolation of the selected harmonic peaks, extracting non-harmonic spectral envelope information by performing interpolation of the non-harmonic peaks, and comparing the two pieces of envelope information to each other.

Claims

1. A method of estimating harmonic information and spectral envelope information of a speech signal, the method comprising the steps of:

converting a received speech signal of a time domain to a speech signal of a frequency domain;

calculating a coarse pitch value of the speech signal and determining a peak search range using the coarse pitch value;

setting a plurality of peak search ranges in the speech signal, detecting peaks existing in each of the peak search ranges, determining a peak having the greatest spectral value among the detected peaks as a harmonic peak in each of the peak search ranges, and outputting the harmonic peak of each of the peak search ranges as harmonic information of the speech signal; and

generating a harmonic spectral envelope by performing interpolation of the harmonic peaks, and outputting the generated harmonic spectral envelope as spectral envelope information of the speech signal.

2. The method of claim 1, wherein the determined peak search range comprises a total interval, a shifting interval in which peak detection is not performed, and an actual search interval in which the peak detection is performed.

3. The method of claim 2, wherein the actual search interval is an interval excluding the shifting interval from the total interval.

4. The method of claim 3, wherein the total interval is determined to be greater than the coarse pitch value, and the shifting interval is determined to be less than the coarse pitch value.

5. The method of claim 4, wherein when CP denotes the coarse pitch value, b denotes the total interval, and a denotes the shifting interval, the peak search range is determined by the equation below

M·

CP<

b<

2m·

CP,
0<

a<

m·

CP,
where M<

2m and 0<

m<

1<

M.

6. The method of claim 5, wherein when an initial harmonic peak of the speech signal is detected, the total interval is set to the coarse pitch value, and the shifting interval is set to 0.

7. The method of claim 6, wherein in the step of determining and outputting a harmonic peak, the peak search range is set based on the latest harmonic peak detected from the speech signal.

8. The method of claim 7, wherein the step of determining and outputting a harmonic peak comprises determining and outputting a peak as a harmonic peak when it is determined that the peak having the greatest spectral value is a high-order peak of more than 2^nd order.

9. The method of claim 8, further comprising:

generating and outputting a non-harmonic spectral envelope by performing interpolation of peaks excluding the harmonic peak from among the peaks detected in each of the peak search ranges; and

detecting a degree of voicing indicating a rate of a voiced sound included in the speech signal by comparing energy of the harmonic spectral envelope to energy of the non-harmonic spectral envelope.

10. The method of claim 9, further comprising performing audio coding, recognition, and synthesis using the harmonic information, the harmonic spectral envelope information, and the degree of voicing.

11. A method of estimating harmonic information of a speech signal, the method comprising the steps of:

converting a received speech signal of a time domain to a speech signal of a frequency domain;

calculating a coarse pitch value of the speech signal and determining a peak search range using the coarse pitch value; and

setting a plurality of peak search ranges in the speech signal, detecting peaks existing in each of the peak search ranges, determining a peak having the greatest spectral value among the detected peaks as a harmonic peak in each of the peak search ranges, and outputting the harmonic peak of each of the peak search ranges as harmonic information of the speech signal.

12. A method of estimating a degree of voicing of a speech signal using spectral envelope information of the speech signal, the method comprising the steps of:

detecting harmonic spectral envelope information comprising harmonic peaks of the speech signal;

detecting non-harmonic spectral envelope information comprising peaks excluding the harmonic peaks among peaks of the speech signal; and

detecting a degree of voicing indicating a rate of a voiced sound included in the speech signal by comparing energy of the harmonic spectral envelope to energy of the non-harmonic spectral envelope.

13. The method of claim 12, wherein the step of detecting harmonic spectral envelope information comprises:

converting a received speech signal of a time domain to a speech signal of a frequency domain;

calculating a coarse pitch value of the speech signal and determining a peak search range using the coarse pitch value;

setting a plurality of peak search ranges in the speech signal, detecting peaks existing in each of the peak search ranges, determining a peak having the greatest spectral value among the detected peaks as a harmonic peak in each of the peak search ranges, and outputting the determined harmonic peak for each of the peak search ranges; and

generating a harmonic spectral envelope by performing interpolation of the harmonic peaks, and outputting the generated harmonic spectral envelope as spectral envelope information of the speech signal,

wherein the step of detecting non-harmonic spectral envelope information comprises generating and outputting a non-harmonic spectral envelope by performing interpolation of peaks excluding the peak determined as a harmonic peak among the peaks detected in each of the peak search ranges.

14. An apparatus for estimating harmonic information and spectral envelope information of a speech signal, the apparatus comprising;

a frequency domain converter for converting a received speech signal of a time domain to a speech signal of a frequency domain;

a search range determiner for calculating a coarse pitch value of the speech signal output from the frequency domain converter and determining a peak search range using the coarse pitch value;

a harmonic peak detector for setting a plurality of peak search ranges in the speech signal, detecting peaks existing in each of the peak search ranges, determining a peak having the greatest spectral value among the detected peaks as a harmonic peak in each of the peak search ranges, and outputting the harmonic peak of each of the peak search ranges as harmonic information of the speech signal; and

a harmonic spectral envelope detector for generating a harmonic spectral envelope by performing interpolation of the harmonic peaks, and outputting the generated harmonic spectral envelope as spectral envelope information of the speech signal.

15. The apparatus of claim 14, wherein the peak search range comprises a total interval, a shifting interval in which peak detection is not performed, and an actual search interval in which the peak detection is performed.

16. The apparatus of claim 15, wherein the actual search interval is an interval excluding the shifting interval from the total interval.

17. The apparatus of claim 16, wherein the total interval is determined to be greater than the coarse pitch value, and the shifting interval is determined to be less than the coarse pitch value.

18. The apparatus of claim 17, wherein when CP denotes the coarse pitch value, b denotes the total interval, and a denotes the shifting interval, the peak search range is determined by

M·

CP<

b<

2m·

CP,
0<

a<

m·

CP,
where M<

2m and 0<

m<

1<

M.

19. The apparatus of claim 17, wherein when an initial harmonic peak of the speech signal is detected, the search range determiner sets the total interval to the coarse pitch value and the shifting interval to 0.

20. The apparatus of claim 19, wherein the harmonic peak detector sets the peak search range based on the latest harmonic peak detected from the speech signal.

21. The apparatus of claim 20, wherein the harmonic peak detector determines and outputs the peak as a harmonic peak when it is determined that the peak having the greatest spectral value is a high-order peak of more than 2^nd order.

22. The apparatus of claim 20, further comprising:

a non-harmonic spectral envelope detector for generating and outputting a non-harmonic spectral envelope by performing interpolation of peaks excluding the harmonic peak from among the peaks detected in each of the peak search ranges; and

a voicing degree detector for detecting a degree of voicing indicating a rate of a voiced sound included in the speech signal by comparing energy of the harmonic spectral envelope to energy of the non-harmonic spectral envelope.

23. The apparatus of claim 22, further comprising a speech processing unit for performing audio coding, recognition, and synthesis using the harmonic information, the harmonic spectral envelope information, and the degree of voicing.

24. The apparatus of claim 23, wherein when D denotes the degree of voicing, S_n denotes the harmonic spectral envelope, and W_n denotes the non-harmonic spectral envelope, the degree of voicing D is detected by

25. An apparatus for estimating harmonic information of a speech signal, the apparatus comprising:

a frequency domain converter for converting a received speech signal of a time domain to a speech signal of a frequency domain;

a search range determiner for calculating a coarse pitch value of the speech signal output from the frequency domain converter and determining a peak search range using the coarse pitch value; and

a harmonic peak detector for setting a plurality of peak search ranges in the speech signal, detecting peaks existing in each of the peak search ranges, determining a peak having the greatest spectral value among the detected peaks as a harmonic peak in each of the peak search ranges, and outputting the harmonic peaks as harmonic information of the speech signal.