APPARATUS AND METHOD FOR PROCESSING VOICE SIGNAL

• US 20140214412A1
• Filed: 01/13/2014
• Published: 07/31/2014
• Est. Priority Date: 01/29/2013
• Status: Active Grant

• Current Assignee: Cloud Network Technology Singapore Pte. Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Hon Hai Precision Industry Co., Ltd.
• Inventors: Wu, Chun-Te
• Granted Patent: US 9,165,561 B2
• Time in Patent Office: Days
• US Class Current: 704/207
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals

Abstract

A voice signal processing method processes voice signals acquired by a microphone. A voice processing device acquires first voice signals according to a first sampling frequency, and samples second voice signals from the first voice signals according to a second sampling frequency. The second voice signals are encoded to obtain a basic voice package. A voiceprint data package of each voice signal frame of the first voice signals is obtained using a curve fitting method, and a pitch data package of each voice signal frame of the first voice signals is obtained according to pitch distribution of twelve central octave keys of a standard piano. The voiceprint data package and the pitch data package are embedded into the basic audio package to generate a final voice package of the first voice signals.

Claims

1. A computerized voice processing method implemented by a voice processing device having a voice acquisition device, the method comprising:

controlling the voice acquisition device to acquire voices according to a first sampling frequency to obtain first voice signals;

sampling the first voice signals according to a second sampling frequency to obtain second voice signals;

coding the second voice signals to obtain a basic voice package;

dividing the first voice signals into a plurality of voice signal frames according to a predetermined time interval;

dividing data of sampling points of each voice signal frame into N data groups D₁, D₂, . . . , D_i, . . . , D_N;

determining a strongest changed data group of the N data groups;

fitting the data of the strongest changed data group to be a curve of a polynomial function to obtain coefficients of the polynomial function, and coding each of the coefficients of the polynomial function to a hexadecimal number to form a voiceprint data package of each voice signal frame;

calculating a frequency distribution range of each voice signal frame, and calculating an acoustic intensity of each voice signal frame relative to a pitch of each of twelve center octave keys of a standard piano according to the frequency distribution range of each voice signal frame, to obtain a pitch data package of each voice signal frame according to the acoustic intensity of each voice signal frame relative to a pitch of each of twelve center octave keys of a standard piano; and

embedding the voiceprint data package and the pitch data package of each voice signal frame into the basic voice package to obtain a final voice package of the first voice signals.

2. The method according to claim 1, wherein the second sampling frequency is less than the first sampling frequency, and the first sampling frequency is an integer multiple of the second sampling frequency.

3. The method according to claim 2, wherein the first sampling frequency is 48 KHz and the second sampling frequency is 8 KHz.

4. The method according to claim 2, wherein the step of determining a strongest changed data group of the N data groups comprises:

calculating an average value Kavg of data of each data group D_i and an absolute value Kabs_i of each data of each data group D_i, wherein 1≦

j≦

M;

calculating a difference between the absolute value Kabs_j of each data of each data group D_i and the average value Kavg of the data of the corresponding data group D_i; and

calculating a summation of calculated differences corresponding to each data group D according to a formula of

5. The method according to claim 1, wherein the predetermined time interval is 100 milliseconds (ms).

6. The method according to claim 1, wherein the polynomial function is a function of a five polynomial function represented as f(X)=C₅X⁵+C₄X⁴+C₃X³+C₂X²+C₁X+C₀, the coefficients of the polynomial function including C₀, C₁, C₂, C₃, C₄, and C₅.

7. The method according to claim 1, wherein the acoustic intensity of each voice signal frame relative to the pitch of each of the twelve center octave keys of the standard piano is encoded to a byte of a hexadecimal number to form the pitch data package of each voice signal frame, and the pitch data package includes twelve bytes of hexadecimal numbers.

8. The method according to claim 1, wherein the twelve center octave keys of the standard piano include tonal keys of C4, C4#, D4, D4#, E4, F4, F4#, G4, G4#, A4, A4#, and B4, wherein:

the pitch of the C4 tonal key is distributed in a first frequency interval of [261.63 Hz, 277.18 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the first frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the C4 tonal key;

the pitch of the C4# tonal key is distributed in a second frequency interval of [277.18 Hz, 293.66 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the second frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the C4# tonal key;

the pitch of the D4 tonal key is distributed in a third frequency interval of [293.66 Hz, 311.13 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the third frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the D4 tonal key;

the pitch of the D4# tonal key is distributed in a fourth frequency interval of [311.13 Hz, 329.63 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the fourth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the D# key;

the pitch of the E4 tonal key is distributed in a fifth frequency interval of [329.63 Hz, 349.23 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the fifth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the E4 tonal key;

the pitch of the F4 tonal key is distributed in a sixth frequency interval of [349.23 Hz, 369.99 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the sixth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the F4 tonal key;

the pitch of the F4# tonal key is distributed in a seventh frequency interval of [369.99 Hz, 392.00 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the seventh frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the F4# tonal key;

the pitch of the G4 tonal key is distributed in an eighth frequency interval of [392.00 Hz, 415.30 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the eighth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the G4 tonal key;

the pitch of the G4# tonal key is distributed in a ninth frequency interval of [415.30 Hz, 440.00 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the ninth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the G4# tonal key;

the pitch of the A4 tonal key is distributed in a tenth frequency interval of [440.00 Hz, 466.16 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the tenth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the A4 tonal key;

the pitch of the A4# tonal key is distributed in an eleventh frequency interval of [466.16 Hz, 493.88 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the eleventh frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the A4# tonal key; and

the pitch of the B4 tonal key is distributed in a twelfth frequency interval of [493.88 Hz, 523.00 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the twelfth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the B4 tonal key.

9. The method according to claim 1, wherein the second voice signals are encoded according to an international voice codec standard protocol.

10. The method according to claim 1, wherein the basic voice package is a voice over internet protocol package.

11. A voice processing device, comprising:

a voice acquisition device;

a storage;

a processor; and

one or more programs executed by the processor to perform a method of;

controlling the voice acquisition device to acquire voices according to a first sampling frequency to obtain first voice signals;

sampling the first voice signals according to a second sampling frequency to obtain second voice signals;

coding the second voice signals to obtain a basic voice package;

dividing the first voice signals into a plurality of voice signal frames according to a predetermined time interval;

dividing data of sampling points of each voice signal frame into N data groups D₁, D₂, . . . , D_i, . . . , D_N;

determining a strongest changed data group of the N data groups;

fitting the data of the strongest changed data group to be a curve of a polynomial function to obtain coefficients of the polynomial function, and coding each of the coefficients of the polynomial function to a hexadecimal number to form a voiceprint data package of each voice signal frame;

calculating a frequency distribution range of each voice signal frame, and calculating an acoustic intensity of each voice signal frame relative to a pitch of each of twelve center octave keys of a standard piano according to the frequency distribution range of each voice signal frame, to obtain a pitch data package of each voice signal frame according to the acoustic intensity of each voice signal frame relative to a pitch of each of twelve center octave keys of a standard piano; and

embedding the voiceprint data package and the pitch data package of each voice signal frame into the basic voice package to obtain a final voice package of the first voice signals.

12. The voice processing device according to claim 11, wherein the second sampling frequency is less than the first sampling frequency, and the first sampling frequency is an integer multiple of the second sampling frequency.

13. The voice processing device according to claim 12, wherein the first sampling frequency is 48 KHz and the second sampling frequency is 8 KHz.

14. The voice processing device according to claim 12, wherein the step of determining a strongest changed data group of the N data groups comprises:

calculating an average value Kavg of data of each data group D_i and an absolute value Kabs_j of each data of each data group D_i, wherein 1≦

j≦

M;

calculating a difference between the absolute value Kabs_j of each data of each data group D_i and the average value Kavg of the data of the corresponding data group D_i; and

calculating a summation of calculated differences corresponding to each data group D according to a formula of

15. The voice processing device according to claim 11, wherein the predetermined time interval is 100 milliseconds (ms).

16. The voice processing device according to claim 11, wherein the polynomial function is a function of a five polynomial function represented as f(X)=C₅X⁵+C₄X⁴+C₃X³+C₂X²+C₁X+C₀, the coefficients of the polynomial function including C₀, C₁, C₂, C₃, C₄, and C₅.

17. The voice processing device according to claim 11, wherein the acoustic intensity of each voice signal frame relative to the pitch of each of the twelve center octave keys of the standard piano is encoded to a byte of a hexadecimal number to form the pitch data package of each voice signal frame, and the pitch data package includes twelve bytes of hexadecimal numbers.

18. The voice processing device according to claim 11, wherein the twelve center octave keys of the standard piano include tonal keys of C4, C4#, D4, D4#, E4, F4, F4#, G4, G4#, A4, A4#, and B4, wherein:

the pitch of the C4 tonal key is distributed in a first frequency interval of [261.63 Hz, 277.18 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the first frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the C4 tonal key;

the pitch of the C4# tonal key is distributed in a second frequency interval of [277.18 Hz, 293.66 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the second frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the C4# tonal key;

the pitch of the D4 tonal key is distributed in a third frequency interval of [293.66 Hz, 311.13 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the third frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the D4 tonal key;

the pitch of the D4# tonal key is distributed in a fourth frequency interval of [311.13 Hz, 329.63 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the fourth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the D# key;

the pitch of the E4 tonal key is distributed in a fifth frequency interval of [329.63 Hz, 349.23 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the fifth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the E4 tonal key;

the pitch of the F4 tonal key is distributed in a sixth frequency interval of [349.23 Hz, 369.99 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the sixth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the F4 tonal key;

the pitch of the F4# tonal key is distributed in a seventh frequency interval of [369.99 Hz, 392.00 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the seventh frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the F4# tonal key;

the pitch of the G4 tonal key is distributed in an eighth frequency interval of [392.00 Hz, 415.30 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the eighth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the G4 tonal key;

the pitch of the G4# tonal key is distributed in a ninth frequency interval of [415.30 Hz, 440.00 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the ninth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the G4# tonal key;

the pitch of the A4 tonal key is distributed in a tenth frequency interval of [440.00 Hz, 466.16 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the tenth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the A4 tonal key;

the pitch of the A4# tonal key is distributed in an eleventh frequency interval of [466.16 Hz, 493.88 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the eleventh frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the A4# tonal key; and

the pitch of the B4 tonal key is distributed in a twelfth frequency interval of [493.88 Hz, 523.00 Hz], and an average value of acoustic intensities of sampling points of each voice signal frame located within the twelfth frequency interval is defined to be the acoustic intensity of the voice signal frame relative to the pitch of the B4 tonal key.

19. The voice processing device according to claim 11, wherein the second voice signals are encoded according to an international voice codec standard protocol.

20. The voice processing device according to claim 11, wherein the basic voice package is a voice over internet protocol package.