SIGNAL PROCESSING APPARATUS FOR ENHANCING A VOICE COMPONENT WITHIN A MULTI-CHANNEL AUDIO SIGNAL

• US 20170154636A1
• Filed: 02/09/2017
• Published: 06/01/2017
• Est. Priority Date: 12/12/2014
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: GEIGER, Juergen, GROSCHE, Peter
• Granted Patent: US 10,210,883 B2
• Time in Patent Office: Days
• CPC Class Codes: G10L 21/0272 Voice signal separating
• CPC Class Codes: G10L 21/0316 by changing the amplitude
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 5/00 Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation

Abstract

A signal processing apparatus for enhancing a voice component within a multi-channel audio signal comprising a left channel audio signal, a center channel audio signal, and a right channel audio signal, the signal processing apparatus comprising a filter and a combiner; wherein the filter is configured to determine an overall magnitude of the multi-channel audio signal over frequency based on the multi-channel audio signal, to obtain a gain function based on a ratio between a magnitude of the center channel audio signal and the overall magnitude of the multi-channel audio signal, and to weight the left channel audio signal, the center channel audio signal, and the right channel audio signal by the gain function; and wherein the combiner is configured to combine individually the left channel audio signal, the center channel audio signal, and the right channel audio signal with the weighted right channel audio signal.

Claims

1. A signal processing apparatus for enhancing a voice component within a multi-channel audio signal, the multi-channel audio signal comprising a left channel audio signal (L), a center channel audio signal (C), and a right channel audio signal (R), the signal processing apparatus comprising:

a filter configured to;

determine a measure representing an overall magnitude of the multi-channel audio signal over frequency based on the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R),

obtain a gain function (G) based on a ratio between a measure of magnitude of the center channel audio signal (C) and the measure representing the overall magnitude of the multi-channel audio signal,

weight the left channel audio signal (L) by the gain function (G) to obtain a weighted left channel audio signal (L_E),

weight the center channel audio signal (C) by the gain function (G) to obtain a weighted center channel audio signal (C_E), and

weight the right channel audio signal (R) by the gain function (G) to obtain a weighted right channel audio signal (R_E); and

a combiner configured to;

combine the left channel audio signal (L) with the weighted left channel audio signal (L_E) to obtain a combined left channel audio signal (L_EV),

combine the center channel audio signal (C) with the weighted center channel audio signal (C_E) to obtain a combined center channel audio signal (C_EV), and

combine the right channel audio signal (R) with the weighted right channel audio signal (R_E) to obtain a combined right channel audio signal (R_EV).

2. The signal processing apparatus of claim 1, wherein the filter is further configured to determine the measure representing the overall magnitude of the multi-channel audio signal as a sum of the measure of magnitude of the center channel audio signal (C) and a measure of magnitude of a difference of the left channel audio signal (L) and the right channel audio signal (R).

3. The signal processing apparatus of claim 1, wherein the filter is configured to determine the gain function (G) according to the following equations:

4. The signal processing apparatus of claim 1, wherein the multi-channel audio signal further comprises a left surround channel audio signal (LS) and a right surround channel audio signal (RS),

wherein the filter is further configured to:

determine the measure representing the overall magnitude of the multi-channel audio signal over frequency additionally based on the left surround channel audio signal (LS) and the right surround channel audio signal (RS), and

determine the measure representing the overall magnitude of the multi-channel audio signal as the sum of the measure of magnitude of the center channel audio signal (C), of a measure of magnitude of a difference of the left channel audio signal (L) and the right channel audio signal (R), and of a measure of magnitude of a difference of the left surround channel audio signal (LS) and the right surround channel audio signal (RS).

5. The signal processing apparatus of claim 1, further comprising:

a voice activity detector configured to determine a voice activity indicator (V) based on the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R), the voice activity indicator (V) indicating a magnitude of the voice component within the multi-channel audio signal over time,

wherein the combiner is further configured to;

combine the weighted left channel audio signal (L_E) with the voice activity indicator (V) to obtain the combined left channel audio signal (L_EV),

combine the weighted center channel audio signal (C_E) with the voice activity indicator (V) to obtain the combined center channel audio signal (C_EV), and

combine the weighted right channel audio signal (R_E) with the voice activity indicator (V) to obtain the combined right channel audio signal (R_EV).

6. The signal processing apparatus of claim 5, wherein the voice activity detector is further configured to:

determine a measure representing an overall spectral variation of the multi-channel audio signal based on the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R); and

obtain the voice activity indicator (V) based on a ratio between a measure of spectral variation (F_C) of the center channel audio signal (C) and the measure representing the overall spectral variation of the multi-channel audio signal.

7. The signal processing apparatus of claim 6, wherein the voice activity detector is further configured to determine the voice activity indicator (V) according to the following equation:

8. The signal processing apparatus of claim 7, wherein the voice activity detector is further configured to determine the measure of spectral variation (F_C) of the center channel audio signal (C) as the spectral flux and the measure of spectral variation (F_S) of the difference between the left channel audio signal (L) and the right channel audio signal (R) as the spectral flux according to the following equations:

9. The signal processing apparatus of claim 5, wherein the voice activity detector is further configured to filter the voice activity indicator (V) in time based on a predetermined low-pass filtering function.

10. The signal processing apparatus of claim 5, wherein the combiner is further configured to:

weight the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R) by a predetermined input gain factor (G_in); and

weight the voice activity indicator (V) by a predetermined speech gain factor (G_S).

11. The signal processing apparatus of claim 5, wherein the combiner is further configured to:

add the left channel audio signal (L) to the combination of the weighted left channel audio signal (L_E) with the voice activity indicator (V) to obtain the combined left channel audio signal (L_EV);

add the center channel audio signal (C) to the combination of the weighted left channel audio signal (L_E) with the voice activity indicator (V) to obtain the combined center channel audio signal (C_EV); and

add the right channel audio signal (R) to the combination of the weighted left channel audio signal (L_E) with the voice activity indicator (V) to obtain the combined right channel audio signal (R_EV).

12. The signal processing apparatus of claim 1, further comprising:

an up-mixer configured to determine the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R) based on an input left channel stereo audio signal (L_in) and an input right channel stereo audio signal (R).

13. The signal processing apparatus of claim 12, further comprising:

a down-mixer configured to determine an output left channel stereo audio signal (L_out) and an output right channel stereo audio signal (R_out) based on the combined left channel audio signal (L_EV), the combined center channel audio signal (C_EV), and the combined right channel audio signal (R_EV).

14. The signal processing apparatus of claim 1, further comprising:

a down-mixer configured to determine an output left channel stereo audio signal (L_out) and an output right channel stereo audio signal (R_out) based on the combined left channel audio signal (L_EV), the combined center channel audio signal (C_EV), and the combined right channel audio signal (R_EV).

15. The signal processing apparatus of claim 1, wherein the measure of magnitude comprises a power, a logarithmic power, a magnitude, or a logarithmic magnitude of a signal.

16. A signal processing method for enhancing a voice component within a multi-channel audio signal, the multi-channel audio signal comprising a left channel audio signal (L), a center channel audio signal (C), and a right channel audio signal (R), the signal processing method comprising:

determining a measure representing an overall magnitude of the multi-channel audio signal over frequency based on the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R);

obtaining a gain function (G) based on a ratio between a measure of magnitude of the center channel audio signal (C) and the measure representing the overall magnitude of the multi-channel audio signal;

weighting the left channel audio signal (L) by the gain function (G) to obtain a weighted left channel audio signal (L_E);

weighting the center channel audio signal (C) by the gain function (G) to obtain a weighted center channel audio signal (C_E);

weighting the right channel audio signal (R) by the gain function (G) to obtain a weighted right channel audio signal (R_E);

combining the left channel audio signal (L) with the weighted left channel audio signal (L_E) to obtain a combined left channel audio signal (L_EV);

combining the center channel audio signal (C) with the weighted center channel audio signal (C_E) to obtain a combined center channel audio signal (C_EV); and

combining the right channel audio signal (R) with the weighted right channel audio signal (R_E) to obtain a combined right channel audio signal (R_EV).

17. A computer readable medium comprising a program code that, when executed by a processor, causes a computer system to enhance a voice component within a multi-channel audio signal, the multi-channel audio signal comprising a left channel audio signal (L), a center channel audio signal (C), and a right channel audio signal (R), by performing the steps of:

determining a measure representing an overall magnitude of the multi-channel audio signal over frequency based on the left channel audio signal (L), the center channel audio signal (C), and the right channel audio signal (R);

obtaining a gain function (G) based on a ratio between a measure of magnitude of the center channel audio signal (C) and the measure representing the overall magnitude of the multi-channel audio signal;

weighting the left channel audio signal (L) by the gain function (G) to obtain a weighted left channel audio signal (L_E);

weighting the center channel audio signal (C) by the gain function (G) to obtain a weighted center channel audio signal (C_E);

weighting the right channel audio signal (R) by the gain function (G) to obtain a weighted right channel audio signal (R_E);

combining the left channel audio signal (L) with the weighted left channel audio signal (L_E) to obtain a combined left channel audio signal (L_EV);

combining the center channel audio signal (C) with the weighted center channel audio signal (C_E) to obtain a combined center channel audio signal (C_EV); and

combining the right channel audio signal (R) with the weighted right channel audio signal (R_E) to obtain a combined right channel audio signal (R_EV).