METHOD AND SYSTEM FOR DIALOG ENHANCEMENT

• US 20110119061A1
• Filed: 11/15/2010
• Published: 05/19/2011
• Est. Priority Date: 11/17/2009
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Brown, Charles Phillip
• Granted Patent: US 9,324,337 B2
• Time in Patent Office: Days
• US Class Current: 704/258
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/028 Noise substitution, i.e. substituting non-tonal spectral components by noisy source comfort noise for discontinuous speech transmission G10L19/012
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain

Abstract

A method and system for enhancing dialog determined by an audio input signal. In some embodiments the input signal is a stereo signal, and the system includes an analysis subsystem configured to analyze the stereo signal to generate filter control values, and a filtering subsystem including upmixing circuitry configured to upmix the input signal to generate a speech channel and non-speech channels and a peaking filter configured to filter the speech channel to enhance dialog while being steered by at least one of the control values. The filtering subsystem also includes ducking circuitry for attenuating the non-speech channels while being steered by at least some of the control values, and downmixing circuitry configured to combine outputs of the peaking filter and ducking circuitry to generate a filtered stereo output. In some embodiments, the system is configured to downmix a multichannel input signal to generate a downmixed stereo signal, an analysis subsystem is configured to analyze the downmixed stereo signal to generate filter control values, and a filtering subsystem is configured to generate a dialog-enhanced audio signal in response to the input signal while being steered by at least some of the filter control values. Preferably, the filter control values are generated without use of feedback including by generating power ratios (for pairs of speech and non-speech channels) and preferably also shaping in nonlinear fashion and scaling at least one of the power ratios.

Claims

1. A method for enhancing dialog determined by an audio input signal, said method including the steps of:

(a) analyzing the input signal to generate filter control values without use of feedback; and

(b) filtering a speech channel determined by the input signal in a peaking filter steered by at least one of the control values to generate a dialog-enhanced speech channel, and attenuating non-speech channels determined by the input signal in ducking circuitry steered by at least a subset of the control values to generate attenuated non-speech channels.

2. The method of claim 1, wherein step (a) includes a step of generating power ratios, including at least one ratio of power in a speech channel determined by the input signal to power in a non-speech channel determined by the input signal.

3. The method of claim 2, wherein step (a) also includes a step of shaping in nonlinear fashion and scaling at least one of the power ratios.

4. The method of claim 3, wherein said shaping in nonlinear fashion includes a step of exponentiating at least one value determined from at least one of the power ratios.

5. The method of claim 1, wherein the input signal is a stereo signal, and also including the step of:

(c) combining the dialog-enhanced speech channel and the attenuated non-speech channels to generate a dialog-enhanced stereo output signal.

6. The method of claim 5, wherein step (b) includes a step of upmixing the input signal to determine a first one of the non-speech channels, a second one of the non-speech channels, and the speech channel.

7. The method of claim 5, wherein step (a) includes a step of generating power ratios, including at least one ratio of power in a speech channel determined by the input signal to power in a non-speech channel determined by the input signal.

8. The method of claim 7, wherein step (a) also includes a step of shaping in nonlinear fashion and scaling at least one of the power ratios.

9. The method of claim 1, wherein the input signal is a multi-channel audio signal having more than two channels, and step (a) includes steps of:

(c) downmixing the input signal to generate a downmixed stereo signal; and

(d) analyzing the downmixed stereo signal to generate the filter control values.

10. The method of claim 9, wherein the dialog-enhanced speech channel and the attenuated non-speech channels generated in step (b) determine a dialog-enhanced multi-channel output signal.

11. The method of claim 9, wherein step (a) includes a step of generating power ratios, including at least one ratio of power in a speech channel determined by the input signal to power in a non-speech channel determined by the input signal.

12. The method of claim 11, wherein step (a) also includes a step of shaping in nonlinear fashion and scaling at least one of the power ratios.

13. The method of claim 1, wherein the analyzing is time domain analysis on samples of the input signal, the filtering is time domain filtering of samples of the speech channel, and the attenuating is time domain attenuation of samples of the non-speech channels.

14. A system for enhancing dialog determined by an audio input signal, including:

an analysis subsystem coupled and configured to analyze the input signal to generate filter control values without use of feedback; and

a filtering subsystem coupled to the analysis subsystem and including a peaking filter and ducking circuitry, wherein the peaking filter is configured to filter a speech channel determined by the input signal, while being steered by at least one of the control values, to generate a dialog-enhanced speech channel, and the ducking circuitry is configured to attenuate non-speech channels determined by the input signal, while being steered by at least a subset of the control values, to generate attenuated non-speech channels.

15. The system of claim 14, wherein the analysis subsystem is configured to generate power ratios in response to the input signal, the power ratios including at least one ratio of power in a speech channel determined by the input signal to power in a non-speech channel determined by the input signal.

16. The system of claim 15, wherein the analysis subsystem is configured to shape in nonlinear fashion and scale at least one of the power ratios.

17. The system of claim 15, wherein the analysis subsystem is configured to shape in nonlinear fashion at least one of the power ratios including by exponentiating at least one value determined from said at least one of the power ratios.

18. The system of claim 14, wherein the input signal is a stereo signal, and the filtering subsystem includes:

upmixing circuitry configured to upmix the input signal to generate a speech channel and non-speech channels; and

circuitry coupled and configured to analyze the speech channel and the non-speech channels to generate the filter control values.

19. The system of claim 14, wherein the input signal is a stereo signal having a left channel and a right channel, and the filtering subsystem includes:

upmixing circuitry configured to upmix the input signal to generate a speech channel by summing the left input channel and the right input channel, and non-speech channels by subtracting the speech channel from each of the left input channel and the right input channel; and

circuitry coupled and configured to analyze the speech channel and the non-speech channels to generate the filter control values.

20. The system of claim 14, wherein the input signal is a stereo signal and the filtering subsystem is configured to combine the dialog-enhanced speech channel and the attenuated non-speech channels to generate a dialog-enhanced stereo output signal.

21. The system of claim 20, wherein the analysis subsystem is configured to upmix the input signal to determine a first one of the non-speech channels, a second one of the non-speech channels, and the speech channel.

22. The system of claim 20, wherein the analysis subsystem is configured to generate power ratios in response to the input signal, the power ratios including at least one ratio of power in a speech channel determined by the input signal to power in a non-speech channel determined by the input signal.

23. The system of claim 22, wherein in the analysis subsystem is configured to shape in nonlinear fashion and scale at least one of the power ratios.

24. The system of claim 14, wherein the input signal is a multi-channel audio signal having more than two channels, the system is configured to downmix the input signal to generate a downmixed stereo signal, and the analysis subsystem is configured to analyze the downmixed stereo signal to generate the filter control values.

25. The system of claim 24, wherein the analysis subsystem is configured to downmix the input signal to generate the downmixed stereo signal, and the filtering subsystem is configured to assert the dialog-enhanced speech channel and the attenuated non-speech channels as a dialog-enhanced multi-channel output signal.

26. The system of claim 24, wherein the analysis subsystem is configured to generate power ratios in response to the input signal, the power ratios including at least one ratio of power in a speech channel of the input signal to power in a non-speech channel of the input signal.

27. The system of claim 26, wherein in the analysis subsystem is configured to shape in nonlinear fashion and scale at least one of the power ratios.

28. The system of claim 14, wherein the peaking filter is a biquadratic filter whose response is determined a current value of each said at least one of the control values.

29. The system of claim 14, wherein said system is a data processing system configured to implement the analysis subsystem and the filtering subsystem.

30. The system of claim 14, wherein said system is an audio digital signal processor.

31. The system of claim 14, wherein said system is an audio digital signal processor including circuitry configured to implement the analysis subsystem and the filtering subsystem.