Enhancement of multichannel audio

• US 9,368,128 B2
• Filed: 01/26/2015
• Issued: 06/14/2016
• Est. Priority Date: 02/26/2007
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Muesch, Hannes
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US14/605,003
• Publication Number:
  US 20150142424A1
• Time in Patent Office: 505 Days
• Field of Search: 704226-230
• US Class Current: 1/1
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G10L 2025/932 Decision in previous or following frames
• CPC Class Codes: G10L 2025/937 Signal energy in various frequency bands
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: G10L 21/0364 for improving intelligibility
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

The invention relates to audio signal processing. More specifically, the invention relates to enhancing multichannel audio, such as television audio, by applying a gain to the audio that has been smoothed between portions of the audio. The invention relates to methods, apparatus for performing such methods, and to software stored on a computer-readable medium for causing a computer to perform such methods.

Claims

1. A method for enhancing an audio signal, wherein the audio signal comprises two or more channels of audio content, the method comprising:

examining a portion of the audio signal to determine whether the portion contains one or more characteristics of speech, and if the portion contains one or more characteristics of speech, classifying the portion as a speech portion, said examining including;

applying a first portion of the audio signal to a speech versus other sound (SVO) detector,

applying a second portion of the audio signal to a voice activity detector (VAD), the second portion overlapping the first portion and being smaller than the first portion, and

biasing a decision by the VAD based on the SVO output;

calculating a gain for the speech portion; and

applying the calculated gain to the audio signal.

2. The method of claim 1, wherein the applying the gain creates a substantially uniform perceived loudness between at least two speech portions of the audio signal.

3. The method of claim 1, wherein the one or more characteristics of speech includes a speech frequency band.

4. The method of claim 1, wherein the one or more characteristics of speech includes interchannel phase difference.

5. The method of claim 1, wherein the one or more characteristics of speech includes correlation.

6. The method of claim 1, wherein the examined portion comprises one or more blocks of the audio signal.

7. A non-transitory computer-readable storage medium encoded with a computer program for causing a computer to perform the method of claim 1.

8. A system for enhancing an audio signal, wherein the audio signal comprises two or more channels of audio content, the system comprising:

a controller operable to receive a first portion of the audio signal;

a detection module operable to determine whether the first portion contains characteristics of speech, and if the first portion is determined to contain characteristics of speech, to identify the first portion as a speech portion, said detection module including a speech-versus-other (SVO) detector applied to a first portion of the audio signal and driving a voice activity detector (VAD) applied to a second portion of the audio signal as a function of an output of the SVO, said second portion overlapping the first portion and being smaller than the first portion, said driving including biasing a decision by the VAD based on the SVO output; and

an enhancement processor operable to calculate a gain for the speech portion and apply the calculated gain to the audio signal.

9. The system of claim 8, wherein the first portion comprises a block of the audio signal.

10. The system of claim 8, wherein the first portion comprises a frame of the audio signal.

11. The system of claim 8, wherein the two or more channels are processed independently of each other.

12. The system of claim 8, wherein the enhancement processor operates in accordance with one or more processing parameters and adjustment of the parameters is operative to urge a metric of speech intelligibility of the audio content above a desired threshold level.

13. The system of claim 8, wherein the enhancement processor calculates the gain based in part on the level of noise in the speech portion.

14. The system of claim 8, wherein the enhancement processor is operative to perform an enhancement operation selected from the group consisting of dynamic range control, dynamic equalization, dynamic gain modification, spectral sharpening, speech extraction, and noise reduction.

15. The system of claim 8, wherein the system is implemented in one of an audio decoder, an audio encoder, and a non-transitory computer-readable storage medium.

16. The system of claim 8, wherein the first portion comprises a fixed quantity of audio samples of the audio signal.

17. The system of claim 8, wherein the first portion and the second portion are from the same audio channel.

18. The system of claim 8, wherein the system is operative to generate an output audio stream with a substantially constant perceived loudness of speech despite loudness level changes in the audio signal.

19. A method for signal processing, comprising:

receiving an audio signal, wherein the audio signal comprises two or more channels of audio content;

analyzing feature of the audio signal;

classifying a portion of the audio signal as a speech portion if the portion contains one or more features of speech, said classifying including;

applying a first portion of the audio signal to a speech versus other sound (SVO) detector, and

applying a second portion of the audio signal to a voice activity detector (VAD), the second portion overlapping the first portion and being smaller than the first portion, and

biasing a decision by the VAD based on the SVO output;

calculating a gain for the speech portion; and

applying the calculated gain to the audio signal.