Ambience extraction and modification for enhancement and upmix of audio signals

• US 7,412,380 B1
• Filed: 12/17/2003
• Issued: 08/12/2008
• Est. Priority Date: 12/17/2003
• Status: Active Grant

• Current Assignee: Creative Technology Ltd.
• Original Assignee: Creative Technology Ltd.
• Inventors: Goodwin, Michael, Wolters, Martin, Sridharan, Ramkumar, Jot, Jean-Marc, Avendano, Carlos
• Primary Examiner(s): Edouard; Patrick N.
• Assistant Examiner(s): SHAH, PARAS D
• Application Number:
  US10/738,361
• Time in Patent Office: 1,700 Days
• Field of Search: 381/1, 381/61, 381/307, 381/17, 704/216, 704/500, 704/226, 704/224
• US Class Current: 704/216
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 5/005 of the pseudo five- or more-channel type, e.g. virtual surround

Abstract

Modifying an audio signal comprising a plurality of channel signals is disclosed. At least selected ones of the channel signals are transformed into a time-frequency domain. The at least selected ones of the channel signals are compared in the time-frequency domain to identify corresponding portions of the channel signals that are not correlated or are only weakly correlated across channels. The identified corresponding portions of said channel signals are modified.

Claims

1. A method for modifying an audio signal comprising a plurality of channel signals, the method comprising:

transforming at least selected ones of the channel signals into a time-frequency domain;

comparing said at least selected ones of the channel signals in the time-frequency domain to identify corresponding portions of said channel signals that are not correlated or are only weakly correlated across channels; and

modifying the identified corresponding portions of said channel signals, wherein the step of modifying comprises;

determining for each channel an input ratio in which the numerator comprises a measure of said portions of the channel signal that are uncorrelated or weakly correlated and the denominator comprises a measure of the overall channel signal;

receiving a user input indicating a desired output ratio of uncorrelated or weakly correlated portions to total signal; and

applying to said portions of said channel signals that are uncorrelated or weakly correlated a modification factor calculated to modify the channel signals as required to achieve the desired output ratio indicated by the user.

2. The method of claim 1, wherein determining for each channel an input ratio comprises:

extracting the uncorrelated or weakly correlated portions from the overall signal;

determining the energy level of the uncorrelated or weakly correlated portions;

determining the energy level of the overall signal; and

dividing the energy level of the uncorrelated or weakly correlated portions by the energy level of the overall signal.

3. The method of claim 2, wherein the modification factor comprises the square root of the result obtained by dividing the user-indicated ratio by the input ratio.

4. A method for providing a generated signal to a playback channel of a multichannel playback system, the method comprising:

receiving an input audio signal comprising a plurality of input channel signals;

transforming at least selected ones of the input channel signals into a time-frequency domain;

comparing said at least selected ones of the input channel signals in the time-frequency domain to identify corresponding portions of said input channel signals that are not correlated or are only weakly correlated;

extracting from each of said input channel signals the identified corresponding portions of said input channel signals that are not correlated or are only weakly correlated;

combining the extracted portions, including;

determining the magnitude of the respective portions of said input channel signals that are not correlated or are only weakly correlated;

taking the absolute difference of the magnitude values; and

applying a phase to the result of the absolute difference; and

providing to the playback channel a signal comprising at least in part said extracted and combined identified corresponding portions of said input channel signals that are not correlated or are only weakly correlated.

5. The method of claim 4, wherein combining the extracted portions comprises taking the difference between the corresponding extracted portions.

6. The method of claim 4, wherein the playback channel comprises a first playback channel and further comprising providing to at least one additional playback channel a signal comprising at least in part said extracted and combined identified corresponding portions of said input channel signals that are not correlated or are only weakly correlated.

7. The method of claim 6, further comprising decorrelating the signal provided to said first playback channel and the signal provided to said at least one additional playback channel.

8. The method of claim 7, wherein decorrelating the signal provided to said first playback channel and the signal provided to said at least one additional playback channel comprises processing the signal provided to each respective playback channel using an allpass filter configured to apply a phase adjustment that is different than the phase adjustment applied to the respective signals provided to the other playback channel(s).

9. The method of claim 7, wherein decorrelating the signal provided to said first playback channel and the signal provided to said at least one additional playback channel comprises processing the signal provided to each respective playback channel using a delay line configured to apply a delay that is different than the delay applied to the respective signals provided to the other playback channel(s).

10. The method of claim 4, further comprising modifying the extracted and combined portions prior to providing them to the playback channel.

11. The method of claim 10, wherein the modification is determined at least in part by a user input.

12. The method of claim 11, wherein the user input determines at least in part the gain of an amplifier used to process the extracted and combined portions.

13. The method of claim 11, wherein the user input determines at least in part a bandwidth within which the modification is performed.

14. The method of claim 13, wherein the bandwidth is implemented by processing the extracted and combined portions using a bandpass filter and the user input determines at least in part the lower and upper boundary frequencies of the bandpass filter.

15. The method of claim 4, wherein the steps of extracting and combining comprise determining the magnitude of the respective portions of said input channel signals that are not correlated or are only weakly correlated, taking the absolute difference of the magnitude values, and applying the phase of one of the input channels to the result.

16. The method of claim 4, wherein one of the plurality of input channel signals corresponds to the playback channel and wherein the signal provided to the playback channel further comprises the corresponding input channel signal.