Method, system, apparatus and computer program product for stereo coding

• US 8,041,042 B2
• Filed: 11/30/2006
• Issued: 10/18/2011
• Est. Priority Date: 11/30/2006
• Status: Expired due to Fees

• Current Assignee: RPX Corporation
• Original Assignee: Nokia Corporation
• Inventors: Ojanpera, Juha
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): SUTHERS, DOUGLAS JOHN
• Application Number:
  US11/633,133
• Publication Number:
  US 20080130903A1
• Time in Patent Office: 1,783 Days
• Field of Search: 381/23, 381 17- 18, 381 19- 22, 381/81, 381/123, 381/56, 700/94, 704500-504
• US Class Current: 381/23
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: H04S 2420/03 Application of parametric coding in stereophonic audio systems

Abstract

A method, system, apparatus and computer program product are provided for improved stereo coding. In particular, the method, system, apparatus and computer program product provide a technique for performing Mid-Side (M/S) stereo coding, in which an additional step is added to the coding process, whereby a parameter that is used in determining when the mid and side signals will be used instead of the left and right input signals is modified prior to making the selection between the signal pairs. In particular, the masking threshold associated with either the left or the right input signal may be modified based on a relationship between the energies of the two input signals. In addition, once the selection between the signal pairs has been made, the masking thresholds of the selected signals may be further modified, again based on a relationship between the energies of the left and right input signals.

Claims

1. A method comprising:

receiving a left and a right input signal;

deriving left and right masking thresholds associated with respective left and right input signals;

determining the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

determining a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

comparing the scale value to a predetermined threshold; and

in an instance in which the scale value exceeds the predetermined threshold, modifying the masking threshold associated with the input signal comprising the minimum energy.

2. The method of claim 1, wherein modifying the masking threshold comprises multiplying the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

3. The method of claim 1 further comprising:

determining a mid and a side signal based at least in part on the left and right input signals; and

selecting between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

4. The method of claim 3, wherein the left or right masking threshold is modified prior to selecting between the left and right input signals and the mid and side signals.

5. The method of claim 3, wherein selecting between the left and right input signals and the mid and side signals comprises:

determining a first combined perceptual entropy associated with the left and right input signals, said first combined perceptual entropy based at least in part on the left and right masking thresholds;

determining a second combined perceptual entropy associated with the mid and side signals, said second combined perceptual entropy based at least in part on mid and side masking thresholds; and

comparing the first and second combined perceptual entropies to determine which is lower.

6. The method of claim 3, wherein determining the mid signal comprises averaging the left and right input signals, and wherein determining the side signal comprises taking the difference between the left and right input signals and dividing the difference by two.

7. The method of claim 3 further comprising:

where the left and right input signals are selected, further modifying at least one of the left or the right masking thresholds;

where the mid and side signals are selected, further modifying at least one of a mid or a side masking thresholds; and

quantizing the selected signals based at least in part on the corresponding masking thresholds.

8. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following;

receive left and right input signals;

derive left and right masking thresholds associated with respective left and right input signals;

determine the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

determine a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

compare the scale value to a predetermined threshold; and

in an instance in which the scale value exceeds the predetermined threshold, modify the masking threshold associated with the input signal comprising the minimum energy.

9. The apparatus of claim 8, wherein in order to modify the masking threshold, the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to multiply the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

10. The apparatus of claim 8, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to:

determine a mid and a side signal based at least in part on the left and right input signals; and

select between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

11. The apparatus of claim 10, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to modify the left or right masking threshold prior to selecting between the left and right input signals and the mid and side signals.

12. The apparatus of claim 10, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to:

where the left and right input signals are selected, further modify at least one of the left or the right masking thresholds; and

where the mid and side signals are selected, further modify at least one of a mid or a side masking thresholds.

13. The apparatus of claim 12, wherein the apparatus further comprises:

a quantizer configured to quantize the selected signals based at least in part on the corresponding masking thresholds.

14. An apparatus comprising:

means for receiving a left and a right input signal;

means for deriving left and right masking thresholds associated with respective left and right input signals;

means for determining the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

means for determining a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

means for comparing the scale value to a predetermined threshold; and

means for modifying the masking threshold associated with the input signal comprising the minimum energy, in an instance in which the scale value exceeds the predetermined threshold.

15. The apparatus of claim 14, wherein the means for modifying the masking threshold comprises means for multiplying the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

16. The apparatus of claim 14 further comprising:

means for determining a mid and a side signal based at least in part on the left and right input signals; and

means for selecting between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

17. The apparatus of claim 16, wherein the means for modifying the left or right masking threshold comprises means for modifying the left or right masking threshold prior to selecting between the left and right input signals and the mid and side signals.

18. The apparatus of claim 16, wherein the means for selecting between the left and right input signals and the mid and side signals further comprises:

means for determining a first combined perceptual entropy associated with the left and right input signals, said first combined perceptual entropy based at least in part on the left and right masking thresholds;

means for determining a second combined perceptual entropy associated with the mid and side signals, said second combined perceptual entropy based at least in part on mid and side masking thresholds; and

means for comparing the first and second combined perceptual entropies to determine which is lower.

19. The apparatus of claim 16 further comprising:

means for further modifying at least one of the left or the right masking thresholds, where the left and right input signals are selected;

means for further modifying at least one of a mid or a side masking thresholds, where the mid and side signals are selected; and

means for quantizing the selected signals based at least in part on the corresponding masking thresholds.

20. A computer program product, wherein the computer program product comprises at least one tangible computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion for receiving a left and a right input signal;

a second executable portion for deriving left and right masking thresholds associated with respective left and right input signals;

a third executable portion for determining the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

a fourth executable portion for determining a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

a fifth executable portion for comparing the scale value to a predetermined threshold; and

a sixth executable portion for modifying the masking threshold associated with the input signal comprising the minimum energy, in an instance in which the scale value exceeds the predetermined threshold.

21. The computer program product of claim 20, wherein the sixth executable portion is configured to multiply the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

22. The computer program product of claim 20 further comprising:

a seventh executable portion for determining a mid and a side signal based at least in part on the left and right input signals; and

an eighth executable portion for selecting between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

23. The computer program product of claim 22, wherein the sixth executable portion is configured to modify the left or right masking threshold prior to the eighth executable portion selecting between the left and right input signals and the mid and side signals.

24. The computer program product of claim 22, wherein the eighth executable portion is configured to:

determine a first combined perceptual entropy associated with the left and right input signals, said first combined perceptual entropy based at least in part on the left and right masking thresholds;

determine a second combined perceptual entropy associated with the mid and side signals, said second combined perceptual entropy based at least in part on mid and side masking thresholds; and

compare the first and second combined perceptual entropies to determine which is lower.

25. The computer program product of claim 22 further comprising:

a ninth executable portion for further modifying at least one of the left or the right masking thresholds, where the left and right input signals are selected;

a tenth executable portion for further modifying at least one of a mid or a side masking thresholds, where the mid and side signals are selected; and

an eleventh executable portion for quantizing the selected signals based at least in part on the corresponding masking thresholds.