Spatial object oriented audio apparatus

• US 9,706,324 B2
• Filed: 05/17/2013
• Issued: 07/11/2017
• Est. Priority Date: 05/17/2013
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Makinen, Toni, Vilermo, Miikka Tapani, Vasilache, Adriana, Laaksonen, Lasse Juhani, Jarvinen, Roope Olavi
• Primary Examiner(s): Kim, Paul S
• Assistant Examiner(s): Yu, Norman
• Application Number:
  US14/890,449
• Publication Number:
  US 20160119733A1
• Time in Patent Office: 1,516 Days
• Field of Search: 381 22- 23, 381 17, 381303, 381307, 381 18, 381 1, 381103, 381119, 381 56, 381 98
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 25/03 characterised by the type of extracted parameters
• CPC Class Codes: G10L 25/21 the extracted parameters being power information
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 2400/03 Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 H04S2400/01 takes precedence
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 5/00 Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation

Abstract

An apparatus comprising: a perception sorter configured to perceptually order at least two object orientated audio signal channels; and a selective channel processor configured to process at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels.

Claims

1. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to at least:

determine a perception value for each of at least two object orientated signal channels, wherein for each of the at least two object orientated signal channels the apparatus is caused to determine a perception value of an object orientated signal channel of the at least two object orientated signal channels based at least in part on an angular distance for the object orientated signal channel to a defined position,

perceptually order the at least two object orientated audio signal channels based on the perception value for each of the at least two object orientated audio signal channels; and

process at least one of the at least two object orientated audio signal channels based at least in part on the order of the at least two object orientated audio signal channels.

2. The apparatus as claimed in claim 1, wherein the defined position is a nearest speaker position of a set of speaker positions.

3. The apparatus as claimed in claim 2, wherein the set of speaker positions in polar co-ordinates are L=[L_r, L_θ

, L_φ

]=[1, −

30, 0], R=[R_r, R_θ

, R_φ

]=[1, 30, 0], C=[C_r, C_θ

, C_φ

]=[1, 0, 0], Ls=[Ls_r, Ls_θ

, Ls_φ

]=[1, −

110, 0], and Rs=[Rs_r, Rs_θ

, Rs_φ

]=[1, 110, 0].

4. The apparatus as claimed in claim 1, wherein the apparatus caused to process the at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels is further caused to:

select a first set of the at least two object orientated audio signal channels, the first set of the at least two object orientated audio signal channels being the lowest of the perceptually ordered channels;

downmix the first set of the at least two object orientated audio signal channels to a downmixed channel representation; and

output the downmixed channel representation with the remainder of the at least two object orientated audio signal channels.

5. The apparatus as claimed in claim 1, wherein the apparatus caused to process the at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels is further caused to:

select for parts of the at least two object orientated audio signal channels a highest perceptually ordered channel part;

combine the selected highest perceptually ordered part to generate a first audio signal;

attenuate the at least two object orientated audio signal channels highest perceptually ordered channel part;

combine the attenuated at least two object orientated audio signal channels highest perceptually ordered channel part to the remainder at least two object orientated audio signal channel parts to generate a second audio signal; and

output the first audio signal and the second audio signal.

6. The apparatus as claimed in claim 5, wherein the parts are frequency sub-bands and/or bands of time periods of the at least two object orientated audio signal channels.

7. A method comprising:

determining a perception value for each of at least two object orientated signal channels by determining, for each of the at least two object orientated signal channels, a perception value of an object orientated signal channel of the at least two object orientated signal channels based at least in part on an angular distance for the object orientated signal channel to a defined position;

perceptually ordering the at least two object orientated audio signal channels based on the perception value for each of the at least two object orientated audio signal channels; and

processing at least one of the at least two object orientated audio signal channels based at least in part on the order of the at least two object orientated audio signal channels.

8. The method as claimed in claim 7, wherein the defined position is a nearest speaker position of a set of speaker positions.

9. The method as claimed in claim 8, wherein the set of speaker positions in polar co-ordinates are L=[L_r, L_θ

, L_φ

]=[1, −

30, 0], R=[R_r, R_θ

, R_φ

]=[1, 30, 0], C=[C_r, C_θ

, C_φ

]=[1, 0, 0], Ls=[Ls_r, Ls_θ

, Ls_φ

]=[1, −

110, 0], and Rs=[Rs_r, Rs_θ

, Rs_φ

]=[1, 110, 0].

10. The method as claimed in claim 7, wherein processing the at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels comprises:

selecting a first set of the at least two object orientated audio signal channels, the first set of the at least two object orientated audio signal channels being the lower perceptually ordered channels;

downmixing the first set of the at least two object orientated audio signal channels to a downmixed channel representation; and

outputting the downmixed channel representation with the remainder of the at least two object orientated audio signal channels.

11. The method as claimed in claim 7, wherein processing the at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels comprises:

selecting for parts of the at least two object orientated audio signal channels a highest perceptually ordered channel part;

combining the selected highest perceptually ordered part to generate a first audio signal;

attenuating the at least two object orientated audio signal channels highest perceptually ordered channel part;

combining the attenuated at least two object orientated audio signal channels highest perceptually ordered channel part to the remainder at least two object orientated audio signal channel parts to generate a second audio signal; and

outputting the first audio signal and the second audio signal.

12. The method as claimed in claim 11 wherein the parts are frequency sub-bands and/or bands of time periods of the at least two object orientated audio signal channels.

13. A computer program product comprising a non-transitory computer-readable medium bearing computer program code embodied therein, the computer program code configured to cause an apparatus at least to perform:

determining a perception value for each of at least two object orientated signal channels by determining, for each of the at least two object orientated signal channels, a perception value of an object orientated signal channel of the at least two object orientated signal channels based at least in part on an angular distance for the object orientated signal channel to a defined position;

perceptually ordering the at least two object orientated audio signal channels based on the perception value for each of the at least two object orientated audio signal channels; and

processing at least one of the at least two object orientated audio signal channels based at least in part on the order of the at least two object orientated audio signal channels.

14. The computer program product as claimed in claim 13, wherein the defined position is a nearest speaker position of a set of speaker positions.

15. The computer program product as claimed in claim 14, wherein the set of speaker positions in polar co-ordinates are L=[L_r, L_θ

, L_φ

]=[1, −

30, 0], R=[R_r, R_θ

, R_φ

]=[1, 30, 0], C=[C_r, C_θ

, C_φ

]=[1, 0, 0], Ls=[Ls_r, Ls_θ

, Ls_φ

]=[1, −

110, 0], and Rs=[Rs_r, Rs_θ

, Rs_φ

]=[1, 110, 0].

16. The computer program product as claimed in claim 13, wherein the computer program code configured to cause the apparatus at least to perform processing the at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels further causes the apparatus to perform:

selecting a first set of the at least two object orientated audio signal channels, the first set of the at least two object orientated audio signal channels being the lower perceptually ordered channels;

downmixing the first set of the at least two object orientated audio signal channels to a downmixed channel representation; and

outputting the downmixed channel representation with the remainder of the at least two object orientated audio signal channels.

17. The computer program product as claimed in claim 13, wherein the computer program code configured to cause an apparatus at least to perform processing the at least one of the at least two object orientated audio signal channels based on the order of the at least two object orientated audio signal channels further causes the apparatus to perform:

selecting for parts of the at least two object orientated audio signal channels a highest perceptually ordered channel part;

combining the selected highest perceptually ordered part to generate a first audio signal;

attenuating the at least two object orientated audio signal channels highest perceptually ordered channel part;

combining the attenuated at least two object orientated audio signal channels highest perceptually ordered channel part to the remainder at least two object orientated audio signal channel parts to generate a second audio signal; and

outputting the first audio signal and the second audio signal.

18. The computer program product as claimed in claim 17 wherein the parts are frequency sub-bands and/or bands of time periods of the at least two object orientated audio signal channels.