Multi-way analysis for audio processing

• US 9,055,381 B2
• Filed: 10/12/2010
• Issued: 06/09/2015
• Est. Priority Date: 10/12/2009
• Status: Active Grant

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Virolainen, Jussi Kalevi, Shenoy, Ravi, Lorho, Gaetan, Kirkeby, Ole, Patwardhan, Pushkar Prasad
• Primary Examiner(s): GAY, SONIA L
• Application Number:
  US13/500,625
• Publication Number:
  US 20120207310A1
• Time in Patent Office: 1,701 Days
• Field of Search: 381/17
• US Class Current: 1/1
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 5/005 of the pseudo five- or more-channel type, e.g. virtual surround

Abstract

It is disclosed to determine, for a direction being at least associated with a value of a first direction component and with a value of a second direction component, at least one weighting factor for each basis function of a set of basis functions, each of the basis functions being associated with an audio transfer characteristic, wherein said determining is at least based on a first set of gain factors, associated with the first direction component, and on a second set of gain factors, associated with the second direction component

Claims

1. A method comprising:

determining, for a direction being at least associated with a value of a first direction component and with a value of a second direction component, at least one weighting factor for each basis function of a set of basis functions, each of the basis functions being associated with an audio transfer characteristic, wherein said determining comprises multiplying one of a first set of gain factors, associated with the first direction component, with one of a second set of gain factors, associated with the second direction component; and

using the determined at least one weighting factor for each basis function to construct a filter at least based on decomposing a given multi-dimensional transfer function database, arranged in a multi-way array having at least three dimensions, into the set of first gain factors being associated with the first direction component, the set of second gain factors being associated with the second direction component and a set of basis functions.

2. The method according to claim 1, wherein the first direction component represents an azimuth dimension and the second direction component represents an elevation dimension.

3. The method according to claim 1, wherein the first set of gain factors comprises a plurality of first subsets of gain factors, each subset of the plurality of first subsets of gain factors being associated with one basis function of the set of basis functions, and wherein the second set of gain factors comprises a plurality of second subsets of gain factors, each subset of the plurality of second subsets of gain factors being associated with one basis function of the set of basis functions.

4. The method according to claim 1, wherein the set of basis functions, the first set of gain factors and the second set of gain factors are associated with head related transfer functions.

5. The method according to claim 1, wherein determining the at least one weighting factor for each basis function comprises for a respective basis function:

determining a first weighting factor being associated with the value of the first direction component of the direction based on the set of first gain values for the respective basis function, and determining a second weighting factor being associated with the value of the second direction component of the direction based on the set of second gain values for the respective basis function.

6. The method according to claim 5, wherein determining the first weighting factor is based on one out of:

selecting a gain value of the first set of gain values being associated with the value of the first direction component for the respective basis function;

determining an interpolated gain value based on the first set of gain values being associated with the value of the first direction component for the respective basis function;

determining an extrapolated gain value based on the first set of gain values being associated with the value of the first direction component for the respective basis function;

and wherein determining the second weighting factor is based on one out of;

selecting a gain value of the second set of gain values being associated with the value of the second direction component for the respective basis function;

determining an interpolated gain value based on the second set of gain values being associated with the value of the second direction component for the respective basis function; and

determining an extrapolated gain value based on the second set of gain values being associated with the value of the second direction component for the respective basis function.

7. The method according to claim 1, wherein said determining at least one weighting factor for the respective basis function is further based on at least one further set of gain factors.

8. The method according to claim 1, wherein the set of basis functions is associated with audio transfer characteristics.

9. The method according to claim 8, wherein the first set of gain factors comprises a plurality of first subsets of gain factors, each subset of the plurality of first subsets of gain factors being associated with one basis function of the set of basis functions, and wherein the second set of gain factors comprises a plurality of second subsets of gain factors, each subset of the plurality of second subsets of gain factors being associated with one basis function of the set of basis functions.

10. The method according to claims 8, wherein a first dimension of the array is associated with the first direction component, a second dimension of the array is associated with the second direction component, and the third dimension is associated with a transfer function representative.

11. The method according to claim 8, wherein the decomposing is one out of:

a Parallel Factor (PARAFAC) decomposition; and

a Tucker decomposition.

12. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

determine, for a direction being at least associated with a value of a first direction component

and with a value of a second direction component, at least one weighting factor for each basis function of a set of basis functions, each of the basis functions being associated with an audio transfer characteristic, wherein said determining comprises multiplying one of a first set of gain factors, associated with the first direction component, with one of a second set of gain factors, associated with the second direction component; and

use the determined at least one weighting factor for each basis function to construct a filter at

least based on decomposing a given multi-dimensional transfer function database, arranged in a multi-way array having at least three dimensions, into the set of first gain factors being associated with the first direction component, the set of second gain factors being associated with the second direction component and a set of basis functions.

13. The apparatus according to claim 12, wherein the at least one memory and the computer program code, with the at least one processor, are configured to cause the apparatus to perform, for each input signal of at least one input signal, said determination the at least one weighting factor for each basis function of a set of basis functions for each direction of at least one direction associated with the respective input signal.

14. The apparatus according to claim 13, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to perform, for each input signal of the at least one input signal:

filter the respective input signal, for each direction associated with the respective input signal, with a filter function based on the set of basis functions and on the determined at least one weighting factors associated with each of the basis functions for the respective direction of the respective input signal.

15. The apparatus according to claim 13, wherein the apparatus is one of:

a chip;

an integrated circuit; and

an audio device.

16. The apparatus of claim 13, wherein

the set of basis functions is associated with audio transfer characteristics.

17. The apparatus according to claim 16, wherein a first dimension of the array is associated with the first direction component, a second dimension of the array is associated with the second direction component, and the third dimension is associated with a transfer function representative.

18. The apparatus according to claim 16, wherein the apparatus is one of:

a chip;

an integrated circuit; and

an audio device.

19. A computer program code stored in a non-transitory computer readable storage medium, causing an apparatus to perform the following when executed on a processor:

determine, for a direction being at least associated with a value of a first direction component and with a value of a second direction component, at least one weighting factor for each basis function of a set of basis functions, each of the basis functions being associated with an audio transfer characteristic, wherein said determination comprises multiplying one of a first set of gain factors, associated with the first direction component, and one of a second set of gain factors, associated with the second direction component; and

use the determined at least one weighting factor for each basis function to construct a filter at least based on decomposing a given multi-dimensional transfer function database, arranged in a multi-way array having at least three dimensions, into the set of first gain factors being associated with the first direction component, the set of second gain factors being associated with the second direction component and a set of basis functions.

20. The computer program code of claim 19, wherein

the set of basis functions is associated with audio transfer characteristics.