Method and apparatus for processing interaural time delay in 3D digital audio

• US 7,174,229 B1
• Filed: 11/13/1998
• Issued: 02/06/2007
• Est. Priority Date: 11/13/1998
• Status: Expired due to Fees

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Agere Systems Incorporated (Broadcom, Inc.)
• Inventors: Chen, Jiashu, Wendt, Christopher Anton
• Primary Examiner(s): Chin; Vivian
• Assistant Examiner(s): LAO, LUNSEE
• Application Number:
  US09/190,208
• Time in Patent Office: 3,007 Days
• Field of Search: 381/1, 381/17, 381/310, 381/74, 381/309, 381/12, 381/19, 381/300, 381302-303, 381/307, 381/18, 381/61, 381/63, 700/94, 327/149, 327/153, 327/158, 327/161, 704/216, 704/218
• US Class Current: 700/94
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

A high quality digital 3D sound rendering is implemented using high resolution interaural time delays formed from two delay lines: a first delay line providing a rough estimate of the desired interaural time delay for a particular audio sample, and a second delay line in series with the first delay line providing a more finely resolved fractional delay. In the disclosed embodiment, the first delay module, i.e., the integer delay module, is formed from a first-in, first-out (FIFO) buffer with appropriate selection control of a desired sample as it passes through the FIFO buffer with each clock cycle based on the sampling rate. The second delay module (i.e., the fractional delay module) is formed from a plurality of polyphase (FIR) filters. The number of polyphase filters is determined based on the desired resolution of the interaural time delay.

Claims

1. Apparatus for generating a delayed output digital audio signal from an input digital audio signal, the apparatus comprising:

a first delay module adapted to apply a first amount of delay to the input digital audio signal to generate a partially delayed digital audio signal, wherein the first delay module is adapted to select the first amount of delay from a plurality of available first delay values separated from one another by increments at a first resolution level; and

a second delay module adapted to apply a second amount of delay to the partially delayed digital audio signal to generate the delayed output digital audio signal, wherein the second delay module is adapted to select the second amount of delay from a plurality of available second delay values separated from one another by increments at a second resolution level different from the first resolution level.

2. The invention of claim 1, wherein the total range of the plurality of available second delay values at the second resolution level is substantially equal to each increment at the first resolution level.

3. The invention of claim 1, wherein the first delay module comprises:

a buffer adapted to receive and store a plurality of digital values corresponding to the input digital audio signal such that each position in the buffer corresponds to a different one of the plurality of available first delay values; and

a switch having a plurality of input ports and an output port, wherein;

each input port is connected to receive a different digital value stored in the buffer; and

the switch is adapted to present one of the received digital values at its output port based on a first delay control signal.

4. The invention of claim 3, wherein the buffer is a first-in, first-out (FIFO) buffer adapted to receive a new digital value in the input digital audio signal at each clock cycle of the FIFO buffer.

5. The invention of claim 1, wherein the second delay module comprises:

a plurality of digital filters, configured in parallel, each digital filter adapted to apply a different one of the plurality of available second delay values; and

switch circuitry adapted to select, based on a second delay control signal, one of the digital filters to provide the second amount of delay.

6. The invention of claim 5, wherein the digital filters are all-pass filters having different phase shift values.

7. The invention of claim 5, wherein the switch circuitry comprises an input switch adapted to receive and forward the partially delayed digital audio signal to only the selected digital filter.

8. The invention of claim 7, wherein the switch circuitry further comprises an output multiplexer having a plurality of input ports and an output port, wherein:

each input port is connected to a different digital filter; and

the output multiplexer is adapted to present the output from the selected digital filter at its output port.

9. The invention of claim 1, further comprising a control module adapted to generate first and second delay control signals used by the first and second delay modules to select the first and second amounts of delay.

10. The invention of claim 9, wherein:

the control module comprises a look-up table (LUT) storing data that maps 3D positions to interaural delays; and

the control module is adapted to;

receive a specified 3D position value;

retrieve a corresponding interaural delay value from the LUT based on the specified 3D position value; and

generate the first and second delay control signals on the retrieved interaural delay value.

11. The invention of claim 1, wherein:

the first delay module is a coarse delay module having a coarse resolution level; and

the second delay module is a fine delay module having a fine resolution level that is finer than the coarse resolution level.

12. The invention of claim 11, wherein the first and second amounts of delay are applied to the input digital audio signal to create a relative delay between the delayed output digital audio signal and a second digital audio signal.

13. The invention of claim 12, wherein the delayed output and second digital audio signals are left and right ear signals.

14. The invention of claim 12, wherein the coarse delay module is adapted to generate the second digital audio signal by delaying the input digital audio signal by a coarse delay value.

15. The invention of the claim 14, wherein the coarse delay value used to generate the second digital audio signal is different from the first amount of delay used to generate the partially delayed digital audio signal.

16. The invention of the claim 1, further comprising a control module adapted to generate first and second delay control signals used by the first and second delay modules to select the first and second amounts of delay, wherein:

the first delay module comprises;

a buffer adapted to receive and store a plurality of digital values corresponding to the input digital audio signal such that each position in the buffer corresponds to a different one of the plurality of available first delay values; and

a switch having a plurality of input ports and an output port, wherein;

each input port is connected to receive a different digital value stored in the buffer; and

the switch is adapted to present one of the received digital values at its output port based on the first delay control signal;

the second delay module comprises;

a plurality of digital filters, configured in parallel, each digital filter adapted to apply a different one of the plurality of available second delay values; and

switch circuitry adapted to select, based on the second delay control signal, one of the digital filters to provide the second amount of delay; and

the total range of the plurality of available second delay values at the second resolution level is substantially equal to each increment at the first resolution level.

17. The invention of claim 16, wherein:

the buffer is a FIFO buffer adapted to receive a new digital value in the input digital audio signal at each clock cycle of the FIFO buffer;

the digital filters are all-pass filters having different phase shift values;

the switch circuitry comprises;

an input switch adapted to receive and forward the partially delayed digital audio signal to only the selected digital filter; and

an output multiplexer having a plurality of input ports and an output port, wherein;

each input port is connected to a different digital filter; and

the output multiplexer is adapted to present the output from the selected digital filter at its output port;

the control module comprises a LUT storing data that maps 3D positions to interaural delays; and

the control module is adapted to;

receive a specified 3D position value;

retrieve a corresponding interaural delay value from the LUT based on the specified 3D position value; and

generate the first and second delay control signals on the retrieved interaural delay value.

18. The invention of claim 16, wherein:

the first delay module is a coarse delay module having a coarse resolution level;

the second delay module is a fine delay module having a fine resolution level that is finer than the coarse resolution level;

the first and second amounts of delay are applied to the input digital audio signal to create a relative delay between the delayed output digital audio signal and a second digital audio signal;

the delayed output and second digital audio signals are left and right ear signals;

the coarse delay module is adapted to generate the second digital audio signal by delaying the input digital audio signal by a coarse delay value;

the coarse delay value used to generate the second digital audio signal is different from the first amount of delay used to generate the partially delayed digital audio signal.

19. A method for generating a delayed output digital audio signal from an input digital audio signal, the method comprising:

(a) applying a first amount of delay to the input digital audio signal to generate a partially delayed digital audio signal, wherein the first amount of delay is selected from a plurality of available first delay values separated from one another by increments at a first resolution level; and

(b) applying a second amount of delay to the partially delayed digital audio signal to generate the delayed output digital audio signal, wherein the second amount of delay is selected from a plurality of available second delay values separated from one another by increments at a second resolution level different from the first resolution level.

20. The invention of claim 19, wherein the total range of the plurality of available second delay values at the second resolution level is substantially equal to each increment at the first resolution level.

21. The invention of claim 19, wherein step (a) comprises:

receiving and storing, in a buffer, a plurality of digital values corresponding to the input digital audio signal such that each position in the buffer corresponds to a different one of the plurality of available first delay values; and

selecting, based on a first delay control signal, one of the stored digital values as the partially delayed digital audio signal.

22. The invention of claim 21, wherein the buffer is a FIFO buffer adapted to receive a new digital value in the input digital audio signal at each clock cycle of the FIFO buffer.

23. The invention of claim 19, wherein step (b) comprises:

selecting, based on a second delay control signal, one of a plurality of digital filters, configured in parallel, each digital filter adapted to apply a different one of the plurality of available second delay values; and

delaying the partially delayed digital audio signal using the selected digital filter to provide the second amount of delay.

24. The invention of claim 23, wherein the digital filters are all-pass filters having different phase shift values.

25. The invention of claim 19, further comprising (c) generating first and second delay control signals used in steps (a) and (b) to select the first and second amounts of delay.

26. The invention of claim 25, wherein step (c) comprises:

receiving a specified 3D position value;

retrieving, based on the specified 3D position value, a corresponding interaural delay value from a LUT storing data that maps 3D positions to interaural delays; and

generating the first and second control signals based on the retrieved interaural delay value.

27. The invention of claim 19, wherein the first amount of delay is larger than the second amount of delay.

28. The invention of claim 27, wherein the first and second amounts of delay are applied to the input digital audio signal to create a relative delay between the delayed output digital audio signal and a second digital audio signal.

29. The invention of claim 28, wherein the delayed output and second digital audio signals are left and right ear signals.

30. The invention of claim 28, wherein a coarse delay value is applied to the input digital audio signal to generate the second digital audio signal.

31. The invention of the claim 30, wherein the coarse delay value used to generate the second digital audio signal is different from the first amount of delay used to generate the partially delayed digital audio signal.

32. The invention of claim 19, further comprising (c) generating first and second delay control signals used in steps (a) and (b) to select the first and second amounts of delay, wherein:

step (a) comprises;

receiving and storing, in a buffer, a plurality of digital values corresponding to the input digital audio signal such that each position in the buffer corresponds to a different one of the plurality of available first delay values; and

selecting, based on a first delay control signal, one of the stored digital values as the partially delayed digital audio signal;

step (b) comprises;

selecting, based on a second delay control signal, one of a plurality of digital filters, configured in parallel, each digital filter adapted to apply a different one of the plurality of available second delay values; and

delaying the partially delayed digital audio signal using the selected digital filter to provide the second amount of delay; and

the total range of the plurality of available second delay values at the second resolution level is substantially equal to each increment at the first resolution level.

33. The invention of claim 32, wherein:

the buffer is a FIFO buffer adapted to receive a new digital value in the input digital audio signal at each clock cycle of the FIFO buffer;

the digital filters are all-pass filters having different phase shift values; and

step (c) comprises;

receiving a specified 3D position value;

retrieving, based on the specified 3D position value, a corresponding interaural delay value from a LUT storing data that maps 3D positions to interaural delays; and

generating the first and second control signals based on the retrieved interaural delay value.

34. The invention of claim 32, wherein:

the first amount of delay is larger than the second amount of delay;

the first and second amounts of delay are applied to the input digital audio signal to create a relative delay between the delayed output digital audio signal and a second digital audio signal;

the delayed output and second digital audio signals are left and right ear signals;

a coarse delay value is applied to the input digital audio signal to generate the second digital audio signal;

the coarse delay value used to generate the second digital audio signal is different from the first amount of delay used to generate the partially delayed digital audio signal.

35. An apparatus for generating a delayed output digital audio signal from an input digital audio signal, the apparatus comprising:

(a) means for applying a first amount of delay to the input digital audio signal to generate a partially delayed digital audio signal, wherein the first amount of delay is selected from a plurality of available first delay values separated from one another by increments at a first resolution level; and

(b) means for applying a second amount of delay to the partially delayed digital audio signal to generate the delayed output digital audio signal, wherein the second amount of delay is selected from a plurality of available second delay values separated from one another by increments at a second resolution level different from the first resolution level.