Utilization of filtering effects in stereo headphone devices to enhance spatialization of source around a listener

• US 7,539,319 B2
• Filed: 02/28/2007
• Issued: 05/26/2009
• Est. Priority Date: 09/16/1997
• Status: Expired due to Fees

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: McGrath, David Stanley, McKeag, Adam Richard, Reilly, Andrew Peter, Cartwright, Richard James, Dickins, Glen Norman
• Primary Examiner(s): Lee; Ping
• Application Number:
  US11/680,238
• Publication Number:
  US 20070223751A1
• Time in Patent Office: 818 Days
• Field of Search: 381/17, 381/18, 381/61, 381/63, 381/74, 381/309, 381/310
• US Class Current: 381/310
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/004 For headphones
• CPC Class Codes: H04S 7/304 For headphones
• CPC Class Codes: H04S 7/306 For headphones

Abstract

An apparatus for creating, utilizing a pair of oppositely opposed headphone speakers, the sensation of a sound source being spatially distant from the area between the pair of headphones, the apparatus comprising: (a) a series of audio inputs representing audio signals being projected from an idealised sound source located at a spatial location relative to the idealised listener; (b) a first mixing matrix means interconnected to the audio inputs and a series of feedback inputs for outputting a predetermined combination of the audio inputs as intermediate output signals; (c) a filter system of filtering the intermediate output signals and outputting filtered intermediate output signals and the series of feedback inputs, the filter system including separate filters for filtering the direct response and short time response and an approximation to the reverberant response, in addition to the feedback response filtering for producing the feedback inputs; and (d) a second matrix mixing means combining the filtered intermediate output signals to produce left and right channel stereo outputs.

Claims

1. An apparatus including a programmable processor or a semi-custom or full-custom dedicated processor, or one or more programmable logic devices, the apparatus comprising:

(a) a first mixer configured to accept a set of audio inputs and a set of feedback inputs and to form a first predetermined combination of said audio inputs and of said feedback inputs as intermediate output signals, the audio inputs representing audio signals, each audio signal being projected from an idealized sound source located at a respective spatial sound source location relative to a listener location, the set of audio inputs including at least a left audio input and a right audio input;

(b) a filter system configured to filter said intermediate output signals to form filtered intermediate output signals and to filter a second predetermined combination of a plurality of said input signals to produce said feedback inputs, the filter system including one or more filters applied to said intermediate output signal to account for the direct response of a room and one or more filters applied to the second predetermined combination to account for a non-directional approximation to the reverberant response of the room, the filter system including feedback response filtering of said second predetermined combination, such that the filtered intermediate output signals include filtered direct response signals, and filtered reverberant signals that also account for the direct response, wherein said feedback inputs are non-directional; and

(c) a second mixer configured to accept said filtered intermediate output signals and to determine left and right channel stereo outputs for oppositely opposed headphones, the determining being by mixing of said filtered intermediate output signals,

such that a listener at the listener location and listening using the oppositely opposed headphones has the sensation of a sound source being spatially distant from the area between said pair of headphones.

2. An apparatus as recited in claim 1, wherein a predetermined number of the feedback inputs are also input to the second mixer.

3. An apparatus as recited in claim 1, wherein the feedback response filtering includes reverberation filtering.

4. An apparatus as recited in claim 3, wherein the reverberation filtering uses at least a sparse tap FIR filter, or a recursive algorithmic filter, or a full convolution FIR filter.

5. An apparatus as recited in claim 1, wherein the audio inputs include a surround sound set of signals.

6. An apparatus as recited in claim 5, wherein the feedback inputs are mixed with the frontal portions of the audio inputs only.

7. An apparatus as recited in claim 1, wherein the audio inputs includes audio inputs positioned in front of the listener location, and wherein the filter system includes a front sum filter filtering a summation of the audio inputs positioned in front of the listener location and the front sum filter includes substantially an approximation of the sum of a direct and shadowed head related transfer function for the front inputs.

8. An apparatus as recited in claim 1, wherein the audio inputs includes audio inputs positioned in front of the listener location, and wherein the filter system includes a front difference filter filtering a difference of the audio inputs positioned in front of the listener location and the front difference filter includes substantially an approximation of the difference of a direct and shadowed head related transfer function for the front inputs.

9. An apparatus as recited in claim 1, wherein the audio inputs includes audio inputs positioned in rear of the listener location, and wherein the filter system includes a rear sum filter filtering a summation of the audio inputs positioned in rear of the listener location and the rear sum filter includes substantially an approximation of the sum of a direct and shadowed head related transfer function for the rear inputs.

10. An apparatus as recited in claim 1, wherein the audio inputs includes audio inputs positioned in rear of the listener location, and wherein the filter system includes a rear difference filter filtering a difference of the audio inputs positioned in rear of the listener location and the rear difference filter includes substantially an approximation of the difference of a direct and shadowed head related transfer function for the rear inputs.

11. An apparatus as recited in claim 1, wherein the filter system includes a reverberation filter accepting a sum of the audio inputs.

12. An apparatus as recited in claim 1, wherein said apparatus is implemented using a skip protection processor unit located inside a CD-ROM player unit.

13. An apparatus as recited in claim 1, wherein said apparatus is implemented using a dedicated integrated circuit including a modified form of a digital to analog converter.

14. An apparatus as recited in claim 1, wherein said apparatus is implemented using a dedicated or programmable Digital Signal Processor.

15. An apparatus as recited in claim 1, wherein said apparatus operates on analog inputs by means of a DSP processor interconnected between an Analog to Digital Converter and a Digital to Analog Converter.

16. An apparatus as recited in claim 1, wherein said apparatus is implemented using a separately detachable external device connected intermediate of a sound output signal generator and said headphones said sound output signals being output in a digital form for processing by said external device.

17. An apparatus as recited in claim 1, wherein said apparatus is implemented using a separately detachable external device connected intermediate of a sound output signal generator and said headphones, said sound output signals being output in an analog form.

18. An apparatus as recited in claim 1, wherein the filter system uses filter coefficients, the apparatus further comprising:

a variable zoom control adapted to alter said filter coefficients in accordance with a control setting so as to alter a perceived distance of the location of the sound source.

19. An apparatus as recited in claim 1, wherein the approximation to the reverberant response of the room is weighted toward the front of the listener location.

20. A method of operating a signal processing apparatus, the method comprising:

(a) accepting a set of audio inputs representing audio signals, each audio signal being projected from an idealized sound source located at a respective spatial sound source location relative to a listener location, the set of audio inputs including at least a left audio input and a right audio input;

(b) determining by mixing said audio inputs and a set of feedback inputs, the determining by mixing forming a first predetermined combination of said audio inputs and of said feedback inputs as intermediate output signals;

(c) filtering said intermediate output signals to form filtered intermediate output signals, the filtering using one or more filters to account for the direct response of a room;

(d) filtering a second predetermined combination of a plurality of said input signals to produce said feedback inputs to account for a non-directional approximation to the reverberant response of the room, such that the filtered intermediate output signals include filtered direct response signals, and filtered reverberant signals that also account for the direct response, wherein said feedback inputs are non-directional; and

(e) determining left and right channel stereo outputs for oppositely opposed headphones, the determining being by mixing of said filtered intermediate output signals such that a listener at the listener location and listening using the oppositely opposed headphones has the sensation of a sound source being spatially distant from the area between said pair of headphones.

21. A method as recited in claim 20, wherein the determining in (e) includes mixing a predetermined number of the feedback inputs.

22. A method as recited in claim 20, wherein the filtering in (d) includes reverberation filtering.

23. A method as recited in claim 22, wherein the reverberation filtering uses at least a sparse tap FIR filter, or a recursive algorithmic filter, or a full convolution FIR filter.

24. A method as recited in claim 20, wherein the audio inputs include a surround sound set of signals.

25. A method as recited in claim 24, wherein the feedback inputs are mixed with the frontal portions of the audio inputs only.

26. A method as recited in claim 20, wherein the audio inputs includes audio inputs positioned in front of the listener location, and wherein the filter system includes a front sum filter filtering a summation of the audio inputs positioned in front of the listener location and the front sum filter includes substantially an approximation of the sum of a direct and shadowed head related transfer function for the front inputs.

27. A method as recited in claim 20, wherein the audio inputs includes audio inputs positioned in front of the listener location, and wherein the filtering of (c) includes front difference filtering to filter a difference of the audio inputs positioned in front of the listener location and the front difference filter, the front difference filtering using substantially an approximation of the difference of a direct and shadowed head related transfer function for the front inputs.

28. A method as recited in claim 20, wherein the audio inputs includes audio inputs positioned in rear of the listener location, and wherein the filtering of (c) includes rear sum filtering to filter a summation of the audio inputs positioned in rear of the listener location, the rear sum filtering using substantially an approximation of the sum of a direct and shadowed head related transfer function for the rear inputs.

29. A method as recited in claim 20, wherein the audio inputs includes audio inputs positioned in rear of the listener location, and wherein the filtering of (c) includes rear difference filtering to filter a difference of the audio inputs positioned in rear of the listener location, the rear difference filtering using substantially an approximation of the difference of a direct and shadowed head related transfer function for the rear inputs.

30. A method as recited in claim 20, wherein the filtering of (c) (d) includes reverberation filtering of a sum of the audio inputs.

31. A method as recited in claim 20, further comprising using a variable zoom control to alter a perceived distance of the binaural response of the room in which the listener is located.

32. An apparatus comprising:

a programmable processor or a semi-custom or full-custom dedicated processor, or at least one programmable logic device,

wherein the programmable processor, dedicated processor, or at least one programmable logic device is configured to;

(a) accept a set of audio inputs representing audio signals, each audio signal being projected from an idealized sound source located at a respective spatial sound source location relative to a listener location, the set of audio inputs including at least a left audio input and a right audio input;

(b) mix said audio inputs and a set of feedback inputs, the mixing forming a first predetermined combination of said audio inputs and of said feedback inputs as intermediate output signals;

(c) filter said intermediate output signals to form filtered intermediate output signals, the filtering using one or more filters to account for the direct response of a room;

(d) filter a second predetermined combination of a plurality of said input signals to produce said feedback inputs to account for a non-directional approximation to the reverberant response of the room such that the filtered intermediate output signals include filtered direct response signals, and filtered reverberant signals that also account for the direct response, wherein said feedback inputs are non-directional; and

(e) determine left and right channel stereo outputs for oppositely opposed headphones, the determining being by mixing of said filtered intermediate output signals such that a listener at the listener location and listening using the oppositely opposed headphones has the sensation of a sound source being spatially distant from the area between said pair of headphones.

33. An apparatus as recited in claim 32, wherein the second predetermined combination includes a sum of said audio inputs.

34. An apparatus as recited in claim 32, wherein the filtering in (d) includes reverberation filtering.

35. An apparatus as recited in claim 34, wherein the reverberation filtering uses at least a sparse tap FIR filter, or a recursive algorithmic filter, or a full convolution FIR filter.

36. An apparatus as recited in claim 32, wherein the audio inputs include a surround sound set of signals.

37. An apparatus as recited in claim 36, wherein the feedback inputs are mixed with the frontal portions of the audio inputs only.