Multi-channel audio enhancement system for use in recording and playback and methods for providing same

• US 5,912,976 A
• Filed: 11/07/1996
• Issued: 06/15/1999
• Est. Priority Date: 11/07/1996
• Status: Expired due to Term

• Current Assignee: DTS, Inc. (Adeia Inc.)
• Original Assignee: SRS Labs Incorporated (Adeia Inc.)
• Inventors: Kraemer, Alan D., Klayman, Arnold I.
• Primary Examiner(s): Harvey, Minsun Oh
• Application Number:
  US08/743,776
• Time in Patent Office: 950 Days
• Field of Search: 381/1, 381/17, 381/18, 381/19, 381/20, 381/22, 381/23, 381/307, 381/300, 381/27
• US Class Current: 381/18
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

An audio enhancement system and method for use receives a group of multi-channel audio signals and provides a simulated surround sound environment through playback of only two output signals. The multi-channel audio signals comprise a pair of front signals intended for playback from a forward sound stage and a pair of rear signals intended for playback from a rear sound stage. The front and rear signals are modified in pairs by separating an ambient component of each pair of signals from a direct component and processing at least some of the components with a head-related transfer function. Processing of the individual audio signal components is determined by an intended playback position of the corresponding original audio signals. The individual audio signal components are then selectively combined with the original audio signals to form two enhanced output signals for generating a surround sound experience upon playback.

Claims

1. A system for processing at least four discrete audio signals including main left and right signals containing audio information intended for playback from a front sound stage, and surround left and right signals containing audio information intended for playback from a rear sound stage, said system generating a pair of left and right output signals for reproduction from the front sound stage to create the perception of a three dimensional sound image without the need for actual speakers placed in the rear sound stage, said system comprising:

a first electronic audio enhancer receiving said main left and right signals, said first audio enhancer processing an ambient component of said main left and right signals to create the perception of a broadened sound image across the front sound stage when said left and right output signals are reproduced by a pair of speakers positioned within the front sound stage;

a second electronic audio enhancer receiving said surround left and right signals, said second audio enhancer processing an ambient component of said surround left and right signals to create the perception of an acoustic sound image across the rear sound stage when said left and right output signals are reproduced by the pair of speakers positioned within the front sound stage;

a third electronic audio enhancer receiving said surround left and right signals, said third audio enhancer processing a monophonic component of said surround left and right signals to create the perception of an acoustic sound image at a center location of the rear sound stage when said left and right output signals are reproduced by the pair of speakers positioned within the front sound stage; and

a signal mixer for generating said left and right output signals from the at least four discrete audio signals by combining the processed ambient component from the main left and right signals, the processed ambient component for the surround left and right signals, and the processed monophonic component from the surround left and right signals, wherein said ambient components of said main and surround signals are included in the left and right output signals in an out-of-phase relationship with respect to each other.

2. The system of claim 1 wherein said at least four discrete audio signals comprise a center channel signal containing audio information intended for playback by a front sound stage center speaker, and wherein said center channel signal is combined by said signal mixer as part of said left and right output signals.

3. The system of claim 1 wherein said at least four discrete audio signals comprise a center channel signal containing audio information intended for playback by a center speaker located within the front sound stage, and wherein said center channel signal is combined with a monophonic component of the main left and right signals by said signal mixer to generate said left and right output signals.

4. The system of claim 1 wherein said at least four discrete audio signals comprises a center channel signal having center stage audio information which is acoustically reproduced by a dedicated center channel speaker.

5. The system of claim 1 wherein said first, second, and third electronic audio enhancers apply an HRTF-based transfer function to a respective one of said discrete audio signals for creating an apparent sound image corresponding to said discrete audio signals when said left and right output signals are acoustically reproduced.

6. The system of claim 1 wherein said first audio enhancer equalizes said ambient component of said main left and right signals by boosting said ambient component below approximately 1 kHz and above approximately 2 kHz relative to frequencies between approximately 1 and 2 kHz.

7. The system of claim 6 wherein the peak gain applied to boost said ambient component, relative to the gain applied to said ambient component between approximately 1 and 2 kHz, is approximately 8 dB.

8. The system of claim 1 wherein said second and third audio enhancers equalize said ambient and monophonic components of said surround left and right signals by boosting said ambient and monophonic components below approximately 1 kHz and above approximately 2 kHz, relative to frequencies between approximately 1 and 2 kHz.

9. The system of claim 8 wherein the peak gain applied to boost said ambient and monophonic components of said surround left and right signals, relative to the gain applied to said ambient and monophonic components between approximately 1 and 2 kHz, is approximately 18 dB.

10. The system of claim 1 wherein said first, second, and third electronic audio enhancers are formed upon a semiconductor substrate.

11. The system of claim 1 wherein said first, second, and third electronic audio enhancers are implemented in software.

12. A multi-channel recording and playback apparatus receives a plurality of individual audio signals and processes said plurality of audio signals to provide first and second enhanced audio output signals for achieving an immersive sound experience upon playback of said output signals, said multi-channel recording apparatus comprising:

a plurality of parallel audio signal processing devices for modifying the signal content of said individual audio signals wherein each parallel audio signal processing device comprises;

a circuit for receiving two of said individual audio signals and isolating an ambient component of said two audio signals from a monophonic component of said two audio signals;

positional processing means capable of electronically applying a head related transfer function to each of said ambient and monophonic components of said two audio signals to generate processed ambient and monophonic components, said head related transfer functions corresponding to a desired spatial location with respect to a listener; and

a multi-channel circuit mixer for combining said processed monophonic components and ambient components generated by said plurality of positional processing means to generate said enhanced audio output signals wherein said processed ambient components are combined in an out-of-phase relationship with respect to said first and second output signals.

13. The multi-channel recording and playback apparatus of claim 12 wherein each of said plurality of positional processing means further includes a circuit capable of individually modifying said two audio signals and wherein said multi-channel mixer further combines said two modified signals from said plurality of positional processing means with said respective ambient and monophonic components to generate said audio output signals.

14. The multi-channel recording and playback apparatus of claim 13 wherein said circuit capable of individually modifying said two audio signals electronically applies a head related transfer function to said two audio signals.

15. The multi-channel recording and playback apparatus of claim 13 wherein said circuit capable of individually modifying said two audio signals electronically applies a time delay to one of said two audio signals.

16. The multi-channel recording and playback apparatus of claim 12 wherein said two audio signals comprise audio information corresponding to a left front location and a right front location with respect to a listener.

17. The multi-channel recording and playback apparatus of claim 12 wherein said two audio signals comprise audio information corresponding to a left rear location and a right rear location with respect to a listener.

18. The multi-channel recording and playback apparatus of claim 12 wherein said plurality of parallel processing devices comprises first and second processing devices, said first processing device applying a head related transfer function to a first pair of said audio signals for achieving a first perceived direction for said first pair of audio signals when said output signals are reproduced, and said second processing device applying a head related transfer function to a second pair of said audio signals for achieving a second perceived direction for said second pair of audio signals when said output signals are reproduced.

19. The multi-channel recording and playback apparatus of claim 12 wherein said plurality of parallel audio processing devices and said multi-channel circuit mixer are implemented in a digital signal processing device of said multi-channel recording and playback apparatus.

20. An audio enhancement system for processing a plurality of audio source signals to create a pair of stereo output signals for generating a three dimensional sound field when said pair of stereo output signals are reproduced by a pair of loudspeakers, said audio enhancement system comprising:

a first processing circuit in communication with a first pair of said audio source signals, said first processing circuit configured to isolate a first ambient component and a first monophonic component from said first pair of audio signals, said first processing circuit further configured to modify said first ambient component and said first monophonic component to create a first acoustic image such that said first acoustic image is perceived by a listener as emanating from a first location;

a second processing circuit in communication with a second pair of said audio source signals, said second processing circuit configured to isolate a second ambient component and a second monophonic component from said second pair of audio signals, said second processing circuit further configured to modify said second ambient component and said second monophonic component to create a second acoustic image, such that said second acoustic image is perceived by said listener as emanating from a second location; and

a mixing circuit in communication with said first processing circuit and said second processing circuit, said mixing circuit configured to combine said first and second modified monophonic components in phase and combine said first and second modified ambient components out of phase to generate a pair of stereo output signals.

21. The system of claim 20 wherein said first processing circuit is further configured to modify a plurality of frequency components in said first ambient component with a first transfer function.

22. The system of claim 21 wherein said first transfer function is further configured to emphasize a portion of the low frequency components in said first ambient component relative to other frequency components in said first ambient component.

23. The system of claim 21 wherein said first transfer function is configured to emphasize a portion of the high frequency components of said first ambient component relative to other frequency components in said first ambient component.

24. The system of claim 21 wherein said second processing circuit is configured to modify a plurality of frequency components in said second ambient component with a second transfer function.

25. The system of claim 24 wherein said second transfer function is configured to modify said frequency components in said second ambient component in a different manner than said first transfer function modifies said frequency components in said first ambient component.

26. The system of claim 24 wherein said second transfer function is configured to deemphasize a portion of said frequency components above approximately 11.5 kHz relative to other frequency components in said second ambient component.

27. The system of claim 24 wherein said second transfer function is configured to deemphasize a portion of said frequency components between approximately 125 Hz and approximately 2.5 khz relative to other frequency components in said second ambient component.

28. The system of claim 24 wherein said second transfer function is configured to increase a portion of said frequency components between approximately 2.5 khz and approximately 11.5 khz relative to other frequency components in said second ambient component.

29. A multi-track audio processor receiving a plurality of separate audio signals as part of a composite audio source, said plurality of audio signals comprising at least two distinct audio signal pairs containing audio information which is desirably interpreted by a listener as emanating from distinct locations within a sound listening environment, said multi-track audio processor comprising:

first electronic means receiving a first pair of said audio signals, said first electronic means separately applying a head related transfer function to an ambient component of said first pair of audio signals for creating a first acoustic image wherein said first acoustic image is perceived by a listener as emanating from a first location;

second electronic means receiving a second pair of said audio signals, said second electronic means separately applying a head related transfer function to an ambient component and a monophonic component of said second pair of audio signals for creating a second acoustic image wherein said second acoustic image is perceived by the listener as emanating from a second location; and

means for mixing said components of said first and second pair of audio signals received from said first and second electronic means, said means for mixing combining said ambient components out of phase to generate said pair of stereo output signals.

30. An entertainment system having two main audio reproduction channels for reproducing an audio-visual recording to a user wherein said audio-visual recording comprises five discrete audio signals including a front-left signal, F_L, a front-right signal, F_R, a rear-left signal, R_L, a rear-right signal, R_R, and a center signal, C, and wherein said entertainment system achieves a surround sound experience for said user from said two main audio channels, said entertainment system comprising:

an audio-visual playback device for extracting said five discrete audio signals from said audio-visual recording;

an audio processing device for receiving said five discrete audio signals and generating said two main audio reproduction channels, said audio processing device comprising;

a first processor for equalizing an ambient component of said front signals, F_L and F_R, to obtain a spatially-corrected ambient component (F_L -F_R)_P ;

a second processor for equalizing an ambient component of said rear signals, R_L and R_R, to obtain a spatially-corrected ambient component (R_L -R_R)_P ;

a third processor for equalizing a direct-field component of said rear signals, R_L and R_R, to obtain a spatially-corrected direct-field component (R_L +R_R)_P ;

a left mixer for generating a left output signal, said left mixer combining the spatially-corrected ambient component, (F_L -F_R)_P, with said spatially-corrected ambient component, (R_L -R_R)_P, and said spatially-corrected direct-field component, (R_L +R_R)_P, to create said left output signal; and

a right mixer for generating a right output signal, said right mixer combining an inverted spatially-corrected ambient component, (F_R -F_L)_P, with an inverted spatially-corrected ambient component, (R_R -R_L)_P, and said spatially-corrected direct-field component, (R_L +R_R)_P, to create said right output signal; and

means for reproducing said left and right output signals through said two main channels in connection with playback of said audio-visual recording to create a surround sound experience for said user.

31. The entertainment system of claim 30 wherein said center signal is input by said left mixer and combined as part of said left output signal and said center signal is combined by said right mixer and combined as part of said right output signal.

32. The entertainment system of claim 30 wherein said center signal and a direct field component of said front signals, F_L +F_R, are combined by said left and right mixers as part of said left and right output signals, respectively.

33. The entertainment system of claim 30 wherein said center signal is provided as a third output signal for reproduction by a center channel speaker of said entertainment system.

34. The entertainment system of claim 30 wherein said entertainment system is a personal computer and said audio-visual playback device is a digital versatile disk (DVD) player.

35. The entertainment system of claim 30 wherein said entertainment system is a television and said audio-visual playback device is an associated digital versatile disk (DVD) player connected to said television system.

36. The entertainment system of claim 30 wherein said first, second, and third processors emphasize a low and high range of frequencies relative to a mid-range of frequencies.

37. The entertainment system of claim 30 wherein said audio processing device is implemented as an analog circuit formed upon a semiconductor substrate.

38. The entertainment system of claim 30 wherein said audio processing device is implemented in a software format, said software format executed by a microprocessor of said entertainment system.

39. A method of enhancing a group of audio source signals wherein the audio source signals are designated for speakers placed around a listener to create left and right output signals for acoustic reproduction by a pair of speakers in order to simulate a surround sound environment, the audio source signals comprising a left-front signal (L_F), a right-front signal (R_F), a left-rear signal (L_R), and a right-rear signal (R_R), said method of enhancing comprising the following steps:

modifying said audio source signals to create processed audio signals based on the audio content of selected pairs of said source signals, said processed audio signals defined in accordance with the following equations;

space="preserve" listing-type="equation">P.sub.1 =F.sub.1 (L.sub.F -R.sub.F),

space="preserve" listing-type="equation">P.sub.2 =F.sub.2 (L.sub.R -R.sub.R),

and

space="preserve" listing-type="equation">P.sub.3 =F.sub.3 (L.sub.R +R.sub.R),

where F₁, F₂, and F₃ are transfer functions for emphasizing the spatial content of an audio signal to achieve a perception of depth with respect to a listener upon playback of the resultant processed audio signal by a loudspeaker, and

combining said processed audio signals with said audio source signals to create said left and right output signals, said left and right output signals comprising the components recited in the following equations;

space="preserve" listing-type="equation">L.sub.OUT =K.sub.1 L.sub.F +K.sub.2 L.sub.R +K.sub.3 P.sub.1 +K.sub.4 P.sub.2 +K.sub.5 P.sub.3,

space="preserve" listing-type="equation">R.sub.OUT =K.sub.6 R.sub.F +K.sub.7 R.sub.R -K.sub.8 P.sub.1 -K.sub.9 P.sub.2 +K.sub.10 P.sub.3,

where K₁ -K₁₀ are independent variables which determine the gain of the respective audio signal.

40. The method of enhancing a group of audio source signals as recited in claim 39 wherein the transfer functions F1, F2, and F3 apply a level of equalization characterized by amplification of frequencies between approximately 50 and 500 Hz and between approximately 4 and 15 kHz relative to frequencies between approximately 500 Hz and 4 kHz.

41. The method of enhancing a group of audio source signals as recited in claim 39 wherein the left and right output signals further comprise a center channel audio source signal.

42. The method of enhancing a group of audio source signals as recited in claim 39 wherein said method is performed by a digital signal processing device.

43. A method of creating a simulated surround sound experience through reproduction of first and second output signals within an entertainment system having a source of at least four audio signals wherein said at least four audio source signals comprise a pair of front audio signals representing audio information emanating from a forward sound stage with respect to a listener, and a pair of rear audio signals representing audio information emanating from a rear sound stage with respect to the listener, said method comprising the following steps:

combining said front audio signals to create a front ambient component signal and a front direct component signal,

combining said rear audio signals to create a rear ambient component signal and a rear direct component signal,

processing the front ambient component signal with a first HRTF-based transfer function to create a perceived source of direction of said front ambient component about a forward left and right aspect with respect to the listener,

processing the rear ambient component signal with a second HRTF-based transfer function to create a perceived source of direction of said rear ambient component about a rear left and right aspect with respect to the listener,

processing the rear direct component signal with a third HRTF-based transfer function to create a perceived source of direction of said rear direct component at a rear center aspect with respect to the listener, and

combining a first one of said front audio signals, a first one of said rear audio signals, said processed front ambient component, said processed rear ambient component, and said processed rear direct component to create said first output signal,

combining a second one of said front audio signals, a second one of said rear audio signals, said processed front ambient component, said processed rear ambient component, and said processed rear direct component to create said second output signal, and

reproducing said first and second output signals, respectively, through a pair of speakers situated in said forward sound stage with respect to the listener.

44. The method of claim 43 wherein said first, second, and third HRTF-based transfer functions equalize a respective inputted through amplification of signal frequencies between approximately 50 and 500 Hz and between approximately 4 and 15 kHz relative to frequencies between approximately 500 Hz and 4 kHz.

45. The method of claim 43 wherein the entertainment system is a personal computer system and said at least four audio source signals are generated by a digital video disk player attached to said computer system.

46. The method of claim 43 wherein the entertainment system is a television and said at least four audio source signals are generated by an associated digital video disk player connected to said television system.

47. The method of claim 43 wherein said at least four audio signals comprise a center channel audio signal, said center channel signal electronically added to said first and second output signals.

48. The method of claim 43 wherein said steps of processing with said first, second, and third HRTF-based transfer functions is performed by a digital signal processor.