Virtual sound source localization apparatus

• US 8,494,189 B2
• Filed: 11/14/2008
• Issued: 07/23/2013
• Est. Priority Date: 11/14/2007
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Katayama, Masaki
• Primary Examiner(s): Clark, S. V.
• Assistant Examiner(s): Miyoshi, Jesse Y
• Application Number:
  US12/271,289
• Publication Number:
  US 20090123007A1
• Time in Patent Office: 1,712 Days
• Field of Search: 381/1, 381/17, 381/303, 381/306
• US Class Current: 381/303
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

In a virtual sound source localization apparatus, a distance between two loudspeakers and a shortest distance between a line connecting the loudspeakers and a listening position are set beforehand, and a listener operates an operating section to localize a Cch sound source at an approximately center of the loudspeakers, thereby adjusting a sound balance of the loudspeakers. In addition, a controller calculates a difference in distance from the loudspeakers to the listening position, sets a delay amount of delay correctors such that sound emitted from the loudspeakers substantially reaches the listening position simultaneously, and adjusts sound output timing of the loudspeakers. In this way, even though the listening position is changed, the listener can operate the operating section to optimize a virtual surround effect.

Claims

1. A virtual sound source localization apparatus that receives input multi-channel audio signals of video/sound contents and supplies output multi-channel audio signals to two loudspeakers for emitting sound of the video/sound contents, wherein the two loudspeakers are arranged at front-left and front-right positions, respectively, with respect to a default listening position, to thereby localize virtual sound sources around a listener at the default listening position, the apparatus comprising:

a virtual localization imparting unit that calculates transfer characteristics of sound that reaches ears of the listener at the default listening position from a virtually localized position around the default listening position on the basis of predetermined head related transfer functions, and imparts the transfer characteristics to audio signals of one or more channels which are to be localized as the virtual sound source among the input multi-channel audio signals, wherein the virtual localization imparting unit outputs transfer characterized audio signals;

a crosstalk cancellation unit that performs crosstalk cancellation on the transfer characterized audio signals to cancel crosstalk to the listener at the default listening position, wherein the crosstalk cancellation unit outputs crosstalk cancelled audio signals;

a balance adjusting unit that performs balance adjustment;

a first delay unit that performs delay processing; and

a controller that receives an operation from an operating unit to localize a sound image, which is desired to be localized at an approximate center of the two loudspeakers at a new listening position different from the default listening position, wherein;

the controller calculates signal levels for the output multi-channel audio signals to be supplied to the two loudspeakers, respectively, in accordance with the operation received by the operating unit to set sound of the sound image emitted from the two loudspeakers to be at the same volume level at the new listening position,

the controller calculates a difference in distance from the two loudspeakers to the new listening position by using the calculated signal levels for the output multi-channel audio signals, and calculates a delay amount by which at least a timing to supply the crosstalk cancelled audio signals to the two loudspeakers on the basis of the difference in distance is delayed in order to change a timing at which sounds emitted from the two loudspeakers reach the new listening position, to the same as a timing at which sounds emitted from the two loudspeakers reach the default listening position,

the controller causes the balance adjusting unit to perform balance adjustment on the input multi-channel audio signals in accordance with the calculated signal levels for the output multi-channel audio signals, and causes the first delay unit to perform delay processing at least on the crosstalk cancelled audio signals by the calculated delay amount, and

the virtual sound source localization apparatus outputs the output multi-channel audio signals including processing results of the balance adjusting unit and the first delay unit.

2. The apparatus according to claim 1, further comprising:

an adding unit that, for each of the multi-channel audio signals, adds the crosstalk cancelled audio signals and non-crosstalk cancelled audio signals which are not subjected to the crosstalk cancellation, wherein the adding unit outputs an added audio signal, and

wherein the first delay unit delays the added audio signal.

3. The apparatus according to claim 1, further comprising:

an adding unit that is provided between the first delay unit and the balance adjusting unit, and adds, for each of the multi-channel audio signals, the crosstalk cancelled audio signals and non-crosstalk cancelled audio signals which are not subjected to the crosstalk cancellation, wherein the adding unit outputs an added audio signal, and

wherein the balance adjusting unit performs the balance adjustment on the added audio signal.

4. The apparatus according to claim 3,

wherein the non-crosstalk cancellation audio signals which are not subjected to the crosstalk cancellation contain a front-channel audio signal, and

the apparatus further includes:

a second delay unit that is controlled by the controller and delays a sound output timing to supply the front-channel audio signals to the two loudspeakers on the basis of the difference in distance calculated by the controller in order to cause sound based on the front-channel audio signals to be emitted from the virtually localized two loudspeakers.

5. The apparatus according to claim 1, further comprising:

an input unit that, as data to be used to calculate the difference in distance from the two loudspeakers to the new listening position, receives an input of information regarding a distance between the two loudspeakers and a shortest distance between a line connecting the two loudspeakers and the listening position; and

a storage unit that stores the information received by the input unit,

wherein the controller calculates the difference in distance by using the information read out from the storage unit and a difference in output level between the two loudspeakers after the balance adjustment performed by the balance adjusting unit.

6. The apparatus according to claim 1,

further comprising:

a monitor for displaying video of the video/sound contents, disposed between the two loudspeakers;

a size storage unit that stores a size of the monitor, a distance between the two loudspeakers set according to the size, and a shortest distance between a line connecting the two loudspeakers and the listening position; and

a size input unit that receives an input of the size of the monitor,

wherein the controller reads out information regarding the distance between the two loudspeakers according to the size of the monitor received by the size input unit and the shortest distance between the line connecting the two loudspeakers and the listening position from the size storage unit, and calculates the difference in distance from the two loudspeakers to the listening position by using the information regarding the distance between the two loudspeakers and a difference in output level between the two loudspeakers after the balance adjustment performed by the balance adjusting unit.

7. The apparatus according to claim 1,

wherein the controller converts a signal level difference between the two loudspeakers after the balance adjustment by the balance adjusting unit into the difference in distance from the two loudspeakers to the listening position.