Virtual sound image localizing device, virtual sound image localizing method, and storage medium

• US 20030118192A1
• Filed: 12/02/2002
• Published: 06/26/2003
• Est. Priority Date: 12/25/2000
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sasaki, Toru
• Granted Patent: US 7,336,792 B2
• Time in Patent Office: Days
• US Class Current: 381/17
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/00 Systems employing more than two channels, e.g. quadraphonic H04S5/00, H04S7/00 take precedence
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

An acoustic image localization processing device is provided which can localize the acoustic image of reproduced sound in an arbitrary position according to the circumstances of reproduction. As means for this, an acoustic image localization processing device 1 comprises a decoder 3, which reproduces reproduction acoustic signals and angle selection signals SA from a DVD disc 2; angle selection specification signals SA′ which specify modification of the acoustic image position with respect to an angle selection signal SA; a synthesis circuit 4 which performs processing to modify the acoustic image localization position of reproduced acoustic signals by means of the angle selection signal, modified by the angle selection specification signal SA′; and, speakers 7, 8 which output reproduced sound, with the acoustic image localized in the modified acoustic image localization position. By specifying modification of the angle selection signal SA, an acoustic image is localized in an arbitrary position, and each acoustic image localization position is set appropriately, and sound reproduced, according to the angle mode selected by the listener 9.

Claims

1. An acoustic image localization processing device, comprising:

localization information modification means which applies modifications to acoustic image localization information indicating a predetermined reproduction acoustic image localization position or direction with respect to a sound source signal and provides new acoustic image information; and

,

acoustic image localization processing means, which, based on the acoustic image localization information provided by said localization information modification means with respect to said sound source signal, performs processing to modify the reproduction acoustic image localization position or direction.

2. An acoustic image localization processing device according to claim 1, wherein said localization information modification means modifies the reproduction acoustic image localization position or direction of said sound source viewed by the listener, by modifying the angle at which the listener faces the sound source localized in said reproduction acoustic image localization position or direction, determined in advance.

3. An acoustic image localization processing device according to claim 1, wherein said acoustic image localization processing means is a synthesis circuit which modifies the synthesis ratios or channel allocations of said sound source signals for output to at least two channels.

4. An acoustic image localization processing device according to claim 1, wherein said acoustic image localization processing means performs acoustic image localization processing based on the head-related transfer function from the reproduction acoustic image localization position of said sound source, provided by said localization information modification means, to both ears of the listener.

5. An acoustic image localization processing device according to claim 1, wherein said acoustic image localization processing means comprises:

synthesis means, which modifies the synthesis ratios or channel allocations of said sound source signals for output to at least two channels, and

signal processing means, which performs acoustic image localization processing based on the head-related transfer function from a reproduction acoustic image localization position, newly determined by said synthesis means, to both ears of the listener.

6. An acoustic image localization processing device according to claim 1, further comprising recording means, wherein:

acoustic image localization information modified by said localization information modification means and reproduction time information for which the acoustic image localization information is modified are recorded in association by said recording means; and

,

said sound source signal processing and reproduction are performed based on said acoustic image localization information and said reproduction time information recorded by said recording means.

7. An acoustic image localization processing device according to claim 6, wherein, together with said acoustic image localization information and said reproduction time information, sound source identification information to identify the sound source is also recorded by said recording means.

8. An acoustic image localization processing device according to claim 6, wherein, together with said acoustic image localization information and said reproduction time information, information to identify the recording operation is also recorded by said recording means.

9. An acoustic image localization processing device, comprising:

localization information modification means, which modifies acoustic image localization information supplied accompanying a sound source signal as indicates the reproduction acoustic image localization position or direction of the sound source signal to thereby provide new acoustic image localization information; and

,

acoustic image localization processing means, which performs processing to modify the reproduction acoustic image localization position or direction, based on acoustic image localization information provided by said localization information modification means for said sound source signal.

10. An acoustic image localization processing device according to claim 9, wherein said localization information modification means modifies the reproduction acoustic image localization position or direction of said sound source as seen by the listener, by modifying the angle at which the listener faces the sound source localized at said reproduction acoustic image localization position or direction, determined in advance.

11. An acoustic image localization processing device according to claim 9, wherein said acoustic image localization processing means is a synthesis circuit which modifies the synthesis ratios or channel allocations of said sound source signals for output to at least two channels.

12. An acoustic image localization processing device according to claim 9, wherein said acoustic image localization processing means performs acoustic image localization processing based on the head-related transfer function from a reproduction acoustic image localization position of said sound source, provided by said localization information modification means, to both ears of the listener.

13. An acoustic image localization processing device according to claim 9, wherein said acoustic image localization processing means comprises:

synthesis means, which modifies the synthesis ratios or channel allocations of said sound source signals for output to at least two channels; and

,

signal processing means, which performs acoustic image localization processing based on the head-related transfer function from a reproduction acoustic image localization position newly determined by said synthesis means, to both ears of the listener.

14. An acoustic image localization processing device according to claim 9, further comprising recording means, and wherein

acoustic image localization information modified by said localization information modification means, and reproduction time information for which the acoustic image localization information is modified, are recorded in association by said recording means;

and,

processing and reproduction of said sound source signals are performed based on said acoustic image localization information and said reproduction time information, recorded by said recording means.

15. An acoustic image localization processing device according to claim 14, wherein said recording means records sound source identification information to identify a sound source, together with said acoustic image localization information and said reproduction time information.

16. An acoustic image localization processing device according to claim 14, wherein said recording means records information to identify a recording operation, together with said acoustic image localization information and said reproduction time information.

17. An acoustic image localization processing device, comprising:

image selection means, which selects one among a plurality of image signals to obtain reproduction image output;

localization information modification means, which modifies acoustic image localization information indicating the reproduction acoustic image localization position or direction, determined in advance, for sound source signals provided in association with said image signals, to provide new acoustic image localization information;

control means, to control the selection of image signals by said image selection means and the modification of acoustic image localization information by said localization information modification means; and

,

acoustic image localization processing means, to perform processing to modify the reproduced acoustic image localization position or direction based on acoustic image localization information provided by said localization information modification means for said sound source signals.

18. An acoustic image localization processing method, comprising the steps of

modifying acoustic image localization information indicating the reproduction acoustic image localization position or direction, determined in advance, for sound source signals to thereby provide new acoustic image localization information;

and

applying processing to said sound source signals to modify the reproduction acoustic image localization position or direction based on said provided acoustic image localization information.

19. An acoustic image localization processing method according to claim 18, wherein the step of modifying the acoustic image localization information is to modify the angle at which the listener faces the sound source localized in said reproduction acoustic image localization position or direction to thereby modify the reproduction acoustic image localization position or direction of said sound source as seen by the listener.

20. An acoustic image localization processing method, comprising the steps of

modifying acoustic image localization information supplied accompanying sound source signals which indicates the reproduction acoustic image localization position or direction for sound source signals to thereby provide new acoustic image localization information;

and,

applying processing to said sound source signals to modify the reproduction acoustic image localization position or direction based on said provided acoustic image localization information.

21. An acoustic image localization processing method according to claim 20, wherein the step of modifying the acoustic image localization information is to modify the angle at which the listener faces the sound source localized in said reproduction acoustic image localization position or direction to thereby modify the reproduction acoustic image localization position or direction of said sound source as seen by the listener.

22. Recording media characterized in that acoustic image localization information obtained by modifying a predetermined reproduction acoustic image localization position of sound source signal and reproduction time information obtained by modifying the acoustic image localization information are recorded in association.