Device and Method for Generating and Processing Sound Effects in Spatial Sound-Reproduction Systems by Means of a Graphic User Interface

• US 20080101616A1
• Filed: 11/02/2007
• Published: 05/01/2008
• Est. Priority Date: 05/04/2005
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Langhammer, Jan, Melchior, Frank
• Granted Patent: US 8,325,933 B2
• Time in Patent Office: Days
• US Class Current: 381/17
• CPC Class Codes: H04S 2420/13 Application of wave-field synthesis in stereophonic audio systems
• CPC Class Codes: H04S 7/305 Electronic adaptation of stereophonic audio signals to reverberation of the listening space H04S7/301 takes precedence
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

The present invention is based on the finding that a sound-reproduction system, which can generate a spatial sound impression in a reproduction environment, can be efficiently and intuitively controlled by means of a graphic user interface when an impulse response associated with a spatial direction with respect to the reproduction environment is graphically represented, and when the possibility is created for a user to change the impulse response graphically so that, based on the user input of a change, the changed impulse response can be graphically represented and the changed graphical representation can be detected, in order to control the sound-reproduction system. Since it is system-theoretically possible to describe all known linear signal processing operations by impulse responses, it is possible, with the inventive graphic user interface, to provide a sound mixer, through a graphical representation, with an intuitive access to sound effects depending on the direction.

Claims

1. A graphic user interface for a sound-reproduction system, which is formed so as to generate in a reproduction environment a spatial sound impression, comprising:

a display for graphically displaying an impulse response, which is associated with a spatial direction of the reproduction environment, the impulse response, relative to the reproduction environment, being represented in the spatial direction it is allocated to;

an input device for allowing changing the graphical display of the impulse response by the user, a change of the graphical display of the impulse response being enabled at predetermined points;

a receiver for receiving a user input of a change, in order to graphically represent a changed impulse response by the display; and

a detector for detecting the changed impulse response.

2. The graphic user interface according to claim 1, wherein the display is formed so as to represent the impulse response as a time-dependent evolution of an intensity value.

3. The graphic user interface according to claim 2, wherein the display is formed so as to represent the time-dependent evolution of the impulse response such that same is divided into discrete time periods, an intensity value being associated with each time period.

4. The graphic user interface according to claim 1, wherein the display is formed so as to represent the impulse response as a function of the frequency.

5. The graphic user interface according to claim 4, wherein the display is formed so as to represent the frequency evolution of the impulse response such that same is divided into discrete frequency segments, an intensity value being associated with each frequency segment.

6. The graphic user interface according to claim 1, wherein the display is formed so as to graphically represent the impulse response as a function of the time and as a function of the frequency in a three-dimensional representation, the function values being represented as a height over a two-dimensional surface, one side of which comprises the time as a measure and a second side of which following the first side comprises the frequency as a measure.

7. The graphic user interface according to claim 1, wherein the display is formed so as to display in addition a graphical representation of the reproduction environment in a three-dimensional representation, the impulse responses regarding the reproduction environment being represented in the spatial directions, which the impulse responses are associated with.

8. The graphic user interface according to claim 1, wherein the input device for allowing changing the graphical display of the impulse response is formed so as to allow changing the graphical representation of the impulse response at any arbitrary point of the graphical representation of the impulse response.

9. The graphic user interface according to claim 1, wherein the input device for allowing changing the graphical display of the impulse response is formed so as to allow shifting the impulse response in the time as a change of the graphical display of the impulse response.

10. The graphic user interface according to claim 1, wherein the receiver for receiving a user input of a change is formed so as to receive signals of a computer mouse, a touch pad, a touch screen, a track ball or a keyboard.

11. The graphic user interface according to claim 1, wherein the detector for detecting the changed impulse response is formed so as to scan, for detecting, the changed impulse response graphically represented and to store the scanned values in a memory.

12. The graphic user interface according to claim 1, wherein the display is formed so as to graphically display an impulse response, which includes information about a space to be simulated.

13. The graphic user interface according to claim 1, wherein the display is formed so as to graphically display an impulse response, which includes information about the position of a sound source with respect to the reproduction environment.

14. A controlling apparatus for a sound-reproduction system, which is formed so as to generate a spatial sound impression in a reproduction environment, comprising:

a graphic user interface for a sound-reproduction system, which is formed so as to generate in a reproduction environment a spatial sound impression, comprising;

a display for graphically displaying an impulse response, which is associated with a spatial direction of the reproduction environment, the impulse response, relative to the reproduction environment, being represented in the spatial direction it is allocated to;

an input device for allowing changing the graphical display of the impulse response by the user, a change of the graphical display of the impulse response being enabled at predetermined points;

a receiver for receiving a user input of a change, in order to graphically represent a changed impulse response by the display; and

a detector for detecting the changed impulse response; and

a signal generator for providing loudspeaker signals for loudspeakers of a plurality of loudspeakers that can be placed at different spatial positions.

15. The controlling apparatus according to claim 14, wherein the signal generator comprises a combiner for combining at least one sound signal with the changed impulse response, the sound signal being intended for a loudspeaker arranged at a spatial position corresponding to the spatial direction, which the impulse response is associated with, in order to achieve a loudspeaker signal, the combiner being formed so as to combine such that the loudspeaker signal includes the information about the space to be simulated.

16. The controlling apparatus according to claim 15, wherein the signal generator comprises a combiner for combining at least one sound signal with the changed impulse response, in order to achieve a loudspeaker signal, the combiner being formed so as to combine such that the loudspeaker signal includes the information about the relative position of a sound source associated with the sound signal.

17. The controlling apparatus according to claim 15, wherein the combiner is formed so as to alias, during the combination, the sound signal with the changed impulse response.

18. A method for using a sound-reproduction system, which is formed so as to generate a spatial sound impression in a reproduction environment, comprising:

graphically displaying an impulse response associated with a spatial direction of the reproduction environment, the impulse response, relative to the reproduction environment, being represented in the spatial direction it is allocated to;

allowing changing the graphical display of the impulse response by the user, a change of the graphical display of the impulse response being enabled at predetermined points;

receiving a user input of a change, in order to represent a changed impulse response; and

detecting the changed impulse response.

19. A method for controlling a sound-reproduction system, comprising the method for using a sound-reproduction system, which is formed so as to generate a spatial sound impression in a reproduction environment, comprising:

graphically displaying an impulse response associated with a spatial direction of the reproduction environment, the impulse response, relative to the reproduction environment, being represented in the spatial direction it is allocated to;

allowing changing the graphical display of the impulse response by the user, a change of the graphical display of the impulse response being enabled at predetermined points;

receiving a user input of a change, in order to represent a changed impulse response; and

detecting the changed impulse response; and

additionally comprising;

providing loudspeaker signals for a plurality of loudspeakers, which can be placed at different spatial positions based on the changed impulse response.

20. A computer program with a program code for performing, when the computer program is executed on a computer, the method for using a sound-reproduction system, which is formed so as to generate a spatial sound impression in a reproduction environment, the method comprising:

graphically displaying an impulse response associated with a spatial direction of the reproduction environment, the impulse response, relative to the reproduction environment, being represented in the spatial direction it is allocated to;

allowing changing the graphical display of the impulse response by the user, a change of the graphical display of the impulse response being enabled at predetermined points;

receiving a user input of a change, in order to represent a changed impulse response; and

detecting the changed impulse response.