Apparatus and method for controlling a wave field synthesis renderer means with audio objects

• US 8,755,922 B2
• Filed: 02/24/2011
• Issued: 06/17/2014
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Reichelt, Katrin, Gatzsche, Gabriel, Brix, Sandra
• Primary Examiner(s): ELBIN, JESSE A
• Application Number:
  US13/033,649
• Publication Number:
  US 20110144783A1
• Time in Patent Office: 1,209 Days
• Field of Search: 700/94, 381 17- 22, 381/119, 381/310, 369/4, 369/5, 369/87, 369/88
• US Class Current: 700/94
• CPC Class Codes: H04S 2420/13 Application of wave-field synthesis in stereophonic audio systems
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

An apparatus for controlling a wave field synthesis renderer with audio objects includes a provider for providing a scene description, wherein the scene description defines a temporal sequence of audio objects in an audio scene and further includes information on the source position of a virtual source as well as on a start or an end of the virtual source. Furthermore, the audio object includes at least a reference to an audio file associated with the virtual source. The audio objects are processed by a processor, in order to generate a single output data stream for each renderer module, wherein both information on the position of the virtual source and the audio file itself are included in mutual association in this output data stream. With this, high portability on the one hand and high quality due to secure data consistency on the other hand are achieved.

Claims

1. An apparatus for controlling a wave field synthesis renderer with audio objects, so that the wave field synthesis renderer generates, from the audio objects, synthesis signals reproducible by a plurality of loudspeakers attachable in a reproduction room, comprising:

a provider arranged to provide a scene description, the scene description defining a temporal sequence of audio objects in an audio scene, and wherein each audio object of the temporal sequence of audio objects in the audio scene includes information on a source position of a virtual source as well as an audio file for the virtual source or reference information referring to the audio file for the virtual source; and

a processor arranged to process the audio objects, in order to generate a single serial output data stream, which is to be fed to the wave field synthesis renderer, the single serial output data stream comprising both the audio file of the audio object and, in association with the audio file, information on the position of the virtual source of the audio object;

wherein

the processor is arranged to generate the single serial output data stream so that, for each audio object of the temporal sequence of audio objects in the scene, a header, in which the position information for the virtual source for each object is included, is followed by the audio file for the virtual source for each object or follows the audio file for the virtual source for each object, so that the wave field synthesis renderer is capable of determining, based on the temporal position of the header with reference to the audio file, that the audio file is to be rendered with the position information in the header; and

the apparatus for controlling a wave field synthesis renderer comprises a hardware device.

2. The apparatus according to claim 1, wherein the wave field synthesis renderer includes a single renderer module to which all loudspeakers may be coupled, and wherein the processor is arranged to generate a data stream in which the information on the position of a virtual source and the audio file for all data to be processed by the renderer module are included, or

wherein the wave field synthesis renderer includes a plurality of renderer modules, which may be coupled with different loudspeakers, and wherein the processor is arranged to generate, for each renderer module, the single serial output data stream in which information on the position of the virtual sources and audio data only for audio objects to be rendered by the one renderer module for which the single serial output data stream is provided are included.

3. The apparatus according to claim 1, wherein the processor is further arranged to receive information on a starting time instant or an end time instant due to the scene description and to introduce the information on the starting time instant or the end time instant into the single serial output data stream in association with the audio file.

4. The apparatus according to claim 1,

wherein the provider is arranged to provide a scene description with relative time information or position information of an audio object to another audio object or a reference audio object, and

wherein the processor is arranged to compute, from the relative time information or the relative position information, an absolute position of the virtual source in the reproduction room or an actual starting time instant or an actual end time instant and to introduce the absolute position of the virtual source in the reproduction room or the actual starting time instant or the actual end time instant into the single serial output data stream in association with the audio file.

5. The apparatus according to claim 1,

wherein the provider includes a database in which also the audio files for the audio objects are stored, and

wherein the processor is formed as a database output scheduler.

6. A method for controlling a wave field synthesis renderer with audio objects, so that the wave field synthesis renderer generates, from the audio objects, synthesis signals reproducible by a plurality of loudspeakers attachable in a reproduction room, comprising:

providing a scene description, the scene description defining a temporal sequence of audio objects in an audio scene, and wherein each audio object of the temporal sequence of audio objects in the audio source includes information on a source position of a virtual source as well as an audio file for the virtual source or reference information referring to the audio file for the virtual source; and

processing the audio objects, in order to generate a single serial output data stream, which is to be fed to the wave field synthesis renderer, the single serial output data stream comprising both the audio file of the audio object and, in association with the audio file, information on the position of the virtual source of the audio object;

wherein

the processing the audio objects includes generating the single serial output data stream so that, for each audio object of the temporal sequence of audio objects in the audio scene, a header, in which the position information for the virtual source for each object is included, is followed by the audio file for the virtual source for each object or follows the audio file for the virtual source for each object, so that the wave field synthesis renderer is capable of determining, based on the temporal position of the header with reference to the audio file, that the audio file is to be rendered with the position information in the header; and

the method for controlling a wave field synthesis renderer is performed by a hardware device.

7. A non-transitory computer readable medium including a computer program with program code for performing, when the program is executed on a computer, a method for controlling a wave field synthesis renderer with audio objects, so that the wave field synthesis renderer generates, from the audio objects, synthesis signals reproducible by a plurality of loudspeakers attachable in a reproduction room, the method comprising:

providing a scene description, the scene description defining a temporal sequence of audio objects in an audio scene, and wherein each audio object of the temporal sequence of audio objects in the audio source includes information on a source position of a virtual source as well as an audio file for the virtual source or reference information referring to the audio file for the virtual source; and

processing the audio objects, in order to generate a single serial output data stream, which is to be fed to the wave field synthesis renderer, the single serial output data stream comprising both the audio file of the audio object and, in association with the audio file, information on the position of the virtual source of the audio object;

wherein

the processing the audio objects includes generating the single serial output data stream so that, for each audio object of the temporal sequence of audio objects in the audio scene, a header, in which the position information for the virtual source for each object is included, is followed by the audio file for the virtual source for each object or follows the audio file for the virtual source for each object, so that the wave field synthesis renderer is capable of determining, based on the temporal position of the header with reference to the audio file, that the audio file is to be rendered with the position information in the header.