Method and device for processing binaural audio signal

• US 10,659,904 B2
• Filed: 11/29/2017
• Issued: 05/19/2020
• Est. Priority Date: 09/23/2016
• Status: Active Grant

• Current Assignee: G'Audio Lab, Inc.
• Original Assignee: G'Audio Lab, Inc.
• Inventors: Chon, Sangbae, Lee, Taegyu, Oh, Hyunoh
• Primary Examiner(s): Zhu, Qin
• Application Number:
  US15/826,485
• Publication Number:
  US 20180091919A1
• Time in Patent Office: 902 Days
• Field of Search: None
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 2420/11 Application of ambisonics in stereophonic audio systems
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

An audio signal processing device for processing an audio signal may include a receiving unit configured to receive an audio file including the audio signal, a processor configured to simultaneously render a first audio signal component included in a first track of the audio file and a second audio signal component included in a second track of the audio file, and an output unit configured to output the rendered first audio signal component and the rendered second audio signal component.

Claims

1. An audio signal processing device for rendering an audio signal, comprising:

a receiving unit configured to receive a file comprising the audio signal;

a processor configured to simultaneously render a first audio signal component of the audio signal and a second audio signal component of the audio signal, wherein the first audio signal component is included in a first track of the file and the second audio signal component is included in a second track of the file, wherein a number of channels supported by a format of an audio file used by each of the first track and the second track is fewer than a total number of channels of the first audio signal component and the second audio signal component; and

an output unit configured to output the rendered first audio signal component and the rendered second audio signal component,

wherein the first audio signal component and the second audio signal component comprise at least one of a channel signal, an object signal and an ambisonic signal.

2. The audio signal processing device of claim 1, wherein the first track is a track included in a pre-designated location among a plurality of tracks of the file.

3. The audio signal processing device of claim 2, wherein the first audio signal component is able to be rendered without metadata comprising a location of a sound image simulated by the audio signal.

4. The audio signal processing device of claim 2, wherein the first audio signal component is able to be rendered without metadata for binaural rendering.

5. The audio signal processing device of claim 2,

wherein the first track comprises metadata, and

wherein the processor is configured to determine, on the basis of the metadata, which one or more among a plurality of tracks of the file comprise an audio signal component.

6. The audio signal processing device of claim 4, wherein the processor is configured to render the first audio signal component and the second audio signal component on the basis of the metadata.

7. The audio signal processing device of claim 2, wherein the processor is configured to check whether the plurality of tracks of the file comprise an audio signal component of the audio signal in a pre-designated track order.

8. The audio signal processing device of claim 1, wherein the processor is configured to select the first audio signal component and the second audio signal component among a plurality of audio signal components included in a plurality of tracks of the file according to a capability of the audio signal processing device.

9. An audio signal processing device for processing an audio signal to transfer the audio signal, comprising:

a receiving unit configured to receive the audio signal;

a processor configured to generate a file comprising a first audio signal component of the audio signal in a first track and a second audio signal component of the audio signal in a second track, wherein a number of channels supported by a format of an audio file used by each of the first track and the second track is fewer than a total number of channels of the first audio signal component and the second audio signal component; and

an output unit configured to output the file,

wherein the first audio signal component and the second audio signal component comprise at least one of a channel signal, an object signal and an ambisonic signal.

10. The audio signal processing device of claim 9, wherein the first track is a track included in a pre-designated location among a plurality of tracks of the file.

11. The audio signal processing device of claim 10, wherein the first audio signal component is able to be rendered without metadata including a location of a sound image simulated by the audio signal.

12. The audio signal processing device of claim 10, wherein the first audio signal component is able to be rendered without metadata for binaural rendering.

13. The audio signal processing device of claim 10,

wherein the processor is configured to insert metadata into the first track, and

wherein the metadata indicates one or more tracks comprising an audio signal component of the audio signal among a plurality of tracks of the file.

14. The audio signal processing device of claim 10, wherein the processor is configured to insert a plurality of audio signal components of the audio signal into the plurality of tracks of the file in a pre-designated order.

15. A audio signal processing device, comprising:

one or more processors; and

memory including instructions executable by the one or more processors to cause the device to at least;

receive a file comprising the audio signal, wherein a plurality of audio signal components of the audio signal are divided and inserted into a plurality of tracks included in the audio signal from a transport file, wherein a number of channels supported by a format of an audio file used by each of the plurality of tracks is fewer than a total number of channels of the plurality of audio signal components;

simultaneously render the plurality of audio signal components included in the plurality of tracks of the file; and

output the plurality of audio signal components simultaneously rendered,

wherein the plurality of audio signal components comprise at least one of a channel signal, an object signal and an ambisonic signal.

16. The audio signal processing device of claim 15, wherein metadata is comprised in at least one track included in a pre-designated location among the plurality of tracks, and the one or more processors are configured to simultaneously render the plurality of audio signal components by using the metadata.

17. The audio signal processing device of claim 15, wherein metadata is comprised in at least one track included in a pre-designated location among the plurality of tracks, and the one or more processors are configured to determine whether to render the audio signal by reflecting a location of a sound image simulated by the audio signal by using the metadata.