Encoder, decoder and methods for encoding and decoding data segments representing a time-domain data stream

• US 8,818,796 B2
• Filed: 12/07/2007
• Issued: 08/26/2014
• Est. Priority Date: 12/12/2006
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Geiger, Ralf, Neuendorf, Max, Yokotani, Yoshikazu, Rettelbach, Nikolaus, Herre, Juergen, Geyersberger, Stefan
• Primary Examiner(s): YEN, ERIC L
• Application Number:
  US12/518,627
• Publication Number:
  US 20100138218A1
• Time in Patent Office: 2,454 Days
• Field of Search: 704/205, 704/211, 704/228
• US Class Current: 704/205
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/032 Quantisation or dequantisation of spectral components
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 19/265 Pre-filtering, e.g. high frequency emphasis prior to encoding
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002

Abstract

An apparatus for decoding data segments representing a time-domain data stream, a data segment being encoded in the time domain or in the frequency domain, a data segment being encoded in the frequency domain having successive blocks of data representing successive and overlapping blocks of time-domain data samples. The apparatus includes a time-domain decoder for decoding a data segment being encoded in the time domain and a processor for processing the data segment being encoded in the frequency domain and output data of the time-domain decoder to obtain overlapping time-domain data blocks. The apparatus further includes an overlap/add-combiner for combining the overlapping time-domain data blocks to obtain a decoded data segment of the time-domain data stream.

Claims

1. An apparatus for decoding data segments representing a time-domain data stream, wherein one or more data segments are encoded in the time domain, and wherein two or more data segments are encoded in the frequency domain, wherein the data segments which are encoded in the frequency domain represent time-domain data samples of overlapping data blocks, the apparatus comprising:

a time-domain decoder adapted to decode a data segment which is encoded in the time domain to acquire output data of the time-domain decoder;

a processor adapted to process the data segments which are encoded in the frequency domain and the output data of the time-domain decoder to acquire time-domain data blocks, such that time-domain data blocks obtained based on consecutive data segments which consecutive data segments are encoded in the frequency domain, overlap, and such that consecutive time-domain data blocks of which one was encoded in the frequency domain and of which one was encoded in the time domain, overlap; and

an overlap/add-combiner adapted to combine the overlapping time-domain data blocks to acquire decoded data segments of the time-domain data stream;

wherein the overlap/add-combiner is adapted to apply weights according to synthesis windowing functions to overlapping time-domain data blocks,

wherein the synthesis windowing functions are adapted to a size of an overlapping region of consecutive overlapping time-domain data blocks,

wherein, when switching from frequency-domain coding to time domain coding, a window with a reduced overlapping size is applied to a time-domain data block which was encoded in the frequency domain;

wherein a size of an overlapping region of two consecutive time-domain data blocks which were encoded in the frequency-domain is larger than a size of an overlapping region of two consecutive time-domain data blocks of which one was encoded in the frequency-domain and one was encoded in the time domain.

2. The apparatus of claim 1, wherein the processor comprises a frequency-domain decoder adapted to decode data segments which are encoded in the frequency domain to acquire frequency-domain data segments.

3. The apparatus of claim 1, wherein the processor is adapted to process a data segment which is encoded in the time domain and in the frequency domain in parallel.

4. The apparatus of claim 2, wherein the processor comprises a time-domain to frequency-domain converter adapted to convert the output data of the time-domain decoder to acquire converted frequency-domain data segments.

5. The apparatus of claim 4, wherein the processor comprises a frequency-domain combiner adapted to combine the frequency-domain data segments and the converted frequency-domain data segments to acquire a frequency-domain data stream.

6. The apparatus of claim 5, wherein the processor comprises a frequency-domain to time-domain converter adapted to convert the frequency-domain data stream to overlapping time-domain data blocks.

7. The apparatus of claim 2, wherein the frequency domain decoder further comprises a re-quantization stage.

8. The apparatus of claim 4, wherein the time-domain to frequency-domain converter comprises a cosine modulated filterbank, an extended lapped transform, a low-delay filterbank, a polyphase filterbank or a modified discrete cosine transform.

9. The apparatus of claim 5, wherein the frequency-domain combiner comprises an adder.

10. The apparatus of claim 6, wherein the frequency-domain to time-domain converter comprises a cosine modulated filterbank or an inverse modified discrete cosine transform.

11. The apparatus of claim 1, wherein the time-domain decoder is adapted to use a prediction filter to decode a data segment encoded in the time domain.

12. The apparatus of claim 1, wherein the processor comprises a calculator adapted to calculate overlapping time-domain data blocks based on the output data of the time-domain decoder.

13. The apparatus of claim 12, wherein the calculator is adapted to reproduce an overlapping property of the frequency-domain to time-domain converter based on the output data of the time-domain decoder.

14. The apparatus of claim 13, wherein the calculator is adapted to reproduce a time-domain aliasing characteristic of the frequency-domain to time-domain converter based on the output data of the time-domain decoder.

15. The apparatus of claim 6, wherein the frequency-domain to time-domain converter is adapted to convert the frequency-domain data segments provided by the frequency-domain decoder to overlapping time-domain data blocks.

16. The apparatus of claim 15, wherein the overlap/add-combiner is adapted to combine the overlapping time-domain data blocks provided by the frequency-domain to time-domain converter and the processor to acquire decoded data segments of the time-domain data stream.

17. The apparatus of claim 8, wherein the calculator comprises a time-domain aliasing stage adapted to time-alias output data of the time-domain decoder to acquire the overlapping time-domain data blocks.

18. The apparatus of claim 12, wherein the calculator is adapted

to segment the output of the time-domain decoder in calculator segments comprising 2N sequential samples,

apply weights to the 2N samples according to an analysis window function,

subtract the first N/2 samples in reversed order from the second N/2 samples,

add the last N/2 samples in reversed order to third N/2 samples,

invert the second and third N/2 samples

replace the first N/2 samples with the time-reversed and inverted version of the second N/2 samples,

replace the fourth N/2 samples with the time-reversed version of the third N/2 samples, and

apply weights to the 2N samples according to a synthesis windowing function.

19. The apparatus of claim 6, wherein the overlap/add-combiner is adapted to apply weights according to a synthesis windowing function to overlapping time-domain data blocks provided by the frequency-domain to time-domain converter.

20. The apparatus of claim 18, wherein the processor is adapted to apply weights to the 2N samples according to an analysis windowing function which is adapted to a size of an overlapping region of consecutive overlapping time-domain data blocks and wherein the processor is adapted to apply weights to the 2N samples according to a synthesis windowing function which is adapted to the size of the overlapping region.

21. The apparatus of claim 1, wherein the overlapping of data blocks is determined according to the AAC-specifications.

22. The apparatus of claim 1, further comprising a bypass for the processor and the overlap/add-combiner, wherein the bypass is adapted to bypass the processor and the overlap/add-combiner when non-overlapping consecutive time-domain data blocks occur in data segments which are encoded in the time domain.

23. A method for decoding data segments representing a time-domain data stream, one or more data segments being encoded in the time domain, two or more data segments being encoded in the frequency domain, wherein the data segments which are encoded in the frequency domain represent time-domain data samples of overlapping data blocks, comprising:

decoding a data segment which is encoded in the time domain to acquire output data of the time-domain decoder;

processing the data segments which are encoded in the frequency domain and the output data of the time-domain decoder to acquire time-domain data blocks, such that time-domain data blocks obtained based on consecutive data segments which consecutive data segments are encoded in the frequency domain, overlap, and such that consecutive time-domain data blocks of which one was encoded in the frequency domain and of which one was encoded in the time domain, overlap; and

combining the overlapping time-domain data blocks to acquire decoded data segments of the time-domain data stream,

wherein weights according to synthesis window functions are applied to the overlapping time-domain data blocks;

wherein the synthesis windowing functions are adapted to a size of an overlapping region of consecutive overlapping time-domain data blocks,

wherein, when switching from frequency-domain coding to time domain coding, a window with a reduced overlapping size is applied to a time-domain data block which was encoded in the frequency domain;

wherein a size of an overlapping region of two consecutive time-domain data blocks which were encoded in the frequency-domain is larger than a size of an overlapping region of two consecutive time-domain data blocks of which one was encoded in the frequency-domain and one was encoded in the time domain,

wherein the method is performed using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

24. A non-transitory computer readable medium comprising a computer program

adapted to perform the method according to claim 23 when the program code runs on a computer.