Apparatus and method of encoding audio data and apparatus and method of decoding encoded audio data

• US 20060235678A1
• Filed: 04/14/2006
• Published: 10/19/2006
• Est. Priority Date: 04/14/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Donyung, Kim, Miyoung, Lee, Shihwa, Kim, Junghoe, Kim, Sangwook
• Granted Patent: US 7,813,932 B2
• Time in Patent Office: Days
• US Class Current: 704/200.100
• CPC Class Codes: G10L 19/0017 Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error G10L19/24 takes precedence
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 21/038 using band spreading techniques

Abstract

An apparatus and method encode audio data, and an apparatus and method decode encoded audio data. An audio data encoding apparatus includes: a scalable encoding unit dividing audio data into a plurality of layers, representing the audio data in predetermined numbers of bits in each of the plurality of layers, and encoding a lower layer prior to encoding an upper layer and an upper bit of each layer prior to encoding a lower bit of each layer; an SBR encoding unit generating spectral band replication (SBR) data that has information with respect to audio data in a frequency band of frequencies equal to or greater than a predetermined frequency among the audio data to be encoded, and encoding the SBR data; and a bitstream production unit generating a bitstream using the encoded SBR data and the encoded audio data corresponding to a predetermined bitrate.

Claims

1. An audio data encoding apparatus comprising:

a scalable encoding unit dividing audio data into a plurality of layers, representing the audio data in predetermined numbers of bits in each of the plurality of layers, and encoding a lower layer prior to encoding an upper layer and an upper bit of each layer prior to encoding a lower bit of each layer;

an SBR encoding unit generating spectral band replication (SBR) data that has information with respect to audio data in a frequency band of frequencies equal to or greater than a predetermined frequency among the audio data to be encoded, and encoding the SBR data; and

a bitstream production unit generating a bitstream using the encoded SBR data and the encoded audio data corresponding to a predetermined bitrate.

2. The audio data encoding apparatus of claim 1, wherein the predetermined frequency is the maximum frequency of a lowest layer of the plurality of layers of the audio data.

3. The audio data encoding apparatus of claim 1, wherein the SBR encoding unit generates the SBR data using information with respect to an envelope of the audio data having a frequency band of frequencies equal to or greater than a predetermined frequency and performs lossless encoding on the generated SBR data.

4. The audio data encoding apparatus of claim 3, wherein the lossless encoding is entropy encoding or Huffman encoding.

5. The audio data encoding apparatus of claim 1, wherein the scalable encoding unit down samples the audio data and divides the down-sampled audio data to generate the plurality of layers.

6. The audio data encoding apparatus of claim 1, wherein the predetermined bitrate is equal to or greater than a bitrate of a lowest layer of the plurality of layers.

7. The audio data encoding apparatus of claim 1, wherein the SBR encoding unit further comprises a first starting code encoding unit which encodes a first starting code that indicates the start of the SBR data.

8. The audio data encoding apparatus of claim 7, wherein the first starting code comprises:

a zero code expressed in 32 bits of 0; and

an extension code expressed in 4 bits of 1 and 4 bits of 0.

9. The audio data encoding apparatus of claim 1, wherein the SBR encoding unit further comprises a second starting code encoding unit which encodes a second starting code that indicates a start of the SBR data and error-detection data that is used to detect an error from the SBR data.

10. The audio data encoding apparatus of claim 9, wherein the second starting code comprises:

a zero code expressed in 32 bits of 0; and

an extension code expressed in 4 bits of 1, a series of 3 bits of 0, and 1.

11. The audio data encoding apparatus of claim 1, wherein:

the audio data is for each of first through M-th, where M denotes an integer equal to or greater than 3, channels; and

the scalable encoding unit comprises;

a mono/stereo encoding unit encoding the audio data of one of the first and second channels; and

a multi-channel extended data encoding unit encoding the audio data of one of the third through M-th channels.

12. The audio data encoding apparatus of claim 11, wherein the multi-channel extended data encoding unit further comprises a third starting code encoding unit which encoding a third starting code that indicates the start of the audio data of the third through M-th channels.

13. The audio data encoding apparatus of claim 12, wherein the third starting code comprises:

a zero code expressed in 32 bits of 0; and

an extension code expressed in 8 bits of 1.

14. An audio data decoding apparatus comprising:

a bitstream analysis unit extracting encoded SBR data and encoded audio data corresponding to at least one layer, the at least one layer being expressed in predetermined numbers of bits, from a bitstream;

a scalable decoding unit decoding the encoded audio data by decoding a lower layer prior to decoding an upper layer and an upper bit of each layer prior to decoding a lower bit of each layer;

a SBR decoding unit decoding the encoded SBR data, and inferring audio data in a frequency band between a first frequency and a second frequency based on the decoded audio data and the decoded SBR data; and

a data synthesis unit generating synthetic data by using the decoded audio data and the inferred audio data and outputting the synthetic data as the audio data in a frequency band between 0 and the second frequency,

wherein the second frequency is equal to or greater than a maximum frequency of the at least one layer, and the SBR data comprises information with respect to the audio data in a frequency band between the first and the second frequencies.

15. The audio data decoding apparatus of claim 14, wherein the synthetic data in the frequency band where the decoded audio data exists is the decoded audio data, and the synthetic data in the frequency band where the decoded audio data does not exist is the inferred audio data.

16. The audio data decoding apparatus of claim 14, wherein:

the information with respect to the audio data includes information with respect to an envelope of the audio data;

the SBR decoding unit comprises;

a lossless decoding unit performing lossless decoding on the encoded SBR data and obtaining the information with respect to the envelope;

a high frequency generation unit causing the decoded audio data to be generated in a frequency band of frequencies equal to or greater than a maximum frequency of the decoded audio data; and

an envelope adjustment unit adjusting the envelope of the generated audio data based on the obtained information; and

the data synthesis unit outputs the decoded audio data as the synthetic data for the frequency band where the decoded audio data exists, and outputs the envelope-adjusted audio data as the synthetic data for a frequency band where only the envelope-adjusted audio data exists.

17. The audio data decoding apparatus of claim 16, wherein the lossless decoding is entropy decoding or Huffman decoding.

18. The audio data decoding apparatus of claim 14, wherein the decoding of the encoded audio data is executed at or below a predetermined bitrate, and the predetermined bitrate is equal to or greater than a bitrate of a lowest layer of the at least one layer.

19. The audio data decoding apparatus of claim 14, wherein the first frequency is a maximum frequency of a lowest layer of the at least one layer.

20. The audio data decoding apparatus of claim 14, wherein:

the bitstream analysis unit determines if an encoded first starting code exists in the bitstream;

the audio data decoding apparatus further comprises a first starting code decoding unit to decode the encoded first starting code;

if the encoded first starting code exists in the bitstream, the bitstream analysis unit extracts the encoded first starting code from the bitstream, and the SBR decoding unit operates in response to a determination by the bitstream analysis unit that the encoded first starting code exists; and

the first starting code indicates the start of the SBR data.

21. The audio data decoding apparatus of claim 20, wherein the first starting code comprises:

a zero code expressed in 32 bits of 0; and

an extension code expressed in 4 bits of 1 and 4 bits of 0.

22. The audio data decoding apparatus of claim 14, wherein:

the bitstream analysis unit determines if an encoded second starting code exists in the bitstream;

the audio data decoding apparatus further comprises a second starting code decoding unit to decode the encoded second starting code;

if the encoded second starting code exists in the bitstream, the bitstream analysis unit extracts the encoded second starting code from the bitstream, and the SBR decoding unit operates in response to a determination by the bitstream analysis unit that the encoded second starting code exists; and

the second starting code indicates the SRB data and the start of error-detection data which is used in detecting an error from the SBR data.

23. The audio data decoding apparatus of claim 22, wherein the second starting code comprises:

a zero code expressed in 32 bits of 0; and

an extension code expressed in 4 bits of 1, a series of 3 bits of 0, and 1.

24. The audio data decoding apparatus of claim 14, wherein:

the encoded audio data is for each of first through M-th (where M denotes an integer equal to or greater than

     3) channels; and

the scalable decoding unit comprises;

a mono/stereo decoding unit decoding the encoded audio data of one of the first and second channels; and

a multi-channel extended data decoding unit decoding the encoded audio data of one of the third through M-th channels.

25. The audio data decoding apparatus of claim 24, wherein:

the bitstream analysis unit determines if an encoded third starting code exists in the bitstream;

the scalable decoding unit further comprises a third starting code decoding unit to decode the encoded third starting code;

if the encoded third starting code exists in the bitstream, the bitstream analysis unit extracts the encoded third starting code from the bitstream, and the multi-channel extended data decoding unit operates in response to a determination by the bitstream analysis unit that the encoded third starting code exists; and

the third starting code indicates the start of the audio data of the third through M-th channels.

26. The audio data decoding apparatus of claim 25, wherein the third starting code comprises:

a zero code expressed in 32 bits of 0; and

an extension code expressed in 8 bits of 1.

27. An audio data encoding method comprising:

dividing audio data into a plurality of layers, representing the layers of the audio data in predetermined numbers of bits, and encoding lower layers prior to encoding the upper layers and upper bits of each layer prior to encoding lower bits of each layer;

generating SBR (spectral band replication) data that has information about audio data in a frequency band of frequencies equal to or greater than a predetermined frequency among the audio data to be encoded, and encoding the SBR data; and

generating a bitstream using the encoded SBR data and the encoded audio data corresponding to a predetermined bitrate.

28. The audio data encoding method of claim 27, wherein the predetermined frequency is a maximum frequency of a lowest layer of the plurality of layers of the audio data.

29. The audio data encoding method of claim 27, wherein dividing audio data into a plurality of layers comprises generating the SBR data using information with respect to an envelope of the audio data having a frequency band of frequencies equal to or greater than a predetermined frequency and performing lossless encoding on the generated SBR data.

30. The audio data encoding method of claim 29, wherein the lossless encoding is entropy encoding or Huffman encoding.

31. The audio data encoding method of claim 27, wherein dividing audio data into a plurality of layers comprises down-sampling the audio data and dividing the down-sampled audio data to generate the plurality of layers.

32. The audio data encoding method of claim 27, wherein the predetermined bitrate is equal to or greater than the bitrate of a lowest layer of the plurality of layers.

33. The audio data encoding method of claim 27, wherein:

the audio data is for each of first through M-th, where M denotes an integer equal to or greater than 3, channels; and

dividing audio data into a plurality of layers comprises;

encoding the audio data of one of the first and second channels; and

encoding the audio data of one of the third through M-th channels.

34. An audio data decoding method comprising:

extracting encoded SBR data and encoded audio data corresponding to at least one layer, the layer being expressed in predetermined numbers of bits, from a bitstream;

decoding the encoded audio data by decoding a lower layer prior to decoding an upper layer and an upper bit of each layer prior to decoding a lower bit of each layer;

decoding the encoded SBR data, and inferring audio data in a frequency band between a first frequency and a second frequency based on the decoded audio data and the decoded SBR data; and

generating synthetic data by using the decoded audio data and the inferred audio data and determining the synthetic data to be the audio data in the frequency band between 0 and the second frequency,

wherein the second frequency is equal to or greater than a maximum frequency of the plurality of layers, and the SBR data comprises information with respect to the audio data in the frequency band between the first and the second frequencies.

35. The audio data decoding method of claim 34, wherein the synthetic data in the frequency band where the decoded audio data exists is the decoded audio data, and the synthetic data in the frequency band where the decoded audio data does not exist is the inferred audio data.

36. The audio data decoding method of claim 34, wherein:

the information with respect to the audio data includes information with respect to an envelope of the audio data;

decoding the encoded SBR data comprises;

performing, by a lossless decoding unit, lossless decoding on the encoded SBR data and obtaining the information with respect to the envelope;

causing, by a high frequency generation unit, the decoded audio data to be generated in a frequency band of frequencies equal to or greater than a maximum frequency of the decoded audio data; and

adjusting, by an envelope adjustment unit, the envelope of the generated audio data based on the obtained information; and

generating synthetic data comprises determining the decoded audio data to be the synthetic data for the frequency band where the decoded audio data exists, and determining the envelope-adjusted audio data to be the synthetic data for the frequency band where only the envelope-adjusted audio data exists.

37. The audio data decoding method of claim 36, wherein the lossless decoding is entropy decoding or Huffman decoding.

38. The audio data decoding method of claim 34, wherein the decoding of the encoded audio data is executed at or below a predetermined bitrate, and the predetermined bitrate is equal to or greater than a bitrate of a lowest layer.

39. The audio data decoding method of claim 34, wherein the first frequency is a maximum frequency of a lowest layer.

40. The audio data decoding method of claim 34, wherein:

the encoded audio data is for each of first through M-th, where M denotes an integer equal to or greater than 3, channels; and

decoding the encoded audio data comprises;

decoding the encoded audio data of one of the first and second channels; and

decoding the encoded audio data of one of the third through M-th channels.

41. A computer-readable storage medium having a computer program stored thereon, wherein executing the computer program implements an audio data encoding method, the method comprising:

dividing audio data into a plurality of layers, representing the layers of the audio data in predetermined numbers of bits, and encoding lower layers prior to encoding upper layers and upper bits of each layer prior to encoding lower bits of each layer;

(b) generating spectral band replication (SBR) data that has information with respect to audio data in a frequency band of frequencies equal to or greater than a predetermined frequency among the audio data to be encoded, and encoding the SBR data; and

(c) generating a bitstream using the encoded SBR data and the encoded audio data corresponding to a predetermined bitrate.

42. A computer-readable storage medium having a computer program stored thereon, wherein executing the computer program implements an audio data decoding method, the method comprising:

extracting encoded SBR data and encoded audio data corresponding to at least one layer, the layer being expressed in predetermined numbers of bits, from a bitstream;

decoding the encoded audio data by decoding a lower layer prior to decoding an upper layer and an upper bit of each layer prior to decoding a lower bit of each layer;

decoding the encoded SBR data, and inferring audio data in a frequency band between a first frequency and a second frequency based on the decoded audio data and the decoded SBR data; and

generating synthetic data by using the decoded audio data and the inferred audio data and determining the synthetic data to be the audio data in the frequency band between 0 and the second frequency,

wherein the second predetermined frequency is equal to or greater than a maximum frequency of the at least one layer, and the SBR data comprises information with respect to the audio data in a frequency band between the first and the second frequencies.