Method, medium, and apparatus encoding/decoding audio data with extension data

• US 8,055,500 B2
• Filed: 10/12/2006
• Issued: 11/08/2011
• Est. Priority Date: 10/12/2005
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Junghoe, Oh, Eunmi
• Primary Examiner(s): Smits; Talivaldis Ivars
• Assistant Examiner(s): ROBERTS, SHAUN A
• Application Number:
  US11/546,433
• Publication Number:
  US 20070083363A1
• Time in Patent Office: 1,853 Days
• Field of Search: 704/500, 704/501, 704/219, 704/201, 704/200.1
• US Class Current: 704/229
• CPC Class Codes: G10L 19/0017 Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error G10L19/24 takes precedence
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 21/038 using band spreading techniques

Abstract

A method, medium, and apparatus encoding/decoding audio data in which audio data is hierarchically encoded, and at least one extension data of the audio data is encoded using at least one encoding method, and decoding is performed in the same manner, thereby ensuring fine grain scalability (FGS) and unlimited extendibility of the audio data.

Claims

1. An audio encoding method, comprising:

encoding audio data using at least one encoding method;

selecting an extension type code indicating a type of extension data to be added to the encoded audio data, the extension type code being selected from plural extension type codes identifying defined types of extension data, including a type of data for extending a select channel, from plural available channels, of the audio data, a type of data for extending a bandwidth of the audio data, and a type of data for the extending of the select channel of the audio data and for an extending of a bandwidth of the extended channel, different from the extending of the bandwidth of the audio data; and

encoding the extension type code indicating the type of the extension data and the extension data corresponding to the extension type code, in addition to the encoded audio data, for the encoded audio data using at least one encoding method.

2. The encoding method of claim 1,

wherein, in the encoding of the audio data, the audio data is hierarchically encoded using a first encoding method, and in the encoding of the extension data, the extension data is encoded using at least one encoding method, including the first encoding method.

3. The encoding method of claim 1, wherein the encoding of the extension data comprises encoding data for extending the select channel of the audio data to generate the select channel of the audio data and an additional channel of the audio data when the audio data is decoded.

4. The encoding method of claim 1, wherein the encoding of the extension data comprises at least encoding data for extending the bandwidth of the audio data.

5. The encoding method of claim 1, wherein additional extension data for the audio data is encoded and includes at least one selected from data for checking for transmission errors, metadata of the audio data, and a fill element of the audio data.

6. The encoding method of claim 1, further comprising:

generating a start code indicating a start of an encoded portion of the extension data.

7. The encoding method of claim 6, further comprising:

inserting an end code indicating an end of an encoded portion of the audio data, immediately after the encoded portion of the audio data, wherein the generating of the start code further comprises inserting the start code after the inserted end code, and the generating of the extension type code further comprises inserting the extension type code after the inserted start code.

8. The encoding method of claim 6, wherein the start code is a 4-bit code with four consecutive identical bits, and the extension type code is a different 4-bit code.

9. The encoding method of claim 1, wherein the encoding of the extension data comprises at least one of hierarchically encoding data for extending the select channel of the audio data and encoding data for extending the bandwidth of the audio data.

10. The encoding method of claim 1, wherein the extension type code is selected from respective extension type codes identifying defined types of the type of data for extending the select channel of the audio data, the type of data for extending the bandwidth of the audio data, the type of data for the extending of the select channel of the audio data and for the extending of the bandwidth, and a type of data for extending the bandwidth of the audio data and for checking for transmission errors.

11. The encoding method of claim 10, wherein the extension type code is selected from respective extension type codes identifying defined types of the type of data for extending the select channel of the audio data, the type of data for extending the bandwidth of the audio data, the type of data for the extending of the select channel of the audio data and for the extending of the bandwidth, the type of data for extending the bandwidth of the audio data and for checking for transmission errors, and a type of data for the extending of the select channel of the audio data, for the extending of the bandwidth, and for checking for transmission errors.

12. The encoding method of claim 1, wherein, when the selected extension type code is the type of data for the extending of the select channel of the audio data and for the extending of the bandwidth, the selected extension type code indicates the subsequent presence of channel extension data of the audio data and data of a bandwidth extension particular to the extended channel.

13. The encoding method of claim 1, wherein, when plural extension data for the encoded audio data are encoded, the encoding method further comprises repeatedly encoding an extension type code, of the plural extension type codes, with each extension data, before an encoding of a next extension type code, of the plural extension type codes, and corresponding extension data.

14. The encoding method of claim 1, further comprising:

inserting another extension type code indicating a type of a different extension data after an encoded portion of the extension data; and

encoding the extension data, wherein the adding of the other extension type code and the encoding of the least one extension data are repeatedly performed for plural extension data with respective extension type codes until all extension data are encoded.

15. At least one computer readable medium comprising computer readable code to control at least one processing device to implement the method of claim 1.

16. An audio encoding method, comprising:

encoding multi-channel audio data using at least one encoding method; and

encoding a extension type code indicating a type of extension data and the extension data corresponding to the extension type code, in addition to the encoded audio data, for the encoded audio data using at least one encoding method,

wherein the encoding of the extension data comprises hierarchically encoding channel extension data for extending a select channel, from plural available channels, of the audio data and bandwidth extension data for extending a bandwidth of the extended channel of the audio data, different from an extending of the bandwidth of the audio data without channel extension.

17. An encoding method, comprising:

encoding audio data using at least one encoding method;

selecting a type code indicating a type of extension data to be added to the encoded audio data, the type code being selected from respective codes identifying defined types of a type of data for extending a channel of the audio data, a type of data for extending a bandwidth of the audio data, and a type of data for the extending of the channel of the audio data and for the extending of the bandwidth;

encoding the type code indicating the type of the extension data and the extension data corresponding to the type code, in addition to the encoded audio data, for the encoded audio data using at least one encoding method;

inserting another code indicating a type of a different extension data after an encoded portion of the extension data; and

encoding the extension data, wherein the adding of the other code and the encoding of the least one extension data are repeatedly performed until all extension data are encoded.

18. An audio encoding apparatus, comprising:

a first encoding unit to encode audio data using at least one encoding method;

a extension type code generating unit to select an extension type code indicating a type of extension data to be added to the encoded audio data, the extension type code being selected from respective extension type codes identifying defined types of extension data, including a type of data for extending a select channel, of plural available channels, of the audio data, a type of data for extending a bandwidth of the audio data, and a type of data for the extending of the select channel of the audio data and for extending a bandwidth corresponding to the extended channel; and

a second encoding unit to encode the selected extension type code indicating the type of at the least one extension data and the extension data corresponding to the extension type code, in addition to the encoded audio data, for the encoded audio data using at least one encoding method,

wherein, when the selected extension type code represents a type of extension data including the type of data extending of the select channel of the audio data and the extending of the bandwidth corresponding to the extended channel, data for respective bandwidth extensions for each of one or more select channels are separately encoded with respective channel extension data for each extended channel.

19. An audio decoding method, comprising:

decoding encoded audio data in an encoded data bitstream using at least one decoding method;

detecting an extension type code in the bitstream indicating a type of extension data for the encoded audio data, the extension type code being detected as being from respective extension type codes identifying defined types of extension data, including a type of data for extending a select channel, of plural available channels, of the audio data, a type of data for extending a bandwidth of the audio data, and a type of data for the extending of the select channel of the audio data and for extending a bandwidth corresponding to the extended channel; and

decoding the extension data corresponding to the detected extension type code, in addition to the encoded audio data, for the encoded audio data using at least one decoding method,

wherein, when the detected extension type code represents a type of extension data including the type of data extending of the select channel of the audio data and the extending of the bandwidth corresponding to the extended channel, data for respective bandwidth extensions for each of one or more select channels are separately decoded with respective channel extension data for each extended channel.

20. The decoding method of claim 19, wherein, in the decoding of the audio data, the audio data is hierarchically decoded using a first decoding method, and in the decoding of the extension data, the extension data is decoded using at least one decoding method, including the first decoding method.

21. The decoding method of claim 19, wherein the decoding of the extension data comprises decoding data for extending a channel.

22. The decoding method of claim 19, wherein the decoding of the extension data comprises decoding data for extending a bandwidth of the audio data.

23. The decoding method of claim 19, wherein the decoding of the extension data comprises decoding data for extending a bandwidth of the audio data and decoding data for checking for transmission errors.

24. The decoding method of claim 19, wherein additional extension data for the audio data is decoded and includes data for checking for transmission errors of the audio data, metadata of the audio data, and a fill element of the audio data.

25. The decoding method of claim 19, further comprising:

detecting a start code indicating a start of an encoded portion of the extension data.

26. The decoding method of claim 25, further comprising:

detecting an end code indicating an end of an encoded portion of the audio data, immediately after the encoded portion of the audio data, wherein the detecting of the start code further comprises detecting the start code after the end code when the end code is detected, and the detecting of the extension type code further comprises detecting the extension type code after the start code when the start code is detected.

27. The decoding method of claim 25, wherein the start code is a 4-bit code with four consecutive identical bits, and the extension type code is a different 4-bit code.

28. The decoding method of claim 19, further comprising:

detecting another extension type code indicating a type of a different extension data for the encoded audio data after an encoded portion of the extension data; and

decoding the different extension data using a decoding method according to the detected other extension type code when the other extension type code indicates the type of the different extension data, wherein the detecting of the other extension type code and the decoding of the different extension data are repeatedly performed until all extension data for the encoded audio data are decoded.

29. The decoding method of claim 19, wherein the extension type code is detected as being from respective extension type codes identifying defined types of the type of data for extending the select channel of the audio data, the type of data for extending the bandwidth of the audio data, the type of data for the extending of the select channel of the audio data and for the extending of the bandwidth, and a type of data for extending the bandwidth of the audio data and for checking for transmission errors.

30. The decoding method of claim 29, wherein the extension type code is detected as being from respective extension type codes identifying defined types of the type of data for extending the select channel of the audio data, the type of data for extending the bandwidth of the audio data, the type of data for the extending of the select channel of the audio data and for the extending of the bandwidth, the type of data for extending the bandwidth of the audio data and for checking for transmission errors, and a type of data for the extending of the select channel of the audio data, for the extending of the bandwidth, and for checking for transmission errors.

31. The decoding method of claim 19, wherein the decoding of the extension data comprises at least one of hierarchically decoding data for extending a select channel of the audio data and decoding data for extending a bandwidth of the audio data.

32. At least one computer readable medium comprising computer readable code to control at least one processing device to implement the method of claim 19.

33. An audio decoding method, comprising:

decoding encoded multi-channel audio data using at least one decoding method; and

detecting an extension type code indicating an extension type of extension data and decoding the extension data corresponding to the extension type code, in addition to the encoded audio data, for the encoded audio data using at least one decoding method,

wherein the decoding of the extension data comprises hierarchically decoding data for extending a select channel, of plural available channels, of the audio data and decoding data for extending a bandwidth of the extended channel of the audio data, as defined by the detected extension type code,

wherein, when the detected extension type code represents a type of extension data including the type of data extending of the select channel of the audio data and the extending of the bandwidth of the extended channel, data for respective bandwidth extensions for each of one or more select channels are separately decoded with respective channel extension data for each extended channel.

34. An audio decoding apparatus, comprising:

a first decoding unit to decode encoded audio data from encoded data in a bitstream using at least one decoding method; and

a second decoding unit to detect an extension type code in the bitstream indicating a type of extension data for the encoded audio data, the extension type code being detected as being from respective extension type codes identifying defined types of encoding data, including a type of data for extending a select channel, of plural available channels, of the audio data, a type of data for extending a bandwidth of the audio data, and a type of data for the extending of the select channel of the audio data and for an extending of a bandwidth corresponding to the extended channel, and to decode the extension data corresponding to the detected extension type code, in addition to the encoded audio data, for the encoded audio data using at least one decoding method,

wherein, when the detected extension type code represents the type of extension data including the type of data extending of the select channel of the audio data and the extending of the bandwidth corresponding to the extended channel, data for respective bandwidth extensions for each of one or more select channels are separately decoded with respective channel extension data for each extended channel.

35. An audio encoding method comprising:

encoding an audio data;

generating a code indicating the end of payload of the encoded audio data;

generating a code indicating the start of the payload of an extension data for the encoded audio data; and

encoding an extension data and an extension type code, selected from plural extension type codes as corresponding to a data type the extension data;

wherein the extension data is at least one of a first extension data type extending a select channel, of plural available channels, of the audio data and extending a bandwidth corresponding to the extended channel, and a second extension data type extending the select channel of the audio data, extending the bandwidth corresponding to the extended channel, and a checking of a transmission error, with the extending of the bandwidth of the extended channel being different from an extending of a bandwidth of the audio data without channel extension.

36. An audio encoding method comprising:

encoding an audio data;

generating a code indicating the end of payload of the encoded audio data;

generating a code indicating the start of the payload of an extension data for the encoded audio data; and

encoding an extension data and an extension type code, selected from plural extension type codes as corresponding to a data type of the extension data;

wherein the extension data is at least one of a first extension type extending a select channel, of plural available channels, of the audio data and extending a bandwidth of corresponding to the extended channel, and a second extension type extending the select channel of the audio data, extending the bandwidth corresponding to the extended channel, and a checking of a transmission error,

wherein the extending of the bandwidth of the extended channel is different from an extending of a bandwidth of the audio data without channel extension, and

wherein the generation of the extension type and the encoding of the extension data are processed repeatedly until all extension data for the encoded audio data are encoded.

37. An audio decoding method comprising:

decoding an encoded audio data;

detecting a code indicating the end of payload of the encoded audio data;

detecting a code indicating the start of the payload of an extension data for the encoded audio data;

detecting an extension type code, of plural extension type codes, each representing different data types of extension data; and

decoding an encoded extension data based on the detected extension type code;

wherein the encoded extension data is at least one of a first extension type extending a select channel, of plural available channels, of the audio data and extending a bandwidth corresponding to the extended channel, and a second extension type extending the select channel of the audio data, extending the bandwidth corresponding to the extended channel, and a checking of a transmission error, and

wherein, when the detected extension type code represents a type of extension data including a type of data extending of the select channel of the audio data and extending the bandwidth corresponding to the extended channel, data for respective bandwidth extensions for each of one or more select channels are separately decoded with respective channel extension data for each extended channel.

38. An audio decoding method comprising:

decoding an encoded audio data;

detecting a code indicating the end of payload of the encoded audio data;

detecting a code indicating the start of the payload of an extension data for the encoded audio data;

detecting an extension type code, of plural extension type codes, each representing different data types of extension data; and

decoding an encoded extension data based on the detected extension type code;

wherein the extension data is at least one of a first extension type extending a select channel, of plural available channels, of the audio data and extending a bandwidth corresponding to the extended channel, and a second extension type extending the select channel of the audio data, extending the bandwidth corresponding to extended channel, and a checking of a transmission error,

wherein, when the detected extension type code represents a type of extension data including a type of data extending of the select channel of the audio data and extending the bandwidth corresponding to the extended channel, data for respective bandwidth extensions for each of one or more select channels are separately decoded with respective channel extension data for each extended channel, and

wherein the detection of the extension type code and the decoding of the encoded extension data based on the detected extension type code are processed repeatedly for different extension data based on respective extension type codes until all extension data for the encoded audio data are decoded.

39. An audio decoding method comprising:

decoding an encoded audio data;

detecting ‘

zero code’

;

detecting ‘

sync code’

;

detecting an ‘

extension type’

, of one or more extension types, of encoded extension data for the decoded audio data after the decoding of the encoded audio data, detecting of the ‘

zero code’

, and detecting of the ‘

sync’

code; and

decoding the encoded extension data based on the detected ‘

extension type’

;

wherein the encoded extension data is at least one of a first extension type extending a select channel, of plural available channels, of the audio data and extending the bandwidth of the audio data, and a second extension type extending the select channel of the audio data, extending the bandwidth of the audio data, and a checking of a transmission error.

40. An audio decoding method comprising:

decoding an encoded audio data;

detecting ‘

zero code’

;

detecting ‘

sync code’

;

detecting an ‘

extension type’

, of one or more extension types, of encoded extension data for the decoded audio data after the decoding of the encoded audio data, detecting of the ‘

zero code’

, and detecting of the ‘

sync’

code; and

decoding the extension data based on the detected ‘

extension type’

;

wherein the encoded extension data is at least one of a first extension type extending a select channel, of plural available channels, of the audio data and extending the bandwidth of the audio data, and a second extension type extending the select channel of the audio data, extending the bandwidth of the audio data, and a checking of a transmission error, and

wherein the detection of the extension type and the decoding of the encoded extension data are processed repeatedly for different extension data based upon respective detected extension types until all extension data for the encoded audio data are decoded.

41. An audio decoding method comprising:

decoding an encoded audio data;

detecting an end code indicating an end of a payload of the encoded audio data;

detecting a start code indicating a start of a payload of an extension data for the encoded audio data;

detecting an extension type, from plural available extension types, of encoded extension data for the decoded audio data after the decoding of the encoded audio data, the detecting of the end code, and the detecting of the start code; and

decoding the encoded extension data based on the detected extension type,

wherein the plural available extension types include a first type of data extending a select channel, of plural available channels, of the audio data, a second type of data extending a bandwidth of the audio data, a third type of data extending the bandwidth of the audio data and checking a transmission error, a fourth type of data of extending the select channel of the audio data and extending the bandwidth of the audio data, and a fifth type of data extending the select channel of the audio data, extending the bandwidth of the audio data, and checking a transmission error.

42. The decoding method of claim 41, wherein, when a value of the extension type is ‘

1111’

, the extension type is the first type, when the value of the extension type is ‘

0000’

, the extension type is the second type, when the value of the extension type is ‘

0001’

, the extension type is the third type, when the value of the extension type is ‘

1110’

, the extension type is the fourth type, when the value of the extension type is ‘

1101’

, the extension type is the fifth type.

43. An audio encoding method, comprising:

encoding multi-channel audio data using at least one encoding method; and

encoding, after the encoding of the audio data, extension data of the audio data and at least one extension type code, of plural extension type codes, indicating a type the extension data,

wherein, when plural extension data for the encoded audio data are encoded, the encoding method further comprises encoding a first extension type code, of the plural extension type codes, with at least one first extension data of the encoded audio data, and then encoding a second extension type code, of the plural extension type codes, with at least one second extension data of the encoded audio data.

44. The encoding method of claim 43, wherein the first extension data includes at least data for extending a first channel of the audio data, and the second extension data includes at least data for extending a second channel of the audio data.

45. The encoding method of claim 44, wherein the plural channels include at least front left/right (FL/FR) channel, a center (C) channel, and a side left/right (SL/SR) channel.

46. The encoding method of claim 43, wherein the first extension data includes data for extending a first channel of the audio data and data for extending a bandwidth of the first channel of audio data, and the second extension data includes data extending a second channel of the audio data and data for extending a bandwidth of the second channel of audio data.