Method and apparatus for sending additional sideband information in a codestream

• US 6,973,217 B2
• Filed: 03/06/2001
• Issued: 12/06/2005
• Est. Priority Date: 02/15/2001
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Schwartz, Edward L., Boliek, Martin, Wu, Kok Gi
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): SHERALI, ISHRAT I
• Application Number:
  US09/800,832
• Publication Number:
  US 20040120585A1
• Time in Patent Office: 1,736 Days
• Field of Search: 382232-233, 382/248, 382/251, 382/250, 382/245, 382238-240, 382/247, 375/240.03, 375/240.11, 375/240.18, 375/240.19, 375/240.2, 375/240.25, 35842601-42609, 341/59, 341/65, 341/67, 341/50, 341/107
• US Class Current: 382/251
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 19/10 using adaptive coding
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/426 : using memory downsizing methods
• CPC Class Codes: H04N 19/45 : performing compensation of the inverse transform mismatch, e.g. Inverse Discrete Cosine Transform [IDCT] mismatch
• CPC Class Codes: H04N 19/46 : Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/593 : involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 : in combination with predictive coding
• CPC Class Codes: H04N 19/619 : the transform being operated outside the prediction loop
• CPC Class Codes: H04N 19/63 : using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/635 : characterised by filter definition or implementation details
• CPC Class Codes: H04N 19/64 : characterised by ordering of coefficients or of bits for transmission
• CPC Class Codes: H04N 19/645 : by grouping of coefficients into blocks after the transform
• CPC Class Codes: H04N 19/647 : using significance based coding, e.g. Embedded Zerotrees of Wavelets [EZW] or Set Partitioning in Hierarchical Trees [SPIHT]
• CPC Class Codes: H04N 19/70 : characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/85 : using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/86 : involving reduction of coding artifacts, e.g. of blockiness

Abstract

A method and apparatus for sending additional sideband information in a codestream is described. In one embodiment, the method comprises receiving a JPEG 2000 codestream of compressed image data having sideband information hidden therein and decompressing the codestream based on the sideband information.

Claims

1. A method comprising:

receiving a JPEG 2000 codestream of compressed image data having sideband information hidden in a sideband area of the codestream, the sideband information including information indicating how at least a portion of the codestream is to be decompressed;

providing the sideband information via inclusion in the codestream of a non-minimal tag tree construction; and

decompressing the codestream based on the sideband information retrieved from the sideband area of the codestream.

2. The method defined in claim 1 wherein the sideband information is stored in a marker from the group of markers that includes PPM, PPT, PLM, PLT, QCD, QCC, POC markers.

3. The method defined in claim 1 wherein the sideband information is stored in a packet header.

4. The method defined in claim 1 wherein the sideband information is stored at the end of a packet header rounding information in the header to a byte boundary.

5. The method defined in claim 1 wherein the sideband information is stored after the last packet but before a next tile.

6. The method defined in claim 1 wherein the sideband information is stored in packet header Lblock signaling.

7. The method defined in claim 1 wherein the sideband information is stored in the arithmetic coder (AC) termination information.

8. The method defined in claim 1 wherein the sideband information is stored in the Least Significant Bit parity information for at least one codeblock.

10. The method defined in claim 1 wherein decompressing the codestream comprises decompressing the codestream using hints stored in the sideband information.

11. The method defined in claim 10 wherein the hints comprise at least one of decoding, segmentation, and filtering hints.

12. The method defined in claim 11 wherein the sideband information comprises security information.

13. The method defined in claim 11 wherein the sideband information comprises codestream identification information.

14. The method defined in claim 11 wherein the sideband information comprises post-processing hints.

9. A method comprising:

receiving a JPEG 2000 codestream of compressed image data having sideband information hidden therein; and

decompressing the codestream based on the sideband information.

15. An apparatus comprising:

means for receiving a JPEG 2000 codestream of compressed image data having sideband information hidden in a sideband area of the codestream, the sideband information including information indicating how at least a portion of the codestream is to be decompressed;

means for providing the sideband information via inclusion in the codestream of a non-minimal tag tree construction; and

means for decompressing the codestream based on the sideband information retrieved from the sideband area of the codestream.

16. The apparatus defined in claim 15 wherein the sideband information is stored in a marker from the group of markers that includes PPM, PPT, PLM, PLT, QCD, QCC, POC markers.

17. The apparatus defined in claim 15 wherein the sideband information is stored in a packet header.

18. The apparatus defined in claim 15 wherein the sideband information is stored at the end of a packet header rounding information in the header to a byte boundary.

19. The apparatus defined in claim 15 wherein the sideband information is stored after the last packet but before a next tile.

20. The apparatus defined in claim 15 wherein the sideband information is stored in packet header Lblock signaling.

21. The apparatus defined in claim 15 wherein the sideband information is stored in the arithmetic coder (AC) termination information.

22. The apparatus defined in claim 15 wherein the sideband information is stored in the Least Significant Bit parity information for at least one codeblock.

24. The apparatus defined in claim 15 wherein the means for decompressing the codestream comprises means for decompressing the codestream using hints stored in the sideband information.

25. The apparatus defined in claim 24 wherein the hints comprise at least one of decoding, segmentation, and filtering hints.

26. The apparatus defined in claim 25 wherein the sideband information comprises security information.

27. The apparatus defined in claim 25 wherein the sideband information comprises codestream identification information.

28. The apparatus defined in claim 25 wherein the sideband information comprises post-processing hints.

23. An apparatus comprising:

means for receiving a JPEG 2000 codestream of compressed image data having sideband information hidden therein;

means for providing the sideband information via inclusion in the codestream of a non-minimal tag tree construction; and

means for decompressing the codestream based on the sideband information.

29. An article of manufacture comprising at least one recordable media storing executable instructions thereon which, when executed by a processing device, cause the processing device to:

receive a JPEG 2000 codestream of compressed image data having sideband information hidden in a sideband area of the codestream, the sideband information including information indicating how at least a portion of the codestream is to be decompressed;

provide the sideband information via inclusion in the codestream of a non-minimal tag tree construction; and

decompress the codestream based on the sideband information retrieved from the sideband area of the codestream.

30. The article of manufacture defined in claim 29 wherein the sideband information is stored in a marker from the group of markers that includes PPM, PPT, PLM, PLT, QCD, QCC, POC markers.

31. The article of manufacture defined in claim 29 wherein the sideband information is stored in a packet header.

32. The article of manufacture defined in claim 29 wherein the sideband information is stored at the end of a packet header rounding information in the header to a byte boundary.

33. The article of manufacture defined in claim 29 wherein the sideband information is stored after the last packet but before a next tile.

34. The article of manufacture defined in claim 29 wherein the sideband information is stored in packet header Lblock signaling.

35. The article of manufacture defined in claim 29 wherein the sideband information is stored in the arithmetic coder (AC) termination information.

36. The article of manufacture defined in claim 29 wherein the sideband information is stored in the Least Significant Bit parity information for at least one codeblock.

38. The article of manufacture defined in claim 29 wherein decompressing the codestream comprises decompressing the codestream using hints stored in the sideband information.

39. The article of manufacture defined in claim 38 wherein the hints comprise at least one of decoding, segmentation, and filtering hints.

40. The article of manufacture defined in claim 39 wherein the sideband information comprises security information.

41. The article of manufacture defined in claim 39 wherein the sideband information comprises codestream identification information.

42. The article of manufacture defined in claim 39 wherein the sideband information comprises post-processing hints.

37. An article of manufacture comprising at least one recordable media storing executable instructions thereon which, when executed by a processing device, cause the processing device to:

receive a JPEG 2000 codestream of compressed image data having sideband information hidden therein, provide the sideband information via inclusion in the codestream of a non-minimal tag tree construction; and

decompress the codestream based on the sideband information.

43. An apparatus, comprising

a decoder to receive a JPEG 2000 codestream of compressed image data having sideband information hidden in a sideband area of the codestream, the sideband information including information indicating how at least a portion of the codestream is to be decompressed, provide the sideband information via inclusion in the codestream of a non-minimal tag tree construction, and to decompress the codestream based on the sideband information retrieved from the sideband area of the codestream.

44. The apparatus defined in claim 43 wherein the sideband information is stored in a marker from the group of markers that includes PPM, PPT, PLM, PLT, QCD, QCC, POC markers.

45. The apparatus defined in claim 43 wherein the sideband information is stored in a packet header.

46. The apparatus defined in claim 43 wherein the sideband information is stored at the end of a packet header rounding information in the header to a byte boundary.

47. The apparatus defined in claim 43 wherein the sideband information is stored after the last packet but before a next tile.

48. The apparatus defined in claim 43 wherein the sideband information is stored in packet header Lblock signaling.

49. The apparatus defined in claim 43 wherein the sideband information is stored in the arithmetic coder (AC) termination information.

50. The apparatus defined in claim 43 wherein the sideband information is stored in the Least Significant Bit parity information for at least one codeblock.

52. The apparatus defined in claim 43 wherein decompressing the codestream comprises decompressing the codestream using hints stored in the sideband information.

53. The apparatus defined in claim 52 wherein the hints comprise at least one of decoding, segmentation, and filtering hints.

54. The apparatus defined in claim 53 wherein the sideband information comprises security in formation.

55. The apparatus defined in claim 53 wherein the sideband information comprises codestream identification information.

56. The apparatus defined in claim 53 wherein the sideband information comprises post-processing hints.

51. An apparatus, comprising:

a decoder to receive a JPEG 2000 codestream of compressed image data having sideband information hidden therein, provide the sideband information via inclusion in the codestream of a non-minimal tag tree construction, and to decompress the codestream based on the sideband information.

57. A method comprising:

receiving a codestream of compressed image data having sideband information hidden over marker segments for specifying predefined information, the sideband information being included in one or more marker segments along with the predefined information, such that a file size of the codestream remains substantially the same;

providing the sideband information via inclusion in the codestream of a non-minimal tag tree construction; and

decompressing the codestream based on the sideband information.