Error resilient still image packetization method and packet structure

• US 6,339,658 B1
• Filed: 03/09/1999
• Issued: 01/15/2002
• Est. Priority Date: 03/09/1999
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Rockwell Science Center LLC
• Inventors: Moccagatta, Iole, Al-Shaykh, Osama K.
• Primary Examiner(s): Couso, Jose L.
• Assistant Examiner(s): Dang, Duy M.
• Application Number:
  US09/265,277
• Time in Patent Office: 1,043 Days
• Field of Search: 382/239, 382/240, 382/248, 382/263, 382/274, 382/232, 382/251, 382/260, 348/430, 348/398, 348/408, 348/447, 348/453
• US Class Current: 382/240
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/65 using error resilience
• CPC Class Codes: H04N 19/68 involving the insertion of resynchronisation markers into the bitstream
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

A packetization method and packet structure improve the robustness of a bitstream generated when a still image is decomposed with a wavelet transform. The wavelet coefficients of one “texture unit” are scanned and coded in accordance with a chosen scanning method to produce a bitstream. The bitstreams for an integral number of texture units are assembled into a packet, each of which includes a packet header. Each packet header includes a resynchronization marker to enable a decoder to resynchronize with the bitstream if synchronization is lost, and an index number which absolutely identifies one of the texture units in the packet to enable a decoder to associate following packets with their correct position in the wavelet transform domain. The header information enables a channel error to be localized to a particular packet, preventing the effects of the error from propagating beyond packet boundaries. The invention is applicable to the pending MPEG-4 and JPEG-2000 image compression standards.

Claims

1. A method of encoding a still image which improves the error resiliency of the resulting bitstream, comprising the steps of:

decomposing a still image with a wavelet transform,

choosing a scanning method with which to scan the wavelet coefficients produced by said decomposition,

scanning the wavelet coefficients of a texture unit which is defined in accordance with said chosen scanning method,

coding the wavelet coefficients of said texture unit to produce a bitstream,

adding said bitstream to a packet which includes a data stream, all of the bits of the bitstream resulting from said coding of said texture unit becoming part of said packet'"'"'s data stream,

determining, in accordance with a first predetermined criterion, whether the packet associated with said data stream should be closed,

repeating the steps of scanning and coding the wavelet coefficients of a texture unit to produce a bitstream and adding the resulting bitstream to said data stream for additional texture units until said first predetermined criterion for closing said packet has been met,

constructing a packet header for said data stream, said packet header comprising;

a resynchronization marker for enabling a decoder to resynchronize with the encoder producing said bitstream if synchronization is lost, and

at least one index number, each of said index numbers identifying a respective one of the texture units in the packet header'"'"'s associated data stream, for enabling a decoder to associate following packets with their correct position in the wavelet transform domain, and

combining said packet header and its associated data stream to form a packet suitable for transmitting over a communication channel, the use of said encoding method providing independently decodable packets and thereby improving the error resilience of said bitstream by eliminating dependencies across the packets and isolating corrupted data to a single packet.

2. The method of claim 1, wherein said decomposition produces a DC band and a plurality of higher subbands, further comprising the steps of determining whether a texture unit contains coefficients from said DC band, and if so, determining, in accordance with a second predetermined criterion, whether the packet associated with the data stream resulting from the coding of said DC texture unit should be closed, said second predetermined criterion selected to produce packets having respective data streams that contain bits representing DC band coefficients exclusively.

3. The method of claim 2, wherein said second predetermined criterion comprises determining whether the length of said data stream exceeds a predetermined bit threshold value.

4. The method of claim 2, wherein said second predetermined criterion comprises determining whether all of the coefficients from said DC band have been coded.

5. The method of claim 1, wherein said wavelet transform is a dyadic wavelet transform and said chosen scanning method comprises tree-depth scanning which organizes said wavelet coefficients into at least one tree structure, each of said texture units consisting of all the bits that result from coding a respective one of said tree structures.

6. The method of claim 1, wherein said chosen scanning method comprises subband-by-subband scanning, each of said texture units consisting of the bits that result from coding an integer number of consecutive lines of a subband.

7. The method of claim 1, wherein said chosen scanning method comprises subband-by-subband scanning, each of said texture units consisting of the bits that result from coding a block of coefficients from a respective subband, each of said packets formed by collecting said texture units in a raster scan order.

8. The method of claim 1, wherein said chosen scanning method comprises subband-by-subband scanning, each of said texture units consisting of the bits that result from coding a block of coefficients from a respective subband, each of said packets formed by collecting texture units in a check-board fashion such that if one of said packets is lost its texture units can be interpolated from its four neighboring blocks which belong to different packets, said scanning and packet formation steps facilitating error concealment.

9. The method of claim 1, wherein said coding step comprises quantizing and arithmetically coding said wavelet coefficients to produce said bitstream.

10. The method of claim 9, further comprising the step of resetting the statistical models used in said arithmetic coding step prior to encoding and decoding each of said packets.

11. The method of claim 9, wherein said quantizing and coding of said wavelet coefficients is accomplished using the zero-tree algorithm.

12. The method of claim 9, wherein said quantizing and coding of said wavelet coefficients is accomplished using context-based arithmetic coding.

13. The method of claim 1, wherein said scanning step comprises subband-by-subband scanning in a bit-plane by bit-plane order, each of said texture units comprising at least one bit-plane.

14. The method of claim 13, further comprising the steps of dividing a data stream into sub-packets, each of which contains at least one bit-plane, a resynchronization marker, and an index number which identifies the sub-packet'"'"'s first bit-plane.

15. The method of claim 1, wherein said first predetermined criterion is met when the total number of bits in said data stream, including all of the bits of the most-recently-coded texture unit, exceeds a predetermined bit threshold value.

16. The method of claim 1, wherein said predetermined bit threshold value varies with the bandwidth of the image being coded.

17. The method of claim 1, wherein said packet header includes two unique index numbers, said index numbers absolutely identifying the first texture unit and the last texture unit in the packet'"'"'s data stream.

18. The method of claim 1, wherein said packet header further comprises a one-bit header extension code (HEC) which, when set to a predetermined value, indicates that the packet header includes additional information.

19. A packet structure suitable for use when transmitting a bitstream produced by encoding a still image, comprising:

a data stream, said data stream comprising at least one texture unit, each of said texture units comprising a respective bitstream generated by scanning and coding the wavelet coefficients produced by a wavelet decomposition of a still image in accordance with a predetermined scanning method, and

a packet header, said packet header including;

a resynchronization marker for resynchronizing a decoder to the encoder which produces said bitstream if synchronization is lost, and

an index number which absolutely identifies one of said texture units in said data stream for enabling a decoder to associate following packets with their correct position in the wavelet transform domain, said packet header and said data stream combined to form a packet suitable for conveying a bitstream representing at least a portion of a still image across a communication channel.

20. The packet structure of claim 19, wherein said wavelet decomposition uses a dyadic wavelet transform and said wavelet coefficients are tree-depth scanned, each of said texture units comprising the bits produced when coding one of the tree structures resulting from said tree-depth scan.

21. The packet structure of claim 19, wherein said wavelet coefficients are subband-by-subband scanned, each of said texture units comprising the bits that result from coding an integer number of consecutive lines of a respective subband.

22. The packet structure of claim 19, wherein said wavelet coefficients are subband-by-subband scanned, each of said texture units comprising the bits that result from coding a block of coefficients from a respective subband, each of said packets formed by collecting said texture units in a raster scan order.

23. The packet structure of claim 19, wherein said wavelet coefficients are subband-by-subband scanned, said packets formed by collecting said texture units in a check-board fashion such that a lost texture unit can be interpolated from its four neighboring blocks which belong to different packets.

24. The packet structure of claim 19, wherein said wavelet coefficients are subband-by-subband scanned in a bit-plane by bit-plane order, each of said texture units comprising at least one of the bit-planes of one subband.

25. The packet structure of claim 24, wherein said data stream is divided into sub-packets, each of which contains at least one bit-plane, a resynchronization marker, and an index number which identifies the sub-packet'"'"'s first bit-plane.

26. The packet structure of claim 19, wherein said bitstream comprises quantized and arithmetically coded wavelet coefficients, said wavelet coefficients produced by said wavelet decomposition.

27. The packet structure of claim 19, wherein said data stream contains an integral number of complete texture units such that the total number of bits in said data stream is greater than a predetermined bit threshold value.

28. The packet structure of claim 19, wherein said packet header includes two index numbers which absolutely identify the first texture unit and the last texture unit in the packet'"'"'s data stream.

29. The packet structure of claim 19, wherein said packet header further comprises a one-bit header extension code (HEC) which, when set to a predetermined value, indicates that the packet header includes additional information.