Separate shape and texture coding of transparency data for video coding applications

• US 5,946,419 A
• Filed: 02/19/1998
• Issued: 08/31/1999
• Est. Priority Date: 03/22/1996
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lee, Ming-Chieh, Chen, Wei-ge
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): Tadayon, Bijan
• Application Number:
  US09/026,187
• Time in Patent Office: 558 Days
• Field of Search: 345/434, 345/421, 345/428, 345/429, 345/441, 345/443, 345/525, 345/501, 345/502, 345/513, 345/519, 345/521, 382/173, 382/171, 382/307, 382/164, 382/176, 382/308, 382/180, 382/181, 382/190, 382/195, 382/196, 382/197, 382/199, 382/201, 382/202, 382/203, 382/204, 382/209, 382/217 , 382/224, 382/232, 382/233, 382/235, 382/239, 382/237, 382/240, 382/241, 382/242, 382/243, 382/244, 382/248, 382/251, 382/260, 382/261, 382/282, 382/283, 382/284, 382/28 6
• US Class Current: 382/243
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
• CPC Class Codes: H04N 19/517 by encoding
• CPC Class Codes: H04N 19/54 using feature points or meshes
• CPC Class Codes: H04N 19/543 using regions
• CPC Class Codes: H04N 19/563 Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/649 the transform being applied to non rectangular image segments

Abstract

A hierarchical object encoding technique or process capable of representing general binary arbitrary shapes that include, for example, embedded or disconnected components. The method decomposes successive layers of general binary arbitrary shapes into simple arbitrary shapes. Each mask formed in this manner is a simple arbitrary shape having only a continuous outer boundary. Accordingly, each outer boundary is encoded, preferably by a contour encoding method, to provide accurate encoding of general binary shapes.

Claims

1. A method of encoding a general arbitrary image feature in a video image frame, the image feature including pixels that each have a pixel value and a non-binary transparency value, the method comprising the steps:

applying a threshold filter to the non-binary transparency values to form a binary representation of shape of the image feature;

shape coding the binary shape of the image feature; and

texture coding the non-binary transparency values of the image feature separately from the binary shape.

2. The method of claim 1 in which the pixels of the image feature include non-binary color values;

and

texture coding the non-binary color values.

3. The method of claim 1 in which texture coding of the non-binary transparency values of the image feature includes extrapolating the non-binary transparency values of the image feature to a rectangular configuration to facilitate block-based texture coding.

4. The method of claim 3 including:

subdividing the rectangular configuration into blocks of pixel locations;

for each block of pixel locations, transform coding the non-binary transparency values at the pixel locations in the block.

5. The method of claim 4 in which the transform coding step includes performing a discrete cosine transform of the non-binary transparency values at the pixel locations in each block.

6. The method of claim 4 including:

for each block of pixel locations, performing motion compensation on the non-binary transparency values of the image feature to compute a residual alpha signal and transform coding the residual alpha signal.

7. The method of claim 1 including performing motion compensation on the non-binary transparency values of the image feature to compute a residual alpha signal and transform coding the residual alpha signal.

8. The method of claim 1 including:

identifying a rectangular bounding box around the image feature;

subdividing the rectangular bounding box into blocks of pixel locations within the bounding box;

for each block, transform coding a color value for each pixel location in the block and transform coding the non-binary transparency value for each pixel location in the block.

9. The method of claim 1 including extrapolating color values of pixel locations inside the image feature to pixel locations outside the image feature;

and

extrapolating non-binary transparency values of pixel locations inside the image feature to pixel locations outside the image feature.

10. A computer readable medium having instructions for performing the steps of claim 1.

11. A method of encoding multi-bit image transparency data for a general arbitrary image feature in a video image frame, the image feature including feature pixels that each have a pixel value including a multi-bit image transparency value, the method comprising the steps:

identifying a transparency boundary of the arbitrary image feature within the multi-bit transparency values;

forming a mask in relation to the identified transparency boundary of the image feature;

shape coding the mask of the image feature; and

texture coding the multi-bit transparency values of the image feature separately from the shape coding of the mask of the image feature.

12. The method of claim 11 in which identifying the image transparency boundary of the image feature includes applying a threshold filter to the multi-bit image transparency values to form binary representations of the values.

13. The method of claim 11 in which encoding of the multi-bit image transparency values of the image feature separately from the image feature boundary includes extrapolation of the multi-bit image transparency values of the image feature to a predefined configuration to facilitate encoding.

14. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 11.

15. A computer-readable medium having stored thereon a data structure representing multi-bit image transparency data for a general arbitrary image feature in an image segment of a video image frame, the image feature being bounded by a feature boundary and including feature pixels that each have a pixel value including a multi-bit image transparency value, the data structure comprising:

an encoded binary contour representation of an image transparency boundary of the image feature; and

encoded representations of the multi-bit image transparency values within the image transparency boundary of the image feature.

16. A method of decoding multi-bit image transparency data for a general arbitrary image feature in a video image frame, the image feature including feature pixels that each have a pixel value including a multi-bit image transparency value, the method comprising the steps:

decoding an encoded mask representing the shape of the image feature;

decoding texture coded multi-bit transparency values of the image feature separately from the decoding of the binary mask of the image feature; and

applying the binary mask to the decoded multi-bit transparency values of the image feature to remove unwanted pixel values at pixel locations outside the shape of the image feature.

17. The method of claim 16 in which the mask is a binary mask and the decoding of the mask includes applying a binary shape decoder to the encoded mask.

18. The method of claim 16 in which the texture coded multi-bit transparency values comprise transform coded blocks of the multi-bit transparency values, and the decoding of the texture includes performing inverse transform coding on each of the coded blocks.