Encoding a transparency (alpha) channel in a video bitstream

• US 7,852,353 B1
• Filed: 03/31/2005
• Issued: 12/14/2010
• Est. Priority Date: 03/31/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Haskell, Barin Geoffry, Singer, David William
• Primary Examiner(s): Amini; Javid A
• Application Number:
  US11/095,013
• Time in Patent Office: 2,084 Days
• Field of Search: 345/629
• US Class Current: 345/629
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/188 the unit being a video data packet, e.g. a network abstraction layer [NAL] unit
• CPC Class Codes: H04N 19/21 with binary alpha-plane coding for video objects, e.g. context-based arithmetic encoding [CAE]
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder

Abstract

Disclosed herein is a technique for delimiting the alpha channel at the NAL layer in codecs like H.264 to facilitate the optional nature of the alpha channel. In coded video sequences that include alpha, there is one alpha picture for every primary coded (e.g., luma-chroma) picture, and the coded alpha picture is contained in the same access unit as its corresponding primary coded picture. The alpha coded slice NAL units of each access unit are sent after the NAL units of the primary coded picture and redundant coded pictures, if any. The presence or absence of the alpha NAL units does not affect the decoding of the remaining NAL units in any way.

Claims

1. A method of transmitting image data for a composite image, wherein the transmitted data includes at least a foreground image and a transparency mask, the method comprising:

encoding, by a video codec device, the foreground image;

encoding, by the video codec device, the transparency mask;

transmitting, by the video codec device, an image data stream comprising one or more syntax structures corresponding to the encoded foreground image and one or more syntax structures corresponding to the encoded transparency mask, wherein the one or more syntax structures corresponding to the transparency mask are delimited from and are located after the syntax structures corresponding to the foreground image in the data stream.

2. The method of claim 1 wherein the image data is encoded according to ITU Recommendation H.264.

3. The method of claim 2 wherein the image data stream is in a NAL unit format.

4. The method of claim 3 wherein the image data stream is in a byte stream format.

5. The method of claim 1 wherein there is one and only one transparency mask for each foreground image.

6. The method of claim 1, wherein the video codec device comprises hardware and software.

7. A method of receiving and processing an image data stream, the method comprising:

receiving, by a video codec device, an image data stream comprising one or more syntax structures corresponding to an encoded foreground image and one or more syntax structures corresponding to an encoded transparency mask, wherein the one or more syntax structures corresponding to the transparency mask are delimited from and are located after the syntax structures corresponding to the foreground image in the data stream;

decoding, by the video codec device, the syntax structures corresponding to the encoded foreground image;

decoding, by the video codec device, the syntax structures corresponding to the transparency mask; and

computing, by the video codec device, a displayed image as a function of the decoded foreground image and the decoded transparency mask.

8. The method of claim 7 wherein the image data stream is encoded according to ITU Recommendation H.264.

9. The method of claim 8 wherein the image data stream is in a NAL unit format.

10. The method of claim 9 wherein the image data stream is in a byte stream format.

11. The method of claim 10 wherein there is one and only one transparency mask for each foreground image.

12. The method of claim 10 wherein computing a displayed image as a function of the decoded foreground image and the decoded transparency mask further comprises computing the displayed image as a function of a background image.

13. The method of claim 12 wherein the background image is received separately from the foreground image and transparency mask.

14. The method of claim 12 wherein the background image is created at a decoder and is not received.

15. The method of claim 7, wherein the video codec device comprises hardware and software.

16. A method of receiving and processing an image data stream, the method comprising:

receiving, by a video codec device, an image data stream comprising one or more syntax structures corresponding to an encoded foreground image and one or more syntax structures corresponding to an encoded transparency mask, wherein the one or more syntax structures corresponding to the transparency mask are delimited from and are located after the syntax structures corresponding to the foreground image in the data stream;

decoding, by the video codec device, the syntax structures corresponding to the encoded foreground image;

discarding, by the video codec device, the syntax structures corresponding to the transparency mask; and

computing, by the video codec device, a displayed image as a function of the decoded foreground image and not as a function of the discarded transparency mask.

17. The method of claim 16 wherein the image data is encoded according to ITU Recommendation H.264.

18. The method of claim 17 wherein the image data stream is in a NAL unit format.

19. The method of claim 18 wherein the image data stream is in a byte stream format.

20. The method of claim 16 wherein there is one and only one transparency mask for each foreground image.

21. The method of claim 16, wherein the video codec device comprises hardware and software.