Method and apparatus for providing prediction mode scalability

• US 10,070,141 B2
• Filed: 05/16/2012
• Issued: 09/04/2018
• Est. Priority Date: 01/09/2001
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Peng, Wen-Hsiao, Chen, Yen-Kuang
• Primary Examiner(s): Diep, Nhon
• Application Number:
  US13/473,351
• Publication Number:
  US 20120224630A1
• Time in Patent Office: 2,302 Days
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

In an encoding process, video data are represented as a bitstream of a quantized base layer and at least two enhancement layers, with each picture in each layer identified by a start code. The base layer, plus a number of enhancement layers capable of being transmitted by the communication channel'"'"'s bandwidth, are transmitted on the communication channel.

Claims

1. A method of scalable video decoding comprising:

receiving a bit-stream at a decoder, the bit stream including an enhancement frame layer, a base frame layer, and a syntax;

pre-parsing the bit-stream to separate the bit-stream into enhancement layer frames, base layer frames, and syntax;

selecting one from among a plurality of prediction modes for a current enhancement layer frame using an indication associated with the current enhancement layer frame in the syntax of the bit-stream received at the decoder;

predicting a current enhancement layer frame using the selected prediction mode from the associated indication in the syntax, wherein the selected prediction mode is predicting the current enhancement layer frame based on a reconstructed current base layer frame, the reconstructed current base layer frame being associated with a same picture as that of the current enhancement layer frame, wherein the reconstructed current base layer frame and the previous enhancement layer frame have both undergone spatial-domain reconstruction and clipping.

2. The method of claim 1, wherein the memory comprises a frame buffer.

3. The method of claim 1, wherein predicting the current enhancement layer frame comprises predicting at least a portion of the current enhancement layer frame.

4. The method of claim 3, wherein the portion of the current enhancement layer frame comprises a macroblock.

5. The method of claim 1, wherein the reconstructed current base layer frame and the previous enhancement layer frame comprise reference frames.

6. The method of claim 5, wherein the reconstructed current base layer frame comprises a lower quality reference frame, and wherein the previous enhancement layer frame comprises a higher quality reference frame.

7. The method of claim 1, wherein a second one of the plurality of prediction modes is predicting the current enhancement frame based on the previous enhancement layer and a third one of the plurality of prediction modes is predicting the current enhancement frame based on the previous enhancement layer frame and the reconstructed current base layer frame and wherein an indication associated with a next enhancement layer fame in the syntax of the bit-stream indicates one of the second and the third prediction modes.

8. One or more non-transitory machine-readable media including instructions to be executed that, when executed, cause a computing device to:

receive a bit-stream at a decoder, the bit stream including an enhancement frame layer, a base frame layer, and a syntax;

pre-parse the bit-stream to separate the bit-stream into enhancement layer frames, base layer frames, and syntax;

select one from among a plurality of prediction modes for a current enhancement layer frame using an indication associated with the current enhancement layer frame in the syntax of the bit-stream received at the decoder;

predict a current enhancement layer frame using the selected prediction mode from the associated indication in the syntax, wherein the selected prediction mode is predicting the current enhancement layer frame based on a reconstructed current base layer frame, the reconstructed current base layer frame being associated with a same picture as that of the current enhancement layer frame, wherein the reconstructed current base layer frame and the previous enhancement layer frame have both undergone spatial-domain reconstruction and clipping.

9. The one or more machine-readable media of claim 8, wherein the memory comprises a frame buffer.

10. The one or more machine-readable media of claim 8, wherein predicting the current enhancement layer frame comprises predicting at least a portion of the current enhancement layer frame.

11. The one or more machine-readable media of claim 10, wherein the portion of the current enhancement layer frame comprises a macroblock.

12. The one or more machine-readable media of claim 8, wherein the reconstructed current base layer fame and the previous enhancement layer frame comprise reference frames.

13. The one or more machine-readable media of claim 12, wherein the reconstructed current base layer frame comprises a lower quality reference frame, and where in the previous enhancement layer frame comprises a higher quality reference fame.

14. The one or more machine-readable media of claim 8, wherein a second one of the plurality of prediction modes is predicting the current enhancement frame based on the previous enhancement layer and a third one of the plurality of prediction modes is predicting the current enhancement frame based on the previous enhancement layer frame and the reconstructed current base layer frame and wherein an indication associated with a next enhancement layer fame in the syntax of the bit-stream indicates one of the second and the third prediction modes.

15. A device for decoding scalable video data, comprising:

memory; and

an interface of the decoder to receive a bit-stream, the bit-stream including an enhancement frame layer, a base frame layer, and a syntax;

a parser to pre-parse the bit-stream to separate the bit-stream into enhancement layer frames, base layer frames, and syntax;

an enhancement layer decoder coupled to the memory, the enhancement layer decoder to select one from among a plurality of prediction modes for a current enhancement layer frame using an indication associated with the current enhancement layer frame in the syntax of the bit-stream received at the decoder, to predict a current enhancement layer frame using the selected prediction mode from the associated indication in the syntax, wherein the selected prediction mode is prediction of the current enhancement layer frame based on a reconstructed current base layer frame, the reconstructed current base layer frame being associated with the same picture as that of the current enhancement layer frame, wherein the memory is to store at least one of a previous enhancement layer frame or the reconstructed current base layer frame, wherein the reconstructed current base layer frame and the previous enhancement layer frame have both undergone spatial domain reconstruction and clipping.

16. The device of claim 15, further comprising a variable length decoder to decode the bitstream syntax.

17. The device of claim 15, further comprising an inverse discrete cosine transform (IDCT) unit to perform an IDCT operation on enhancement layer video data, the enhancement layer video data to specify at least in part the current enhancement layer frame.

18. The device of claim 15, wherein the memory comprises the frame buffer.

19. The device of claim 15, wherein the reconstructed current base layer frame and the previous enhancement layer frame comprise reference frames.

20. The device of claim 15, wherein the reconstructed current base layer frame comprise a lower quality reference frame, and wherein the previous enhancement layer frame comprises a higher quality reference frame.

21. The device of claim 15, wherein a second one of the plurality of prediction modes is predicting the current enhancement frame based on the previous enhancement layer and a third one of the plurality of prediction modes is predicting the current enhancement frame based on the previous enhancement layer frame and the reconstructed current base layer frame and wherein an indication associated with a next enhancement layer fame in the syntax of the bit-stream indicates one of the second and the third prediction modes.