Efficiency FGST framework employing higher quality reference frames

• US 6,944,222 B2
• Filed: 03/04/2002
• Issued: 09/13/2005
• Est. Priority Date: 03/04/2002
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Van Der Schaar, Mihaela
• Primary Examiner(s): Kelley, Chris
• Assistant Examiner(s): REKSTAD, ERICK J
• Application Number:
  US10/090,863
• Publication Number:
  US 20030165331A1
• Time in Patent Office: 1,289 Days
• Field of Search: 375/240.01, 375/240.15, 375/240.16, 375/240.27, 375/240.12, 375/240.14
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]

Abstract

A method and apparatus for coding video includes constructing motion-compensated extended base layer reference frames from base layer frames and at least portions of base layer residual image frames. The motion-compensated extended base layer reference frames are used for bi-directionally or uni-directionally predicting FGS motion-compensated residual image or temporal frames.

Claims

1. A method of coding video, comprising the steps of:

coding the video into a data-stream of base layer frames;

computing residual image frames in a transform domain from the base layer frames;

coding the residual image frames into a data-stream of SNR quality frames;

constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

predicting motion-compensated residual image frames from the motion-compensated extended base layer reference frames and the video; and

fine granular scalable coding the motion-compensated residual image frames into a data-stream of temporal frames.

2. The method of coding video according to claim 1, wherein the data-stream of SNR quality frames are fine granular scalable coded.

3. The method of coding video according to claim 2, further comprising the step of combining the data-stream of temporal frames with the data-stream of SNR quality frames to construct a single data-stream of the temporal and SNR quality frames.

4. A method of coding a video signal, comprising the steps of:

coding the video signal into a data-stream of base layer frames;

computing residual image frames in a transform domain from the base layer frames;

coding the residual image frames into a data-stream of SNR quality frames;

constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

predicting motion-compensated residual image frames from the motion-compensated extended base layer reference frames and the video signal; and

fine granular scalable coding the motion-compensated residual image frames into a data-stream of temporal frames.

5. The method of coding a video signal according to claim 4, wherein the data-stream of SNR quality frames are fine granular scalable coded.

6. The method of coding a video signal according to claim 5, further comprising the step of combining the data-stream of temporal frames with the data-stream of SNR quality frames to construct a single data-stream of the temporal and SNR quality frames.

7. An apparatus for coding video, comprising:

means for coding the video into a data-stream of base layer frames;

means for computing residual image frames in a transform domain from the base layer frames;

means for coding the residual image frames into a data-stream of SNR quality frames;

means for constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

means for motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

means for predicting motion-compensated residual image frames from the motion-compensated extended base layer reference frames and the video; and

means for fine granular scalable coding the motion-compensated residual image frames into a data-stream of temporal frames.

8. The apparatus according to claim 7, wherein the means for coding the residual image frames into a data-stream of SNR quality frames utilizes fine granular scalable coding.

9. The apparatus according to claim 8, further comprising means for combining the data-stream of the temporal frames with the data-stream of the SNR quality frames to construct a single data-stream of the temporal and SNR quality frames.

10. A memory medium for coding video, comprising:

code for coding the video into a data-stream of base layer frames;

code for computing residual image frames in a transform domain from the base layer frames;

code for fine granular scalable coding the residual image frames into a data-stream of SNR quality frames;

code for constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

code for motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

code for predicting motion-compensated residual image frames from the motion-compensated extended base layer reference frames and the video; and

code for fine granular scalable coding the motion-compensated residual image frames into a data-stream of temporal frames.

11. The memory medium according to claim 10, wherein the code for coding the residual image frames into a data-stream of SNR quality frames utilizes fine granular scalable coding.

12. The memory medium according to claim 11, further comprising code for combining the data-stream of the temporal frames with the data-stream of the SNR quality frames to construct a single data-stream of the temporal and SNR quality frames.

13. A method of decoding a base layer data-stream and an enhancement layer data-stream, which collectively represent a video, comprising the steps of:

decoding the base layer data-stream to construct base layer frames;

fine granular scalable decoding an SNR quality frame portion of the enhancement layer data-stream to construct SNR quality frames;

constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

fine granular scalable decoding a temporal frame portion of the enhancement layer data-stream to construct motion-compensated residual frames;

combining the motion-compensated extended base layer reference frames with the motion-compensated residual frames to construct temporal frames.

14. The method according to claim 13, further comprising the step of combining the base layer frames and the SNR quality frames into an enhanced video.

15. The method according to claim 13, further comprising the step of combining the base layer frames, the SNR quality frames, and the temporal frames into an enhanced video.

16. An apparatus for decoding a base layer data-stream and an enhancement layer data-stream, which collectively represent a video, comprising:

means for decoding the base layer data-stream to construct base layer frames;

means for fine granular scalable decoding an SNR quality frame portion of the enhancement layer data-stream to construct SNR quality frames;

means for constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

means for motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

means for fine granular scalable decoding a temporal frame portion of the enhancement layer data-stream to construct motion-compensated residual frames;

means for combining the motion-compensated extended base layer reference frames with the motion-compensated residual frames to construct temporal frames.

17. The apparatus according to claim 16, further comprising means for combining the base layer frames and the SNR quality frames into an enhanced video.

18. The apparatus according to claim 16, further comprising means for combining the base layer frames, the SNR quality frames, and the temporal frames into an enhanced video.

19. A memory medium for decoding a base layer data-stream and an enhancement layer data-stream, which collectively represent a video, comprising:

code for decoding the base layer data-stream to construct base layer frames;

code for fine granular scalable decoding an SNR quality frame portion of the enhancement layer data-stream to construct SNR quality frames;

code for constructing extended base layer reference frames, each of the extended base layer reference frames constructed from one of the base layer frames and at least a portion of one of the SNR quality frames;

code for motion-compensating the extended base layer reference frames to produce motion-compensated extended base layer reference frames;

code for fine granular scalable decoding a temporal frame portion of the enhancement layer data-stream to construct motion-compensated residual frames;

code for combining the motion-compensated extended base layer reference frames with the motion-compensated residual frames to construct temporal frames.

20. The memory medium according to claim 19, further comprising code for combining the base layer frames and the SNR quality frames into an enhanced video.

21. The memory medium according to claim 19, further comprising code for combining the base layer frames, the SNR quality frames, and the temporal frames into an enhanced video.