Skip modes for inter-layer residual video coding and decoding

• US 8,213,503 B2
• Filed: 09/05/2008
• Issued: 07/03/2012
• Est. Priority Date: 09/05/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Tu, Chengjie, Regunathan, Shankar, Sun, Shijun, Lin, Chih-Lung
• Primary Examiner(s): Pearson, David
• Assistant Examiner(s): HOLMES, ANGELA R
• Application Number:
  US12/205,689
• Publication Number:
  US 20100061447A1
• Time in Patent Office: 1,397 Days
• Field of Search: 375/240.25, 375/240.16, 375/240.13, 375/240.03, 37524011- 15, 375 25- 26, 382/233, 382/236
• US Class Current: 375/240.03
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002

Abstract

Techniques and tools for skip modes in encoding and decoding of inter-layer residual video are described. For example, an encoder encodes multiple macroblocks of a picture of inter-layer residual video. For a current macroblock that is skipped, the encoder selects a skip mode from among multiple available skip modes and uses the selected skip mode when encoding the current macroblock. The skip modes can include intra skip mode and predicted-motion skip mode. A corresponding decoder, for the current macroblock, selects and uses the skip mode for the current macroblock during decoding. As another example, an encoder encodes multiple channels of a picture of inter-layer residual video. For each channel, the encoder determines whether to skip the channel. The encoder signals channel skip information to indicate which channels are skipped. A corresponding decoder parses the channel skip information and determines on a channel-by-channel basis whether to skip the respective channels.

Claims

1. A method of processing inter-layer residual video, the method comprising:

with a computing device implements a video encoder, encoding inter-layer residual video to produce at least part of a bit stream of encoded for the inter-layer residual video, wherein the encoding includes processing plural macroblocks of a current picture of the inter-layer residual video, including, for a current macroblock of the plural macroblocks that is skipped;

selecting a skip mode for the current macroblock that is skipped, wherein the skip mode is selected from among plural available skip modes, including;

determining context information for each of one or more context macroblocks in the current picture around the current macroblock that is skipped; and

determining the skip mode based upon the context information for the one or more context macroblocks; and

using the selected skip mode for the current macroblock that is skipped; and

outputting the at least part of the bit stream, wherein the bit stream of encoded data for the inter-layer residual video includes macroblock skip information indicating which of the plural macroblocks are skipped.

2. The method of claim 1 wherein the plural available skip modes include intra skip mode and predicted-motion skip mode.

3. The method of claim 1 wherein:

the bit stream of encoded data for the inter-layer residual video lacks information indicating the selected skip modes of those of the plural macroblocks that are skipped.

4. The method of claim 1 wherein the context information is macroblock type.

5. The method of claim 1 wherein:

the selecting the skip mode for the current macroblock that is skipped includes selecting between first and second skip modes depending on whether any of the one or more context macroblocks in the current picture use motion compensation;

use of the first skip mode includes performing motion compensation according to motion derived from motion information of the one or more context macroblocks; and

use of the second skip mode includes no motion compensation.

6. The method of claim 1 wherein, for the current macroblock that is skipped, the processing includes:

evaluating, in terms of rate-distortion performance, results of the using the selected skip mode for, the current macroblock that is skipped during the encoding; and

deciding that the current macroblock is skipped.

7. The method of claim 1 wherein the current picture has plural channels, and wherein the method further comprises, as part of the encoding for the current picture:

determining on a channel-by-channel basis whether to skip the plural channels of the current picture; and

in the bit stream, signaling channel skip information indicating which of the plural channels are skipped.

8. The method of claim 2 wherein the selected skip mode for the current macroblock is intra skip mode, and wherein the using the intra skip mode for the current macroblock includes assigning defined intra skip values to the current macroblock.

9. The method of claim 2 wherein the selected skip mode for the current macroblock is the predicted-motion skip mode, and wherein the using the predicted-motion skip mode for the current macroblock includes assigning, to the current macroblock, values of a motion-compensated prediction from a reference picture of the inter-layer residual video.

10. A computer system comprising a processor, memory and storage media having stored thereon computer software for causing the computer system to perform a method comprising:

processing plural macroblocks of a current intra-coded picture of inter-layer residual video, the current intra-coded picture having only intra-coded content encoded without motion compensation, wherein the processing includes, for a current macroblock of the plural macroblocks that is skipped;

selecting intra skip mode for the current macroblock that is skipped; and

using the intra skip mode for the current macroblock that is skipped, including assigning defined intra skip values to the current macroblock that is skipped; and

outputting a result of the processing;

wherein a bit stream of encoded data for the inter-layer residual video includes macroblock skip information indicating which of the plural macroblocks of the current intra-coded picture are skipped.

11. The computer system of claim 10 wherein the defined intra skip values are selected such that any intra-skipped macroblocks of the current intra-coded picture are reconstructed with zero values, and wherein the method further comprises:

receiving at least part of the bit stream;

decoding the inter-layer residual video using the at least part of the bit stream, wherein the decoding includes the processing the plural macroblocks, and wherein the result of the processing is the decoded inter-layer residual video; and

combining the decoded inter-layer residual video with reconstructed base layer video to produce reconstructed video for output.

12. A method of processing inter-layer residual video, the method comprising:

with a computing device that implements a video encoder, encoding inter-layer residual video to produce at least part of a bit stream of encoded data for the inter-layer residual video, wherein the inter-layer residual video is organized as plural channels according to a color space, and wherein the encoding includes processing the plural channels of the inter-layer residual video, including for each of the plural channels;

determining whether to skip the channel of the inter-layer residual video;

if the channel is skipped, processing the channel as skipped; and

if the channel is not skipped, processing the channel as coded;

outputting the at least part of the bit stream, wherein the bit stream of encoded data for the inter-layer residual video includes channel skip information indicating which of the plural channels are skipped.

13. The method claim 12 wherein the determining further comprises, for one of the plural channels that is skipped, selecting a channel skip mode from among plural available channel skip modes, and wherein the channel skip information also indicates the selected channel skip mode.

14. The method of claim 12 wherein, for each of the plural channels in a current picture, the channel skip information includes a code that indicates whether the channel is (a) skipped using defined zero skip values, (b) skipped by copying values of a corresponding channel from a reference picture, or (c) not skipped.

15. The method of claim 12 wherein, for each of the plural channels in a current picture, the channel skip information includes a single bit code that indicates whether the channel is skipped or not skipped.

16. The method of claim 12 wherein the plural channels include a luma channel and plural chroma channels.

17. A computer system comprising a processor, memory and storage media having stored thereon computer software for causing the computer system to perform a method of processing inter-layer residual video, the method comprising:

receiving at least part of a bit stream of encoded data for inter-layer residual video, wherein the bit stream includes macroblock skip information indicating which of plural macroblocks of a current picture of the inter-layer residual video are skipped;

with a computing device that implements a video decoder, decoding the inter-layer residual video, wherein the decoding includes processing the plural macroblocks of the current picture of the inter-layer residual video, including, for a current macroblock of the plural macroblocks that is skipped;

selecting a skip mode for the current macroblock that is skipped, wherein the skip mode is selected from among plural available skip modes, including;

determining context information for each of one or more context macroblocks in the current picture around the current macroblock that is skipped; and

determining the skip mode based upon the context information for the one or more context macroblocks; and

using the selected skip mode for the current macroblock that is skipped; and

combining the decoded inter-layer residual video with reconstructed base layer video to produce reconstructed video for output.

18. The computer system of claim 17 wherein the plural available skip modes include intra skip mode and predicted-motion skip mode.

19. The computer system of claim 17 wherein:

the bit stream of encoded data for the inter-layer residual, video lacks information indicating the selected skip modes of those of the plural macroblocks that are skipped.

20. The computer system of claim 17 wherein the context information is macroblock type.

21. The computer system of claim 17 wherein:

the selecting the skip mode for the current macroblock that is skipped includes selecting between first and second skip modes depending on whether any of the one or more context macroblocks in the current picture use motion compensation;

use of the first skip mode includes performing motion compensation according to motion derived from motion information of the one or more context macroblocks; and

use of the second skip mode includes no motion compensation.

22. The computer system of claim 17 wherein the current picture has plural channels, and wherein the method further comprises, as part of the decoding for the current picture:

from the bit stream, parsing channel skip information indicating which of the plural channels are skipped; and

determining on a channel-by-channel basis whether to skip the plural channels of the current picture.

23. The computer system of claim 18 wherein the selected skip mode for the current macroblock is intra skip mode, and wherein the using the intra skip mode for the current macroblock includes assigning defined intra skip values to the current macroblock.

24. The computer system of claim 18 wherein the selected skip mode for the current macroblock is the predicted-motion skip mode, and wherein the using the predicted-motion skip mode for the current macroblock includes assigning, to the current macroblock, values of a motion-compensated prediction from a reference picture of the inter-layer residual video.

25. A method of processing inter-layer residual video, the method comprising:

receiving at least part of a bit stream of encoded data for inter-layer residual video that is organized as plural channels according to a color space, wherein the bit stream includes channel skip information indicating which of the plural channels are skipped;

with a computing device that implements a video decoder, decoding the inter-layer residual video, wherein the decoding includes processing the plural channels of the inter-layer residual video, including for each of the plural channels;

determining whether to skip the channel of the inter-layer residual video;

if the channel is skipped, processing the channel as skipped; and

if the channel is not skipped, processing the channel as coded; and

combining the decoded inter-layer residual video with reconstructed base layer video to produce reconstructed video for output.

26. The method claim 25 wherein the determining further comprises, for one of the plural channels that is skipped, selecting a channel skip mode from among plural available channel skip modes, and wherein the channel skip information also indicates the selected channel skip mode.

27. The method of claim 25 wherein, for each of the plural channels in a current picture, the channel skip information includes a code that indicates whether the channel is (a) skipped using defined zero skip values, (b) skipped by copying values of a corresponding channel from a reference picture, or (c) not skipped.

28. The method of claim 25 wherein, for each of the plural channels in a current picture, the channel skip information includes a single bit code that indicates whether the channel is skipped or not skipped.

29. The method of claim 25 wherein the plural channels include a luma channel and plural chroma channels.