Multi-resolution video coding and decoding

• US 7,379,496 B2
• Filed: 08/19/2003
• Issued: 05/27/2008
• Est. Priority Date: 09/04/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lin, Chih-Lung Bruce, Srinivasan, Sridhar, Regunathan, Shankar, Holcomb, Thomas W.
• Primary Examiner(s): Vo; Tung
• Assistant Examiner(s): SENFI, BEHROOZ M
• Application Number:
  US10/644,258
• Publication Number:
  US 20040213345A1
• Time in Patent Office: 1,743 Days
• Field of Search: 348/581, 348/448, 348/458, 348/714, 348/716, 348/443, 348/445, 348/446, 348/459, 348/721, 348/401, 348/402, 348/409, 348/410, 348/413, 348/415, 348/416, 348/420, 348/421, 348/424.1, 348/392, 348/397, 348/565, 348/566, 348/567, 348/568, 348/423, 348/555, 348/556, 375/240.02, 375/240.03, 375/240.01, 375/240.24, 375/240.21, 375/240.12, 375/240.16, 375/240.15, 375/240.29, 382/261, 382/262, 382/263, 382/264, 382/232, 382/239, 382/240
• US Class Current: 375/240.03
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

A video encoder performs multi-resolution video coding. For example, the encoder adaptively changes frame sizes to reduce blocking artifacts at low bitrates. A video decoder performs corresponding multi-resolution decoding.

Claims

1. A method for decoding a bitstream for a sequence of video frames, the method comprising:

receiving and processing first information for the sequence, wherein the first information indicates whether multiple spatial resolution coding is enabled for the sequence;

determining the first information indicates that multiple spatial resolution coding is enabled for the sequence, and then for each of plural frames in the sequence,

receiving and processing second information at frame level in the bitstream, the second information indicating one or more spatial resolution scaling factors for the frame; and

outputting a result of the processing;

wherein the plural frames comprise at least one I-frame and at least one P-frame, wherein each of the at least one P-frame has a reference I-frame among the at least one I-frame, and wherein for each of the at least one P-frame the one or more spatial resolution scaling factors are constrained to be identical to the one or more spatial resolution scaling factors for the reference I-frame for that P-frame.

2. The method of claim 1 wherein the one or more spatial resolution scaling factors are determined adaptively based at least in part on bitrate criteria.

3. The method of claim 1 wherein the one or more spatial resolution scaling factors are determined adaptively based at least in part on high-frequency content criteria.

4. The method of claim 1 wherein the one or more spatial resolution scaling factors are determined adaptively based at least in part on quantization step size criteria.

5. The method of claim 1 wherein the second information is a fixed-length code.

6. The method of claim 5 wherein the fixed-length code is a 2-bit code that represents 4 possible states of the one or more spatial resolution scaling factors.

7. The method of claim 1 wherein the second information is a variable-length code.

8. The method of claim 1 wherein the first information is signaled in a sequence header.

9. The method of claim 8 wherein the first information is a 1-bit code in the sequence header.

10. The method of claim 1 further comprising:

receiving and processing third information in the bitstream, the third information indicating a selected re-sampling filter.

11. The method of claim 1 wherein the one or more spatial resolution scaling factors comprise a vertical spatial resolution scaling factor and a horizontal spatial resolution scaling factor.

12. The method of claim 11 wherein the vertical spatial resolution scaling factor differs from the horizontal spatial resolution scaling factor.

13. The method of claim 11 wherein the vertical spatial resolution scaling factor is selected from a set of vertical spatial resolutions comprising full resolution and half resolution.

14. The method of claim 11 wherein the horizontal spatial resolution scaling factor is selected from a set of horizontal spatial resolutions comprising full resolution and half resolution.

15. The method claim 1 further comprising:

decoding the plural frames with multiple spatial resolution decoding according to the spatial resolution scaling factors indicated by the second information;

displaying the plural frames.

16. The method of claim 15 wherein the decoding with multiple spatial resolution decoding comprises:

decoding a current frame of the plural frames encoded at a reduced spatial resolution; and

after decoding the current frame, up-sampling the current frame, wherein the up-sampling yields a full-resolution decoded frame.

17. The method of claim 16 wherein the up-sampling comprises applying a 10-tap filter to the decoded current frame.

18. The method of claim 16 wherein the displayed current frame at the reduced spatial resolution comprises reduced blocking artifacts.

19. A method of encoding a bitstream for a sequence of video frames, the bitstream having plural levels, the method comprising:

outputting first information for the sequence, the first information indicating whether multiple spatial resolution coding is enabled for the sequence; and

determining that multiple spatial resolution coding is enabled for the sequence, and then for each of plural frames in the sequence;

outputting second information at frame level in the bitstream, the second information indicating one or more spatial resolution scaling factors for the frame;

wherein the plural frames comprise at least one I-frame and at least one P-frame, wherein each of the at least one P-frame has a reference I-frame among the at least one I-frame, and wherein for each of the at least one P-frame the one or more spatial resolution scaling factors are constrained to be identical to the one or more spatial resolution scaling factors for the reference I-frame for that P-frame.

20. The method of claim 19 wherein the second information is a fixed-length code.

21. The method of claim 20 wherein the fixed-length code is a 2-bit code that represents 4 possible states of the one or more spatial resolution scaling factors.

22. The method of claim 19 wherein the second information is a variable-length code.

23. The method of claim 19 wherein the first information is signaled in a sequence header.

24. The method of claim 23 wherein the first information is a 1-bit code in the sequence header.

25. The method of claim 19 further comprising:

outputting third information in the bitstream, the third information indicating a selected re-sampling filter.

26. The method of claim 19 wherein the one or more spatial resolution scaling factors comprise a vertical spatial resolution scaling factor and a horizontal spatial resolution scaling factor.

27. The method of claim 26 wherein the vertical spatial resolution scaling factor differs from the horizontal spatial resolution scaling factor.

28. The method of claim 26 wherein the vertical spatial resolution scaling factor is selected from a set of vertical spatial resolutions comprising full resolution and half resolution.

29. The method of claim 26 wherein the horizontal spatial resolution scaling factor is selected from a set of horizontal spatial resolutions comprising full resolution and half resolution.

30. The method of claim 19 wherein the one or more spatial resolution scaling factors are determined adaptively based at least in part on bitrate criteria.

31. The method of claim 19 wherein the one or more spatial resolution scaling factors are determined adaptively based at least in part on high-frequency content criteria.

32. The method of claim 19 wherein the one or more spatial resolution sealing factors are determined adaptively based at least in part on quantization step size criteria.

33. The method of claim 19 further comprising:

encoding the plural frames with multiple spatial resolution coding according to the spatial resolution scaling factors indicated by the second information.

34. The method of claim 33 further comprising:

down-sampling a current frame of the plural frames, wherein the down-sampling yields a reduced-resolution frame.

35. The method of claim 34 wherein the down-sampling comprises applying a 6-tap filter to the current frame.

36. The method of claim 34 wherein the down-sampling comprises down-sampling in a horizontal direction prior to down-sampling in a vertical direction.

37. The method of claim 19 wherein a current frame of the plural frames includes plural lines, and wherein the multiple spatial resolution coding for the current frame includes adjusting number of samples in each of the plural lines so the number is a macroblock multiple.

38. A system comprising:

means for receiving and processing first information in a bitstream for a sequence of video frames, wherein the first information indicates whether multiple spatial resolution coding is enabled for the sequence;

means for receiving and processing second information at frame level in the bitstream for each of plural frames in the sequence if the first information indicates that multiple spatial resolution coding is enabled for the sequence, the second information indicating one or more spatial resolution scaling factors, wherein the plural frames comprise at least one I-frame and at least one P-frame, wherein each of the at least one P-frame has a reference I-frame among the at least one I-frame, and wherein for each of the at least one P-frame the one or more spatial resolution scaling factors are constrained to be identical to the one or more spatial resolution scaling factors for the reference I-frame for that P-frame; and

means for outputting a result of the processing.

39. A system comprising:

means for outputting first information in a bitstream for a sequence of video frames, the first information indicating whether multiple spatial resolution coding is enabled for the sequence; and

means for outputting for each of plural frames in the sequence second information at frame level in the bitstream if the first information indicates that multiple spatial resolution coding is enabled for the sequence, the second information indicating one or more spatial resolution scaling factors for the frame, wherein the plural frames comprise at least one I-frame and at least one P-frame, wherein each of the at least one P-frame has a reference I-frame among the at least one I-frame, and wherein for each of the at least one P-frame the one or more spatial resolution scaling factors are constrained to be identical to the one or more spatial resolution scaling factors for the reference I-frame for that P-frame.