Adaptive vertical macroblock alignment for mixed frame video sequences

• US 7,839,933 B2
• Filed: 10/06/2004
• Issued: 11/23/2010
• Est. Priority Date: 10/06/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lin, Chih-Lung, Srinivasan, Sridhar, Hsu, Pohsiang, Holcomb, Thomas W.
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US10/960,380
• Publication Number:
  US 20060072668A1
• Time in Patent Office: 2,239 Days
• Field of Search: None
• US Class Current: 375/240.24
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 7/012 Conversion between an interlaced and a progressive signal for graphics images G09G2310/0229

Abstract

A video codec provides for adaptive vertical macroblock alignment of mixed interlaced and progressive video sequences. With adaptive vertical macroblock alignment, a video codec enforces a macroblock alignment height restriction on per picture basis, rather than requiring that all frames in a sequence adhere to a uniform height restriction. The video codec can then apply less padding to progressive and like type pictures that have smaller macroblock alignment increments, than to interlaced type pictures with larger alignment increments, which can save significant compression overhead.

Claims

1. A method of decoding video using a video decoder, the method comprising:

with the video decoder, reading an indication from a compressed video bit stream whether a video sequence encoded in the bit stream contains at least some interlaced video content;

with the video decoder, reading one or more coded size syntax elements from the bit stream, the one or more coded size syntax elements indicating a coded height of plural frames in the video sequence;

if the video sequence contains at least some interlaced video content, with the video decoder, for each of the plural frames;

reading a mode syntax element for the frame from the bit stream, the mode syntax element indicating one of plural coding modes for the frame, the plural coding modes including;

coded in the bit stream as a frame of progressive video,

coded in the bit stream as a frame of interlaced video, and

coded in the bit stream as two separate fields of interlaced video; and

decoding video content of the frame, wherein the frame has a macroblock-aligned vertical size that depends on the coding mode of the frame, and wherein depending on the coding mode the macroblock-aligned vertical size can vary between the plural frames that have the coded height of the plural frames; and

otherwise, with the video decoder, decoding the video content of the plural frames in the video sequence.

2. The method of claim 1, wherein, when the video sequence contains at least some interlaced video content:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, in terms of pixels the macroblock-aligned vertical size of the frame is restricted to be a multiple of 16 pixels; and

if the frame is coded as two separate fields of interlaced video, in terms of pixels the macroblock-aligned vertical size of the frame is restricted to be a multiple of 32 pixels.

3. The method of claim 1, wherein, when the video sequence contains at least some interlaced video content:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, the macroblock-aligned vertical size of the frame is restricted to have a first macroblock-aligned vertical size increment; and

if the frame is coded as two separate fields of interlaced video, the macroblock-aligned vertical size of the frame is restricted to have a second macroblock-aligned vertical size increment different than the first macroblock-aligned vertical size increment.

4. The method of claim 1, wherein, for each of the plural frames, the decoding the frame comprises:

reconstructing macroblocks of the frame to the macroblock-aligned vertical size and a macroblock-aligned horizontal size; and

excluding content of the frame that is outside an area defined by the coded height and a coded width of the frame.

5. The method of claim 1, wherein the one or more coded size syntax elements include a maximum coded width syntax element and a maximum coded height syntax element for the video sequence that includes the plural frames.

6. The method of claim 5, wherein the one or more coded size syntax elements further include a coded width syntax element and a coded height syntax element for an entry point segment within the video sequence, the entry point segment including the plural frames, wherein syntax of the bit stream permits coded width and coded height for the entry point segment to be different from maximum coded width and maximum coded height, respectively, for the video sequence.

7. The method of claim 1, wherein the coded height of the plural frames is restricted to be a multiple of 2 pixels, and wherein, for each of the plural frames:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, in terms of pixels the macroblock-aligned vertical size is restricted to be a multiple of 16 pixels; and

if the frame is coded as two separate fields of interlaced video, in terms of pixels the macroblock-aligned vertical size is restricted to be a multiple of 32 pixels.

8. The method of claim 1, wherein:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, macroblock height for the frame is the integer part of (the coded height+15)/16; and

if the frame is coded as two separate fields of interlaced video, macroblock height per field of the frame is the integer part of (the coded height+31)/32.

9. A computing device comprising:

a processor;

memory; and

computer-readable storage that stores computer-executable instructions for causing the computing device to perform a method of decoding video comprising;

reading an indication from a compressed video bit stream whether a video sequence encoded in the bit stream contains at least some interlaced video content;

reading one or more coded size syntax elements from the bit stream, the one or more coded size syntax elements indicating a coded height of plural frames in the video sequence;

if the video sequence contains at least some interlaced video content, for each of the plural frames;

reading a mode syntax element for the frame from the bit stream, the mode syntax element indicating one of plural coding modes for the frame, the plural coding modes including (1) coded in the bit stream as a frame of progressive video, (2) coded in the bit stream as a frame of interlaced video, and (3) coded in the bit stream as two separate fields of interlaced video; and

decoding video content of the frame, wherein the frame has a macroblock-aligned vertical size that depends on the coding mode of the frame, and wherein depending on the coding mode the macroblock-aligned vertical size can vary between the plural frames that have the coded height of the plural frames; and

otherwise, decoding the video content of the plural frames in the video sequence.

10. The computing device of claim 9, wherein, when the video sequence contains at least some interlaced video content:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, in terms of pixels the macroblock-aligned vertical size of the frame is restricted to be a multiple of 16 pixels; and

if the frame is coded as two separate fields of interlaced video, in terms of pixels the macroblock-aligned vertical size of the frame is restricted to be a multiple of 32 pixels.

11. The computing device of claim 9, wherein, when the video sequence contains at least some interlaced video content:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, the macroblock-aligned vertical size of the frame is restricted to have a first macroblock-aligned vertical size increment; and

if the frame is coded as two separate fields of interlaced video, the macroblock-aligned vertical size of the frame is restricted to have a second macroblock-aligned vertical size increment different than the first macroblock-aligned vertical size increment.

12. The computing device of claim 9, wherein, for each of the plural frames, the decoding the frame comprises:

reconstructing macroblocks of the frame to the macroblock-aligned vertical size and a macroblock-aligned horizontal size; and

excluding content of the frame that is outside an area defined by the coded height and a coded width of the frame.

13. The computing device of claim 9, wherein the one or more coded size syntax elements include a maximum coded width syntax element and a maximum coded height syntax element for the video sequence that includes the plural frames.

14. The computing device of claim 13, wherein the one or more coded size syntax elements further include a coded width syntax element and a coded height syntax element for an entry point segment within the video sequence, the entry point segment including the plural frames, wherein syntax of the bit stream permits coded width and coded height for the entry point segment to be different from maximum coded width and maximum coded height, respectively, for the video sequence.

15. The computing device of claim 9, wherein the coded height of the plural frames is restricted to be a multiple of 2 pixels, and wherein, for each of the plural frames:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, in terms of pixels the macroblock-aligned vertical size is restricted to be a multiple of 16 pixels; and

if the frame is coded as two separate fields of interlaced video, in terms of pixels the macroblock-aligned vertical size is restricted to be a multiple of 32 pixels.

16. The computing device of claim 9, wherein:

if the frame is coded as a frame of progressive video or coded as a frame of interlaced video, macroblock height for the frame is the integer part of (the coded height+15)/16; and

if the frame is coded as two separate fields of interlaced video, macroblock height per field of the frame is the integer part of (the coded height+31)/32.