Intensity estimation/compensation for interlaced forward-predicted fields

• US 8,009,739 B2
• Filed: 09/02/2004
• Issued: 08/30/2011
• Est. Priority Date: 09/07/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Srinivasan, Sridhar, Regunathan, Shankar, Holcomb, Thomas W.
• Primary Examiner(s): Patel; Jay Au
• Assistant Examiner(s): TORRENTE, RICHARD T
• Application Number:
  US10/933,907
• Publication Number:
  US 20050053155A1
• Time in Patent Office: 2,553 Days
• Field of Search: 375/240.25, 375/240.23
• US Class Current: 375/240.25
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/16 for a given display mode, e.g. for interlaced or progressive display mode
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Techniques and tools for intensity compensation for interlaced forward-predicted fields are described. For example, a video decoder receives and decodes a variable length code that indicates which of two reference fields for an interlaced forward-predicted field use intensity compensation (e.g., both, only the first, or only the second). The decoder performs intensity compensation on each of the two reference fields that uses intensity compensation. A video encoder performs corresponding intensity estimation/compensation and signaling.

Claims

1. A computer-implemented method for transforming encoded video information using a video decoder, the method comprising:

with the video decoder;

receiving encoded video information in a bitstream;

decoding, from the encoded video information in the bitstream, a syntax element indicating an entire interlaced forward-predicted field has two reference fields rather than a single reference field;

decoding, from the encoded video information in the bitstream, a variable length code that represents information indicating which of the two reference fields for the interlaced forward-predicted field use intensity compensation, wherein the information indicates whether both, only the first, or only the second of the two reference fields use intensity compensation, and wherein the variable length code is signaled at field level for the interlaced forward-predicted field;

performing intensity compensation on at least part of each of the two reference fields that uses intensity compensation, wherein the performing intensity compensation comprises adjusting plural pixel values in each of the two reference fields that uses intensity compensation based at least in part on intensity compensation parameters; and

performing motion compensation for one or more parts of the interlaced forward-predicted field relative to the two reference fields after the adjustment for the intensity compensation, wherein both, only the first, or only the second of the two reference fields used in the motion compensation has pixel values adjusted for intensity compensation.

2. The method of claim 1 further comprising decoding, from the encoded video information in the bitstream, the intensity compensation parameters separately for each of the two reference fields that uses intensity compensation.

3. The method of claim 1 further comprising, before decoding the variable length code, decoding one or more syntax elements indicating intensity compensation is used for at least one reference field for the interlaced forward-predicted field.

4. The method of claim 1 wherein the one or more parts of the interlaced forward-predicted field are one or more macroblocks or blocks of the interlaced forward-predicted field.

5. The method of claim 1 wherein, for each of the two reference fields that uses intensity compensation, the adjustment of the plural pixel values of the reference field includes shifting and/or scaling the plural pixel values of the reference field according to the intensity compensation parameters.

6. The method of claim 1 further comprising:

decoding, from the encoded video information in the bitstream, a first set of the intensity compensation parameters for one of the two reference fields, wherein the first set of the intensity compensation parameters is for the second of the two reference fields if only the second of the two reference fields uses intensity compensation but otherwise the first set of the intensity compensation parameters is for the first of the two reference fields; and

if both of the two reference fields use intensity compensation, decoding, from the encoded video information in the bitstream, a second set of the intensity compensation parameters for the second of the two reference fields.

7. The method of claim 1 wherein the encoded video information is received over a wireless network connection, the method further comprising:

outputting, on a display, pictures decoded from the encoded video information.

8. A video decoder comprising:

a processor;

memory; and

storage storing computer-executable instructions implementing;

means for decoding a syntax element indicating an entire interlaced forward-predicted field has two reference fields rather than a single reference field;

means for decoding a variable length code to determine which of the two reference fields use intensity compensation for the interlaced forward-predicted field, wherein the variable length code indicates whether both, only the first, or only the second of the two reference fields use intensity compensation, and wherein the variable length code is signaled at field level for the interlaced forward-predicted field;

means for performing intensity compensation on at least part of either one or both of the two reference fields that use intensity compensation, wherein the performing intensity compensation comprises adjusting plural pixel values in each of the two reference fields that use intensity compensation based at least in part on intensity compensation parameters; and

means for performing motion compensation for one or more parts of the interlaced forward-predicted field relative to the two reference fields after the adjustment for the intensity compensation, wherein both, only the first, or only the second of the two reference fields used in the motion compensation has pixel values adjusted for intensity compensation.

9. The decoder of claim 8 wherein the means for performing intensity compensation applies different intensity compensation parameters to each of the two reference fields.

10. The video decoder of claim 8 further comprising:

a wireless network connection; and

a display.

11. A computer-implemented method for transforming video information using a video encoder, the method comprising:

with the video encoder;

determining that an interlaced forward-predicted field has two reference fields rather than a single reference field;

signaling, in an output bitstream, a one-bit code indicating that the entire interlaced forward-predicted field has two reference fields;

determining whether to perform intensity compensation for each of the two reference fields of the interlaced forward-predicted field;

performing intensity compensation on at least part of each of the two reference fields that are determined to use intensity compensation, wherein the performing intensity compensation comprises adjusting plural pixel values in each of the two reference fields that are determined to use intensity compensation based at least in part on intensity compensation parameters;

performing motion compensation for one or more parts of the interlaced forward-predicted field relative to the two reference fields after the adjustment for the intensity compensation, wherein both, only the first, or only the second of the two reference fields used in the motion compensation has pixel values adjusted for intensity compensation;

coding a variable length code that represents information indicating which of the two reference fields for the interlaced forward-predicted field use intensity compensation, wherein the information indicates whether both, only the first, or only the second of the two reference fields use intensity compensation; and

signaling the variable length code in the output bitstream, wherein the variable length code is signaled at field level for the interlaced forward-predicted field.

12. The method of claim 11 wherein the performing intensity compensation comprises estimating the intensity compensation parameters separately for each of the two reference fields that uses intensity compensation, the method further comprising:

signaling the intensity compensation parameters in the output bitstream.

13. The method of claim 11 wherein the performing intensity compensation comprises detecting fading on each of the two reference fields;

and

signaling whether fading compensation is on or off for the forward-predicted field.

14. The method of claim 11 wherein, for each of the two reference fields of the interlaced forward-predicted field, the determining whether to perform the intensity compensation includes evaluating differences between versions of the reference field and the interlaced forward-predicted field using a metric that is based at least in part on sum of absolute errors of the differences, sum of squared errors of the differences or mean squared error of the differences.

15. The method of claim 11 wherein, for each of the two reference fields of the interlaced forward-predicted field, the determining whether to perform the intensity compensation includes evaluating differences between versions of the reference field and the interlaced forward-predicted field using a metric but ignoring motion between the reference field and the interlaced forward-predicted field.

16. The method of claim 11 further comprising, for each of the two reference fields that is determined to use intensity compensation, determining a set of the intensity compensation parameters for the reference field using statistical analysis.