Motion video signal encoder and encoding method

• US 7,154,951 B2
• Filed: 03/16/2004
• Issued: 12/26/2006
• Est. Priority Date: 03/14/1997
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Albert S.
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US10/803,070
• Publication Number:
  US 20040184535A1
• Time in Patent Office: 1,015 Days
• Field of Search: 375/240.12, 375/240.02, 375/240.03, 375/240.05, 375/240.22, 348/405.1, 348/407.1, 348/409.1, 348/411.1, 348/412.1, 348/415.1, 348/439.1, 348/384, 348/390, 348/400.1, 348/401.1, 348/416.1, 348/419.1, 382/232, 382/236, 382/238, 382/251
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/19 using optimisation based on Lagrange multipliers

Abstract

A motion video signal encoder maximizes image quality without exceeding transmission bandwidth available to carry the encoded motion video signal by comparing encoded frames of the motion video signal to a desired size of frame. If the size of encoded frames differ from the desired size, encoding is adjusted to produce encoded frames closer in size to the desired size. In addition, a cumulative bandwidth error records an accumulated amount of available bandwidth. The cumulative bandwidth error is adjusted as time elapses to add to the available bandwidth and as each frame is encoded to thereby consume bandwidth. As the cumulative bandwidth error grows in magnitude above or below zero, encoding is adjusted as needed to either improve image quality to more completely consume available bandwidth or to reduce image quality to thereby consume less bandwidth and to thereby cause the cumulative bandwidth error to move toward zero. Rapid changes in the amount of change or motion in the motion video signal are detected by comparing the amount of change between two consecutive frames and filtering the amount of change with previously measured amounts of change. Encoding is pre-compensated according to the filtered measurement of rapid change.

Claims

1. A method for encoding a motion video signal, the method comprising:

determining a desired size for a first frame of the motion video signal;

encoding the first frame of the motion video signal to form an encoded frame;

determining an encoded size of the encoded frame;

comparing the encoded size to the desired size;

adjusting an encoding parameter such that encoding the first frame according to the encoding parameter as adjusted would form a different encoded frame having a size closer to the desired size than the encoded size is to the desired size; and

wherein the adjusting employs first and second adjustment mechanisms, the first adjustment mechanism comprising a pre-compensator and the second adjustment mechanism comprises a first encoding adjuster and a second encoding adjuster that is based at least in part on a damping factor which reduces overcorrection of the encoding parameter; and

encoding a second frame of the motion video signal according to the encoding parameter as adjusted.

2. The method of claim 1 wherein the second frame is subsequent to the first frame in the motion video signal.

3. The method of claim 1 where in the encoding parameter is a numerical representation of a compromise between consumed bandwidth and image quality of the motion video signal as encoded.

4. The method of claim 1 wherein the step of adjusting comprises:

determining a difference between the encoded size and the desired size; and

adjusting the encoding parameter by an amount which is proportional to the difference.

5. A computer readable medium comprising instructions which, when executed by a computer, performs the method of claim 1.

6. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium having computer instructions stored thereon which are configured to cause the computer to encode a motion video signal by performing the steps of:

determining a desired size for a first frame of the motion video signal;

encoding the first frame of the motion video signal to form an encoded frame;

determining an encoded size of the encoded frame;

comparing the encoded size to the desired size;

adjusting an encoding parameter such that encoding the first frame according to the encoding parameter as adjusted would form a different encoded frame having a size closer to the desired size than the encoded size is to the desired size; and

wherein the adjusting employs first and second adjustment mechanisms, the first adjustment mechanism comprising a pre-compensator and the second adjustment mechanism comprises a first encoding adjuster and a second encoding adjuster that is based at least in part on a damping factor which reduces overcorrection of the encoding parameter; and

encoding a second frame of the motion video signal according to the encoding parameter as adjusted.

7. The computer readable medium of claim 6 wherein the second frame is subsequent to the first frame in the motion video signal.

8. The computer readable medium of claim 6 where the encoding parameter is a numerical representation of a compromise between consumed bandwidth and image quality of the motion video signal as encoded.

9. The computer readable medium of claim 6 wherein the step of adjusting comprises:

determining a difference between the encoded size and the desired size; and

adjusting the encoding parameter by an amount which is proportional to the difference.

10. A computer system comprising:

a processor;

a memory operatively coupled to the processor; and

a motion video signal encoder which executes in the processor from the memory and which, when executed by the processor, causes the computer to encode a motion video signal by performing the steps of;

determining a desired size for a first frame of the motion video signal;

encoding the first frame of the motion video signal to form an encoded frame;

determining an encoded size of the encoded frame;

comparing the encoded size to the desired size;

adjusting an encoding parameter such that encoding the first frame according to the encoding parameter as adjusted would form a different encoded frame having a size closer to the desired size than the encoded size is to the desired size; and

wherein the adjusting employs first and second adjustment mechanisms, the first adjustment mechanism comprising a pre-compensator and the second adjustment mechanism comprises a first encoding adjuster and a second encoding adjuster that is based at least in part on a damping factor which reduces overcorrection of the encoding parameter; and

encoding a second frame of the motion video signal according to the encoding parameter as adjusted.

11. The computer system of claim 10 wherein the second frame is subsequent to the first frame in the motion video signal.

12. The computer system of claim 10 where in the encoding parameter is a numerical representation of a compromise between consumed bandwidth and image quality of the motion video signal as encoded.

13. The computer system of claim 10 wherein the step of adjusting comprises:

determining a difference between the encoded size and the desired size; and

adjusting the encoding parameter by an amount which is proportional to the difference.

14. A method, comprising:

determining a desired size for a first frame of a motion video signal;

encoding the first frame of the motion video signal to form an encoded frame;

determining an encoded size of the encoded frame;

comparing the encoded size to the desired size;

adjusting an encoding parameter such that encoding the first frame according to the encoding parameter as adjusted would form a different encoded frame having a size closer to the desired size than the encoded size is to the desired size, and wherein the adjusting employs first and second adjustment mechanisms, the first adjustment mechanism comprising a pre-compensator and the second adjustment mechanism comprising a first encoding adjuster and a second different encoding adjuster; and

encoding a second frame of the motion video signal according to the encoding parameter as adjusted.

15. The method of claim 14, wherein the pre-compensator is operable to adjust the encoding parameter based on a degree of change between the first frame and the second frame, and the first encoding adjuster comprises a primary open loop rate control adjuster and the second encoding adjuster comprises a secondary closed loop rate control adjuster, and wherein a higher weight is given to the secondary closed loop rate control adjuster.

16. The method of claim 15, wherein the degree of change comprises an absolute pixel difference between the first and second frames.