Digital video signal encoder and encoding method

• US 6,115,420 A
• Filed: 05/05/1997
• Issued: 09/05/2000
• Est. Priority Date: 03/14/1997
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Albert S.
• Primary Examiner(s): BRITTON, HOWARD W
• Application Number:
  US08/841,838
• Time in Patent Office: 1,219 Days
• Field of Search: 348/407, 348/405, 348/409, 348/411, 348/412, 348/415, 348/420, 348/384, 348/399, 375/10, 375/240
• US Class Current: 375/240.03
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/19 using optimisation based on Lagrange multipliers

Abstract

A motion video signal encoder maximizes image quality without exceeding transmission bandwidth available to carry the encoded motion video signal by comparing encoded frames of the motion video signal to a desired size of frame. If the size of encoded frames differ from the desired size, encoding is adjusted to produce encoded frames closer in size to the desired size. In addition, a cumulative bandwidth error records an accumulated amount of available bandwidth. The cumulative bandwidth error is adjusted as time elapses to add to the available bandwidth and as each frame is encoded to thereby consume bandwidth. As the cumulative bandwidth error grows in magnitude above or below zero, encoding is adjusted as needed to either improve image quality to more completely consume available bandwidth or to reduce image quality to thereby consume less bandwidth and to thereby cause the cumulative bandwidth error to move toward zero. Rapid changes in the amount of change or motion in the motion video signal are detected by comparing the amount of change between two consecutive frames and filtering the amount of change with previously measured amounts of change. Encoding is pre-compensated according to the filtered measurement of rapid change.

Claims

1. A method for encoding a motion video signal, the method comprising:

initializing a cumulative bandwidth error record which stores data representing accumulated deviation of consume bandwidth from available bandwidth;

encoding a first frame of the motion video signal to form an encoded frame;

determining a consumed bandwidth of the encoded frame;

adjusting the cumulative bandwidth error record according to the consumed bandwidth;

adjusting an encoding parameter such that encoding subsequent frames of the motion video signal according to the encoding parameter as adjusted consumes bandwidth in a manner which compensates for a deviation from zero by the cumulative bandwidth error record;

encoding a second frame of the motion video signal according to the encoding parameter as adjusted, a distortion factor and a rate; and

wherein the distortion factor represents a distortion of a particular block of the second frame and the rate represents an amount of data required to encode the block.

2. The method of claim 1 wherein the second frame is subsequent to the first frame in the motion video signal.

3. The method of claim 1 wherein the step of adjusting the encoding parameter comprises:

determining that the cumulative bandwidth error record represents a non-positive cumulative bandwidth error; and

increasing the encoding parameter by an amount which is proportional to the cumulative bandwidth error to decrease bandwidth consumed by encoding of subsequent frames of the motion video signal.

4. The method of claim 1 wherein the step of adjusting the cumulative bandwidth error record comprises:

adding to the cumulative bandwidth error record an amount of available bandwidth which is available for the encoded frame; and

subtracting from the cumulative bandwidth error record an amount of consumed bandwidth which is consumed by the encoded frame.

5. The method of claim 4 wherein the amount of available bandwidth is the amount of bandwidth available for a time difference between the first frame and a preceding frame.

6. The method of claim 1 wherein the step of adjusting the encoding parameter comprises:

determining that the cumulative bandwidth error record represents a non-negative cumulative bandwidth error; and

decreasing the encoding parameter by an amount which is proportional to the cumulative bandwidth error to increase bandwidth consumed by encoding of subsequent frames of the motion video signal.

7. The method of claim 6, wherein the amount to decrease the encoding parameter by is reduced by a damping factor.

8. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to encode a motion video signal by performing the steps of:

initializing a cumulative bandwidth error record which stores data representing accumulated deviation of consume bandwidth from available bandwidth;

encoding a first frame of the motion video signal to form an encoded frame;

determining a consumed bandwidth of the encoded frame;

adjusting the cumulative bandwidth error record according to the consumed bandwidth;

adjusting an encoding parameter such that encoding subsequent frames of the motion video signal according to the encoding parameter as adjusted consumes bandwidth in a manner which compensates for a deviation from zero by the cumulative bandwidth error record; and

encoding a second frame of the motion video signal according to the encoding parameter as adjusted and a dampening factor.

9. The computer readable medium of claim 8 wherein the step of adjusting the cumulative bandwidth error record comprises:

adding to the cumulative bandwidth error record an amount of available bandwidth which is available for the encoded frame; and

subtracting from the cumulative bandwidth error record an amount of consumed bandwidth which is consumed by the encoded frame.

10. The computer readable medium of claim 9 wherein the amount of available bandwidth is the amount of bandwidth available for a time difference between the first frame and a preceding frame.

11. The computer readable medium of claim 8 wherein the second frame is subsequent to the first frame in the motion video signal.

12. The computer readable medium of claim 8 wherein the step of adjusting the encoding parameter comprises:

determining that the cumulative bandwidth error record represents a non-negative cumulative bandwidth error; and

decreasing the encoding parameter by an amount which is proportional to the cumulative bandwidth error to increase bandwidth consumed by encoding of subsequent frames of the motion video signal.

13. The computer readable medium of claim 8 wherein the step of adjusting the encoding parameter comprises:

determining that the cumulative bandwidth error record represents a non-positive cumulative bandwidth error; and

increasing the encoding parameter by an amount which is proportional to the cumulative bandwidth error to decrease bandwidth consumed by encoding of subsequent frames of the motion video signal.

14. A computer system comprising:

a processor;

memory operatively coupled to the processor; and

a motion video signal encoder which executes in the processor from the memory and which, when executed by the processor, causes the computer to encode a motion video signal by;

initializing a cumulative bandwidth error record which stores data representing accumulated deviation of consume bandwidth from available bandwidth;

encoding a first frame of the motion video signal to form an encoded frame;

determining a consumed bandwidth of the encoded frame;

adjusting the cumulative bandwidth error record according to the consumed bandwidth;

adjusting an encoding parameter such that encoding subsequent frames of the motion video signal according to the encoding parameter as adjusted consumes bandwidth in a manner which compensates for a deviation from zero by the cumulative bandwidth error record; and

encoding a second frame of the motion video signal according to the encoding parameter as adjusted and a distortion factor.

15. The computer system of claim 14 wherein the step of adjusting the cumulative bandwidth error record comprises:

adding to the cumulative bandwidth error record an amount of available bandwidth which is available for the encoded frame; and

subtracting from the cumulative bandwidth error record an amount of consumed bandwidth which is consumed by the encoded frame.

16. The computer system of claim 15 wherein the amount of available bandwidth is the amount of bandwidth available for a time difference between the first frame and a preceding frame.

17. The computer system of claim 14 wherein the second frame is subsequent to the first frame in the motion video signal.

18. The computer system of claim 14 wherein the step of adjusting the encoding parameter comprises:

determining that the cumulative bandwidth error record represents a non-negative cumulative bandwidth error; and

decreasing the encoding parameter by an amount which is proportional to the cumulative bandwidth error to increase bandwidth consumed by encoding of subsequent frames of the motion video signal.

19. The computer system of claim 14 wherein the step of adjusting the encoding parameter comprises:

determining that the cumulative bandwidth error record represents a non-positive cumulative bandwidth error; and

increasing the encoding parameter by an amount which is proportional to the cumulative bandwidth error to decrease bandwidth consumed by encoding of subsequent frames of the motion video signal.