Digital video signal encoder and encoding method

• US 6,707,852 B1
• Filed: 08/31/2000
• Issued: 03/16/2004
• Est. Priority Date: 03/14/1997
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Albert S.
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US09/653,124
• Time in Patent Office: 1,293 Days
• Field of Search: H04/N.712, 375/240.12, 348/700
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/19 using optimisation based on Lagrange multipliers

Abstract

A motion video signal encoder maximizes image quality without exceeding transmission bandwidth available to carry the encoded motion video signal by comparing encoded frames of the motion video signal to a desired size of frame. If the size of encoded frames differ from the desired size, encoding is adjusted to produce encoded frames closer in size to the desired size. In addition, a cumulative bandwidth error records an accumulated amount of available bandwidth. The cumulative bandwidth error is adjusted as time elapses to add to the available bandwidth and as each frame is encoded to thereby consume bandwidth. As the cumulative bandwidth error grows in magnitude above or below zero, encoding is adjusted as needed to either improve image quality to more completely consume available bandwidth or to reduce image quality to thereby consume less bandwidth and to thereby cause the cumulative bandwidth error to move toward zero. Rapid changes in the amount of change or motion in the motion video signal are detected by comparing the amount of change between two consecutive frames and filtering the amount of change with previously measured amounts of change. Encoding is pre-compensated according to the filtered measurement of rapid change.

Claims

1. A method for encoding a motion video signal, the method comprising:

comparing first and second frames of the motion video signal to one another;

determining whether the second frame represents a scene change in a motion video image represented by the motion video image by;

measuring a difference between the first and second frames;

filtering the difference with a previously filtered difference to form a filtered difference;

comparing the filtered difference to a threshold;

determining that the second frame represents the scene change if the filtered difference is greater than the threshold; and

determining that the second frame does not represent the scene change if the filtered difference is not greater than the threshold;

encoding the second frame as an independent frame upon a condition in which the second frame represents the scene change in the motion video image; and

encoding the second frame as a motion-compensated frame upon a condition in which the second frame does not represent the scene change in the motion video image.

2. The method of claim 1 wherein the difference is an absolute pixel difference.

3. The method of claim 1 wherein the threshold is proportional to the previously filtered difference.

4. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to encode a motion video signal by performing the steps of:

comparing first and second frames of the motion video signal to one another;

determining whether the second flame represents a scene change in a motion video image represented by the motion video image by;

measuring a difference between the first and second frames;

filtering the difference with a previously filtered difference to form a filtered difference;

comparing the filtered difference to a threshold;

determining that the second frame represents the scene change if the difference is greater than the threshold; and

determining that the second frame does not represent the scene chance if the filtered difference is not greater than the threshold;

encoding the second frame as an independent frame upon a condition in which the second frame represents the scene change in the motion video image; and

encoding the second frame as a motion-compensated frame upon a condition in which the second frame does not represent the scene change in the motion video image.

5. The computer readable medium of claim 4 wherein the difference is an absolute pixel difference.

6. The computer readable medium of claim 4 wherein the threshold is proportional to the previously filtered difference.

7. A computer system comprising:

a processor;

a memory operatively coupled to the processor; and

a motion video signal encoder which executes in the processor from the memory and which, when executed by the processor, causes the computer to encode a motion video signal by performing the steps of;

comparing first and second frames of the motion video signal to one another;

determining whether the second same represents a scene change in a motion video image represented by the motion video image by;

measuring a difference between the first and second frames;

filtering the difference with a previously filtered difference to form a filtered difference;

comparing the filtered difference to a threshold;

determining that the second frame represents the scene change if the faltered difference is greater than the threshold; and

determining that the second frame does not represent the scene change if the filtered difference is not greater than the threshold;

encoding the second frame as an independent frame upon a condition in which the second frame represents the scene change in the motion video image; and

encoding the second frame as a motion-compensated frame upon a condition in which the second frame does not represent the scene change in the motion video image.

8. The computer system of claim 7 wherein the difference is an absolute pixel difference.

9. The computer system of claim 7 wherein the threshold is proportional to the previously filtered difference.

10. A method for encoding a motion video signal, the method comprising:

comparing first and second frames of the motion video signal to one another;

determining whether the second frame represents a scene change in a motion video image represented by the motion video image by;

measuring a difference between the first and second frames;

comparing the difference to a predetermined threshold;

determining that the second frame represents the scene change if the difference is greater than the predetermined threshold; and

determining that the second frame does not represent the scene change if the difference is not greater than the predetermined threshold;

encoding the second frame as an independent frame upon a condition in which the second frame represents the scene change in the motion video image; and

encoding the second frame as a motion-compensated frame upon a condition in which the second frame does not represent the scene change in the motion video image.

11. The method of claim 10 wherein the difference is an absolute pixel difference.

12. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to encode a motion video signal by performing the steps of:

comparing first and second frames of the motion video signal to one another;

determining whether the second frame represents a scene change by;

measuring a difference between the first and second frames;

comparing the difference to a predetermined threshold;

determining that the second frame represents the scene change if the difference is greater than the predetermined threshold; and

determining whether the second frame does not represent the scene change if the difference is not greater than the predetermined threshold;

encoding the second frame as an independent frame upon a condition in which the second frame represents the scene change in the motion video image; and

encoding the second frame as a motion-compensated frame upon a condition in which the second frame does not represent the scene change in the motion video image.

13. The computer readable medium of claim 12 wherein the difference is an absolute pixel difference.