Method of encoding a sequence of images of a digital motion video signal

• US 5,265,180 A
• Filed: 02/08/1993
• Issued: 11/23/1993
• Est. Priority Date: 06/13/1991
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Golin, Stuart J.
• Primary Examiner(s): Moore, David K.
• Assistant Examiner(s): Johns, Andrew W.
• Application Number:
  US08/015,286
• Time in Patent Office: 288 Days
• Field of Search: 382/56, 358/105, 358/133, 358/135, 358/136, 358/137, 358/430, 358/432
• US Class Current: 382/236
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/197 including determination of the initial value of an encoding parameter H04N19/56 takes precedence
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression

Abstract

In a method of encoding a sequence of images of a digital motion video signal, information regarding future images in the image sequence is obtained by making an initial analysis of the image data before compression. The initial analysis provides information to the compression system regarding variations in complexity between images. This information is used to determine the setting of a compression controller. From this setting, other compression system thresholds and quantizers are scaled. In addition, the initial analysis provides qualitative information regarding events such as scene changes, brief periods of rapid motion, dissolves, wipes, and the appearance of a single anomalous image.

Claims

1. A method of encoding a sequence of images of a digital motion video signal, said method comprising the steps of:

a performing a preliminary analysis of the entire sequence of images to determine complexity values, each complexity value being associated with at least one of said images and, after completion of said preliminary analysis;

b compressing the images of said sequence of images using a compression system including a compression controller having adjustable settings for scaling compression system quantizers and thresholds; and

c adjusting the compression controller setting for each image being compressed in accordance with adjustment parameters including at least one complexity value associated with an image occurring in the sequence subsequent to the image being compressed.

2. The method in accordance with claim 1 wherein step a comprises the steps of:

i selecting at least one image from said sequence of images as a target image; and

ii determining, as the complexity value associated with said target image, the mean square value of said target image.

3. The method in accordance with claim 2 wherein step c comprises the steps of:

i determining the average value of the complexity values associated with the target image being compressed and at least one target image occurring in the sequence subsequent to the target image being compressed; and

ii using said average value to adjust said compression controller setting for the target image being compressed.

4. The method in accordance with claim 3 wherein said average value also includes the complexity value associated with at least one target image occurring in the sequence of images prior to the target image being compressed.

5. The method in accordance with claim 1 wherein step a comprises the steps of:

i selecting an image from said sequence of images as a first target image;

ii forming a previous target image by storing said first target image in storage means;

iii selecting an image occurring in said sequence of images subsequent to said first target image as a target image;

iv providing at least one displacement vector representing the magnitude and direction of the displacement between at least one region in said target image and a corresponding region in said previous target image;

v applying each displacement vector to a corresponding region in said previous target image to form a predicted image;

vi subtracting pixel values in the predicted image from corresponding pixel values in said target image to form a difference image; and

viii determining, as the complexity value associated with said target image, the mean square value of said difference image.

6. The method in accordance with claim 5 wherein step c comprises the steps of:

i determining the average value of the complexity values associated with the target image being compressed and at least one target image occurring in the sequence subsequent to the target image being compressed; and

ii using said average value to adjust the compression controller setting for the target image being compressed.

7. The method in accordance with claim 6 wherein said average value also includes the complexity value associated with at least one target image occurring in the sequence prior to the target image being compressed.

8. The method in accordance with claim 5 wherein said target image and said previous target image are each resolved into a level of resolution lower than full resolution and wherein steps iv through vii are performed at said lower level of resolution.

9. The method in accordance with claim 5 comprising the additional step of subtracting a constant quantity from the previous target image so that the target image and the previous target image have the same mean value.

10. A method of encoding a sequence of images of a digital motion video signal, said method comprising the steps of:

a performing a preliminary analysis of the entire sequence of images to determine complexity values, each complexity value being associated with at least one of said images and, after completion of said preliminary analysis;

b analyzing said complexity values to locate the first image in a scene change; and

c encoding said first image differently from images occurring in said sequence subsequent to said first image.

11. The method in accordance with claim 10 wherein step b comprises the steps of:

i locating an image having a substantial increase in complexity associated therewith compared to the complexity of at least one preceding image;

ii analyzing the complexity of at least one image subsequent to said located image and, if the complexity of said subsequent image is substantially lower than the complexity of said located image, identifying said located image as the first image in a scene change.