Motion estimation method for control on the basis of scene analysis in video compression systems

• US 20030128754A1
• Filed: 01/09/2003
• Published: 07/10/2003
• Est. Priority Date: 01/09/2002
• Status: Abandoned Application

• Current Assignee: Institute of Super Compression Technologies
• Original Assignee: Institute of Super Compression Technologies
• Inventors: Vostrov, Georgiy N., Akimoto, Hiroshi
• Application Number:
  US10/338,984
• Publication Number:
  US 20030128754A1
• Time in Patent Office: Days
• US Class Current: 375/240.02
• CPC Class Codes: H04N 19/25 with scene description coding, e.g. binary format for scenes [BIFS] compression

Abstract

The method for video compression to a high degree on the basis of the calculation of motion estimation is based on obtaining complete information and on the structure and dynamic of the inter-frame interaction and its use in video compression procedures. Video films are presented as a series of scenarios, which are examined as a series of scenes, dynamically replacing each other. Scene analysis is presented as a labeled graph of relationships between subjects. Coding of scenes permits consideration of their structure and the structure of subjects by using an adaptive metric. An increase in the degree of compression and improvement in the quality of the images obtained by removal of unwanted artifacts during compression are permitted. The disclosed method checks for conflicting situations during motion estimation, and its reverse-recursive structure provides for their removal. The stochastic nature of the criteria for the proximity of the object is also considered.

Claims

1. A method for presenting a video film comprising the steps of;

a) presenting the video film as a dynamic sequence of scenarios;

b) presenting the scenarios as a sequence of scenes, each scene being replaced by another;

c) presenting the conditions of a subject field in a given moment of time, by means of adequate description of a set of objects interacting with each other; and

d) presenting the objects of a scene with the required degree of adequacy on the basis of a theoretical-multiple description in terms of pixels, their properties and the relationships between them.

2. A method for controlling compression of a video film having a dynamic sequence of images, comprising the steps of:

a) classifying the dynamic sequence of images according to the degree of the correlation between the same images in similar scenarios;

b) selecting a scenario (i) from within the dynamic sequence of images;

c) selecting an image (j) from within the scenario (i);

d) selecting a strategy for global control with motion estimation for a class subsequent of images that form one common scenario;

e) selecting a local strategy for control with motion estimation for the current scenario (i) and image (j);

f) setting the parameters for the local strategy for control with motion estimation during the process of encoding blocks of the current scenario (i);

g) assuming that (i) is the number of the current scenario and (j) is the number of the encoded image;

h) constructing a graph of the interconnections of the relationships of the objects in image (j) and scenario (i); and

i) encoding image (j) and scenario (i) with the selected strategy for global control and local strategy for control with motion estimation.

3. The method of claim 2 wherein steps c through i are repeated for all images within the selected scenario.

4. The method of claim 2 wherein if (j) is the final image of scenario (i), the quality of the video compression for scenario (i) is verified by checking to see if a predetermined condition has been met.

5. The method of claim 4 wherein if the predetermined condition has not been met, the setting for the parameters for the local strategy for control are adjusted and steps c through i are repeated for all images within the selected scenario.

6. The method of claim 4 wherein if the predetermined condition has not been met, a different local strategy for control is selected and steps c through i are repeated for all images within the selected scenario.

7. The method of claim 2 wherein if (j) is the final image of scenario (i) and (i) is the final scenario of the dynamic sequence of images, the quality of the video compression for the entire sequence of dynamic images is verified by checking to see if a predetermined condition has been met.

8. The method of claim 7 wherein if the predetermined condition has not been met, the setting for the parameters for the strategy for global control are reconstructed, and steps b through i are repeated for all scenarios (i) and images (j) within the dynamic sequence of images.

9. The method of claim 2 wherein the dynamic sequence of images is classified by evaluating the relationship between adjacent frames on the basis of a correlation coefficient.

10. The method of claim 2 wherein the dynamic sequence of images is classified by evaluating the relationship between adjacent frames on the basis of an Euclidian metric.

11. The method of claim 2 wherein the strategy for global control with motion estimation is selected within the limits of a single scenario.

12. The method of claim 2 wherein the local strategy for control with motion estimation comprises the steps of:

a) selecting an initial block of pixels;

b) selecting a set of functions representing the vector sum of the character of the approximation from a pre-defined library of functions that determine the degree of proximity of the approximating and approximable blocks;

c) selecting an optimal plan for review of the blocks through the vector of displacement on the approximating image;

d) selecting a procedure and conditions for re-encoding blocks;

e) selecting a procedure for quadratic splitting of the blocks; and

f) selecting a function for the removal of artifacts.

13. The method of claim 12 wherein the procedure and conditions for re-encoding blocks comprises the following steps:

a) determining whether it is necessary to re-encode a given block;

b) determining if there are other blocks, in the vicinity of given block, that require re-encoding; and

c) re-encoding the blocks.

14. The method of claim 12 wherein the initial block of pixels is selected from a key object isolated in a graph of the interrelationships of the objects in the approximal image.