Video sequences correlation and static analysis and scene changing forecasting in motion estimation

• US 20030128880A1
• Filed: 01/09/2003
• Published: 07/10/2003
• Est. Priority Date: 01/09/2002
• Status: Active Grant

• Current Assignee: Institute of Super Compression Technologies
• Original Assignee: Institute of Super Compression Technologies
• Inventors: Akimoto, Hiroshi, Vostrov, Georgiy N.
• Granted Patent: US 7,248,741 B2
• Time in Patent Office: Days
• US Class Current: 382/236
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/277 involving stochastic approaches, e.g. using Kalman filters
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression

Abstract

The invention teaches correlation analysis of the stochastic relationship between video images for use in motion estimation. On the basis of the method of analysis of correlation values as temporal series, a method was created for the analysis of the dynamics of the objects in the scenes, the isolation of quasi-static fragments of the images and the use of the obtained information for the construction of optimal procedures for making decisions in the control of motion estimation and the isolation of different types of motion of the objects. The dynamics of motion of objects or blocks in a video scene can be predicted, and the results of the predicting permit the isolation in motion of each element of the scene—the following components: camera motion, object motion, object distortion thereby allowing the possibility of isolating groups of blocks for which a given coding strategy has maximum effectiveness.

Claims

1. A method for analyzing the inter-frame interaction in a video film having a dynamic sequence of images, comprising the steps of:

a) adapting a video encoder to include procedures for correlation and statistical analysis of a video sequence; and

b) executing the procedures for correlation and statistical analysis during the encoding of a video film.

3. The method of claim 1 wherein the procedures for correlation and statistical analysis are executed on an as needed basis.

4. The method of claim 1 wherein the video encoder is adapted to include procedures for correlation and statistical analysis that perform operations comprised of:

a) isolating of subjects of the video film;

b) arranging reference frames;

c) determining the rate of information exchange between successive frames on one scenario;

d) determining the speed of movement of complex objects relative to the video camera; and

e) conducting analysis of the stochastic relationships between blocks and separate pixels within the limits of one subject.

2. The method of claim I wherein the procedures for correlation and statistical analysis are constantly executed during the encoding of a video film.