Video sequences correlation and static analysis and scene changing forecasting in motion estimation

• US 7,248,741 B2
• Filed: 01/09/2003
• Issued: 07/24/2007
• Est. Priority Date: 01/09/2002
• Status: Expired due to Fees

• Current Assignee: Institute of Super Compression Technologies
• Original Assignee: Institute of Super Compression Technologies
• Inventors: Akimoto, Hiroshi, Vostrov, Georgiy N.
• Primary Examiner(s): Wu; Jingge
• Assistant Examiner(s): Bayat; Ali
• Application Number:
  US10/338,983
• Publication Number:
  US 20030128880A1
• Time in Patent Office: 1,657 Days
• Field of Search: 382/232, 382/233, 382/304, 382/236, 382/238, 382/240, 382/246, 382/248, 382250-251, 382/253, 382/239, 382244-245, 375/240.16, 375/240.19
• US Class Current: 382/236
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/277 involving stochastic approaches, e.g. using Kalman filters
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression

Abstract

The invention teaches correlation analysis of the stochastic relationship between video images for use in motion estimation. On the basis of the method of analysis of correlation values as temporal series, a method was created for the analysis of the dynamics of the objects in the scenes, the isolation of quasi-static fragments of the images and the use of the obtained information for the construction of optimal procedures for making decisions in the control of motion estimation and the isolation of different types of motion of the objects. The dynamics of motion of objects or blocks in a video scene can be predicted, and the results of the predicting permit the isolation in motion of each element of the scene—the following components: camera motion, object motion, object distortion thereby allowing the possibility of isolating groups of blocks for which a given coding strategy has maximum effectiveness.

Claims

1. A method for analyzing the inter-frame interaction in a video film having a dynamic sequence of images, comprising the steps of:

1) adapting a video encoder to include procedures for correlation and statistical analysis of a video sequence, said video encoder adapted to include procedures for correlation and statistical analysis that perform operations comprised of;

a) isolating of subjects of the video film;

b) arranging reference frames;

c) determining the rate of information exchange between successive frames on one scenario;

d) determining the speed of movement of complex objects relative to the video camera; and

e) conducting analysis of the stochastic relationships between blocks and separate pixels within the limits of one subject

2) executing the procedures for correlation and statistical analysis during the encoding of a video film.

2. The method of claim 1 wherein the procedures for correlation and statistical analysis are constantly executed during the encoding of a video file.

3. The method of claim 1 wherein the procedures for correlation and statistical analysis are executed on an as needed basis.

4. A method for analyzing the interframe interaction in a video film having a dynamic sequence of images, comprising:

a) isolating subjects of the video film by the steps of

1) calculating the function of the correlation relationship between successive frames;

2) finding images in successive frames that have a small correlation relationship;

3) isolating frames into groups which have small correlation relationship;

4) determining gradual changes of scenario

5) isolating duplicate or groups of duplicate neighboring frames and eliminate all but one duplicate frame

b) arranging reference frames to form a sequence of scenarios

c) determining the rate of information exchange between successive scenarios

d) determining the speed of movement of complex objects relative to the video camera

e) conducting analysis of stochastic relationships between blocks and separate pixels during transition from one image to another; and

performing video compression based upon results of steps a–

f.