Gridlocked method and system for video motion compensation

• US 5,247,355 A
• Filed: 06/11/1992
• Issued: 09/21/1993
• Est. Priority Date: 06/11/1992
• Status: Expired due to Fees

• Current Assignee: MEWS Incorporated
• Original Assignee: Northwest Starcan Limited Partnership
• Inventors: Frederiksen, Jeffrey E.
• Primary Examiner(s): Chin, Tommy
• Assistant Examiner(s): LEE, RICHARD J
• Application Number:
  US07/897,286
• Time in Patent Office: 467 Days
• Field of Search: 358/105, 358/136
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/433 characterised by techniques for memory access
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20

Abstract

A method and system for video motion compensation in which an overall interframe motion vector is divided into a relative block motion vector and a subblock motion vector. Image reconstruction is achieved by adjusting the delay between the synchronization pulse and the start of the pixel data according to the subblock motion vector, and accessing stored data from memory according to the relative block motion vector. Accessing memory in a block-quantized format ensures that page mode accesses are confined to the same memory row.

Claims

1. A video motion compensation method for re-generating a second video frame from a first video frame, each frame represented as an array of pixels, said array subdivided into a plurality of blocks, said method comprising the steps of:

(a) generating a motion estimation signal representing a displacement between said first and second video frames;

(b) generating from said motion estimation signal a block displacement signal representing the displacement between said first and second video frames approximated to an integer number of blocks;

(c) generating from said motion estimation signal an absolute displacement signal, said absolute displacement signal compensating for the discrepancy between said motion estimation signal and said block displacement signal;

(d) generating a trigger signal delayed from a video synchronization signal according to said absolute displacement signal; and

(e) accessing a storage device according to said block displacement signal, said accessing initiated by said trigger signal, said storage device containing a representation of said first video frame, output from said storage device representing said re-generated second video frame.

2. The method according to claim 1 wherein the step of reconstructing said re-generated second video frame from said first video frame includes summing stored said first video frame with data representing the difference between said second video frame and said first video frame, wherein corresponding pixels of each frame for calculating said difference are determined according to said motion estimation signal, and corresponding pixel data for calculating said summing is determined according to relative said block displacement signal.

3. A video motion compensation system which compensates for the relative motion between a first video frame and a second video frame, each frame represented as an array of pixels, said array subdivided into a plurality of blocks, comprising:

(a) a motion estimator adapted to generate a motion estimation signal representative of the horizontal and vertical displacement between said first and second video frames;

(b) a block displacement signal generator responsive to said motion estimation signal, generating a block displacement signal representing the displacement approximated to the nearest block;

(c) an absolute displacement signal generator responsive to said motion estimation signal for generating an absolute displacement signal representing subblock motion;

(d) a timing controller which adjusts the delay between a trigger signal and a video synchronization signal according to said absolute displacement signal, said delay time compensating for the subblock motion between said video frames; and

(e) an address signal generator for accessing a storage device according to said block displacement signal, said storage device containing pixel information for said first video frame, output from said storage device representing a re-generated second video frame.

4. The system according to claim 3 wherein said storage device is a random access memory (RAM).

5. The system according to claim 4 wherein said RAM is organized such that one row of said RAM contains data corresponding to an integer number of video blocks.

6. The system according to claim 5 wherein said accessing is implemented in a page mode with a plurality of column address strobe signals generated for each row address strobe signal.

7. In a video transmission and reception system, said video transmission system including an encoder and a decoder for processing a sequence of video frames for video display, each frame subdivided into blocks of pixel arrays, said encoder containing a motion compensation system comprising:

(a) a motion estimation processor adapted to estimate the displacement between a first video frame and a second video frame, and to generate a motion estimation signal representing said displacement;

(b) a relative block displacement signal generator responsive to said motion estimation signal for generating a relative block displacement signal indicating said displacement rounded to the nearest block;

(c) an absolute pixel adjustment signal generator responsive to said motion estimation signal for generating an absolute pixel adjustment signal indicating subblock motion representing the discrepancy between said relative block displacement signal and said motion estimation signal;

(d) a motion compensation processor responsive to said motion estimation signal for reframing one of said video frames;

(e) a frame differencing processor for generating a difference signal between reframed video frame and other video frame.

8. The system of claim 7 wherein said decoder includes a motion compensation circuit comprising:

(a) a memory for storing a representation of one of said video frames;

(b) timing circuitry for generating a trigger signal delayed from a video synchronization signal controlling said subblock motion by adjusting the starting location of the video frame for video display, the delay generated according to said absolute pixel adjustment signal; and

(c) address circuitry for accessing said memory according to said relative block displacement signal, said accessing initiated by said trigger signal;

(d) output gating circuitry for generating an output signal representing a re-generated second video frame corresponding to said second video frame by summing output from said memory with said difference signal, said output signal stored in said memory as reference frame for subsequent frame motion compensation.

9. The system according to claim 8 further comprising 1/2 pixel and 1/2 line motion compensation by averaging adjacent pixels in one of said video frames in said motion estimation processor thereby generating said motion estimation signal with 1/2 pixel and 1/2 line resolution, and averaging adjacent pixels of one of said video frames in said motion compensation processor according to the motion estimation signal.

10. A method for video motion compensation, compensating for the relative motion between a first video frame and a second video frame, each frame represented as an array of pixels, said array subdivided into a plurality of blocks, comprising the steps of:

(a) estimating the horizontal and vertical displacement between said video frames;

(b) generating from said estimating a relative block displacement vector representing the relative frame motion rounded to the nearest block;

(c) generating from said estimating an absolute displacement vector representing the subblock motion;

(d) accessing a storage device containing pixel information according to the block displacement vector; and

(e) controlling the timing between said accessing and a video synchronization signal according to said absolute displacement vector.