Video coding/decoding arrangement and method therefor

• US 6,249,318 B1
• Filed: 09/12/1997
• Issued: 06/19/2001
• Est. Priority Date: 09/12/1997
• Status: Expired due to Term

• Current Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Original Assignee: 8X8, Inc.
• Inventors: Girod, Bernd, Wiegand, Thomas
• Primary Examiner(s): BRITTON, HOWARD W
• Application Number:
  US08/928,356
• Time in Patent Office: 1,376 Days
• Field of Search: H04/N.750, 348/409, 348/411, 348/412, 348/413, 348/415, 348/416, 348/402, 382/236
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/573 Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
• CPC Class Codes: H04N 19/58 Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one H04N19/23 takes precedence
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

Coding and decoding of video images includes the use of multiple reference pictures and determining motion vector and time delay information for the video images. Video images are quantized and transmitted with the motion vector and time delay information from a first station to a second station. A new video image is predicted for display at the second station as function of the motion parameter codes and multiple reference pictures. The invention may be used in connection with a video communication and/or video conferencing system as a long-term memory predictor to improve image-coding efficiencies and motion compensation. The long-term memory prediction extends the spatial displacement utilized in block-based hybrid video coding by a variable time delay. The arrangement and method employ a proposed bit allocation scheme to provide increased coding efficiencies of the video coder. Applications include video reproduction of repetitive sequences, such as when the video camera is shaking or an image portion is repetitively moving between previously-displayed positions.

Claims

1. A method of coding and decoding video images for transmission from a first station to a second station, the method comprising:

providing respective sets of multiple reference pictures at the first and second stations to permit use of up to frames N for prediction, where N is a positive integer;

encoding the video images at the first station;

at the first station, determining motion parameters, including a frame selection parameter and a spatial displacement parameter, for the video images as a function of at least one of;

a distortion criteria and a data transmission rate;

transmitting the encoded video images and the motion parameters to the second station; and

predicting a new video image for display at the second station as function of the motion parameters and a group of the N frames.

2. A method of coding and decoding video images, according to claim 1, wherein, determining the motion parameters includes determining a motion vector and time delay information.

3. A method of coding and decoding video images, according to claim 1, wherein, determining the motion parameters includes determining the spatial displacement parameters as polynomial motion coefficients.

4. A method according to claim 1, wherein the step of determining includes executing a minimization of a Lagrangian cost function.

5. A method, according to claim 1, wherein the motion parameters are determined as a function of both a distortion criteria and a data transmission rate.

6. A method according to claim 1, wherein the step of determining the motion parameters is a computed as a function of a minimization of a Lagrangian cost function based on both a distortion criteria and a data transmission rate.

7. An arrangement for coding and decoding video images for transmission from a first station to a second station, the method comprising:

memories for storing respective sets of multiple reference pictures at the first and second stations to permit use of up to frames N for prediction, where N is a positive integer;

an encoder responsive to video images provided at the first station and arranged to generate encoded video images;

means for determining motion parameters, including a frame selection parameter and a spatial displacement parameter, for the video images as a function of at least one of;

a distortion criteria and a data transmission rate; and

means, responsive to the encoded video images and the motion parameters, for predicting a new video image for display at the second station as function of the motion parameters and a group of the N frames.

8. An arrangement for coding and decoding video images, according to claim 7, wherein said motion parameters are determined as a function of a distortion criteria and a data transmission rate.