Video encoder using global motion estimation and polygonal patch motion estimation

• US 5,592,228 A
• Filed: 03/02/1994
• Issued: 01/07/1997
• Est. Priority Date: 03/04/1993
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Dachiku, Kenshi, Yamaguchi, Shogo, Kuratate, Takaaki, Omokawa, Mitsunori, Ozeki, Kazuo, Takahashi, Katsumi
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): LIN, BRYAN T
• Application Number:
  US08/205,028
• Time in Patent Office: 1,042 Days
• Field of Search: 348/699, 348/700, 348/701, 348/416, 348/420, 348/407, 348/402, 348/401, 348/400, 348/390, 348/384, 382/241
• US Class Current: 348/416.1
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/122 Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/537 Motion estimation other than block-based
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/649 the transform being applied to non rectangular image segments

Abstract

A video coding apparatus ensuring a high coding efficiency even at a low bit rate includes a moving object analyzer which extracts a moving part from an input picture signal, analyzes its motion, and outputs a residual signal relative to a reconstruction image and motion parameters. The apparatus further includes a residual coding device for coding the residual signal, a reconstruction device for reconstructing a picture using the motion parameters, and a device that performs a variable length coding of the motion parameters and residual coded information.

Claims

1. A video encoding apparatus comprising:

a moving region analyzing means for extracting a moving region from an input video signal, analyzing its motion and outputting a residual signal relative to a reconstructed two-dimensional picture and motion parameters;

a residual coding means for encoding said residual signal from said moving region analyzing means to form encoded residual data;

a reconstruction means for creating the reconstructed picture using said motion parameters from said moving region analyzing means and said encoded residual data from said residual coding means; and

a variable length coding means for performing a variable length coding of said motion parameters from said moving region analyzing means and said encoded residual data from said residual coding means;

wherein said moving region analyzing means comprises;

a global motion estimating means for estimating global motion parameters of the moving region;

a polygonal patch motion estimating means for estimating polygonal patch motion parameters for local motions within the moving region by applying polygonal patches to the moving region using the global motion parameters estimated by said global motion estimating means; and

a motion compensating means for performing a motion compensation of the reconstructed picture using the global motion parameters estimated by said global motion estimating means and the polygonal patch motion parameters estimated by said polygonal patch motion estimating means.

2. A video decoding apparatus comprising:

a variable length decoding means for receiving variable length-coded data, decoding the coded data and resolving it into a global motion parameter, polygonal patch motion parameters and a global motion parameter, polygonal patch motion parameters and a residual code;

a residual code decoding means for decoding the residual code from said variable length decoding means and outputting a residual signal;

a global motion compensating means for performing a motion compensation of an entire moving region using a decoded picture of a preceding frame stored in a frame memory and the global motion parameter output from said variable length decoding means and outputting a global motion compensated image;

a polygonal patch compensating means for performing a local motion compensation within the moving region using the global motion compensated image output from said global motion compensating means and the polygonal patch motion parameter output from said variable length decoding means and outputting a motion compensated prediction image; and

an adding means for adding the motion compensated prediction image from said polygonal patch compensating means and the residual code output from said residual code decoding means to construct a decoded picture and outputting the decoded picture to a frame memory.

3. A video encoder/decoder system comprising:

a video encoding apparatus, including a moving object analyzing means for extracting a moving object from an input video signal, analyzing its motion and outputting a residual signal relative to a reconstruction picture and motion parameters,

a residual coding means for encoding said residual signal from said moving object analyzing means to form encoded residual data,

a reconstruction means for reconstructing a picture image using said motion parameters from said moving object analyzing means and said encoded residual data from said residual coding means, and

a variable length coding means for performing a variable length coding of said motion parameters from said moving object analyzing means and said encoded residual data from said residual coding means to produce variable length-coded data,

wherein said moving object analyzing means comprises

a global motion estimating means for estimating a global motion parameter of the moving region within the input picture,

a polygonal patch motion estimating means for estimating polygonal patch motion parameters by applying polygonal patches to the moving region within the input picture or reconstructed picture, and

a motion compensating means for performing a motion compensation of the reconstructed picture using the global motion parameter estimated by said global motion estimating means and the polygonal patch motion parameters estimated by said polygonal patch motion estimating means; and

a video decoding apparatus including a variable length decoding means for receiving the variable length-coded data, decoding and resolving the variable length-coded data into the global motion parameter, the polygonal patch motion parameters and a residual code,

residual code decoding means for decoding the residual code from said variable length decoding means and outputting a decoded residual signal,

a global motion compensating means for performing a motion compensation of the entire moving region using the decoded picture of a preceding frame stored in a frame memory and the global motion parameter output from said variable length decoding means and outputting a global motion compensated image,

a polygonal patch compensating means for performing a local motion compensation within the moving region using the global motion compensated image output from said global motion compensating means and the polygonal patch motion parameter output from said variable length decoding means and outputting a motion compensated prediction image, and

an adding means for adding the motion compensated prediction image from said polygonal patch compensating means and the residual code output from said residual code decoding means to construct a decoded picture and outputting the decoded picture to a frame memory.