Encoding and decoding system of motion image containing arbitrary object
First Claim
1. A motion image encoding apparatus for encoding a current image containing an object, the motion image encoding apparatus comprising:
- object extraction means for extracting the object contained in the current image from received current image data and outputting object contour data indicating a contour of the extracted object;
predictive encoding means for performing a predictive encoding operation using the current image data, prestored data of a reference image, and control points of meshes which divide one of the current image and the reference image, and generating motion information relating to the control points, differential data between the current image and the reference image, and predictive image data;
object difference generator means for selecting differential data in an object region among the differential data supplied from the predictive encoding means to encode the selected differential data based on the object contour data output from the object extraction means, and outputting the selected differential data and the encoded differential data; and
adder means for receiving and adding the predictive image data output from the predictive encoding means and the selected differential data output from the object difference generator means to produce image data of an addition result, and updating the reference image data prestored in the predictive encoding means using the image data of the addition result.
1 Assignment
0 Petitions
Accused Products
Abstract
A motion image encoding apparatus for a current image containing an object uses mesh representation for encoding a motion image. The encoding apparatus includes an object extractor for extracting the object contained in the current image from received current image data and outputting object contour data indicating a contour of the extracted object. A predictive encoder performs a predictive encoding operation using the current image data, prestored data of a reference image, and control points of meshes which divide one of the current image and the reference image, and generates motion information relating to the control points, differential data between the current image and the reference image, and predictive image data. An object difference generator selects differential data in an object region among the differential data supplied from the predictive encoder to encode the selected differential data based on the object contour data output from the object extractor, and generates the selected differential data and the encoded differential data. An adder receives and adds the predictive image data output from the predictive encoder and the differential data selected in the object difference generator, and updates the reference image data prestored in the predictive encoder using the image data obtained by the addition result.
-
Citations
22 Claims
-
1. A motion image encoding apparatus for encoding a current image containing an object, the motion image encoding apparatus comprising:
-
object extraction means for extracting the object contained in the current image from received current image data and outputting object contour data indicating a contour of the extracted object; predictive encoding means for performing a predictive encoding operation using the current image data, prestored data of a reference image, and control points of meshes which divide one of the current image and the reference image, and generating motion information relating to the control points, differential data between the current image and the reference image, and predictive image data; object difference generator means for selecting differential data in an object region among the differential data supplied from the predictive encoding means to encode the selected differential data based on the object contour data output from the object extraction means, and outputting the selected differential data and the encoded differential data; and adder means for receiving and adding the predictive image data output from the predictive encoding means and the selected differential data output from the object difference generator means to produce image data of an addition result, and updating the reference image data prestored in the predictive encoding means using the image data of the addition result. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A motion image decoding apparatus for decoding an output of a motion image encoding apparatus, the motion image decoding apparatus comprising:
-
object contour restoring means for decoding received encoded object contour data and restoring object contour data indicating a contour of an object contained in a current image; differential data decoding means for decoding received encoded differential data and outputting differential data; motion compensation decoding means for performing a motion compensation operation using data of the object contour, prestored data of a reference image, control points of meshes which divide one of the object contour and the reference image, and motion information relating to the control points; and adder means for adding the predictive image data selected by the object contour data and the differential data to produce image data of an addition result, and updating the reference image data prestored in the motion compensation decoding means using the image data of the addition result. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
-
19. An object oriented image encoding apparatus for performing a motion prediction and compensation in a unit of an object image, the object-oriented image encoding apparatus comprising:
-
object contour information extraction means for extracting information representing a contour of an object image and outputting the extracted contour information; mesh production means for representing the object image as a triangular or a rectangular mesh; reference image input means for receiving a reference image to calculate a motion vector on a node point of the mesh in the object image represented as the mesh; motion vector estimation means for receiving said reference image and the object image represented as the mesh and calculating the motion vector on the node point of the mesh; motion compensation means for performing spatial transformation of a unit of the mesh in the object represented as the mesh using said motion vector on the node point of the mesh and producing a prediction data with respect to said reference image; and transmission means for transmitting said contour information, mesh information and said motion vector on the node point of the mesh.
-
-
20. An object-oriented image encoding method for performing a motion prediction and compensation in a unit of an object image, the object-oriented image encoding method comprising the steps of:
-
(a) extracting information representing a contour of an object image and outputting the extracted contour information; (b) representing the object image as a triangular or a rectangular mesh; (c) receiving a reference image and the object image represented as the mesh and calculating a motion vector on a node point of the mesh; (d) performing spatial transformation of a unit of the mesh in the object image represented as the mesh using said motion vector on the node point of the mesh and producing a prediction data with respect to said reference image; and (e) transmitting said contour information, mesh information and said motion vector on the node point of the mesh.
-
-
21. An image decoding apparatus for performing a motion compensation in a unit of an object image, the image decoding apparatus comprising:
-
information input means for receiving contour information of an object image and a motion vector on a node point of a mesh; object image contour restoration means for restoring a contour of the object image using said contour information of the object image; mesh production means for restoring a mesh structure for the object image using said contour information of said object image; and motion compensation means for performing spatial transformation as a unit of the mesh using a reference image, said motion vector on the node point of the mesh and the mesh structure for said restored object, and producing a prediction object image.
-
-
22. An image decoding method for performing a motion compensation in a unit of an object image, the image decoding method comprising the steps of:
-
(a) receiving contour information of an object image and a motion vector on a node point of a mesh; (b) restoring a contour of the object image using said contour information of said object image; (c) producing a mesh for restoring a mesh structure for the object image using said contour information of said object image; (d) receiving a reference image for a motion compensation to the object image represented as said mesh; and (e) performing spatial transformation as a unit of the mesh using a reference image, the motion vector on the node point of said mesh and the mesh structure for said restored object image, and producing a prediction object image.
-
Specification