Video coding device and video decoding device with a motion compensated interframe prediction
First Claim
1. A video coding device comprising frame memory means for storing already encoded video signals, motion vector detecting means for determining a representative motion vector per unit area from a difference between an input video signal and a video signal read from the frame memory means, motion vector interpolating means for determining a motion vector per pixel from the representative motion vector, pixel value predicting means for preparing a predicted video signal from a video signal read from the frame memory means by using the motion vector per pixel, wherein weighting coefficient control means for instructing the vector interpolating means to weight a representative motion vector is provided for determining a weighting coefficient for each representative motion vector determined by the motion vector detecting means and instructing the motion vector interpolating means to weight each representative motion vector.
2 Assignments
0 Petitions
Accused Products
Abstract
In a video-coding and video-decoding device, motion-compensated interframe prediction is achieved by determining motion vectors of respective pixels according to representative motion vectors with weighting, and determining accurate motion vectors between video frames, dividing each frame into areas optimal to an objective figure, size and location and performing effective encoding and decoding of the motion vectors. According to the invention a motion-compensated interframe predicting portion generates a predicted video-frame by varying codable area according to a reference video-frame received from a frame memory portion and an input video frame and obtains side-information. A motion vector searching portion searches a motion vector. An effective-area selecting portion selects a valid or invalid mask depending upon a position of a processable object, divides a processable area of the input video frame into suitable areas, a variable-area predicted-frame generating portion generates a predicted frame by affine transformation and translational displacement. An area-diving pattern deciding portion outputs side-information such as the predicted image, motion vectors and divided areas, a side-information coding portion encodes an additional motion vector as a difference from an average basic-motion vector or predictively encodes a motion vector from a median value of three neighboring motion-vectors. A difference between the input video-frame and the predicted video-frame from the predicting portion is encoded, transferred and stored.
136 Citations
57 Claims
- 1. A video coding device comprising frame memory means for storing already encoded video signals, motion vector detecting means for determining a representative motion vector per unit area from a difference between an input video signal and a video signal read from the frame memory means, motion vector interpolating means for determining a motion vector per pixel from the representative motion vector, pixel value predicting means for preparing a predicted video signal from a video signal read from the frame memory means by using the motion vector per pixel, wherein weighting coefficient control means for instructing the vector interpolating means to weight a representative motion vector is provided for determining a weighting coefficient for each representative motion vector determined by the motion vector detecting means and instructing the motion vector interpolating means to weight each representative motion vector.
- 5. A video decoding device comprising frame memory means for storing already decoded video signals, motion vector interpolating means for determining a motion vector per pixel from a representative motion vector inputted per unit area, pixel value predicting means for preparing a predicted video signal from a video signal read from the frame memory means by using the motion vector per pixel, wherein weighting coefficient control means for instructing the motion vector interpolating means to weight a representative motion vector is provided for determining a weighting coefficient for each representative motion vector and instructing the motion vector interpolating means to weight each representative motion vector.
- 8. A video coding device for encoding predicted error-information determined as a difference between an input video-frame and an predicted video-frame obtained by executing motion-compensated interframe prediction, wherein a motion-compensative interframe predicting portion is provided with a variable-area predicted-frame generating portion for dividing a processable area of the input video-frame into suitable areas according to motion vectors and a reference video-frame and generating a predicted video-frame by affine transformation and a area dividing pattern deciding portion for controlling dividing of a processable area and outputting a predicted video-frame and side-information such as motion vectors and area-dividing information.
-
9. A video coding device for encoding predicted error information determined as a difference between an input video-frame and an predicted video-frame obtained by executing motion-compensated interframe prediction, wherein a motion-compensated interframe-predicting portion is provided with a variable-area predicted-frame generating portion for dividing a processable area of the input video-frame into suitable areas according to motion vectors and a reference video frame and generating a predicted video-frame by affine transformation and a predicted video-frame by translational displacement of processable areas and an area dividing pattern deciding portion for controlling dividing of a processable area and outputting a predicted video-frame and side-information such as motion vectors and area dividing information.
-
10. A video coding device for encoding predicted error information determined as a difference between an input video-frame and a predicted video-frame obtained by executing motion-compensated interframe prediction, wherein a motion-compensated interframe-predicting portion is provided with an effective-area selecting portion for selecting a valid processing mask or an invalid processing mask depending upon location of an objective area in a video-frame when searching a motion vector.
-
12. A video coding device for encoding predicted error information determined as a difference between an input video-frame and a predicted video-frame obtained by executing motion-compensated interframe prediction, wherein a motion-vector coding portion is provided with a side-information coding portion for encoding an additional motion vector as a difference from a mean of four basic motion-vectors.
-
14. A video coding device for encoding predicted error information determined as a difference between an input video-frame and a predicted video-frame obtained by executing motion-compensated interframe prediction, wherein a motion-vector coding portion is provided with a side-information coding portion for encoding an additional motion vector positioned between two basic motion-vectors as a difference from a mean of the two basic motion-vectors and encoding a center additional motion-vector as a difference from a mean of four basic motion-vectors.
- 16. A video coding device for encoding predicted error information determined as a difference between an input video-frame and a predicted video-frame obtained by motion-compensated interframe prediction, wherein a motion-vector coding portion is provided with a side-information coding portion for encoding an objective motion-vector value by prediction from values of three motion-vectors which are already encoded basic or additional motion-vectors existing at the left-side, the just upper-side and the upper right-side of the object motion vector.
- 23. A video decoding device for reproducing a video-frame from a coded side-information inputted from a video-coding device and a reference video-frame inputted from a frame memory, wherein a motion-compensated interframe-predicting portion for producing and outputting a predicted video-frame with a changed processable area-size is provided with a side-information decoding portion for decoding coded side-information received from the video coding device and obtaining therefrom motion-vectors and area-dividing information and a variable-area predicted video-frame generating portion for generating a predicted video-frame by using motion vectors and area dividing information received from the side-information decoding portion and a reference video-frame received from the frame memory.
-
24. A video decoding device for reproducing a video-frame from a coded side-information inputted from a video-coding device and a reference video-frame inputted from a frame memory, wherein a side-information decoding portion is provided for decoding four basic motion-vectors contained in the side-information before decoding motion-vectors and for decoding additional motion-vectors representing a difference from a mean of the basic vectors.
-
26. A video decoding device for reproducing a video-frame from a coded side-information inputted from a video-coding device and a reference video-frame inputted from a frame memory, wherein a side-information decoding portion is provided for decoding four basic motion-vectors contained in the side-information before decoding motion-vectors and for decoding an additional motion-vector positioned betweentwo basic motion-vectors as a difference from an obtained mean of the two basic motion-vectors and decoding a center additional motion-vector as a difference from an obtained mean of four basic motion-vectors.
- 28. A video decoding device for reproducing a video-frame from a coded side-information inputted from a video-coding device and a reference video-frame inputted from a frame memory, wherein a side-information decoding portion is provided for decoding a objective motion-vector value by prediction from values of three motion-vectors which are already decoded basic or additional motion-vectors existing at the left-side, the just upper-side and the upper right-side of the object motion vector.
-
33. A video coding device using an adaptive motion-compensated interframe-prediction system, comprising:
-
a predicting portion for producing a plurality of predictive images of variable-size areas by applying different predicting methods to each of the variable-size areas in the process of the motion-compensated interframe prediction and outputting the produced predictive images;
an area prediction deciding portion for determining an adaptive area size and an adaptive prediction method according to a plurality of the predictive images received from the predicting portion and outputting side-information including area-information, prediction-mode information, motion-vectors and so on;
and a side-information coding portion for encoding the side-information outputted from the area prediction deciding portion. - View Dependent Claims (37)
-
-
34. A video coding device using an adaptive motion-compensated interframe-prediction system, comprising:
-
a predicting portion for producing a plurality of predictive images of respective unit areas or further-divided subareas by applying different predicting methods to each of the unit areas or each of the subareas in the process of the motion-compensated interframe prediction and then outputting the produced predictive images;
an area prediction deciding portion for determining an area-information indicating whether the predicted images received from the predicting portion are unit-area images or subarea images and prediction methods applied to the respective predicted images and outputting side-information including area-information, prediction mode information, motion-vectors and so on; and
a side-information coding portion for encoding the side-information received from the area prediction deciding portion.
-
-
35. A video coding device using an adaptive motion-compensated interframe-prediction system, comprising:
-
a predicting portion for producing a plurality of predictive images of respective variable-size areas by using a block-displacement (overlapped motion-compensative) predicting method, an affine transform predicting method, bilinear transform predicting method and a background predicting method, etc. in the process of the motion-compensated interframe prediction and then outputting the produced predictive images;
an area prediction deciding portion for determining an adaptive area-size and an adaptive prediction method according to a plurality of the predictive images received from the predicting portion and outputting side-information including area-information, prediction mode information and motion-vectors and so on; and
a side-information coding portion for encoding the side-information received from the area prediction deciding portion.
-
-
36. A video coding device using an adaptive motion-compensated interframe-prediction system, which is provided with a predicting portion for diagonally dividing each encodable unit-area into two or four subareas, producing a predictive image for each subarea by affine transformation in the process of the motion-compensated interframe prediction and outputting the produced predicted images.
-
38. A video decoding device using an adaptive motion-compensated interframe-prediction system, comprising:
-
a side-information decoding potion for decoding coded side-information including area-information, prediction mode information and motion-vectors, and so on and outputting the decoded side-information;
a predicting portion for producing a plurality of predictive images of variable-size areas by applying different predicting methods to each of the variable-size areas in the process of the motion-compensated interframe prediction and outputting the produced predictive images; and
an area-prediction-mode selecting portion for producing an adaptive predictive image from a plurality of the predictive images received from the predicting portion according to the information received from the side-information decoding portion and outputting the produced predictive images. - View Dependent Claims (42)
-
-
39. A video decoding device using an adaptive motion-compensated interframe-prediction system, comprising:
-
a side-information decoding potion for decoding coded side-information including area-information, prediction mode information and motion-vectors, and so on and outputting the decoded side-information;
a predicting portion for producing a plurality of predictive images of respective decodable unit-areas or further-divided subareas by applying different predicting methods to each of the unit areas or each of the subareas in the process of the motion-compensated interframe prediction and then outputting the produced predictive images; and
an area-prediction-mode selecting portion for producing an adaptive predictive image from a plurality of the predictive images received from the predicting portion according to the information received from the side-information decoding portion and then outputting the produced predictive images.
-
-
40. A video decoding device using an adaptive motion-compensated interframe-prediction system, comprising:
-
a side-information decoding potion for decoding coded side-information including area-information, prediction mode information and motion-vectors, and so on and outputting the decoded side-information;
a predicting portion for producing a plurality of predictive images of respective decodable unit-area or further divided subareas by using a block-displacement (overlapped motion-compensative) predicting method, an affine transform predicting method, bilinear transform predicting method and a background predicting method, etc. in the process of the motion-compensated interframe compensated interframe prediction and then outputting the produced predictive images; and
an area-prediction-mode selecting portion for producing an adaptive predictive image from a plurality of the predictive images received from the predicting portion according to the information received from the side-information decoding portion and outputting the produced predicted images.
-
-
41. A video decoding device using an adaptive motion-compensated interframe prediction system, which is provided with a predicting portion for diagonally dividing each decodable unit-area into two or four subareas, producing a predictive image for each subarea by affine transformation in the process of the motion-compensated interframe prediction and outputting the produced predicted images.
Specification