FRAME INTERPOLATION DEVICE AND METHOD
First Claim
1. A frame interpolation apparatus for generating an interpolated frame between a first frame and a second frame in a video signal, the second frame temporally preceding the first frame, the frame interpolation apparatus comprising:
- a reference image generator for receiving image signals of the first frame and the second frame and generating therefrom a plurality of sets of reference images, the reference images in each one of the sets having mutually identical resolution, the reference images in different ones of the sets having different resolutions;
a motion estimation unit for performing motion estimation based on the plurality of sets of reference images; and
an interpolated frame generator for generating an image signal of the interpolated frame, each pixel on the interpolated frame being based on at least one motion vector candidate obtained as a result of motion estimation performed by the motion estimation unit using the set of reference images of highest resolution;
whereinthe motion estimation unit sequentially generates information representing results of motion estimation by proceeding sequentially from motion estimation using the reference images of lowest resolution to motion estimation using the reference images of the highest resolution; and
in performing motion estimation by using the reference images of each resolution, the motion estimation unit determines a search range, for each pixel processed on the second frame, byusing information indicating a motion vector candidate obtained for the pixel being processed as a result of motion estimation performed using the set of reference images of next lower resolution, andalso using information indicating a motion vector candidate obtained for a pixel neighboring the pixel being processed as a result of motion estimation performed using the set of reference images of the next lower resolution.
1 Assignment
0 Petitions
Accused Products
Abstract
To interpolate a frame between two frames of a video signal, sets of reference images are generated, each set having a different resolution level. Motion between the two frames is estimated at each resolution level by using these sets of reference images. For each pixel processed at each resolution level, multiple motion vector candidates are obtained. Information indicating the multiple motion vector candidates is used to select motion search ranges at the next higher resolution level. To determine the motion search range for a pixel, selected motion vector candidates pertaining both to the pixel itself and to its neighboring pixels are used. An interpolated frame of high image quality is thereby obtainable without increased computation and with reduced risk of major image defects due to erroneous motion estimation.
-
Citations
21 Claims
-
1. A frame interpolation apparatus for generating an interpolated frame between a first frame and a second frame in a video signal, the second frame temporally preceding the first frame, the frame interpolation apparatus comprising:
-
a reference image generator for receiving image signals of the first frame and the second frame and generating therefrom a plurality of sets of reference images, the reference images in each one of the sets having mutually identical resolution, the reference images in different ones of the sets having different resolutions; a motion estimation unit for performing motion estimation based on the plurality of sets of reference images; and an interpolated frame generator for generating an image signal of the interpolated frame, each pixel on the interpolated frame being based on at least one motion vector candidate obtained as a result of motion estimation performed by the motion estimation unit using the set of reference images of highest resolution;
whereinthe motion estimation unit sequentially generates information representing results of motion estimation by proceeding sequentially from motion estimation using the reference images of lowest resolution to motion estimation using the reference images of the highest resolution; and in performing motion estimation by using the reference images of each resolution, the motion estimation unit determines a search range, for each pixel processed on the second frame, by using information indicating a motion vector candidate obtained for the pixel being processed as a result of motion estimation performed using the set of reference images of next lower resolution, and also using information indicating a motion vector candidate obtained for a pixel neighboring the pixel being processed as a result of motion estimation performed using the set of reference images of the next lower resolution. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A frame interpolation method for generating an interpolated frame between a first frame and a second frame in a video signal, the second frame temporally preceding the first frame, the frame interpolation method comprising:
-
receiving image signals of the first frame and the second frame and generating therefrom a plurality of sets of reference images, the reference images in each one of the sets having mutually identical resolution, the reference images in different ones of the sets having different resolutions; performing motion estimation based on the plurality of sets of reference images; and generating an image signal of the interpolated frame, each pixel on the interpolated frame being based on at least one motion vector candidate obtained as a result of the motion estimation performed using the set of reference images of highest resolution;
whereinperforming the motion estimation further comprises sequentially generating information representing results of motion estimation by proceeding sequentially from motion estimation using the reference images of lowest resolution to motion estimation using the reference images of the highest resolution; and performing the motion estimation by using the reference images of each resolution further comprises determining a search range, for each pixel processed on the second frame, by using information indicating a motion vector candidate obtained for the pixel being processed as a result of motion estimation performed using the set of reference images of next lower resolution, and also using information indicating a motion vector candidate obtained for a pixel neighboring the pixel being processed as a result of motion estimation performed using the set of reference images of the next lower resolution. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
Specification