Temporal interpolation of a pixel on basis of occlusion detection
First Claim
1. A method of determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the method comprising an image apparatus that perform the following steps:
- computing a first motion vector difference on basis of a first ({right arrow over (D)}p) and second ({right arrow over (D)}pp) motion vector of a first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) corresponding to the first image, the first motion vector ({right arrow over (D)}p) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the second motion vector ({right arrow over (D)}pp) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) using the first motion vector ({right arrow over (D)}p);
computing a second motion vector difference on basis of a third ({right arrow over (D)}n) and fourth ({right arrow over (D)}nn) motion vector of a second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)}n) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)}nn) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)}n);
and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.
12 Assignments
0 Petitions
Accused Products
Abstract
A method of determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image is disclosed. The method comprises: computing a first motion vector difference on basis of a first (Dp) and second (Dpp) motion vector of a first motion vector field (D3(x, n−1)) corresponding to the first image; computing a second motion vector difference on basis of a third (Dn) and fourth (Dnn) motion vector of a second motion vector field (D3(x, n)) corresponding to the second image; and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.
-
Citations
10 Claims
-
1. A method of determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the method comprising an image apparatus that perform the following steps:
-
computing a first motion vector difference on basis of a first ({right arrow over (D)}p) and second ({right arrow over (D)}pp) motion vector of a first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) corresponding to the first image, the first motion vector ({right arrow over (D)}p) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the second motion vector ({right arrow over (D)}pp) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) using the first motion vector ({right arrow over (D)}p);computing a second motion vector difference on basis of a third ({right arrow over (D)}n) and fourth ({right arrow over (D)}nn) motion vector of a second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)}n) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)}nn) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)}n); and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A pixel value determining unit for determining a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the pixel value determining unit comprising:
-
first computing means for computing a first motion vector difference on basis of a first ({right arrow over (D)}p) and second ({right arrow over (D)}pp) motion vector of a first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1))corresponding to the first image, the first motion vector ({right arrow over (D)}p) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the second motion vector ({right arrow over (D)}pp) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)}n−
1)) using the first motion vector ({right arrow over (D)}p);second computing means for computing a second motion vector difference on basis of a third ({right arrow over (D)}n)) and fourth ({right arrow over (D)}nn) motion vector of a second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)}n) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)}nn) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)}n); and establishing means for establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.
-
-
7. An image processing apparatus comprising:
-
receiving means for receiving a signal corresponding to a sequence of video images; motion estimation means for estimating a first motion vector field for a first one of the video images and a second motion vector field for a second one of the video images; and a pixel value determining unit for determining a value for a particular pixel of a particular image being temporarily located intermediate the first one of the video images and the second one of the video images, the pixel value determining unit comprising; first computing means for computing a first motion vector difference on basis of a first ({right arrow over (D)}p) and second ({right arrow over (D)}pp) motion vector of a first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) corresponding to the first image, the first motion vector ({right arrow over (D)}p) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the second motion vector ({right arrow over (D)}pp) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) using the first motion vector ({right arrow over (D)}p);second computing means for computing a second motion vector difference on basis of a third ({right arrow over (D)}n) and fourth ({right arrow over (D)}nn) motion vector of a second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)}n) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)}nn) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)}n); establishing means for establishing the value of the particular pixel on basis of a first value of a first pixel of the first one of the video images if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second one of the video images if the second motion vector difference is smaller than the first motion vector difference. - View Dependent Claims (8, 9)
-
-
10. A computer program product embodied on a computer-readable medium to be loaded by a computer arrangement, comprising instructions to determine a value for a particular pixel of a particular image being temporarily located intermediate a first image and a second image, the computer program product, after being loaded providing said processing means with the capability to carry out:
-
computing a first motion vector difference on basis of a first ({right arrow over (D)}p) and second ({right arrow over (D)}pp) motion vector of a first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) corresponding to the first image, the first motion vector ({right arrow over (D)}p) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) on basis of a particular spatial position ({right arrow over (x)}) of the particular pixel and a particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the second motion vector ({right arrow over (D)}pp) being selected from the first motion vector field ({right arrow over (D)}3({right arrow over (x)},n−
1)) using the first motion vector ({right arrow over (D)}p);computing a second motion vector difference on basis of a third ({right arrow over (D)}n) and fourth ({right arrow over (D)}nn) motion vector of a second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) corresponding to the second image, the third motion vector ({right arrow over (D)}n) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) on basis of the particular spatial position ({right arrow over (x)}) of the particular pixel and the particular motion vector ({right arrow over (D)}c) being estimated for the particular pixel and the fourth motion vector ({right arrow over (D)}nn) being selected from the second motion vector field ({right arrow over (D)}3({right arrow over (x)},n)) using the third motion vector ({right arrow over (D)}n); and establishing the value of the particular pixel on basis of a first value of a first pixel of the first image if the first motion vector difference is smaller than the second motion vector difference and establishing the value of the particular pixel on basis of a second value of a second pixel of the second image if the second motion vector difference is smaller than the first motion vector difference.
-
Specification