IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM FOR IMAGE PROCESSING
2 Assignments
0 Petitions
Accused Products
Abstract
An image processing device including: a motion amount estimating unit estimating a first motion amount indicating a displacement amount of a second picture with respect to a first picture; an area setting unit setting an area to be used for post-processing for each of the first picture and a first corrected picture, using feature points extracted from the first picture and the second picture; a post-processing unit generating a first cutout picture from the first picture and a second cutout picture from the first corrected picture and estimating a second motion amount indicating a displacement amount of the second cutout picture with respect to the first cutout picture; and a motion amount obtaining unit obtaining a motion amount indicating a displacement amount between the first picture and the second picture, from the estimated first motion amount and the estimated second motion amount.
37 Citations
31 Claims
-
1-16. -16. (canceled)
-
17. An image processing device which corrects displacement between pictures obtained by temporally-continuous capturing, the image processing device comprising:
-
a motion amount estimating unit configured to estimate a first motion amount indicating a rotational displacement amount of a second picture with respect to a first picture, the rotational displacement amount being obtained based on a combination of axis rotational directions of mutually perpendicular three axes, and the second picture being captured temporally after the first picture; an area setting unit configured to set an area to be used for post-processing for each of the first picture and a first corrected picture, using feature points extracted from the first picture and the second picture, the first corrected picture being generated from the second picture whose displacement is corrected using the estimated first motion amount; a post-processing unit configured to perform the post-processing, by generating a first cutout picture and a second cutout picture and estimating a second motion amount indicating a displacement amount of the second cutout picture with respect to the first cutout picture, the first cutout picture being generated from the area set in the first picture and the second cutout picture being generated from the area set in the first corrected picture; and a motion amount obtaining unit configured to obtain a motion amount indicating a displacement amount between the first picture and the second picture, from the estimated first motion amount and the estimated second motion amount, wherein the motion amount estimating unit includes; a feature point extracting unit configured to extract the feature points from each of the first picture and the second picture; a distortion correcting unit configured to correct distortion (i) developed due to optical strain of an optical system used for capturing and (ii) found between the feature points of the first picture and the feature points of the second picture, the feature points being extracted by the feature point extracting unit; and a feature point matching unit configured to match the feature points of the first picture and the feature points of the second picture with each other to estimate the first motion amount, the first picture and the second picture having the distortion corrected by the distortion correcting unit. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. An image processing method for correcting displacement between pictures obtained by temporally-continuous capturing, the image processing device comprising:
-
estimating a first motion amount indicating a rotational displacement amount of a second picture with respect to a first picture, the rotational displacement amount being obtained based on a combination of axis rotational directions of mutually perpendicular three axes, and the second picture being captured temporally after the first picture; setting an area to be used for post-processing for each of the first picture and a first corrected picture, using feature points extracted from the first picture and the second picture, the first corrected picture being generated from the second picture whose displacement is corrected using the estimated first motion amount; performing the post-processing, by generating a first cutout picture and a second cutout picture and estimating a second motion amount indicating a displacement amount of the second cutout picture with respect to the first cutout picture, the first cutout picture being generated from the area set in the first picture and the second cutout picture being generated from the area set in the first corrected picture; and obtaining a motion amount indicating a displacement amount between the first picture and the second picture, from the estimated first motion amount and the estimated second motion amount, wherein the estimating includes; extracting the feature points from each of the first picture and the second picture; correcting distortion (i) developed due to optical strain of an optical system used for capturing and (ii) found between the feature points of the first picture and the feature points of the second picture, the feature points being extracted in the extracting; and matching the feature points of the first picture and the feature points of the second picture with each other to estimate the first motion amount, the first picture and the second picture having the distortion corrected in the correcting.
-
-
30. A program for causing a computer to correct displacement between pictures obtained by temporally-continuous capturing, the program which includes:
-
estimating a first motion amount indicating a rotational displacement amount of a second picture with respect to a first picture, the rotational displacement amount being obtained based on a combination of axis rotational directions of mutually perpendicular three axes, and the second picture being captured temporally after the first picture; setting an area to be used for post-processing for each of the first picture and a first corrected picture, using feature points extracted from the first picture and the second picture, the first corrected picture being generated from the second picture whose displacement is corrected using the estimated first motion amount; performing the post-processing, by generating a first cutout picture and a second cutout picture and estimating a second motion amount indicating a displacement amount of the second cutout picture with respect to the first cutout picture, the first cutout picture being generated from the area set in the first picture and the second cutout picture being generated from the area set in the first corrected picture; and obtaining a motion amount indicating a displacement amount between the first picture and the second picture, from the estimated first motion amount and the estimated second motion amount, wherein the estimating includes; extracting the feature points from each of the first picture and the second picture; correcting distortion (i) developed due to optical strain of an optical system used for capturing and (ii) found between the feature points of the first picture and the feature points of the second picture, the feature points being extracted in the extracting; and matching the feature points of the first picture and the feature points of the second picture with each other to estimate the first motion amount, the first picture and the second picture having the distortion corrected in the correcting.
-
-
31. An integrated circuit for correcting displacement between pictures obtained by temporally-continuous capturing, the integrated circuit comprising:
-
a motion amount estimating unit configured to estimate a first motion amount indicating a rotational displacement amount of a second picture with respect to a first picture, the rotational displacement amount being obtained from a combination of axis rotational directions of mutually perpendicular three axes, and the second picture being captured temporally after the first picture; an area setting unit configured to set an area to be used for post-processing for each of the first picture and a first corrected picture, using feature points extracted from the first picture and the second picture, the first corrected picture being generated from the second picture whose displacement is corrected using the estimated first motion amount; a post-processing unit configured to perform the post-processing, by generating a first cutout picture and a second cutout picture and estimating a second motion amount indicating a displacement amount of the second cutout picture with respect to the first cutout picture, the first cutout picture being generated from the area set in the first picture and the second cutout picture being generated from the area set in the first corrected picture; and a motion amount obtaining unit configured to obtain a motion amount indicating a displacement amount between the first picture and the second picture, from the estimated first motion amount and the estimated second motion amount, wherein the motion amount estimating unit includes; a feature point extracting unit configured to extract the feature points from each of the first picture and the second picture; a distortion correcting unit configured to correct distortion (i) developed due to optical strain of an optical system used for capturing and (ii) found between the feature points of the first picture and the feature points of the second picture, the feature points being extracted by the feature point extracting unit; and a feature point matching unit configured to match the feature points of the first picture and the feature points of the second picture with each other to estimate the first motion amount, the first picture and the second picture having the distortion corrected by the distortion correcting unit.
-
Specification