IMAGE PROCESSING APPARATUS AND METHOD
First Claim
1. An image processing apparatus generating a virtual viewpoint image from a captured image acquired by an imaging unit having distortion characteristics and ambient light amount decrease characteristics, based on distortion characteristics and ambient light amount decrease characteristics of a virtual camera, the image processing apparatus comprising:
- a first calculation unit configured to execute a distortion correction on coordinates of a target pixel in the virtual viewpoint image based on the distortion characteristics of the virtual camera and to calculate coordinates in the virtual viewpoint image after the distortion correction;
a second calculation unit configured to calculate ideal coordinates in the captured image from the coordinates in the virtual viewpoint image after the distortion correction;
a third calculation unit configured to calculate real coordinates in the captured image from the ideal coordinates in the captured image based on the distortion characteristics of the imaging unit;
a fourth calculation unit configured to calculate a pixel value corresponding to the real coordinates from image data of the virtual viewpoint image; and
a correction unit configured to correct the pixel value corresponding to the real coordinates based on the ambient light amount decrease characteristics of the imaging unit and the ambient light amount decrease characteristics of the virtual camera.
2 Assignments
0 Petitions
Accused Products
Abstract
An image processing apparatus executes a distortion correction on coordinates of a target pixel in a virtual viewpoint image based on distortion characteristics of a virtual camera and calculates coordinates in the virtual viewpoint image after the distortion correction. The image process apparatus calculates ideal coordinates in a captured image from the coordinates in the virtual viewpoint image after the distortion correction and calculates real coordinates in the captured image from the ideal coordinates in the captured image based on distortion characteristics of an imaging unit. The image process apparatus calculates a pixel value corresponding to the real coordinates from image data of the virtual viewpoint image and corrects the pixel value corresponding to the real coordinates based on ambient light amount decrease characteristics of the imaging unit and ambient light amount decrease characteristics of the virtual camera.
-
Citations
6 Claims
-
1. An image processing apparatus generating a virtual viewpoint image from a captured image acquired by an imaging unit having distortion characteristics and ambient light amount decrease characteristics, based on distortion characteristics and ambient light amount decrease characteristics of a virtual camera, the image processing apparatus comprising:
-
a first calculation unit configured to execute a distortion correction on coordinates of a target pixel in the virtual viewpoint image based on the distortion characteristics of the virtual camera and to calculate coordinates in the virtual viewpoint image after the distortion correction; a second calculation unit configured to calculate ideal coordinates in the captured image from the coordinates in the virtual viewpoint image after the distortion correction; a third calculation unit configured to calculate real coordinates in the captured image from the ideal coordinates in the captured image based on the distortion characteristics of the imaging unit; a fourth calculation unit configured to calculate a pixel value corresponding to the real coordinates from image data of the virtual viewpoint image; and a correction unit configured to correct the pixel value corresponding to the real coordinates based on the ambient light amount decrease characteristics of the imaging unit and the ambient light amount decrease characteristics of the virtual camera. - View Dependent Claims (2, 3, 4, 5)
-
-
6. An image processing method for generating a virtual viewpoint image from a captured image acquired by an imaging unit having distortion characteristics and ambient light amount decrease characteristics, based on distortion characteristics and ambient light amount decrease characteristics of a virtual camera, the image processing method comprising:
-
executing a distortion correction on coordinates of a target pixel in the virtual viewpoint image based on the distortion characteristics of the virtual camera and calculating coordinates in the virtual viewpoint image after the distortion correction; calculating ideal coordinates in the captured image from the coordinates in the virtual viewpoint image after the distortion correction; calculating real coordinates in the captured image from the ideal coordinates in the captured image based on the distortion characteristics of the imaging unit; calculating a pixel value corresponding to the real coordinates from image data of the virtual viewpoint image; and correcting the pixel value corresponding to the real coordinates based on the ambient light amount decrease characteristics of the imaging unit and the ambient light amount decrease characteristics of the virtual camera.
-
Specification