Image processing device, image processing method and image processing program
First Claim
1. An image processing device for generating an output image as a color image wherein each pixel has color information, using a first image as a sparsely color sampled image wherein each pixel has monochromatic information, which is obtained by an image sensor which has multiple pixels that photoelectrically convert light of a plurality of colors, the image processing device comprising:
- a simulation unit configured to generate a second image as an estimated image of the sparsely color sampled image by simulating imaging using the image sensor based on the first image as the color image;
a comparison unit configured to compare the second image with the first image, and to generate first information which shows a comparison result;
a converting unit configured to convert the first information into second information which corresponds to the color image;
a penalty computing unit configured to compute a correction amount of the first image based on an image penalty which is determined corresponding to the first image; and
a correction unit configured to generate a third image as the color image, by correcting the first image based on at least one of the second information and the correction amount;
wherein the third image which is generated by repeating the processing of the correction unit as the input image of the third image, becomes the output image.
1 Assignment
0 Petitions
Accused Products
Abstract
An image processing device generates an output image as a color image wherein each pixel has color information, using a first image as a sparsely color sampled image wherein each pixel has monochromatic information obtained by an image sensor which has multiple pixels each photoelectrically converting light of a plurality of colors. The device includes: a simulation unit for generating a second image as an estimated image of the sparsely color sampled image; a comparison unit for comparing the second image with the first image, and generating first information thereof; a converting unit for converting the first information into second information corresponding to the color image; a penalty computing unit for computing the correction amount of the input image; and a correction unit for generating a third image by correcting the input image based on the second information and the correcting amount; this third image being used as an output image.
-
Citations
20 Claims
-
1. An image processing device for generating an output image as a color image wherein each pixel has color information, using a first image as a sparsely color sampled image wherein each pixel has monochromatic information, which is obtained by an image sensor which has multiple pixels that photoelectrically convert light of a plurality of colors, the image processing device comprising:
-
a simulation unit configured to generate a second image as an estimated image of the sparsely color sampled image by simulating imaging using the image sensor based on the first image as the color image;
a comparison unit configured to compare the second image with the first image, and to generate first information which shows a comparison result;
a converting unit configured to convert the first information into second information which corresponds to the color image;
a penalty computing unit configured to compute a correction amount of the first image based on an image penalty which is determined corresponding to the first image; and
a correction unit configured to generate a third image as the color image, by correcting the first image based on at least one of the second information and the correction amount;
wherein the third image which is generated by repeating the processing of the correction unit as the input image of the third image, becomes the output image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. An image processing device for generating an output image as a color image wherein each pixel has color information, using a first image as a sparsely color sampled image wherein each pixel has monochromatic information, which is obtained by an image sensor which has multiple pixels that photoelectrically convert light of a plurality of colors, the image processing device comprising:
-
a simulation unit configured to generate a second image as an estimated image of the sparsely color sampled image, by simulating imaging using the image sensor including nonlinear conversion based on the first image as the color image;
a comparison unit configured to compare the second image with the first image, and to generate first information which shows a comparison result;
a converting unit configured to convert the first image into the second information which corresponds to the color image; and
a correction unit configured to generate a third image as the color image, by correcting the input image based on the second information;
wherein the third image which is generated by repeating the processing of the correction unit as the input image of the third image, becomes the output image. - View Dependent Claims (15, 16)
-
-
17. An image processing method for generating an output image as a color image wherein each pixel has color information, using a first image as a sparsely color sampled image wherein each pixel has monochromatic information, which is obtained by an image sensor which has multiple pixels that photoelectrically convert light of a plurality of colors, the method comprising:
-
a simulation step for generating a second image as an estimated image of the sparsely color sampled image by simulating imaging using the image sensor based on the first image as the color image;
a comparison step for comparing the second image with the first image, and generating first information which shows a comparison result;
a converting step for converting the first information into the second information which corresponds to the color image;
a penalty computing step for computing a correction amount of the input image based on the image penalty which is determined corresponding to the input image; and
a correction step for generating a third image as the color image, by correcting the input image based on at least one of the second information and the correcting amount;
wherein the third image which is generated by repeating the processing of the correction step as the input image of the third image, becomes the output image. - View Dependent Claims (18)
-
-
19. An image processing method for generating an output image as a color image wherein each pixel has color information, using a first image as a sparsely color sampled image wherein each pixel has monochromatic information, which is obtained by an image sensor which has multiple pixels that photoelectrically convert light of a plurality of colors, the method comprising:
-
a simulation step for generating a second image as an estimated image of the sparsely color sampled image by simulating imaging using the image sensor including nonlinear conversion based on the first image as the color image;
a comparison step for comparing the second image with the first image and generating first information which shows a comparison result;
a converting step for converting the first information into the second information which corresponds to the color image; and
a correction step for generating a third image as the color image by correcting the input image based on the second information;
wherein the third image which is generated by repeating the processing of the correction step as the input image of the third image, becomes the output image. - View Dependent Claims (20)
-
Specification