System and Method for Super-Resolution Imaging from a Sequence of Color Filter Array (CFA) Low-Resolution Images
First Claim
1. A system for improving picture quality of color images by combing the content of a plurality of frames of the same subject;
- comprising;
at least one processor;
the at least one processor comprising a memory for storing a plurality of frames of a subject;
the at least one processor operating to combine the content of plurality of frames of the subject into a combined color image by performing;
a process in which at least two multicolored frames are converted to monochromatic predetermined color frames;
a gross shift process in which the gross shift translation of one monochromatic predetermined color frame is determined relative to a reference monochromatic predetermined color frame;
a subpixel shift process utilizing a correlation method to determine the translational and/or rotational differences of one monochromatic predetermined color frame to the reference monochromatic predetermined color frame to estimate sub-pixel shifts and/or rotations between the frames; and
an error reduction process to determine whether the resolution of the resulting combined color image is of sufficient resolution;
the error reduction process comprising applying at least one spatial frequency domain constraint and at least one spatial domain constraint to the combined color image to produce at least one high-resolution full color image.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and system for improving picture quality of color images by combing the content of a plurality of frames of the same subject; comprising: at least one processor; the at least one processor comprising a memory for storing a plurality of frames of a subject; the at least one processor operating to combine the content of plurality of frames of the subject into a combined color image by performing: a process in which at least two multicolored frames are converted to monochromatic predetermined color frames; a gross shift process in which the gross shift translation of one monochromatic predetermined color frame is determined relative to a reference monochromatic predetermined color frame; a subpixel shift process utilizing a correlation method to determine the translational and/or rotational differences of one monochromatic predetermined color frame to the reference monochromatic predetermined color frame to estimate sub-pixel shifts and/or rotations between the frames; and an error reduction process to determine whether the resolution of the resulting combined color image is of sufficient resolution; the error reduction process comprising applying at least one spatial frequency domain constraint and at least one spatial domain constraint to the combined color image to produce at least one high-resolution full color image.
-
Citations
22 Claims
-
1. A system for improving picture quality of color images by combing the content of a plurality of frames of the same subject;
- comprising;
at least one processor;
the at least one processor comprising a memory for storing a plurality of frames of a subject;
the at least one processor operating to combine the content of plurality of frames of the subject into a combined color image by performing;a process in which at least two multicolored frames are converted to monochromatic predetermined color frames; a gross shift process in which the gross shift translation of one monochromatic predetermined color frame is determined relative to a reference monochromatic predetermined color frame; a subpixel shift process utilizing a correlation method to determine the translational and/or rotational differences of one monochromatic predetermined color frame to the reference monochromatic predetermined color frame to estimate sub-pixel shifts and/or rotations between the frames; and an error reduction process to determine whether the resolution of the resulting combined color image is of sufficient resolution;
the error reduction process comprising applying at least one spatial frequency domain constraint and at least one spatial domain constraint to the combined color image to produce at least one high-resolution full color image. - View Dependent Claims (2, 3, 4, 5, 6, 7)
- comprising;
-
8. A system for super-resolving images from color filter array (CFA) low-resolution sequences comprising:
-
an image processor having an input for inputting multiple CFA images of a scene with sub-pixel translations and rotations;
one of the images of the scene being a reference image; andat least one memory comprising; a monochromatic color image constructing algorithm for creating at least one monochromatic color image for each image in the input sequence; a gross translation estimation algorithm for estimating overall translations of the at least one monochromatic color image with respect to the reference image on the image processor; a sub-pixel estimation algorithm for estimating the sub-pixel translations and/and or rotations of at least one monochromatic color image with respect to the reference image; and an error reduction algorithm for applying at least one spatial frequency domain constraint and at least one spatial domain constraint to the CFA low resolution images to produce at least one high-resolution full color image. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15)
-
-
16. A method of super-resolving CFA images affected by movement including translation and rotation comprising:
-
inputting frames of low-resolution CFA images of a scene into a processor;
at least one of the frames being affected by movement;obtaining at least one monochromatic color image for each image in the input frames; estimating the gross translations and sub-pixel shifts and rotations due to the movement using the monochromatic color images; and applying an error reduction algorithm utilizing at least one spatial frequency domain constraint and at least one spatial domain constraint to produce a high-resolution full color output image. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
Specification