Super resolution and color motion artifact correction in a pulsed color imaging system
First Claim
Patent Images
1. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:
- actuating an emitter to emit a plurality of pulses of electromagnetic radiation, wherein the plurality of pulses comprises a sequence of predetermined wavelengths of electromagnetic radiation to cause illumination within the light deficient environment;
pulsing said emitter at a predetermined interval;
sensing reflected electromagnetic radiation from each of said pulses with a pixel array;
wherein said pixel array is actuated at a sensing interval that corresponds to the pulse interval of said emitter;
creating a sample frame for each pulse of electromagnetic radiation in the sequence, wherein the sample frame comprises one of chrominance or luminance;
providing a plurality of sample frames to create an output frame, wherein the plurality of sample frames comprise a plurality of luminance sample frames and at least one chrominance sample frame;
detecting motion of objects being imaged;
increasing resolution for the pixel array by compensating for the detected motion based at least in part on the luminance sample frames;
wherein increasing resolution comprises;
sensing luminescence of a plurality of neighboring pixels to gather luminance data;
bilinear interpolating the luminance data into a first upscaled data set;
bicubic interpolating the luminance data into a second upscaled data set;
creating a baseline with no interpolation of the luminance data into a third upscaled data set; and
creating a stream of images by combining each output frame, such that there is a constant output frame rate.
2 Assignments
0 Petitions
Accused Products
Abstract
The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and associated structures, methods and features. The features of the systems and methods described herein may include providing improved resolution and color reproduction.
-
Citations
46 Claims
-
1. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:
-
actuating an emitter to emit a plurality of pulses of electromagnetic radiation, wherein the plurality of pulses comprises a sequence of predetermined wavelengths of electromagnetic radiation to cause illumination within the light deficient environment; pulsing said emitter at a predetermined interval; sensing reflected electromagnetic radiation from each of said pulses with a pixel array; wherein said pixel array is actuated at a sensing interval that corresponds to the pulse interval of said emitter; creating a sample frame for each pulse of electromagnetic radiation in the sequence, wherein the sample frame comprises one of chrominance or luminance; providing a plurality of sample frames to create an output frame, wherein the plurality of sample frames comprise a plurality of luminance sample frames and at least one chrominance sample frame; detecting motion of objects being imaged; increasing resolution for the pixel array by compensating for the detected motion based at least in part on the luminance sample frames; wherein increasing resolution comprises; sensing luminescence of a plurality of neighboring pixels to gather luminance data; bilinear interpolating the luminance data into a first upscaled data set; bicubic interpolating the luminance data into a second upscaled data set; creating a baseline with no interpolation of the luminance data into a third upscaled data set; and creating a stream of images by combining each output frame, such that there is a constant output frame rate. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A digital imaging method for use with an endoscope in ambient light deficient environments comprising:
-
actuating an emitter to emit a plurality of pulses of electromagnetic radiation, wherein the plurality of pulses comprises a sequence of predetermined wavelengths of electromagnetic radiation to cause illumination within the light deficient environment; pulsing said emitter at a predetermined interval; sensing reflected electromagnetic radiation from each of said pulses with a pixel array; wherein said pixel array is actuated at a sensing interval that corresponds to the pulse interval of said emitter; creating a sample frame for each pulse of electromagnetic radiation in the sequence, wherein the sample frame comprises one of chrominance or luminance; providing a plurality of sample frames to create an output frame, wherein the plurality of sample frames comprise a plurality of luminance sample frames and at least one chrominance sample frame; detecting motion of objects being imaged; increasing resolution for the pixel array by compensating for the detected motion based at least in part on the luminance sample frames; wherein increasing resolution comprises; sensing luminescence of a plurality of neighboring pixels to gather luminance data; bilinear interpolating the luminance data into a first upscaled data set; bicubic interpolating the luminance data into a second upscaled data set; creating a baseline with no interpolation of the luminance data into a third upscaled data set; correcting for color artifacts due to the pulsing of the emitter and the detected motion; and creating a stream of images by combining each output frame, such that there is a constant output frame rate. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46)
-
Specification