Real-time digital processor for producing full resolution color signals from a multi-color image sensor
First Claim
1. A digital circuit for generating a fully interpolated color signal from a single, multi-color image sensor having a two-dimensional pattern of photosites producing luminance and chrominance image signals corresponding to discrete, and respectively separate, pixel locations, said circuit comprising:
- (a) a first digital processing section for operating upon signals that are linearly related to the sensor signal level;
said first section including;
a black reference clamp for establishing a black reference value from the average black signal value of a predetermined number of pixels on the image sensor;
means for subtracting the black reference value from each image signal;
means for replacing image signals obtained from defective pixels with image signals from nearby pixels of the same color; and
means for interpolating additional luminance values for the pixel locations that produce chrominance signals, said interpolating means combining the signal values of nearby luminance pixels according to a predetermined algorithm, said interpolating means providing therefrom a fully interpolated stream of luminance signals and an uninterpolated stream of chrominance signals; and
(b) a second digital processing section for operating upon signals that are logarithmically related to the sensor signal level, said second section including;
means for generating logarithmic luminance and chrominance signals from the fully interpolated luminance image signals and from the uninterpolated chrominance image signals;
means for generating a log hue signal from the log chrominance and log luminance signals;
means operating upon the log hue signal for controlling white balance according to an offset value subtracted from the log hue signal;
means operating upon the log luminance image signal to modifiy signal gain according to a gain offset value input to the second processing section;
means for interpolating additional hue values for the pixel locations that produce luminance signals, said hue interpolating means combining the signal values of nearby chrominance pixel locations according to a predetermined algorithm; and
means for generating a fully interpolated color signal from said interpolated hue and luminance image signals.
1 Assignment
0 Petitions
Accused Products
Abstract
A digital processing system is described for processing luminance and chrominance signals from a single, multi-color image sensor. By concentrating signal improvements and corrections into an application-dependent post-processing phase, the pre-processing functions are isolated in a signle, generic pre-processor integrated circuit that provides fully interpolated color signals in a real-time system by utilizing a fully pipelined architecture. The pre-processor circuit separates luminance and chrominance interpolation so as to operate partly in quantized linear space and partly in quantized logarithmic space. The image signals are processed in a black reference clamp, a defect concealment circuit and a color separation and luminance interpolation circuit in linear space, using right shifts and additions to approximate predetermined multiplications. The signals are then transformed into hue signals and processed in log space for white balance and chroma (hue) interpolation. With the log green signal separately adjusted for gain, quantized red, green and blue signals are output from the pre-processor integrated circuit.
-
Citations
9 Claims
-
1. A digital circuit for generating a fully interpolated color signal from a single, multi-color image sensor having a two-dimensional pattern of photosites producing luminance and chrominance image signals corresponding to discrete, and respectively separate, pixel locations, said circuit comprising:
-
(a) a first digital processing section for operating upon signals that are linearly related to the sensor signal level;
said first section including;a black reference clamp for establishing a black reference value from the average black signal value of a predetermined number of pixels on the image sensor; means for subtracting the black reference value from each image signal; means for replacing image signals obtained from defective pixels with image signals from nearby pixels of the same color; and means for interpolating additional luminance values for the pixel locations that produce chrominance signals, said interpolating means combining the signal values of nearby luminance pixels according to a predetermined algorithm, said interpolating means providing therefrom a fully interpolated stream of luminance signals and an uninterpolated stream of chrominance signals; and (b) a second digital processing section for operating upon signals that are logarithmically related to the sensor signal level, said second section including; means for generating logarithmic luminance and chrominance signals from the fully interpolated luminance image signals and from the uninterpolated chrominance image signals; means for generating a log hue signal from the log chrominance and log luminance signals; means operating upon the log hue signal for controlling white balance according to an offset value subtracted from the log hue signal; means operating upon the log luminance image signal to modifiy signal gain according to a gain offset value input to the second processing section; means for interpolating additional hue values for the pixel locations that produce luminance signals, said hue interpolating means combining the signal values of nearby chrominance pixel locations according to a predetermined algorithm; and means for generating a fully interpolated color signal from said interpolated hue and luminance image signals. - View Dependent Claims (2, 3)
-
-
4. A digital processor for generating a fully interpolated color signal from a single, multi-color image sensor having a two dimensional pattern of photosites producing luminance and chrominance image signals corresponding to discrete, and respectively separate, pixel locations, said processor comprising:
-
a first processing section for digitally processing the image signals in quantized linear space, said first section including means for interpolating additional luminance values for the pixel locations that produce chrominance signals, the output of the first section comprising a fully interpolated stream of quantized luminance signals and an uninterpolated stream of quantized chrominance signals; and a second section for digitally processing the output of the first section in quantized log space, said second section including means for generating a quantized log hue signal from the difference between the chrominance and luminance signals in log space and means for interpolating additional hue values for the pixel locations that produce luminance signals, the output of said second section comprising a fully interpolated stream of quantized color signals. - View Dependent Claims (5, 6, 7, 8)
-
-
9. A digital integrated circuit for generating a fully interpolated color signal from a single, multi-color image sensor having a two-dimensional pattern of photosites producing red, green and blue image signals corresponding to discrete, and respectively separate, pixel locations, said circuit comprising:
-
(a) a first digital processing section for operating upon signals that are linearly related to the sensor signal level;
said first section including;a black reference clamp for establishing a black reference value from the average black signal value of a predetermined number of non-exposed pixels on the image sensor; means for subtracting the black reference value from each image signal; means for replacing image signals obtained from defective pixels with image signals from nearby pixels of the same color; means for producing an uninterpolated line-sequential stream of red and blue image signals; and means for for interpolating additional green values for the pixel locations that produce either red or blue signals, said interpolating means combining the signal values of nearby green pixels according to a predetermined algorithm implemented in a bit-shifting hardware configuration, said interpolating means providing therefrom a fully interpolated stream of green signals; and (b) a second digital processing section for operating upon signals that are logarithmically related to the sensor signal level, said second section including; means for generating logarithmic red, green and blue signals from the fully interpolated green image signals and from the uninterpolated red and blue image signals; means for generating a log hue signal from the difference between the line sequence of log red or blue and log green signals; means operating upon the log hue signal for controlling white balance according to an offset value subtracted from the log hue signal; means operating upon the log green image signals to modify signal gain according to a gain offset value input to the second processing section; means for interpolating additional hue values for the pixel locations that produce green signals, said hue interpolating means combining the hue signal values of nearby red or blue pixel locations according to a predetermined algorithm; and means for generating a fully interpolated color signal from said interpolated log hue and log green image signals.
-
Specification