System and method for efficient improvement of image quality in cameras

• US 20040239782A1
• Filed: 05/30/2003
• Published: 12/02/2004
• Est. Priority Date: 05/30/2003
• Status: Abandoned Application

• Current Assignee: Cognex Technology & Investment Corporation (Cognex Corporation)
• Original Assignee: Cognex Technology & Investment Corporation (Cognex Corporation)
• Inventors: Negro, David, Michael, David, King, David R., Equitz, William
• Application Number:
  US10/448,790
• Publication Number:
  US 20040239782A1
• Time in Patent Office: Days
• US Class Current: 348/246
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/68 applied to defects

Abstract

A system and method is provided for efficiently correcting and/or normalizing individual pixel outputs in a sensor array, or another set of image data exhibiting fixed pattern noise, by classing various correction factors into a fixed set of classes and identifying each of the pixels in the array based upon its class. Most classes are used to define specific correction conditions (typically discrete gain/offset values), while some classes are set aside for certain bad pixel conditions. Pixels falling within a certain set of predefined gain/offset ranges that are largely similar, but possibly discrete for each other within an acceptable value range, are assigned to a given class during manufacture and this information is stored within a table in the camera'"'"'s processor. When data is output from the pixels during runtime, the outputting pixel'"'"'s given class is identified and the appropriate class-based gain/offset is applied to the output to normalize it as it is transmitted downstream to an image acquisition system (PC memory and/or view screen). When a given class indicates a bad pixel of a certain type (e.g. single bad pixel, bad pixel with right-side adjacent bad pixel, bad pixel with adjacent left-side bad pixel, etc.), the appropriate replacement procedure, using, for example an interpolation based upon neighboring pixels, is applied to generate an acceptable output for the bad pixel.

Claims

1. A system for calibrating a group of uncorrected pixel data from a imaging device comprising:

a stored table having a plurality of entries less than a total number of uncorrected pixels in the group, the entries each being one of a set of correction parameters indexed to each of a plurality of classes, and each of the classes being associated with a plurality of pixels in the group having similar uncorrected output characteristics;

a register that associates each of the pixels in the group with one of the classes; and

a correction logic that retrieves one of the correction parameters associated with each one of the classes and that applies the retrieved one of the correction parameters to each of the uncorrected pixels.

2. The system as set forth in claim 1 wherein the correction logic includes pixel-defect detection logic that identifies predetermined classes as indicative of a defective pixel and that signals the correction circuit to replace a value generated by the defective pixel with a value calculated using neighboring pixels.

3. The system as set forth in claim 2 wherein the classes associated with defective pixels include a plurality of identifiers that indicate whether the defective pixel is adjacent to another defective pixel.

4. The system as set forth in claim 1 further comprising a first-in-first-out buffer that receives data on each of the classes from the register associated with each of the pixels and buffers the data for use by the correction logic.

5. The system as set forth in claim 1 wherein the table is associated with a predetermined operating condition of the imaging device and further comprising a plurality of tables each having a plurality of entries less than a total number of uncorrected pixels in the group, the entries each being one of the correction parameters indexed to one of a plurality of classes class, and each of the classes being associated with a plurality of pixels in the group having similar uncorrected output characteristics, wherein each of the plurality of tables is associated with a predetermined operating condition and is provided to the correction logic when the predetermined operating condition is present.

6. The system as set forth in claim 5 wherein each of the tables is constructed by providing the imaging device with an image at a plurality of brightness levels, clustering responses of the pixels relative to a normalized response into groups identified by the classes and assigning one of the correction parameters, respectively, to each of the groups.

7. The system as set forth in claim 6 wherein the responses that exceed a predetermined range with respect to the normalized response are each clustered into a defective pixel class that is one of a plurality of defective pixel classes.

8. The system as set forth in claim 1 wherein the table is constructed by providing the imaging device with an image at a plurality of brightness levels, clustering responses of the pixels relative to a normalized response into groups identified by the classes and assigning one of the correction parameters, respectively, to each of the groups.

9. The system as set forth in claim 8 wherein the responses that exceed a predetermined range with respect to the normalized response are each clustered into a defective pixel class that is one of a plurality of defective pixel classes.

10. The system as set forth in claim 1 wherein the imaging device comprises a CMOS camera sensor.

11. The system as set forth in claim 1 wherein each of the correction parameters comprises both of a gain value and an offset value.

12. The system as set forth in claim 1 wherein each of the correction parameters comprises a look-up-table-derived correction factor.

13. A method for calibrating a group of uncorrected pixel data from a imaging device comprising the steps of:

storing a table having a plurality of entries less than a total number of uncorrected pixels in the group, the entries each being one of a set of correction parameters indexed to each of a plurality of classes, and each of the classes being associated with a plurality of pixels in the group having similar uncorrected output characteristics;

associating each of the pixels in the group with one of the classes; and

retrieving one of the correction parameters associated with each one of the classes and that applies the retrieved one of the correction parameters to each of the uncorrected pixels.

14. The method as set forth in claim 13 wherein the step of retrieving includes identifying predetermined classes as indicative of a defective pixel and that signals the correction circuit to replace a value generated by the defective pixel with a value calculated using neighboring pixels.

15. The method as set forth in claim 14 wherein the classes associated with defective pixels include a plurality of identifiers that indicate whether the defective pixel is adjacent to another defective pixel.

16. The method as set forth in claim 13 further comprising moving identifiers of the classes through a first-in-first-out buffer that receives data from a register of classes associated with each of the pixels and buffers the data for use by the correction logic.

17. The method as set forth in claim 13 wherein the table is associated with a predetermined operating condition of the imaging device and further comprising a plurality of tables each having a plurality of entries less than a total number of uncorrected pixels in the group, the entries each being one of the correction parameters indexed to one of a plurality of classes class, and each of the classes being associated with a plurality of pixels in the group having similar uncorrected output characteristics, wherein each of the plurality of tables is associated with a predetermined operating condition and is provided to the correction logic when the predetermined operating condition is present.

18. The method as set forth in claim 17 wherein each of the tables is constructed by providing the imaging device with an image at a plurality of brightness levels, clustering responses of the pixels relative to a normalized response into groups identified by the classes and assigning one of the correction parameters, respectively, to each of the groups.

19. The method as set forth in claim 18 wherein the responses that exceed a predetermined range with respect to the normalized response are clustered into a defective pixel class.

20. The method as set forth in claim 13 further comprising constructing the table by providing the imaging device with an image at a plurality of brightness levels, clustering responses of the pixels relative to a normalized response into groups identified by the classes and assigning one of the correction parameters, respectively, to each of the groups.

21. The method as set forth in claim 20 further comprising clustering the responses that exceed a predetermined range with respect to the normalized response into a defective pixel class from one of a plurality of defective pixel classes.

22. The method as set forth in claim 13 wherein the imaging device comprises a CMOS camera sensor.

23. The method as set forth in claim 13 wherein each of the correction parameters comprises both of a gain value and an offset value.

24. The method as set forth in claim 13 wherein each of the correction parameters comprises a look-up-table-derived correction factor

25. A method for providing correction parameters associated with each of the pixels of an imaging device for use in correcting a runtime image generated by the imaging device comprising the steps of:

providing a substantially uniform image for acquisition by the imaging device and generating a pixel output having a plurality of pixels with respective values based upon the provided image;

comparing each of the values to a normalized value and determining a numerical distance of each of the values away from the normalized value;

clustering similar ones of the values into each of a plurality of classes having a fixed total number of classes and assigning a single one of a plurality of correction parameters to each of the classes; and

assigning one of the classes to each of the pixels, whereby runtime pixels generated in a runtime image are each associated with one of the classes and are each corrected using the single one of the plurality of correction parameters associated with the one of the classes assigned to each of the runtime pixels.

26. The method as set forth in claim 25 wherein the step of comparing, includes comparing each of the values based upon a gain and an offset with respect to the normalized value.

27. The method as set forth in claim 26 wherein the step of providing includes providing an image at a plurality of brightness levels.

28. The method as set forth in claim 27 further comprising averaging the values from multiple images taken at each of the plurality of brightness levels to reduce time-varying noise.

29. The method as set forth in claim 25 wherein the step of comparing includes identifying defective pixels based upon values that are outside of an expected numerical range of values.

30. The method as set forth in claim 29 further comprising allocating specific defective pixel classes to identified defective pixels based upon presence or absence of neighboring defective pixels with respect to the identified defective pixels.

31. The method as set forth in claim 29 wherein each of the steps of providing, comparing, clustering and assigning are performed for a plurality of different operating conditions for the imaging device and wherein the plurality of correction parameters are grouped into a plurality of stored tables each associated with a respective of the plurality of operating conditions.

32. The method as set forth in claim 31 wherein the imaging device comprises an CMOS camera sensor and each of the tables is stored in a camera flash memory and an assignment of the classes to each of the pixels is also stored in the flash memory.

33. A method for correcting a runtime image in an imaging device comprising the steps of:

transmitting a stream of pixel values comprising an image frame to a correction logic;

reading out a stream of classes associated with each of the pixels, a number of the classes being less than a number of pixels in the stream; and

applying a correction parameter associated with each of the classes, respectively, of a set of correction parameters so as to normalize each of the pixel values in the stream.

34. The method as set forth in claim 33 further comprising determining, based upon each of the classes, whether each of the pixel values is a correctable value using the correction parameters or a defect, and correcting each defect by replacing the defect with a value based upon values of neighbor pixels to the defect.

35. A system for calibrating a group of sensor data from a sensing device comprising:

a stored table having a plurality of entries less than a total number of uncorrected elements in the group, the entries each being one of a set of correction parameters indexed to each of a plurality of classes, and each of the classes being associated with a plurality of elements in the group having similar uncorrected output characteristics;

a register that associates each of the elements in the group with one of the classes; and

a correction logic that retrieves one of the correction parameters associated with each one of the classes and that applies the retrieved one of the correction parameters to each of the uncorrected elements.