Method and Device for Reducing the Fixed Pattern Noise of a Digital Image

• US 20090213211A1
• Filed: 10/14/2008
• Published: 08/27/2009
• Est. Priority Date: 10/11/2007
• Status: Abandoned Application

• Current Assignee: PSIP, LLC
• Original Assignee: Avantis Medical Systems, Inc.
• Inventors: Stewart, Michael, Bayer, Lex
• Application Number:
  US12/251,406
• Publication Number:
  US 20090213211A1
• Time in Patent Office: Days
• US Class Current: 348/65
• CPC Class Codes: A61B 1/00181 for multiple fixed viewing angles A61B1/00193 takes precedence
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/63 applied to dark current
• CPC Class Codes: H04N 25/67 applied to fixed-pattern noise, e.g. non-uniformity of response
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction

Abstract

A method or a device that reduces fixed pattern noise in an image captured by a digital image device and adjusts the reduction based on the level of FPN, preferably on an area-by-area basis or on a pixel-by-pixel basis.

Claims

1. A method for reducing a digital image'"'"'s fixed pattern noise, comprising:

determining the amount of FPN in a digital image taken by a digital imaging device as a function of at least one of relevant variables on an area-by-area basis or on a pixel-by-pixel basis; and

modifying the digital image by the determined amount of FPN on an area-by-area basis or on a pixel-by-pixel basis.

2. The method of claim 1, wherein the relevant variables include a brightness level and color composition of the digital image in an area or pixel, an operating temperature, the imaging device'"'"'s voltage level, and a gain of the digital image.

3. The method of claim 2, wherein the at least one of relevant variables includes only the brightness level of the image and the gain of the digital image.

4. The method of claim 2, wherein the at least one of relevant variables includes only the brightness level of the image.

5. The method of claim 2, wherein the at least one of relevant variables includes only the gain of the digital image.

6. The method of claim 2, wherein the at least one of relevant variables includes only the brightness level, operating temperature, and gain value of the image.

7. The method of claim 1, wherein the step of determining includes obtaining a baseline FPN image from the imaging device with the imaging device in a given or known light conditions.

8. The method of claim 7, wherein the baseline FPN image is stored in the imaging device'"'"'s memory.

9. The method of claim 1, wherein the step of determining includes obtaining a dark FPN image from the imaging device with the imaging device in a dark environment.

10. The method of claim 9, wherein the dark FPN image is stored in the imaging device'"'"'s memory.

11. The method of claim 10, wherein the step of determining includes determining a subtraction factor for each area or pixel using a look-up table having the subtraction factor as an output and the at least one of brightness level, operating temperature, and gain value of the image as one or more inputs.

12. The method of claim 11, wherein the step of determining includes determining the amount of FPN in the digital image by using the subtraction factor for each area or pixel to reduce the dark FPN value for this area or pixel, and wherein the dark FPN value is obtained from the memory of the imaging device.

13. The method of claim 10, wherein the step of determining includes determining a subtraction factor for each area or pixel using an equation having the subtraction factor at an independent variable and the at least one of brightness level, operating temperature, and gain value of the image as one or more dependent variable.

14. The method of claim 13, wherein the step of determining includes determining the amount of FPN in the digital image by using the subtraction factor for each area or pixel to reduce the dark FPN value for this area or pixel.

15. The method of claim 10, wherein the step of obtaining a dark FPN image includes obtaining the dark FPN image as part of an initial factory calibration.

16. The method of claim 10, wherein the step of obtaining a dark FPN image includes obtaining periodically during the life of the imaging device.

17. The method of claim 1, wherein the digital image is in YUV format, the method further comprising determining the brightness level from the luma component of the YUV format digital image.

18. The method of claim 1, wherein the digital image is in RGB format, the method further comprising

converting the RGB format digital image to a YUV format digital image, and

determining the brightness level from the luma component of the YUV format digital image.

19. A device for reducing a digital image'"'"'s fixed pattern noise, comprising:

an input for receiving a digital image from a digital imaging device;

an output for sending a modified digital image to a display device;

a processor that includes one or more circuits and/or software for processing the digital image, wherein the processor determines the amount of FPN in a digital image taken by a digital imaging device as a function of at least one of relevant variables on an area-by-area basis or on a pixel-by-pixel basis and modifies the digital image by the determined amount of FPN on an area-by-area basis or on a pixel-by-pixel basis.

20. The device of claim 19, wherein the relevant variables include a brightness level and color composition of the digital image in an area or pixel, an operating temperature, the imaging device'"'"'s voltage level, and a gain of the digital image.

21. The device of claim 20, wherein the at least one of relevant variables includes only the brightness level of the image and the gain of the digital image.

22. The device of claim 20, wherein the at least one of relevant variables includes only the brightness level of the image.

23. The device of claim 20, wherein the at least one of relevant variables includes only the gain of the digital image.

24. The device of claim 20, wherein the at least one of relevant variables includes only the brightness level, operating temperature, and gain value of the image.

25. The device of claim 19, wherein the processor determines the amount of FPN in the digital image by way of obtaining a baseline FPN image from the imaging device with the imaging device in a given or known light conditions.

26. The device of claim 25, wherein the baseline FPN image is stored in the imaging device'"'"'s memory.

27. The device of claim 19, wherein the processor determines the amount of FPN in the digital image by way of obtaining a dark FPN image from the imaging device with the imaging device in a dark environment.

28. The device of claim 27, wherein the dark FPN image is stored in the imaging device'"'"'s memory.

29. The device of claim 28, wherein the processor determines the amount of FPN in the digital image by way of determining a subtraction factor for each area or pixel using a look-up table having the subtraction factor as an output and the at least one of brightness level, operating temperature, and gain value of the image as one or more inputs.

30. The device of claim 29, wherein the processor determines the amount of FPN in the digital image by way of using the subtraction factor for each area or pixel to reduce the dark FPN value for this area or pixel.

31. The device of claim 28, wherein the processor determines the amount of FPN in the digital image by way of determining a subtraction factor for each area or pixel using an equation having the subtraction factor at an independent variable and the at least one of brightness level, operating temperature, and gain value of the image as one or more dependent variable.

32. The device of claim 31, wherein the processor determines the amount of FPN in the digital image by way of using the subtraction factor for each area or pixel to reduce the dark FPN value for this area or pixel.

33. The device of claim 28, wherein the processor obtains the dark FPN image as part of an initial factory calibration.

34. The device of claim 28, wherein the processor obtains the dark FPN image periodically during the life of the imaging device.

35. The device of claim 19, wherein the digital image is in YUV format, and wherein the processor determines the brightness level from the luma component of the YUV format digital image.

36. The device of claim 19, wherein the digital image is in RGB format, and wherein the processor converts the RGB format digital image to a YUV format digital image and determines the brightness level from the luma component of the YUV format digital image.

37. An endoscope system comprising:

the device of claim 19;

an endoscope including the digital imaging device and being connected to the input of the device; and

a displace device that is connected to the output of the device to receive and display the modified digital image.

38. The endoscope system of claim 37, wherein the digital imaging device is a retrograde-viewing auxiliary imaging device.

39. A method for sharpening a digital image, comprising:

determining the amount of sharpening needed to sharpen a digital image taken by a digital imaging device as a function of at least one of brightness level, operating temperature, and gain value of the image on an area-by-area basis or on a pixel-by-pixel basis; and

sharpening the digital image by the determined amount of sharpening on an area-by-area basis or on a pixel-by-pixel basis.

40. A device for sharpening a digital image, comprising:

an input for receiving a digital image from a digital imaging device;

an output for sending a sharpened digital image to a display device;

a processor that includes one or more circuits and/or software for shapening the digital image, wherein the processor determines the amount of sharpening needed to sharpen the digital image as a function of at least one of brightness level, operating temperature, and gain value of the image on an area-by-area basis or on a pixel-by-pixel basis and sharpens the digital image by the determined amount of sharpening on an area-by-area basis or on a pixel-by-pixel basis.