DIGITAL IMAGE ACQUISITION DEVICE WITH BUILT IN DUST AND SENSOR MAPPING CAPABILITY

• US 20070189757A1
• Filed: 02/13/2007
• Published: 08/16/2007
• Est. Priority Date: 02/14/2006
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Petrescu, Stefan, Zamfir, Adrian
• Granted Patent: US 7,702,236 B2
• Time in Patent Office: Days
• US Class Current: 396/213
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 7/0008 checking presence/absence
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 23/811 by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
• CPC Class Codes: H04N 25/68 applied to defects

Abstract

A digital image acquisition device has an image acquisition sensor, a shutter, an aperture and optical elements for focusing an image on the sensor. The device includes a light source located in the body of the device. The light source is periodically activated with one of the aperture or shutter closed, and the device derives a map of defects on the surface of the sensor from a calibration image acquired by the sensor when illuminated by the light source.

Claims

1. A digital image acquisition device having an image acquisition sensor, a shutter, one or more optical elements for focusing an image on the sensor, and an aperture disposed between at least one of said one or more optical elements and said shutter, the device including a light source located in a body of the device, and being arranged to periodically activate the light source when one of a lens cap, shutter or said aperture is closed, or a combination thereof, and to derive a map of defects in the sensor or on the surface of the sensor, or both, from a calibration image acquired by the sensor when illuminated by the light source.

2. A digital image acquisition device according to claim 1, wherein the device is arranged to activate the light source in one or a combination of the following events:

just before taking an image of a scene;

or

during inactivity of the device in accordance with a predefined schedule;

or just after each turn-ON of the device;

or

when a lens is replaced;

or

after each Nth image of a scene is captured.

3. A digital image acquisition device according to claim 2, where N is between 3 and 10.

4. A digital image acquisition device according to claim 1, wherein said sensor comprises one of a CCD or a CMOS array.

5. A digital image acquisition device according to claim 1, wherein said light source comprises one or more LEDs.

6. A digital image acquisition device according to claim 1, wherein said light source is disposed between the sensor and the shutter, and wherein the device is arranged to activate the light source when the shutter is closed.

7. A digital image acquisition device according to claim 1, wherein said light source is disposed between the shutter and the aperture, and wherein the device is arranged to activate the light source when the aperture is closed and when the shutter is open.

8. A digital image acquisition device according to claim 1, wherein said device is arranged to activate said light source when the optical elements are covered by the lens cap.

9. A digital image acquisition device according to claim 1, wherein the device is arranged to compare two images captured by the sensor when illuminated by the light source, and responsive to said images differing by greater than a threshold amount, to derive said map of defects.

10. A digital image acquisition device according to claim 1, wherein the device is arranged to analyze an image captured by the sensor when illuminated by the light source, and responsive to said image including greater than a threshold amount of defects, to derive said map of defects.

11. A digital image acquisition device according to claim 1, wherein said device is arranged to map said calibration image to said map of defects in association with a device specific look-up table.

12. A digital image acquisition device according to claim 1, wherein said calibration image comprises a low resolution image or a full resolution image.

13. A digital image acquisition device according to claim 1, wherein said calibration image comprises a full color image or a grayscale image.

14. A digital image acquisition device according to claim 1, further comprising a body that contains said light source and a removable lens that comprises at least one of said one or more optical elements and said aperture.

15. A digital image acquisition device according to claim 1, wherein the device is arranged to correct an image of a scene in accordance with said map of defects.

16. A digital image acquisition device according to claim 15, wherein the device is arranged to inform the user of a need to physically de-dust said device due to excess dust beyond reasonable digital correction

17. A digital image acquisition device according to claim 15, further arranged to construct a second map of defects of said optical elements and being arranged to correct said corrected image in accordance with said second map.

18. A digital image acquisition device according to claim 1, wherein the device is arranged to store said map of defects with an image of a scene.

19. A digital image acquisition device according to claim 1, wherein said map of defects comprises a binary, a gray level or a probabilistic image, or combinations thereof.

20. A digital image acquisition device, comprising:

(a) a camera body configured for coupling with a lens assembly;

(b) an electronic image sensor within the camera body;

(c) a shutter for controlling exposure of the sensor by ambient light;

(d) a light source disposed between the sensor and any lenses of the lens assembly for illuminating the sensor;

(e) a processor; and

(f) one or more digital storage devices having instructions embedded therein for programming the processor to control the light source to illuminate the sensor and to create a sensor defect map based on a calibration image acquired by the sensor when illuminated by the light source.

21. The device of claim 20, further comprising said lens assembly coupled with said camera body.

22. The device of claim 21, wherein the lens assembly includes an aperture and one or more lenses.

23. The device of claim 22, wherein the processor is programmed to initiate illumination of the sensor and creation of the sensor defect map when the aperture is closed.

24. The device of claim 23, wherein the shutter is disposed between the light source and the sensor, and the shutter is open when the sensor is illuminated for creating the sensor defect map.

25. The device of claim 21, further comprising a lens cap for coupling with the lens assembly thereby preventing exposure of the sensor by ambient light traversing the lens assembly.

26. The device of claim 25, wherein the processor is programmed to initiate illumination of the sensor for creating the sensor defect map when the lens cap is coupled to the lens assembly.

27. The device of claim 20, wherein the light source is disposed between the shutter and the sensor.

28. The device of claim 27, wherein the processor is programmed to initiate illumination of the sensor for creating the sensor defect map when the shutter is closed.

29. The device of claim 28, wherein the processor is programmed to interpret coupling of the lens assembly to the camera body acts as a trigger for said initiating illumination of the sensor for creating the sensor defect map.

30. The device of claim 28, wherein the processor is programmed to initiate said illumination of the sensor for creating the sensor defect map just before an image of a scene is acquired by the device.

31. The device of claim 28, wherein the processor is programmed to initiate said illumination of the sensor for creating the sensor defect map on a predetermined schedule during inactivity of the device.

32. The device of claim 28, wherein the processor is programmed to interpret turning-on the device as a trigger for initiating illumination of the sensor for creating the sensor defect map.

33. The device of claim 20, wherein the processor is programmed to automatically update an existing sensor defect map upon creation of a new sensor defect map.

34. The device of claim 33, wherein the both the existing and new sensor defect maps are stored for application to images acquired at different times.

35. The device of claim 20, wherein the light source is built into the camera body.

36. The device of claim 20, further comprising a look up table stored therein for to provide a mapping from an acquired calibration image to a real sensor defect position map.

37. A method of correcting acquired digital images for detected sensor defects, comprising:

(a) providing a camera body that is configured for coupling with a lens assembly and that contains an electronic image sensor, and a light source;

(b) optically enclosing the sensor and light source thereby preventing exposure of the sensor by ambient light;

(c) illuminating the sensor with the light source;

(d) detecting a calibration image acquired by the sensor when illuminated by the light source;

(e) creating a sensor defect map based on the calibration image.

38. The method of claim 37, wherein preventing exposure of the sensor by ambient light by enclosing the light source is controlled by a camera body shutter, a lens aperture, a lens cap, an on/off camera switch, a predetermined schedule, or a lens assembly coupling detection switch, or combinations thereof.

39. The method of claim 37, further comprising coupling the lens assembly to the camera body.

40. The method of claim 37, wherein the light source is disposed between a lens aperture and a camera body shutter, and the shutter is disposed between the light source and the sensor, and wherein the optical enclosing comprises closing the aperture, and the illuminating further comprises opening the shutter.

41. The method of claim 37, wherein the light source is disposed between a camera body shutter and the sensor, and wherein the optical enclosing comprises closing the shutter.

42. The method of claim 37, further comprising mapping an acquired calibration image to a real sensor defect position map.

43. The method of claim 37, further comprising automatically updating an existing sensor defect map upon creating a new sensor defect map.

44. One or more digital storage devices having digital code embodied therein for programming one or more processors to perform a method of correcting acquired digital images for detected sensor defects, the method comprising:

(a) initiating an optical enclosure of an image sensor and a light source thereby preventing exposure of the sensor by ambient light;

(b) illuminating the sensor with the light source;

(c) detecting a calibration image acquired by the sensor when illuminated by the light source; and

(d) creating a sensor defect map based on the calibration image.

45. The one or more storage devices of claim 44, wherein preventing exposure of the sensor by ambient light by enclosing the light source is controlled by a camera body shutter, a lens aperture, a lens cap, an on/off camera switch, a predetermined schedule, or a lens assembly coupling detection switch, or combinations thereof.

46. The one or more storage devices of claim 44, the method further comprising coupling the lens assembly to the camera body.

47. The one or more storage devices of claim 44, wherein the light source is disposed between a lens aperture and a camera body shutter, and the shutter is disposed between the light source and the sensor, and wherein the optical enclosing comprises closing the aperture, and the illuminating further comprises opening the shutter.

48. The one or more storage devices of claim 44, wherein the light source is disposed between a camera body shutter and the sensor, and wherein the optical enclosing comprises closing the shutter.

49. The one or more storage devices of claim 44, the method further comprising mapping an acquired calibration image to a real sensor defect position map.

50. The one or more storage devices of claim 44, the method further comprising automatically updating an existing sensor defect map upon creating a new sensor defect map.