Methods to compensate manufacturing variations and design imperfections in a capsule camera

• US 8,405,711 B2
• Filed: 10/29/2007
• Issued: 03/26/2013
• Est. Priority Date: 01/09/2007
• Status: Active Grant

• Current Assignee: CapsoVision, Inc.
• Original Assignee: CapsoVision, Inc.
• Inventors: Wang, Kang-Huai, Wilson, Gordon
• Primary Examiner(s): TANG, KAREN C
• Application Number:
  US11/926,640
• Publication Number:
  US 20080165248A1
• Time in Patent Office: 1,975 Days
• Field of Search: 348/76, 348/187
• US Class Current: 348/76
• CPC Class Codes: A61B 1/00057 provided with means for testing or calibration
• CPC Class Codes: A61B 1/00059 provided with identification means for the endoscope
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 1/0684 using light emitting diodes [LED]
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 25/63 applied to dark current
• CPC Class Codes: H04N 25/633 by using optical black pixels
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction
• CPC Class Codes: H04N 25/673 by using reference sources

Abstract

A method is provided for characterizing manufacturing variations in a camera and imperfections in its operating environment to allow images captured by the camera to be compensated for these defects. In one embodiment, a method for characterizing a camera includes: (a) illuminating a field of view of the optical elements under a controlled condition; (b) exposing multiple images onto the image sensor under the controlled condition; (c) extracting parameter values of a model for the image provided on the image sensor from the multiple images; and (d) compensating images taken subsequently in the camera using the parameter values. The objects in the field of view may have a predetermined color, contrast or pattern. In one instance, the controlled condition includes an external light source for illuminating the field of view, and the image sensor is sensitive to a plurality of color components. The field of view may be illuminated at a predetermined light intensity for each of the color components. The camera may include an archival memory for storing the images taken. Alternatively, the camera may include a transmitter for sending images taken to an external depository. The camera may also be associated with an identification, and the transmitter sends the images together with the identification to identify the images sent.

Claims

1. A method for characterizing a camera with a transparent housing and a light source within the transparent housing, wherein the camera comprises an optical system and image sensor having pixels within a field of view of the optical system and pixels outside of the field of view of the optical system, comprising:

placing the camera inside a light absorption environment so that no substantial reflected light falls on the optical system, and taking a first plurality of exposures using both the pixels within the field of view of the optical system and the pixels outside of the field of view of the optical system;

placing the camera within a field-dependent reflectance environment, and taking a second plurality of exposures using both the pixels within the field of view of the optical system and the pixels outside of the field of view of the optical system; and

processing the first and second pluralities of exposures to extract parameter values of a model for images to be taken with the camera; and

based on the parameter values, compensating images captured by the camera after the images are captured.

2. A method as in claim 1, wherein the first plurality of exposures are taken using an illumination system within the camera.

3. A method as in claim 1, wherein the first plurality of exposures are taken for different relative illuminations.

4. A method as in claim 1, wherein the second plurality of exposures are taken for different exposure times.

5. A method as in claim 1, wherein some of the first and second pluralities of exposures are taken in a liquid environment.

6. A method as in claim 1, wherein the model is based on the first and second pluralities of exposures as sensed in the image sensor.

7. A method as in claim 6, wherein the model comprises a function for compensating pixel-to-pixel variations in the pixels within the field of view of the optical system.

8. A method as in claim 7, wherein the function is temperature dependent.

9. A method as in claim 7, wherein the function comprises a term for compensating a non-uniform pixel responsivity across a plurality of pixels resulting from the optical system, non-uniform light intensities from the light source, reflected light from the transparent housing, or a combination thereof.

10. A method as in claim 7, wherein the function comprises a term for compensating a leakage current in a pixel of the image sensor.

11. A method as in claim 10, wherein the leakage current is integrated over a time of exposure.

12. A method as in claim 7, wherein the function is based on a current in a light emitting diode.

13. A method as in claim 12, wherein the current is a function of a time of exposure.

14. A method as in claim 7, wherein the extracted parameter values are calculated based on a group of pixels and wherein the calculated parameter values are then applied to each pixel in the group of pixels for compensation.

15. A method as in claim 7, wherein the extracted parameter values are calculated for each pixel and wherein the calculated parameter values are applied to that pixel in subsequent exposures.

16. A method as in claim 3, wherein the first and second plurality of exposures are stored in an archival memory in the camera.

17. A method as in claim 3, wherein extracted coefficients or parameters are stored in an archival memory in the camera.

18. A method as in claim 3, wherein the first and second pluralities of exposures are transmitted to an external receiver for storage.

19. A method as in claim 3, wherein extracted parameter values are transmitted to an external receiver for storage.

20. A method as in claim 3, wherein the camera is associated with an identification, and wherein the first and second pluralities of images are transmitted with the identification to allow subsequent retrieval for use in the compensating.