Dynamic range compression

• US 6,973,218 B2
• Filed: 04/25/2001
• Issued: 12/06/2005
• Est. Priority Date: 04/25/2001
• Status: Active Grant

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Inventors: Hopkins, Valete C., Stuart, Charlie W., Nguyen, Chinh X., Alderson, Timothy, Tener, Gene D.
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US09/841,081
• Publication Number:
  US 20020159648A1
• Time in Patent Office: 1,686 Days
• Field of Search: 382/260, 382/262, 382/254, 382/232, 382/299, 382/298, 382/264, 382/266, 348606-624, 358/447, 358/461, 358/463
• US Class Current: 382/260
• CPC Class Codes: G06T 2207/20032 Median filtering
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: H04N 25/63 applied to dark current
• CPC Class Codes: H04N 25/674 based on the scene itself, e.g. defocusing
• CPC Class Codes: H04N 25/68 applied to defects
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A method and apparatus for processing image data is described, comprising acquiring a frame of image data and compressing the dynamic range of the frame of image data using a dynamic range compression (DRC) algorithm that utilizes down-sampling, median filtering, and up-sampling. The DRC algorithm comprises down-sampling a frame of image data comprising a first array of pixels to generate a second array of pixels, applying a first median filter to the second array of pixels to generate a blurred array of pixels, up-sampling the blurred array of pixels, and removing at least a portion of low-frequency gradient data generated by previous steps from the frame of image data.

Claims

1. A method of processing image data, the method comprising the steps of:

acquiring a frame of image data;

correcting the frame of image data using a set of correction coefficients corresponding to detector elements of a detector array used to collect the frame of image data; and

compressing a dynamic range of the frame of image data using a dynamic range compression algorithm that utilizes down-sampling, median filtering, and up-sampling.

2. The method of claim 1, wherein the correcting step

normalizes the frame of image data prior to the step of compressing the dynamic range.

3. The method according to claim 1, wherein the down-sampling, median filtering, and up-sampling are applied in that order.

4. The method of claim 2, further comprising the step of:

applying a dead-channel-replacement correction after the step of normalizing the frame of image data.

5. The method of claim 4, further comprising the step of:

applying a scene-based non-uniformity correction after the step of applying the dead-channel-replacement correction.

6. The method of claim 5, further comprising the step of:

applying edge-enhancement after the step of compressing the dynamic range.

7. The method of claim 6, wherein applying edge-enhancement comprises the steps of:

blurring input image data;

subtracting blurred input image data from the input image data.

8. The method of claim 7, wherein blurring input image data comprises:

applying a first edge filter to the input image data, thereby generating first-edge-filtered data; and

applying a second edge filter to the first-edge-filtered data, wherein first kernel coefficients of the first edge filter and second kernel coefficients of the second edge filter are configured to approximate a resultant gaussian function.

9. The method of claim 6, further comprising the step of:

applying noise filtering after the step of applying edge-enhancement.

10. The method of claim 9, further comprising the step of:

displaying an image corresponding to the frame of image data after the step of applying noise filtering.

22. A computer-readable medium adapted to cause a processor to execute the method of claim 1.

24. The method of claim 1, wherein said median filtering comprises applying a median filter to down-sampled image data, the median filter having a kernel of N=L+M elements, wherein L elements are active elements and M elements are non-active elements, the active elements being arranged in a predetermined pattern.

25. A computer-readable medium adapted to a cause a processor to execute the method of claim 24.

29. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 1.

30. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 2.

32. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 4.

33. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 5.

34. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 6.

35. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 7.

36. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 8.

37. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 9.

38. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to cooperate with a display to execute the method of claim 10.

50. A computer-readable medium adapted to cause a processor to execute the method of claim 2.

51. A computer-readable medium adapted to cause a processor to execute the method of claim 4.

11. A method of dynamic range compression of image data, the method comprising the steps of:

down-sampling a frame of image data comprising a first array of pixels to generate a second array of pixels;

applying a first median filter to the second array of pixels to generate a blurred array of pixels;

up-sampling the blurred array of pixels; and

removing at least a portion of low-frequency gradient data generated by previous steps from the frame of image data.

12. The method of claim 11, wherein said up-sampling comprises applying bilinear interpolation.

13. The method of claim 11, wherein the first median filter is a large-area median filter.

14. The method of claim 13, wherein the large-area median filter has a kernel of N=L+M elements, wherein L elements are active elements and M elements are non-active elements.

15. The method of claim 14, wherein the active elements are arranged in a predetermined pattern.

16. The method of claim 15, wherein the predetermined pattern is configured as a star-shaped pattern.

17. The method of claim 15, wherein the predetermined pattern is configured as a checkerboard pattern.

18. The method of claim 11, further comprising the step of:

applying a second median filter after applying the first median filter, the second median filter having a smaller kernel than the first median filter.

19. The method of claim 18, further comprising the step of:

applying a mean filter after applying the second the median filter.

20. The method of claim 19, further comprising the step of:

smoothing output data from the up-sampling, wherein output data from said smoothing provides the low-frequency gradient data.

21. The method of claim 20, wherein said smoothing comprises:

applying a vertical and horizontal finite-impulse-response (FIR) filter.

23. A computer-readable medium adapted to cause a processor to execute the method of claim 11.

39. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 11.

40. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 12.

41. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 13.

42. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 14.

43. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 15.

44. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 16.

45. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 17.

46. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 18.

47. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 19.

48. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 20.

49. An apparatus for processing image data, comprising:

a memory; and

a processor coupled to the memory, the processor being configured to execute the method of claim 21.

26. An apparatus for processing image data, comprising:

an image-data source; and

a processor unit coupled to the image-data source, the processor unit being configured to correct a frame of image data using a set of correction coefficients corresponding to detector elements of a detector array used to collect the frame of image data, and compress a dynamic range of the frame of image data using a low-frequency-suppression algorithm that uses down-sampling, median filtering, and up-sampling.

28. The apparatus according to claim 26, wherein the down-sampling, median filtering, and up-sampling are applied in that order.

31. The apparatus of claim 26, wherein said median filtering comprises applying a median filter to down-sampled image data, the median filter having a kernel of N=L+M elements, wherein L elements are active elements and M elements are non-active elements, the active elements being arranged in a predetermined pattern.

52. A computer-readable medium adapted to a cause a processor to execute the method of claim 31.

27. An apparatus for dynamic range compression of image data, comprising:

a processor unit coupled to an image-data source, the processor unit being configured to;

down-sample a frame of image data comprising a first array of pixels to generate a second array of pixels;

apply a first median filter to the second array of pixels to generate a blurred array of pixels;

up-sample the blurred array of pixels; and

remove at least a portion of low-frequency gradient data thereby generated by the processor unit from the frame of image data.