Imager system with median filter and method thereof

• US 9,769,430 B1
• Filed: 06/22/2012
• Issued: 09/19/2017
• Est. Priority Date: 06/23/2011
• Status: Active Grant

• Current Assignee: HL Klemove Corporation
• Original Assignee: Gentex Corporation
• Inventors: Bechtel, Jon H., Sherman, Tom B., McMillan, Daniel G.
• Primary Examiner(s): SOSANYA, OBAFEMI OLUDAYO
• Application Number:
  US13/530,947
• Time in Patent Office: 1,915 Days
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 2207/20032 Median filtering
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An imaging system configured to display a captured image on a display having a lower dynamic range than the imaging system is provided, wherein the imaging system includes a high dynamic range imager configured to capture at least one high dynamic range image, and a processing device communicatively connected to the high dynamic range imager, wherein the processing device is configured to reduce color speckles caused by errant interpolated pixel values and reduce occurrence of errant values of alternate color while maintaining at least one of sharpness detail, edge detail, and generate smoothing color rendering in a displayed image.

Claims

1. An imaging system configured to display a captured image on a display having a lower dynamic range than the imaging system, the imaging system comprising:

a high dynamic range imager configured to capture at least one high dynamic range image; and

a processing device communicatively connected to said high dynamic range imager, wherein said processing device is configured to;

reduce color speckles caused by errant interpolated pixel values using a median filter,

reduce occurrence of errant values of alternate color while maintaining at least one of sharpness detail and edge detail,

smooth color rendering in a displayed image,

rank each element of an array with respect to an ordering criterion and select a median element, where the median element is a function of a ratio of a non-reference color component of a pixel to a reference color component of the pixel, wherein said ordering criterion comprises a discrete ranking value assigned to every element, and

sort elements with equal values in a prescribed sequence so each element has a rank that is unique within a set, wherein a middle element is always specified.

2. The imaging system of claim 1, wherein said processing device comprises a field programmable gate array.

3. The imaging system of claim 1, wherein the display of said imaging system replaces an interior rearview mirror in a vehicle.

4. The imaging system of claim 1, wherein said processing device is configured to find a median from a set of pixel related values and provide an enhanced pixel metric based at least partially upon modified ratios of pixel color component to at least one of pixel color component and luminance values.

5. The imaging system of claim 4, wherein said ratio calculation is performed using a logarithmic representation of color components.

6. The imaging system of claim 4, wherein said processing device comprises a field programmable gate array.

7. The imaging system of claim 4, wherein the display of said imaging system replaces an interior rearview mirror in a vehicle.

8. The imaging system of claim 1, wherein said discrete ranking of equal pixel values is based upon at least one of an order of entry into said array and a position within said array of compare values.

9. The imaging system of claim 1, wherein said processing device is configured to filter successive pixels so pixel related values introduced into a neighborhood of pixels over which a median or value of designated rank is chosen are used with related comparison results.

10. The imaging system of claim 9, wherein said processing device is further configured such that comparisons are organized so only pixel related elements in subsets are newly introduced to an array and are compared against other pixel related elements in said array.

11. The imaging system of claim 9, wherein said processing device is further configured to compare results obtained once and used in finding said median or said value of designated rank for more than one pixel in an array.

12. The imaging system of claim 9, wherein said processing device comprises a field programmable gate array.

13. The imaging system of claim 9, wherein the display of said imaging system replaces an interior rearview mirror in a vehicle.

14. The imaging system of claim 1, wherein said processing device is configured to use a second derivative term calculated from one of a red pixel and a blue pixel for interpolation of a green pixel.

15. A non-transitory computer readable medium having stored thereon software instructions that, when executed by a processor, cause the processor to control a high dynamic range imager to capture an image and to display the captured image on a display having a lower dynamic range than the imager, by executing the steps comprising:

(a) capturing at least one high dynamic range image;

(b) reducing color speckles caused by errant interpolated pixel values using a median filter, reducing occurrence of errant values of alternate color while maintaining at least one of sharpness detail and edge detail, and smoothing color rendering in a displayed image;

(c) ranking each element of an array with respect to an ordering criterion and selecting a median element, where the median element is a function of a ratio of a non-reference color component of a pixel to a reference color component of the pixel, wherein said ordering criterion comprises a discrete ranking value assigned to every element; and

(d) sorting elements with equal values in a prescribed sequence so each element has a rank that is unique within a set, wherein a middle element is always specified.

16. The non-transitory computer readable medium of claim 15, wherein said processing device comprises a field programmable gate array.

17. The non-transitory computer readable medium of claim 15, wherein the display replaces an interior rearview mirror in a vehicle.

18. The non-transitory computer readable medium of claim 15, wherein the software instructions further cause the processor to execute the step of:

(e) finding a median from a set of pixel related values and providing an enhanced pixel metric based at least partially upon modified ratios of pixel color component to at least one of pixel color component and luminance values.

19. The non-transitory computer readable medium of claim 18, wherein said ratio calculation is performed using a logarithmic representation of color components.

20. The non-transitory computer readable medium of claim 18, wherein said processing device comprises a field programmable gate array.

21. The non-transitory computer readable medium of claim 18, wherein the display replaces an interior rearview mirror in a vehicle.

22. The non-transitory computer readable medium of claim 15, wherein said discrete ranking of equal pixel values is based upon at least one of an order of entry into said array and a position within said array of compare values.

23. The non-transitory computer readable medium of claim 15, wherein the software instructions further cause the processor to execute the step of:

(e) filtering successive pixels so pixel related values introduced into a neighborhood of pixels over which a median or value of designated rank is chosen are used with related comparison results.

24. The non-transitory computer readable medium of claim 23, wherein said processing device is further configured such that comparisons are organized so only pixel related elements in subsets are newly introduced to an array and are compared against other pixel related elements in said array.

25. The non-transitory computer readable medium of claim 23, wherein said processing device is further configured to compare results obtained once and used in finding said median or said value of designated rank for more than one pixel in an array.

26. The non-transitory computer readable medium of claim 23, wherein said processing device comprises a field programmable gate array.

27. The non-transitory computer readable medium of claim 23, wherein the display replaces an interior rearview mirror in a vehicle.

28. The non-transitory computer readable medium of claim 15, wherein the software instructions further cause the processor to execute the step of:

(e) using a second derivative term calculated from one of a red pixel and a blue pixel for interpolation of a green pixel.