Imager system with median filter and method thereof

• US 10,044,991 B2
• Filed: 09/19/2017
• Issued: 08/07/2018
• Est. Priority Date: 06/23/2011
• Status: Active Grant

• Current Assignee: HL Klemove Corporation
• Original Assignee: Gentex Corporation
• Inventors: Bechtel, Jon H., Sherman, Tom B., McMillan, Daniel G.
• Primary Examiner(s): SOSANYA, OBAFEMI OLUDAYO
• Application Number:
  US15/708,547
• Publication Number:
  US 20180027216A1
• Time in Patent Office: 322 Days
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 2207/20032 Median filtering
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An imaging system configured to display a captured image on a display having a lower dynamic range than the imaging system is provided, wherein the imaging system includes a high dynamic range imager configured to capture at least one high dynamic range image, and a processing device communicatively connected to the high dynamic range imager, wherein the processing device is configured to reduce color speckles caused by errant interpolated pixel values and reduce occurrence of errant values of alternate color while maintaining at least one of sharpness detail, edge detail, and generate smoothing color rendering in a displayed image.

Claims

1. An imaging system configured to display a captured image on a display having a lower dynamic range than the imaging system, the imaging system comprising:

a high dynamic range imager configured to capture at least one high dynamic range image; and

a processing device communicatively connected to said high dynamic range imager, wherein said processing device is configured to rank each element of an array with respect to an ordering criterion and select a median element, where the median element is a function of a ratio of a non-reference color component of a pixel to a reference color component of the pixel, wherein said ordering criterion comprises a discrete ranking value assigned to every element.

2. The imaging system of claim 1, wherein said discrete ranking of equal pixel values is based upon at least one of an order of entry into said array and a position within said array of compare values.

3. The imaging system of claim 1, wherein said processing device comprises a field programmable gate array.

4. The imaging system of claim 1, wherein the display of said imaging system replaces an interior rearview mirror in a vehicle.

5. The imaging system of claim 1, wherein said processing device is configured to filter successive pixels so pixel related values introduced into a neighborhood of pixels over which a median or value of designated rank is chosen are used with related comparison results.

6. The imaging system of claim 5, wherein said processing device is further configured such that comparisons are organized so only pixel related elements in subsets are newly introduced to an array and are compared against other pixel related elements in said array.

7. The imaging system of claim 5, wherein said processing device is further configured to compare results obtained once and used in finding said median or said value of designated rank for more than one pixel in an array.

8. An imaging system configured to display a captured image on a display having a lower dynamic range than the imaging system, the imaging system comprising:

a high dynamic range imager configured to capture at least one high dynamic range image; and

a processing device communicatively connected to said high dynamic range imager, wherein said processing device is configured such that elements with equal values are sorted in a prescribed sequence so each element has a rank that is unique within a set, wherein a middle element is always specified.

9. The imaging system of claim 8, wherein said processing device comprises a field programmable gate array.

10. The imaging system of claim 8, wherein the display of said imaging system replaces an interior rearview mirror in a vehicle.

11. The imaging system of claim 8, wherein said processing device is configured to rank each element of an array with respect to an ordering criterion and select a median element, where the median element is a function of a ratio of a non-reference color component of a pixel to a reference color component of the pixel, wherein said ordering criterion comprises a discrete ranking value assigned to every element.

12. The imaging system of claim 11, wherein said discrete ranking of equal pixel values is based upon at least one of an order of entry into said array and a position within said array of compare values.

13. The imaging system of claim 8, wherein said processing device is configured to find a median from a set of pixel related values and provide an enhanced pixel metric based at least partially upon modified ratios of pixel color components to at least one of pixel color component and luminance values.

14. The imaging system of claim 8, wherein said processing device is configured to filter successive pixels so pixel related values introduced into a neighborhood of pixels over which a median or value of designated rank is chosen are used with related comparison results.

15. An imaging system configured to display a captured image on a display having a lower dynamic range than the imaging system, the imaging system comprising:

a high dynamic range imager configured to capture at least one high dynamic range image; and

a processing device communicatively connected to said high dynamic range imager, wherein said processing device is configured to use a second derivative term calculated from one of a red pixel and a blue pixel for interpolation of a green pixel.

16. The imaging system of claim 15, wherein said processing device is configured such that elements with equal values are sorted in a prescribed sequence so each element has a rank that is unique within a set, wherein a middle element is always specified.

17. The imaging system of claim 15, wherein said processing device is configured to rank each element of an array with respect to an ordering criterion and select a median element, where the median element is a function of a ratio of a non-reference color component of a pixel to a reference color component of the pixel, wherein said ordering criterion comprises a discrete ranking value assigned to every element.

18. The imaging system of claim 15, wherein said discrete ranking of equal pixel values is based upon at least one of an order of entry into said array and a position within said array of compare values.

19. The imaging system of claim 15, wherein said processing device comprises a field programmable gate array.

20. The imaging system of claim 15, wherein the display of said imaging system replaces an interior rearview mirror in a vehicle.