Local contrast adjustment for digital images

• US 10,186,020 B2
• Filed: 08/07/2017
• Issued: 01/22/2019
• Est. Priority Date: 08/05/2014
• Status: Active Grant

• Current Assignee: Seek Thermal, Inc.
• Original Assignee: Seek Thermal, Inc.
• Inventors: Engberg, Andreas, Parrish, William J.
• Primary Examiner(s): Cutler, Albert H
• Application Number:
  US15/670,432
• Publication Number:
  US 20170372458A1
• Time in Patent Office: 533 Days
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement
• CPC Class Codes: H04N 1/6027 Correction or control of colour gradation or colour contrast H04N1/6058 takes precedence
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 25/68 applied to defects
• CPC Class Codes: H04N 5/142 Edging; Contouring
• CPC Class Codes: H04N 5/21 Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Contrast adjustment of a digital image can include using at least two signal processing paths to adjust a display-formatted pixel value to enhance the appearance of edges in displayed image data. A digital image can be filtered by producing an edge enhancement factor, α, per pixel from at least one look up table (LUT). Digital image data can also be adjusted using at least two signal processing paths, where the image data is adjusted if a pixel value and its neighboring pixel values are all within a smoothing range or where the pixel delta value is outside of a bad pixel range and its neighboring pixel delta values are all within the bad pixel range. In such cases, the image data can be adjusted by replacing the pixel value with an average or median value of the neighboring pixels.

Claims

1. A method for efficiently adjusting a digital image representing data from an infrared sensor, wherein the method is performed by a processor operating in association with a memory storing a computer program, the method comprising:

receiving, by the processor, image data acquired with an infrared sensor, the image data comprising an imaging array of pixel values, P_ij;

formatting for display, using a first signal processing path of the processor, individual pixel values of the imaging array to generate an array of display-formatted pixel values, Pd_ij;

for individual pixels in the imaging array, determining, using a second signal processing path of the processor operating parallel to the first signal processing path, an average or median pixel value, Pave_ij, by averaging the values of pixels surrounding the individual pixel;

for individual pixels, replacing at least one of a pixel value, P_ij, or a display-formatted pixel value, Pd_ij, with at least one of an average or median value, Pave_ij, of pixels neighboring the individual pixel if;

an adjusted pixel value, Δ

_ij=P_ij−

Pave_ij, is within a smoothing range S, and

adjusted pixel values for the neighboring pixels are also within the smoothing range S; and

displaying an adjusted image on a display, wherein one or more pixels of the adjusted image have a pixel value or a display-formatted pixel value equal to the average or median value, Pave_ij.

2. The method of claim 1, wherein formatting for display comprises utilizing histogram equalization based methods (HEBM) where Pd_ij is grey scale display-formatted data.

3. The method of claim 1, wherein the smoothing range S corresponds to adjusted pixel values Δ

_ij that are not part of an edge in the image data.

4. The method of claim 1, wherein one or more pixels of the adjusted image are modified by an edge enhancement factor, and wherein the one or more pixels modified by the edge enhancement factor are different from the one or more pixels having a pixel value or a display-formatted pixel value replaced by the average or median value, Pave_ij.

5. The method of claim 1, wherein the infrared sensor comprises an infrared focal plane array in a thermal imaging camera.

6. A method for efficiently adjusting a digital image representing data from an infrared sensor, wherein the method is performed by a processor operating in association with a memory storing a computer program, the method comprising:

receiving, by the processor, image data acquired with an infrared sensor, the image data comprising an imaging array of pixel values, P_ij;

formatting for display, using a first signal processing path of the processor, individual pixel values of the imaging array to generate an array of display-formatted pixel values, Pd_ij;

for individual pixels in the imaging array, determining, using a second signal processing path of the processor operating parallel to the first signal processing path, an average or median pixel value, Pave_ij, by averaging the values of pixels surrounding the individual pixel;

for individual pixels, replacing at least one of a pixel value, P_ij, or a display-formatted pixel value, Pd_ij, with at least one of an average or median value, Pave_ij, of pixels neighboring the individual pixel if;

an adjusted pixel value, Δ

_ij=P_ij−

Pave_ij, is outside a bad pixel range B, and

adjusted pixel values for the neighboring pixels are within the bad pixel range B; and

displaying an adjusted image on a display, wherein one or more pixels of the adjusted image have a pixel value or a display-formatted pixel value equal to the average or median value, Pave_ij.

7. The method of claim 6, wherein formatting for display comprises utilizing histogram equalization based methods (HEBM) where Pd_ij is grey scale display-formatted data.

8. The method of claim 6, wherein the bad pixel range B corresponds to adjusted pixel values Δ

_ij associated with normally functioning pixels.

9. The method of claim 8, wherein adjusted pixel values Δ

_ij outside the bad pixel range B are associated with pixels likely to be at least one of dead, flickering, or stuck.

10. The method of claim 6, wherein one or more pixels of the adjusted image are modified by an edge enhancement factor, and wherein the one or more pixels modified by the edge enhancement factor are different from the one or more pixels having a pixel value or a display-formatted pixel value replaced by the average or median value, Pave_ij.

11. The method of claim 6, wherein the infrared sensor comprises an infrared focal plane array in a thermal imaging camera.