Digital image processing and systems incorporating the same

• US 9,866,805 B2
• Filed: 02/01/2010
• Issued: 01/09/2018
• Est. Priority Date: 02/02/2009
• Status: Active Grant

• Current Assignee: HL Klemove Corporation
• Original Assignee: Gentex Corporation
• Inventors: Bechtel, Jon H., Andrus, Jeremy C., Sherman, Tom B.
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): BHUIYAN, FAYEZ A
• Application Number:
  US12/697,600
• Publication Number:
  US 20100195908A1
• Time in Patent Office: 2,899 Days
• Field of Search: 382167, 382300
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/84 for processing colour signals
• CPC Class Codes: H04N 5/213 Circuitry for suppressing or minimising impulsive noise for suppressing or minimising disturbance in image signal generation H04N23/81
• CPC Class Codes: H04N 5/57 Control of contrast or brightness

Abstract

A spectrally mosaiced digital image is provided with missing color data imputed for each pixel. Circuitry is provided that is configured to perform at least a portion of the calculations related to demosaicing a high dynamic range image.

Claims

1. An image processing apparatus, comprising:

a processing circuit for;

receiving an image obtained using a mosaiced spectral filter having red, green, and blue filtered pixels,

determining a direction of an edge feature in the image using only the color values in the received image that correspond to like-color filtered pixels,

calculating a missing color value for at least one pixel location in the image using an interpolation equation that is selected based on the direction of the edge feature in the image, wherein the selected interpolation equation generates a plurality of product term multipliers, wherein said interpolation equation multiplies color values of neighboring pixels of the pixel location by the product term multipliers, and wherein the only product term multipliers are each an integral power of 2, and

converting the received image into an output image including the missing color value for the at least one pixel location.

2. The image processing apparatus of claim 1, wherein the like-color filtered pixels are green filtered pixels.

3. The image processing apparatus of claim 1, wherein said missing color value is associated with a red filtered pixel, and wherein green and blue color values are calculated.

4. The image processing apparatus of claim 1, wherein said missing color value is associated with a green filtered pixel, and wherein red and blue color values are calculated.

5. The image processing apparatus of claim 1, wherein said missing color value is associated with a blue filtered pixel, and wherein red and green color values are calculated.

6. The image processing apparatus of claim 1, wherein said processing circuit is configured to receive data associated with a first series of spectrally mosaiced, high dynamic range, digital images from an imaging device and output a second series of digital images having missing color data imputed.

7. The image processing apparatus of claim 6, wherein data associated with said first series of spectrally mosaiced, high dynamic range, digital images is received at a rate greater than, or equal to, twenty-five images per second.

8. The image processing apparatus of claim 6, wherein data associated with a second series of spectrally demosaiced, high dynamic range, digital images is output at a rate greater than, or equal to, twenty-five frames per second.

21. The image processing apparatus of claim 1, wherein the product term multipliers do not include 2⁰.

22. The image processing apparatus of claim 1, wherein the product term multipliers are selected from the group consisting of:

1, 2, 4, 8, and 16.

23. The image processing apparatus of claim 1, wherein the product term multipliers are selected from the group consisting of:

2, 4, 8, and 16.

9. An image processing apparatus, comprising:

a processing circuit for;

receiving an image obtained using a mosaiced spectral filter having red, green, and blue filtered pixels,

calculating a missing color value for at least one pixel location in the received image using a selected interpolation equation, the selected interpolation equation generates a plurality of product term multipliers, wherein said interpolation equation multiplies color values of neighboring pixels of the pixel location by the product term multipliers, and wherein the only product term multipliers are each an integral power of 2, and

converting the received image into an output image including the missing color value for the at least one pixel location.

10. The image processing apparatus of claim 9, wherein said processing circuit detects features in the image that are at least in part used to determine selection of the interpolation equation.

11. The image processing apparatus of claim 9, wherein said processing circuit is further configured to select the interpolation equation based at least in part on detected patterns in said the image.

12. The image processing apparatus of claim 9, wherein said missing color value is associated with a red filtered pixel, and wherein green and blue color values are calculated.

13. The image processing apparatus of claim 9, wherein said missing color value is associated with a green filtered pixel, and wherein red and blue color values are calculated.

14. The image processing apparatus of claim 9, wherein said missing color value is associated with a blue filtered pixel, and wherein red and green color values are calculated.

15. The image processing apparatus of claim 9, wherein said processing circuit is configured to receive data associated with a first series of spectrally mosaiced, high dynamic range, digital images from an imaging device and output a second series of digital images having missing color data imputed.

16. The image processing apparatus of claim 15, wherein data associated with said first series of spectrally mosaiced, high dynamic range, digital images is received at a rate greater than, or equal to, twenty-five images per second.

17. The image processing apparatus of claim 15, wherein data associated with a second series of spectrally demosaiced, high dynamic range, digital images is output at a rate greater than, or equal to, twenty-five frames per second.

18. The image processing apparatus of claim 9, wherein the product term multipliers do not include 2⁰.

19. The image processing apparatus of claim 9, wherein the product term multipliers are selected from the group consisting of:

1, 2, 4, 8, and 16.

20. The image processing apparatus of claim 9, wherein the product term multipliers are selected from the group consisting of:

2, 4, 8, and 16.