System and method for lens shading image correction

• US 8,749,662 B2
• Filed: 04/01/2010
• Issued: 06/10/2014
• Est. Priority Date: 04/16/2009
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Cabral, Brian, He, Hu, Ing, Elena, Takemoto, Sohei
• Primary Examiner(s): Vieaux, Gary C
• Application Number:
  US12/752,878
• Publication Number:
  US 20100265358A1
• Time in Patent Office: 1,531 Days
• Field of Search: 348/223.1, 348/251, 345/423, 382/274
• US Class Current: 348/224.1
• CPC Class Codes: G06T 17/30 Polynomial surface description
• CPC Class Codes: H04N 17/00 Diagnosis, testing or measuring for television systems or their details
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Abstract

A system and method for correcting image data. Embodiments of the present invention provide calibration and image correction to overcome various lens effects including lens shading and lens imperfections. In one embodiment, the correction of image data is performed via utilization of a spline surface (e.g., Bezier surface). The use of spline surfaces facilitates efficient hardware implementation. The image correction may be performed on a per channel and illumination type basis. In another embodiment, the present invention provides a method for determine a spline surface to be used for calibrating an image signal processor to be used in correcting image data.

Claims

1. A method of image signal processing, said method comprising:

receiving, within an electronic system, image data from an optical image sensor and wherein said image data comprises data for one or more color channels;

accessing a Bezier patch array, wherein said Bezier patch array comprises control points for each of said one or more color channels, wherein said control points define a surface which is a reciprocal function for correcting a lens shading distortion; and

utilizing said Bezier patch array with said image data to produce corrected image data.

2. A method as described in claim 1 wherein said Bezier patch array comprises patches of a bi-cubic Bezier form.

3. A method as described in claim 1 wherein said Bezier patch array comprises 100 control points and wherein said Bezier patch array comprises 9 patches.

4. A method as described in claim 1 wherein a portion of said control points are located on boundaries of a Bezier patch of said Bezier Patch array and are shared between Bezier patches.

5. A method as described in claim 1 wherein said optical image sensor is a complementary metal-oxide-semiconductor (CMOS) sensor.

6. A method as described in claim 1 wherein said optical) image sensor is a charge-coupled device (CCD) sensor.

7. A method as described in claim 1 wherein said Bezier patch array comprises a respective Bezier surface for each color channel.

8. A method as described in claim 1 wherein said Bezier patch array comprises a respective Bezier surface for each of a plurality of illumination types.

9. A method as described in claim 8 wherein said illumination type is selected from the group consisting of:

tungsten, florescent and daylight.

10. A method as described in claim 1 wherein said Bezier patch array comprises 100 control points and wherein said Bezier patch array comprises 9 patches.

11. An image signal processing system comprising:

an optical sensor operable to capture image data;

a processing unit operable to receive image data from said optical sensor and wherein said processing unit is operable to process said image data to correct for lens shading distortion based on a plurality of values defining a plurality of reciprocal surfaces;

a channel selector for selecting image data of a single color channel for said processing unit to receive; and

a memory operable to store said plurality of values wherein said plurality of reciprocal surfaces comprise a respective surface for each of a plurality of color channels.

12. An image signal processing system as described in claim 11 wherein said plurality of reciprocal surfaces comprise a respective surface for each of a plurality of lighting conditions.

13. An image signal processing system as described in claim 11 wherein said reciprocal surface is a Bezier surface.

14. An image signal processing system as described in claim 13 wherein said Bezier surface comprises a plurality of Bezier patches having one or more control points on a boundary of said plurality of Bezier patches and shared between two Bezier patches.

15. An image signal processing system as described in claim 11 wherein said processing unit is operable to correct said image data on a per color channel basis.

16. A method of image signal processing, said method comprising:

receiving, within an electronic system, image data from an optical image sensor and wherein said image data comprises data for one or more color channels;

accessing a Bezier patch array, wherein said Bezier patch array comprises control points for each of said one or more color channels, wherein said control points define a surface which is a reciprocal function for correcting a lens shading distortion, and wherein a portion of said control points are located on boundaries of a Bezier patch of said Bezier Patch array and are shared between Bezier patches; and

utilizing said Bezier patch array with said image data to produce corrected image data.

17. A method as described in claim 16 wherein said Bezier patch array comprises patches of a bi-cubic Bezier form.

18. A method as described in claim 16 wherein said Bezier patch array comprises a respective Bezier surface for each color channel.

19. A method as described in claim 16 wherein said Bezier patch array comprises a respective Bezier surface for each of a plurality of illumination types.

20. A method as described in claim 19 wherein said illumination type is selected from the group consisting of:

tungsten, florescent and daylight.