Automatic lens flare detection and correction for light-field images
First Claim
1. A method for correcting a light-field image to remove effects of a first lens flare, the method comprising:
- in a data store, receiving the light-field image after the light-field image has been captured by a light-field image capture device having a sensor and a plurality of microlenses;
in a processor, identifying a plurality of flare-affected pixels of the light-field image that have been affected by the first lens flare, wherein the flare-affected pixels have flare-affected pixel values, wherein identifying the plurality of flare-affected pixels of the light-field image comprises;
identifying a plurality of maximum value pixels, each of which has a pixel value higher than neighboring pixel values of neighboring pixels;
generating a global parametric flare model of effects of the first lens flare based on locations of the maximum value pixels; and
using the global parametric flare model to compute a probability that the pixel value of each of the maximum value pixels has been affected by the first lens flare;
in the processor, generating flare-corrected pixel values for the flare-affected pixels, wherein, relative to the flare-affected pixel values, the flare-corrected pixel values at least partially remove effects of the first lens flare; and
in the processor, using the flare-corrected pixel values to generate a corrected light-field image in which effects of the first lens flare are at least partially corrected.
0 Assignments
0 Petitions
Accused Products
Abstract
According to various embodiments, the system and method disclosed herein process light-field image data so as to mitigate lens flare effects. A light-field image may be captured with a light-field image capture device with a microlens array and received in a data store. A plurality of flare-affected pixels may be identified in the light-field image. The flare-affected pixels may have flare-affected pixel values. Flare-corrected pixel values may be generated for the flare-affected pixels. Relative to the flare-affected pixel values, the flare-corrected pixel values may at least partially remove the lens flare effects. The flare-corrected pixel values may be used to generate a corrected light-field image in which the lens flare effects are at least partially corrected. The corrected light-field image may be displayed on a display screen.
-
Citations
22 Claims
-
1. A method for correcting a light-field image to remove effects of a first lens flare, the method comprising:
-
in a data store, receiving the light-field image after the light-field image has been captured by a light-field image capture device having a sensor and a plurality of microlenses; in a processor, identifying a plurality of flare-affected pixels of the light-field image that have been affected by the first lens flare, wherein the flare-affected pixels have flare-affected pixel values, wherein identifying the plurality of flare-affected pixels of the light-field image comprises; identifying a plurality of maximum value pixels, each of which has a pixel value higher than neighboring pixel values of neighboring pixels; generating a global parametric flare model of effects of the first lens flare based on locations of the maximum value pixels; and using the global parametric flare model to compute a probability that the pixel value of each of the maximum value pixels has been affected by the first lens flare; in the processor, generating flare-corrected pixel values for the flare-affected pixels, wherein, relative to the flare-affected pixel values, the flare-corrected pixel values at least partially remove effects of the first lens flare; and in the processor, using the flare-corrected pixel values to generate a corrected light-field image in which effects of the first lens flare are at least partially corrected. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A non-transitory computer-readable medium for correcting a light-field image to remove effects of a first lens flare, comprising instructions stored thereon, that when executed by a processor, perform the steps of:
-
causing a data store to receive the light-field image after the light-field image has been captured by a light-field image capture device having a sensor and a plurality of microlenses; identifying a plurality of flare-affected pixels of the light-field image that have been affected by the first lens flare, wherein the flare-affected pixels have flare-affected pixel values, wherein identifying the plurality of flare-affected pixels of the light-field image comprises; identifying a plurality of maximum value pixels, each of which has a pixel value higher than neighboring pixel values of neighboring pixels; generating a global parametric flare model of effects of the first lens flare based on locations of the maximum value pixels; and using the global parametric flare model to compute a probability that the pixel value of each of the maximum value pixels has been affected by the first lens flare; wherein generating the global parametric flare model of effects of the first lens flare based on locations of the maximum value pixels comprises generating a simple affine model that is predictive of the locations of the maximum value pixels; generating flare-corrected pixel values for the flare-affected pixels, wherein, relative to the flare-affected pixel values, the flare-corrected pixel values at least partially remove effects of the first lens flare; and using the flare-corrected pixel values to generate a corrected light-field image in which effects of the first lens flare are at least partially corrected. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A system for correcting a light-field image to remove effects of a first lens flare, the system comprising:
-
a data store configured to receive the light-field image after the light-field image has been captured by a light-field image capture device having a sensor and a plurality of microlenses; and a processor, communicatively coupled to the data store, configured to; identify a plurality of flare-affected pixels of the light-field image that have been affected by the first lens flare, wherein the flare-affected pixels have flare-affected pixel values, wherein the processor is configured to identify the plurality of flare-affected pixels of the light-field image by; identifying a plurality of maximum value pixels, each of which has a pixel value higher than neighboring pixel values of neighboring pixels; generating a global parametric flare model of effects of the first lens flare based on locations of the maximum value pixels; and using the global parametric flare model to compute a probability that the pixel value of each of the maximum value pixels has been affected by the first lens flare; and wherein the processor is further configured to generate the global parametric flare model of effects of the first lens flare based on locations of the maximum value pixels by generating a simple affine model that is predictive of the locations of the maximum value pixels; generate flare-corrected pixel values for the flare-affected pixels, wherein, relative to the flare-affected pixel values, the flare-corrected pixel values at least partially remove effects of the first lens flare; and use the flare-corrected pixel values to generate a corrected light-field image in which effects of the first lens flare are at least partially corrected. - View Dependent Claims (18, 19, 20, 21, 22)
-
Specification