Enhanced wide dynamic range in imaging

• US 7,409,104 B2
• Filed: 07/17/2003
• Issued: 08/05/2008
• Est. Priority Date: 07/18/2002
• Status: Expired due to Fees

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Sightic Vista Limited
• Inventors: Sorek, Noam, Vitsnudel, Ilya
• Primary Examiner(s): Bella; Matthew C
• Assistant Examiner(s): PERUNGAVOOR, SATHYANARAYA V
• Application Number:
  US10/622,355
• Publication Number:
  US 20040136603A1
• Time in Patent Office: 1,846 Days
• Field of Search: 382/284
• US Class Current: 382/284
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/75 Unsharp masking

Abstract

A method for enhancing wide dynamic range in images. The method comprises: acquiring at least two images of a scene to be imaged, the images acquired using different exposure times; constructing for a first image an illumination mask comprising a set of two weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value, assigning one of the values to each pixels in them, whereas the other value is assigned to other pixels of the other images; using a low-pass filter to smooth border zones between pixels of one value and pixels of the other value, thus assigning weight values in a range between the two weight values; constructing a combined image using image data of pixels of the first image and image data of pixels of the other images proportional to the weight values assigned to each pixel using the illumination mask.

Claims

1. A method for enhancing wide dynamic range in images, the method comprising:

acquiring at least two images of a scene to be imaged, the images acquired using different exposure times, wherein the acquired images are in JPEG format, the JPEG format including a DCT transform domain;

constructing for a first image of said at least two images an illumination mask comprising a set of weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value,

assigning one of the weight values to each pixel, whereas other weight values are assigned to other pixels of the other of said at least two images;

using a spatial low-pass filter to smooth border zones between pixels of one weight value and pixels of other weight values, thus assigning pixels in the border zones new weight values in a range between the weight values; and

constructing a combined image in the DCT transform domain using image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight values of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values, wherein the following relation is used in the constructing the combined image;

I_p,q^DCTWDR=α

(I_DC^Long))*I_p,q^DCTLong+(1−

α

(I_DC^Long))*I_p,q^DCTShort·

Ratio,

where I_DC^Long is the DC coefficient of the DCT transform of the relatively longer exposure image, α

is a weight representing the illumination mask, Ratio is a measure that defines the relationship between the images of different exposures, p, q are DCT coefficients, and*represents convolution.

2. The method of claim 1, wherein only first few DCT coefficients are used in calculating the relationship.

3. The method of claim 2, wherein p=1 and q=1.

4. A method for enhancing wide dynamic range in images, the method comprising:

acquiring at least two images of a scene to be imaged, the images acquired using different exposure times;

detecting pixels in said at least two images indicative of motion by comparing corresponding image data from said at least two images;

constructing for a first image of said at least two images an illumination mask comprising a set of weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value,

assigning one of the weight values to each pixel, whereas other weight values are assigned to other pixels of the other of said at least two images;

using a spatial low-pass filter to smooth border zones between pixels of one weight value and pixels of other weight values, thus assigning pixels in the border zones new weight values in a range between the weight values;

evaluating image data value for pixels identified as indicative of motion using image data from one of said at least two images, using the image data value in constructing the combined image;

constructing a combined image using image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight values of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values,

wherein the step of detecting pixels indicative of motion comprises looking for pixels for which the ratio I<sup>Long/Î

Long</sup> is beyond a predetermined threshold, I^Long is image data from one of said at least two images which was acquired with longest exposure time, and

5. A method for enhancing wide dynamic range in images, the method comprising:

acquiring at least two images of a scene to be imaged, the images acquired using different exposure times;

constructing for a first image of said at least two images an illumination mask comprising a set of weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value,

assigning one of the weight values to each pixel, whereas other weight values are assigned to other pixels of the other of said at least two images;

using a low-pass filter to smooth border zones between pixels of one weight value and pixels of other weight values, thus assigning pixels in the border zones new weight values in a range between the weight values; and

constructing a combined image using image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight values of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values,

wherein the acquired images are in JPEG format, the JPEG format including a DCT transform domain, wherein the step of constructing the combined image is carried out in the DCT transform domain, and wherein the following relationship is used in the constructing the combined image;

I_p,q^DCTWDR=α

(I_DC^Long))*I_p,q^DCTLong+(1−

α

(I_DC^Long))*I_p,q^DCTShort·

Ratio,

where I_p,q^Long is the DC coefficient of the DCT transform of the relatively longer exposure image, α

is a weight representing the illumination mask, Ratio is a measure that defines the relationship between the images of different exposure exposures, p, q are DCT coefficients, and*represents convolution.

6. The method of claim 5, wherein only first few DCT coefficients are used in calculating the relation.

7. The method of claim 6, wherein p=1 and q=1.

8. The method of claim 5, further comprising:

detecting pixels in said at least two images indicative of motion by comparing corresponding image data from said at least two images; and

evaluating image data value for pixels identified as indicative of motion using image data from one of said at least two images and using the image data value in constructing the combined image.

9. The method of claim 8, wherein the step of detecting pixels indicative of motion comprises looking for pixels for which the ratio I^Long/Î

^Long is beyond a predetermined threshold, I^Long is image data from one of said at least two images which was acquired with longest exposure time, and

10. The method of claim 8, wherein the step of constructing a combined image includes using for pixels identified as indicative of motion only image data from one of said at least two images.

11. The method of claim 10, wherein the image data from one of said at least two images is reconstructed to simulate corresponding pixels in the other of said at least two images.

12. The method of claim 11, wherein image data from one of said at least two images which was acquired with longest exposure time is incorporated in two illumination masks.