Method and apparatus for extending the dynamic range of an electronic imaging system

• US 5,309,243 A
• Filed: 06/10/1992
• Issued: 05/03/1994
• Est. Priority Date: 06/10/1992
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Tsai, Yusheng T.
• Primary Examiner(s): Razavi, Michael T.
• Assistant Examiner(s): GARBER, WENDY RAE
• Application Number:
  US07/896,767
• Time in Patent Office: 692 Days
• Field of Search: 358/228, 358/213.19, 358/213.26, 358/213.17, 358/213.11, 358/167, 382/50, 382/54
• US Class Current: 348/221.1
• CPC Class Codes: H04N 1/4072 dependent on the contents of the original
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

A method and apparatus is disclosed for extending the dynamic range of an electronic imaging system to permit the use of lower cost, lower resolution devices to digitize and process the analog image signal generated by an electronic image sensor. Multiple images captured at different exposure levels are stored in a framestore. An electronic data processing unit then compares the pixels from the image captured at a normal exposure level to preselected exposure ranges to determine if the pixel is underexposed or overexposed. If the pixel is underexposed, the pixel is replaced with a corresponding pixel from an image captured at a higher exposure level. If the pixel is overexposed, the pixel is replaced with a corresponding pixel from an image captured at a lower exposure level. A two level optimization routine is employed, wherein median exposure valves are used to compensate for subject motion.

Claims

1. An electronic imaging system comprising:

image generating means for generating a plurality of digitized images including a plurality of pixels at different exposure levels including at least one normal exposure level (N), where N is considered a normal exposure range, one level above the normal exposure level (N+1), one level (N+1/2) equal to the geometric mean between the normal exposure level (N) and the level above the normal exposure level (N+1), one level below the normal exposure level (N-1), one level (N-1/2) equal to the geometric mean between the normal exposure level (N) and the level below the normal exposure level (N-1);

a framestore for storing the digitized images produced by the image generating means; and

an electronic data processing means for comparing each of the pixels of the digitized image generated at the normal exposure level with a preselected normal exposure range to determine if the pixel is underexposed or overexposed;

wherein the electronic data processing means replaces the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level above the normal exposure level (N+1) to create a reconstructed image if the pixel from the normal exposure level (N) is underexposed and the pixel from the digitized image generated at the exposure level above the normal exposure level (N+1) is within a first preselected range;

wherein the electronic data processing means replaces the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level (N+1/2) equal to the geometric mean between the normal exposure level (N) and the level above the normal exposure level (N+1) to create a reconstructed image if the pixel from the exposure level above the normal exposure level (N+1) is outside of the first preselected range and the pixel from the digitized image generated at the exposure level (N+1/2) equal to the geometric mean between the normal exposure level (N) and the level above the normal exposure level (N+1) is within a second preselected range;

wherein the electronic data processing means replaces the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level below the normal exposure level (N-1) to create a reconstructed image if the pixel from the normal exposure level (N) is overexposed and the pixel from the digitized image generated at the exposure level below the normal exposure level (N-1) is within a third preselected range; and

wherein the electronic data processing means replaces the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level (N-1/2) equal to the geometric mean between the normal exposure level (N) and the level below the normal exposure level (N-1) to create a reconstructed image if the pixel from the exposure level below the normal exposure level (N-1) is outside of the first preselected range and the pixel from the digitized image generated at the exposure level (N-1/2) equal to the geometric mean between the normal exposure level (N) and the level below the normal exposure level (N-1) is within a fourth preselected range.

2. A method of extending the dynamic range of an electronic imaging system comprising:

generating a plurality of digitized images including a plurality of pixels at different exposure levels including at least one normal exposure level (N), where N is considered a normal exposure range, one level above the normal exposure level (N+1), one level (N+1/2) equal to the geometric mean between the normal exposure level (N) and the level above the normal exposure level (N+1), one level below the normal exposure level (N-1), one level (N-1/2) equal to the geometric mean between the normal exposure level (N) and the level below the normal exposure level (N-1);

storing the digitized images in a framestore;

comparing each of the pixels of the digitized image generated at the normal exposure level with a preselected normal exposure range to determine if the pixel is underexposed or overexposed;

replacing the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level above the normal exposure level (N+1) to create a reconstructed image if the pixel from the normal exposure level (N) is underexposed and the pixel from the digitized image generated at the exposure level above the normal exposure level (N+1) is within a first preselected range;

replacing the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level (N+1/2) equal to the geometric mean between the normal exposure level (N) and the level above the normal exposure level (N+1) to create a reconstructed image if the pixel from the exposure level above the normal exposure level (N+1) is outside of the first preselected range and the pixel from the digitized image generated at the exposure level (N+1/2) equal to the geometric mean between the normal exposure level (N) and the level above the normal exposure level (N+1) is within a second preselected range;

replacing the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level below the normal exposure level (N-1) to create a reconstructed image if the pixel from the normal exposure level (N) is overexposed and the pixel from the digitized image generated at the exposure level below the normal exposure level (N-1) is within a third preselected range; and

replacing the pixel from the normal exposure level (N) with a corresponding pixel from the digitized image generated at the exposure level (N-1/2) equal to the geometric mean between the normal exposure level (N) and the level below the normal exposure level (N-1) to create a reconstructed image if the pixel from the exposure level below the normal exposure level (N-1) is outside of the first preselected range and the pixel from the digitized image generated at the exposure level (N-1/2) equal to the geometric mean between the normal exposure level (N) and the level below the normal exposure level (N-1) is within a fourth preselected range.