Method for correcting luminance gradation in an image pickup apparatus

• US 6,111,980 A
• Filed: 03/17/1998
• Issued: 08/29/2000
• Est. Priority Date: 03/18/1997
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Sano, Toshiyuki, Toyoda, Keiji
• Primary Examiner(s): Tran, Phuoc
• Application Number:
  US09/042,628
• Time in Patent Office: 896 Days
• Field of Search: 382/162, 382/167, 382/168, 382/169, 382/274, 358/518, 358/520, 358/521, 358/522
• US Class Current: 382/167
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/76 by influencing the image signals

Abstract

A synthesized picture signal of a dynamic image is produced by combining a long-time picture signal representing a low luminance and a short-time picture signal representing a high luminance, pieces of histogram data corresponding to a plurality of luminance levels are detected from the synthesized picture signal, a sum of values of pieces of histogram data is repeatedly calculated as a summed value of a piece of summed histogram data while the number of pieces of histogram data is increased, and an inclination of a line indicated by a series of summed values is detected as a luminance gradation characteristic. Thereafter, the luminance gradation characteristic is corrected to a corrected luminance gradation characteristic according to a relationship between a maximum luminance level and an upper limit luminance level of a dynamic range, and a luminance gradation corrected signal composed of the pieces of histogram data corresponding to gradation corrected luminance levels is produced according to the corrected luminance gradation characteristic to make a maximum gradation corrected luminance level equal to or lower than the upper limit luminance level. Therefore, a low luminance object and/or a high luminance object can be clearly reproduced within the dynamic range.

Claims

1. A luminance gradation correcting method in an image pickup apparatus having a dynamic range, comprising the steps of:

detecting pieces of histogram data respectively indicating the number of pixels of a luminance level from an input picture signal produced in the image pickup apparatus, the input picture signal indicating a particular image;

detecting a maximum luminance level from the luminance levels of the pieces of histogram data;

detecting a luminance gradation characteristic of the particular image indicated by the input picture signal from the pieces of histogram data corresponding to the luminance levels;

producing a corrected luminance gradation characteristic of the particular image from the luminance gradation characteristic of the particular image according to the maximum luminance level and the dynamic range of the image pickup apparatus;

correcting the luminance levels of the pieces of histogram data to a plurality of gradation corrected luminance levels according to the corrected luminance gradation characteristic of the particular image to set the gradation corrected luminance levels corresponding to the pieces of histogram data within the dynamic range of the image pickup apparatus; and

producing a luminance gradation corrected picture signal composed of the pieces of histogram data corresponding to the gradation corrected luminance levels to reproduce the particular image, in which each of the pixels has one corresponding gradation corrected luminance level, from the luminance gradation corrected picture signal.

2. A luminance gradation correcting method according to claim 1 in which the step of producing a corrected luminance gradation characteristic comprises the steps of:

setting the corrected luminance gradation characteristic to the luminance gradation characteristic in cases where the maximum luminance level is lower than or equal to a standard luminance level which is half an upper limit luminance value of the dynamic range;

setting the corrected luminance gradation characteristic to make a maximum gradation corrected luminance level among the gradation corrected luminance levels agree with the maximum luminance level in cases where the maximum luminance level is higher than the standard luminance level and is lower than or equal to the upper limit luminance value of the dynamic range; and

setting the corrected luminance gradation characteristic to make a maximum gradation corrected luminance level among the gradation corrected luminance levels agree with the upper limit luminance value of the dynamic range in cases where the maximum luminance level is higher than the upper limit luminance value of the dynamic range.

3. A luminance gradation correcting method according to claim 1 in which the step of detecting a maximum luminance level comprises the steps of:

selecting one or more particular pieces of histogram data respectively having a value not equal to zero from the luminance levels; and

detecting the maximum luminance level from one or more luminance levels corresponding to the particular pieces of histogram data.

4. A luminance gradation correcting method according to claim 1 in which the step of detecting a luminance gradation characteristic comprises the steps of:

repeatedly calculating a sum of values of pieces of histogram data as a summed value of a piece of summed histogram data while the number of pieces of histogram data is increased one by one in the order of heightening a luminance level corresponding to one piece of particular histogram data added to the pieces of histogram data; and

setting an inclination of a line indicated by the series of summed values of the pieces of summed histogram data, which are arranged in the order of increasing the number of pieces of histogram data corresponding to each piece of summed histogram data, as the luminance gradation characteristic.

5. A luminance gradation correcting method according to claim 1 in which the step of detecting pieces of histogram data comprises the steps of:

detecting pieces of original histogram data respectively indicating the number of pixels of one luminance level from the input picture signal;

preparing a limitation value in cases where the maximum luminance level is lower than or equal to the standard luminance level;

preparing a low limitation value and an upper limitation value higher than the low limitation value in cases where the maximum luminance level is higher than the standard luminance level;

setting the pieces of original histogram data to the pieces of histogram data having values equal to the limitation value in cases where the maximum luminance level is lower than or equal to the standard luminance level;

setting each piece of original histogram data lower than the low limitation value to one piece of histogram data having a value equal to the low limitation value in cases where the maximum luminance level is higher than the standard luminance level;

setting each piece of original histogram data higher than the high limitation value to one piece of histogram data having a value equal to the high limitation value in cases where the maximum luminance level is higher than the standard luminance level; and

setting each piece of original histogram data equal to or higher than the low limitation value and equal to or lower than the high limitation value to one piece of histogram data having the same value as that of the piece of original histogram data in cases where the maximum luminance level is higher than the standard luminance level.

6. A luminance gradation correcting method according to claim 1 in which the step of detecting pieces of histogram data includes the steps of:

producing a long-time picture signal indicating the particular image in a long exposure time;

producing a short-time picture signal indicating the particular image in a short exposure time; and

combining the long-time picture signal and the short-time picture signal to produce the input picture signal in which an image of a low luminance object is indicated by the long-time picture signal and an image of a high luminance object is indicated by the short-time picture signal.

7. A gradation correction apparatus comprising:

an imaging device which has at least double sampling speed;

a time-axis converter receiving signals of said imaging device;

a synthesizer receiving signals of said time-axis converter and outputting a synthesized image signal;

a histogram detector which detects histogram data of said synthesized image signal input from said synthesizer;

a maximum luminance level detector which detects a maximum luminance level from said histogram data;

a gradation characteristic calculator which calculates a gradation characteristic based on said histogram data;

a corrected gradation characteristic calculator which calculates a corrected gradation characteristic according to said maximum luminance level; and

a gradation corrector which corrects a gradation of said synthesized image signal according to said corrected gradation characteristic.

8. The gradation correction apparatus according to claim 7, wherein said imaging device outputs a long exposed image signal and a short exposed image signal in at least said double sampling speed;

said time-axis converter reading out said long exposed image signal and said short exposed image signal in a same time axis; and

said synthesizer combining said long exposed signal and said short exposed signal in said synthesized image signal.

9. The gradation correction apparatus of claim 7, wherein said maximum luminance level is the last datum of said histogram data which is not equal to zero when each of said histogram data is compared with zero from lower histogram data.

10. The gradation correction apparatus of claim 7, said corrected gradation characteristic calculator adjusting the minimum luminance level of said corrected gradation characteristic based an said maximum luminance level of said histogram data.

11. The gradation correction apparatus of claim 7, said corrected gradation characteristic calculator adjusting maximum and minimum inclinations of said corrected gradation characteristic based on said maximum luminance level of said histogram data.

12. The gradation correction apparatus of claim 10, further comprising:

a signal processor processing an output signal of said gradation corrector;

said signal processor having a defined dynamic range;

said corrected gradation characteristic calculator adjusting said gradation characteristic by

a) setting said corrected gradation characteristic to said gradation characteristic when sad maximum luminance level of said histogram data is lower than a standard luminance level;

b) setting a maximum luminance level of said corrected gradation characteristic to said maximum luminance level of said histogram data when said maximum luminance level of said histogram data is higher than said standard luminance level and is lower than or equal to an upper limit luminance value of said dynamic range of said signal processor; and

c) setting said maximum luminance level of said corrected gradation characteristic to said upper limit luminance value of said dynamic range of said signal processor when said maximum luminance level of said histogram data is higher then said upper limit luminance value of said dynamic range of said signal processor.

13. A video camera comprising a gradation correction apparatus, said gradation correction apparatus including:

an image device which has at least double sampling speed;

a time-axis converter;

a synthesizer outputting a synthesized image signal;

a histogram detector which detects histogram data of said synthesized signal input from said synthesizer, said histogram data including a maximum luminance level;

a maximum luminance level detector which detects the maximum luminance level from said histogram data;

a gradation characteristic calculator which calculates a gradation characteristic based on said histogram data;

a corrected gradation characteristic calculator which calculates a corrected gradation characteristic according to said maximum luminance level; and

a gradation corrector which corrects a gradation of said synthesized image signal according to said corrected gradation characteristic.

14. A gradation correction method comprising the steps of:

generating a long exposed image signal and a short exposed image signal in at least said double sampling speed;

converting a time-axis of said long exposed image signal and said short exposed image signal in a same time-axis;

synthesizing said long exposed signal and said short exposed signal in a synthesized image signal;

detecting histogram data of said synthesized picture signal;

detecting a maximum luminance level from said histogram data;

calculating a gradation characteristic based on said histogram data;

calculating a corrected gradation characteristic according to said maximum luminance level; and

correcting a gradation of said synthesized image signal according to said corrected gradation characteristic.