IMAGE GENERATING APPARATUS

• US 20180114300A1
• Filed: 10/25/2017
• Published: 04/26/2018
• Est. Priority Date: 10/26/2016
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Nishikawa, Masato
• Granted Patent: US 10,783,619 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/10144 Varying exposure
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

In an image generating apparatus, a setter is configured to variably set, for an image capturing task at a next capturing cycle, first and second shutter times and a total gain. The total gain is based on combination of an analog gain and a digital gain. An allocating unit is configured to obtain a threshold gain based on the first and second shutter times and a compression characteristic. The allocating unit is configured to variably allocate the total gain to at least one of the analog gain and the digital gain in accordance with a comparison among the total gain, the threshold gain, and an upper limit for the analog gain.

Claims

1. An image generating apparatus comprising:

an image unit configured to;

perform, at a current capturing cycle, a capturing task of capturing first and second images based on respective first and second shutter times different from each other, each of the first and second images having an analog pixel value of each pixel thereof; and

amplify the analog pixel values of each of the first and second images by an analog gain;

an image combination unit configured to;

convert the analog pixel values of each of the first and second images into digital pixel values of a corresponding one of the first and second images; and

combine the digital pixel values of the first image with the digital pixel values of the second image to thereby generate a composite image having a digital pixel value of each pixel thereof;

an amplifier configured to amplify the digital pixel values of the composite image by a digital gain;

a compression unit configured to compress the amplified digital pixel values of the composite image in accordance with a predetermined compression characteristic to thereby generate a compressed composite image as an output image;

a setter configured to variably set, for the image capturing task at a next capturing cycle, the first and second shutter times and a total gain, the total gain being based on combination of the analog gain and the digital gain; and

an allocating unit configured to;

obtain a threshold gain based on the first and second shutter times and the compression characteristic; and

variably allocate the total gain to at least one of the analog gain and the digital gain in accordance with a comparison among the total gain, the threshold gain, and an upper limit for the analog gain.

2. The image generating apparatus according to claim 1, wherein the allocating unit is configured to:

determine whether the total gain is equal to or lower than the threshold gain;

allocate all the total gain to the digital gain upon determination that the total gain is equal to or lower than the threshold gain; and

determine whether the total gain is equal to or lower than the upper limit for the analog gain upon determination that the total gain is higher than the threshold gain;

allocate the threshold gain in the total gain to the digital gain, and a first excess gain in the total gain to the analog gain upon determination that the total gain is equal to or lower than the upper limit for the analog gain, the first excess gain exceeding the threshold gain; and

allocate the upper limit for the analog gain in the total gain to the analog gain, and a second excess gain to the digital gain upon determination that the total gain is higher than the upper limit for the analog gain, the second excess gain being higher than the upper limit for the analog gain.

3. The image generating apparatus according to claim 2, wherein:

the compression characteristic is configured such that;

a first luminance level region lower than the predetermined compression point having a predetermined luminance level has a first compression rate; and

a second luminance level region equal to or higher than the predetermined compression point has a second compression rate;

the first shutter time is set to be longer than the second shutter time;

a signal-to-noise ratio characteristic of the composite image includes a first region based on corresponding digital pixel values of the first image, a second region based on corresponding digital pixel values of the second image, and a switch region between the first and second regions, the switch region being based on at least one of corresponding digital pixel values of the first image and digital pixel values of the second image, a signal-to-noise ratio in the switch region decreasing with an increase of a corresponding signal component in the switch region; and

the threshold gain is configured such that, when the digital gain is set to the threshold gain, the compression point is located within the switch region, and the signal-to-noise ratio of the composite image at the compression point is set to be equal to or higher than a sum of;

an absolute value of an amount of decrease in the signal-to-noise ratio of the composite image when the analog gain is allocated to the upper limit; and

a lower limit of the signal-to-noise ratio required for the composite image.