Monochrome/color dual-slope traffic camera system

• US 8,218,046 B1
• Filed: 12/17/2009
• Issued: 07/10/2012
• Est. Priority Date: 12/17/2009
• Status: Expired due to Fees

• Current Assignee: JAI Corporation Limited
• Original Assignee: JAI Corporation Limited
• Inventors: Tashiro, Kenji
• Primary Examiner(s): Pappas, Peter-Anthony
• Assistant Examiner(s): Perez Toro, Carlos
• Application Number:
  US12/640,275
• Time in Patent Office: 936 Days
• Field of Search: None
• US Class Current: 348/297
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 25/575 with a response composed of multiple slopes

Abstract

A video traffic system comprises a dual-slope, high dynamic range CMOS camera. Shutter, gain, and pedestal control and set-points for the dual-slope integration knee threshold and trigger time are computed from an operational model of the camera response using an input from a wireless light sensor. Darker pixels can integrate over the full shutter period, but bright pixels that are integrating too quickly and will saturate are reset to an adjustable level around 78% of maximum. Such reset occurs at an adjustable time about 93% of the full shutter period. The bright pixels are released to integrate from that point until the shutter closes.

Claims

1. A video traffic system, comprising:

a dual-slope, high dynamic range CMOS camera with photodiodes that integrate the darker pixels over the full shutter period, but that reset the integration of bright pixels to an adjustable percentage of maximum;

a light sensor for positioning outdoors in an area to be imaged by the CMOS camera, and for providing a white plate measurement of the lighting conditions near an image target;

an automatic dynamic range (ADR) processor for computing, from a measurement returned by the light sensor, an optimum set of shutter, dual-slope integration reset time, and dual-slope integration reset thresholds for the CMOS camera to avoid oversaturation of said image; and

an output for image transfer.

2. The system of claim 1, wherein the CMOS camera further includes a calibration obtained in the manufacturing of the CMOS camera and its response to light according to,

DV_avg=(t1×

(L_obj/L_max)×

sh×

10<sup>(g×

k/20)</sup>×

(255−

p)

where,

DV_avg=digital video output;

L_obj=Calibrated Sphere Light Source (fL);

t1=optics compensation factor;

L_max=maximum illumination possible in day (fL);

k=gain coefficient;

sh=normalized exposure time (shutter);

g=gain (0-255); and

p=pedestal (0-255).

3. The system of claim 2, wherein the calibration obtained is such that the known variables are DV_avg, L_obj, and L_max, because they can be measured directly, and software estimated an ideal balance amongst settings for the gain coefficient (k), the normalized exposure time (sh), gain (g), and the pedestal (p).

4. The system of claim 1, wherein the CMOS camera further includes an input to receive a reading obtained by the light sensor, and has outputs for shutter (sh) and gain (g) that are adjusted to provide an optimum value for DV_avg, as in,

DV_avg=(t2×

(LSA/LS_max)×

sh×

10<sup>(g×

k/20)</sup>×

(255−

p)

where,

DV_avg=digital video output;

t2=optics compensation factor;

LSA=Light sensor A-channel reading;

LS_max=Maximum light sensor reading possible;

k=gain coefficient;

sh=normalized exposure time (shutter);

g=gain (0-255); and

p=pedestal (0-255).

5. The system of claim 1, wherein the ADR processor is such that the brightness is adjusted by setting a shutter time (sh) first, to no more than one millisecond, then a gain (g) is chosen, and a pedestal (p) is used to set a black level.

6. The system of claim 1, wherein the ADR processor is such that its dual-slope parameters are initialized with a bright integration reset time placed at 93.2% of a shutter time (sh), and a voltage to reset said bright integration to is adjusted to be about 72.7% of estimated CMOS video saturation voltage.

7. A method of high dynamic range camera operation in which:

shutter control and set-points for a dual-slope integration knee threshold and trigger time are computed from an operational model of a camera response using an input from a wireless light sensor;

wherein, darker pixels can integrate over a full shutter period, but bright pixels that are integrating too quickly and that will saturate are reset to an adjustable level some percentage of maximum; and

wherein a reset occurs at an adjustable time some percentage of the a shutter period, such that any bright pixels are released to integrate from that point until said shutter closes.

8. The method of claim 7, further comprising:

setting a first slope that is linear up to 78% (200/255) of a maximum range (255/255) of analog-to-digital converter attached to a CMOS camera;

setting a second slope to include a 4×

dynamic range;

generating a reset time at 93.2% of a main reset to shutter close; and

set-pointing a reset voltage to 72.7% of a white saturation voltage.

9. The method of claim 7, further comprising:

updating exposure time (sh) and gain every 100-milliseconds from new readings obtained from a light sensor; and

providing an image input for a license plate recognition (LPR) software that succeeds even if a light sensor estimation is not entirely correct.

10. The method of claim 7, further comprising:

setting a first slope that is linear up to a predetermined percentage of a maximum range of analog-to-digital converter attached to a CMOS camera;

setting a second slope to include a multiple dynamic range;

generating a reset time at a predetermined percentage of a main reset to shutter close;

set-pointing a reset voltage to a predetermined percentage of a white saturation voltage; and

color correcting by applying white balances that depend on the locations of pixels on said first slope or said second slope.