Imaging surveillance system and method for event detection in low illumination

• US 7,376,244 B2
• Filed: 11/24/2003
• Issued: 05/20/2008
• Est. Priority Date: 11/24/2003
• Status: Active Grant

• Current Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Original Assignee: Micron Technology, Inc.
• Inventors: Baer, Richard L.
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): LIEW, ALEX KOK SOON
• Application Number:
  US10/720,411
• Publication Number:
  US 20050111696A1
• Time in Patent Office: 1,639 Days
• Field of Search: None
• US Class Current: 382/103
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A surveillance system and method is provided for detecting and event and then capturing an image of the event under low illumination conditions. A camera captures a current image and a prior reference image under low illumination conditions using a long exposure time and compares the current and reference images to determine whether an event has occurred in the current image. An illumination source is activated upon the detection of an event to provide artificial illumination. The illumination allows an additional event image to be captured using a shorter exposure time.

Claims

1. A surveillance system for detecting an event, comprising:

a sensor for capturing a current image using a first exposure time to produce sensor values representing said current image and capturing an event image using a second exposure time; and

an image processing system for performing a comparison of at least a portion of said sensor values representing said current image and spatially corresponding sensor values of a stored reference image captured using said first exposure time, said image processing system further for detecting said event in said current image based upon said comparison and instructing said sensor to capture said event image using the second exposure time;

wherein the first and second exposure times are, respectively, first and second time periods for exposing an array of pixels to capture a respective image to produce sensor values,

the second exposure time is less than the first exposure time, and

the respective image captured by the first exposure time includes several consecutive first image frames and the respective image captured by the second exposure time includes several consecutive second image frames and

the first image frames are captured entirely during the first time period and the second image frames are captured entirely during the second time period.

2. The surveillance system of claim 1, wherein said image processing system is configured to perform said comparison by computing a difference value between at least a portion of sensor values representing said current image and spatially corresponding sensor values representing said reference image.

3. The surveillance system of claim 2, wherein said image processing system is further configured to perform said comparison by determining whether said difference value exceeds a threshold, said image processing system being configured to detect said event when said difference value exceeds said threshold.

4. The surveillance system of claim 1, wherein said image processing system is further configured to replace said reference image with said current image.

5. The surveillance system of claim 1, further comprising:

an illumination source connected to said image processing system and operable in response thereto to provide artificial illumination during the capture of said event image.

6. The surveillance system of claim 1, wherein said first exposure time is up to six seconds, and said second exposure time is up to 1/60 of a second.

7. The surveillance system of claim 1, further comprising:

a storage medium for storing said event image.

8. The surveillance system of claim 1, further comprising:

a transmission interface for transmitting said event image to an external security system.

9. The surveillance system of claim 1, wherein said reference image and said current image are captured under an illumination level between one centilux and one lux.

10. A method for performing event detection within a surveillance system, the method comprising:

comparing a current image with a reference image, said current image and said reference image being captured using a first exposure time;

detecting an event based upon said comparing; and

capturing an event image using a second exposure time;

wherein the first and second exposure times are, respectively, first and second time periods for exposing an array of pixels to capture a respective image to produce sensor values,

the second exposure time is less than the first exposure time, and

the respective image captured by the first exposure time includes several consecutive first image frames and the respective image captured by the second exposure time includes several consecutive second image frames and

the first image frames are captured entirely during the first time period and the second image frames are captured entirely during the second time period.

11. The method of claim 10, wherein said comparing further comprises:

computing a difference value between at least a portion of sensor values representing said current image and spatially corresponding sensor values representing said reference image.

12. The method of claim 11, wherein said comparison further comprises:

determining whether said difference value exceeds a threshold, said event being detected when said difference value exceeds said threshold.

13. The method of claim 10, further comprising:

storing said current image as said reference image.

14. The method of claim 10, further comprising:

in response to said detecting, providing artificial illumination during said capturing.

15. The method of claim 10, further comprising:

transmitting said event image to an external security system.

16. The method of claim 15, further comprising:

transmitting said event image over a wireless connection to said external security system.

17. A method for capturing an image of an event by a surveillance system, the method comprising:

comparing a current image with a reference image, said current image and said reference image being captured using a first exposure time;

detecting an event based upon said comparing;

in response to said detecting, providing artificial illumination; and

capturing an event image under the artificial illumination using a second exposure time,

wherein the first and second exposure times are, respectively, first and second time periods for exposing an array of pixels to capture a respective image to produce sensor values,

the second exposure time is less than the first exposure time, and

the respective image captured by the first exposure time includes several consecutive first image frames and the respective image captured by the second exposure time includes several consecutive second image frames and

the first image frames are captured entirely during the first time period and the second image frames are captured entirely during the second time period.

18. The method of claim 17, wherein said comparing further comprises:

computing a difference value between at least a portion of sensor values representing said current image and spatially corresponding sensor values representing said reference image.

19. The method of claim 18, wherein said comparison further comprises:

determining whether said difference value exceeds a threshold, said event being detected when said difference value exceeds said threshold.

20. The method of claim 17, further comprising:

capturing said reference image and said current image under an illumination level between one centilux and one lux.