Movement detector

• US 6,246,321 B1
• Filed: 07/01/1999
• Issued: 06/12/2001
• Est. Priority Date: 07/06/1998
• Status: Expired due to Fees

• Current Assignee: Siemens Building Technologies AG (Siemens AG)
• Original Assignee: Siemens Building Technologies AG (Siemens AG)
• Inventors: Rechsteiner, Martin, Mahler, Hansjürg
• Primary Examiner(s): Lee, Benjamin C.
• Application Number:
  US09/346,515
• Time in Patent Office: 712 Days
• Field of Search: 340/522, 340/565, 340/567, 340/584, 340/587, 340/588, 340/589, 356/326, 348/164, 348/162, 348/165, 348/166, 348/169, 348/143, 348/154, 348/155, 348/172, 348/148, 396/61, 396/65, 396/168, 382/103, 342/53, 250/338.1, 250/342, 346/107
• US Class Current: 340/522
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: G08B 29/26 by updating and storing reference thresholds

Abstract

A device having an image-providing sensor, hereinafter designated as “image sensor,” operating in the visible and near-infrared range, an thermal image-providing sensor, hereinafter designated as “thermal-image sensor,” operating in the thermal radiation range and having a lower resolution than the image sensor, and an electronic evaluation system. The evaluation system determines whether one or both of the signals generated by the sensors are used for determining whether an alarm condition exists. As a result, the detectability of low-contrast objects is increased, the false alarm rate is reduced, and object classification is made possible.

Claims

1. A device for detecting the movement of an object, comprising,

a first image sensor responsive to visible and near infrared radiation, and generating a first image signal representative of the object, said first image sensor being a pixel-wise addressable sensor;

a second image sensor having a resolution lower than said first image sensor for detecting a second radiation type emitted by the object, and generating a second image signal representative of the object, said second image sensor being a low resolution thermal-image sensor; and

an evaluation system responsive to the first and second image signals and determining whether one or both of the received image signals are to be evaluated for determining whether an alarm condition exists.

2. The device according to claim 1, wherein said second sensor performs an illumination-independent detection and approximate localization of the object, and wherein said first sensor performs a classification of the object.

3. The device according to claim 1, further comprising:

a first preprocessing stage coupling said first image sensor and said evaluation system; and

a second preprocessing stage coupling said second image sensor and said evaluation system, wherein said first and second image signals are separately evaluated by the first and second preprocessing stages, respectively, prior to processing by said evaluation system.

4. The device according to claim 1, wherein said pixel-wise addressable sensor comprises an active pixel sensor.

15. The device according to claim 1, further comprising a memory for storing image information from said first image sensor corresponding to an alarm decision.

5. A device for detecting the movement of an object, comprising:

a first image sensor for detecting a first radiation type emitted by the object and for generating a first image signal representative of the object;

a second image sensor having a resolution lower than said first image sensor for detecting a second radiation type emitted by the object, and generating a second image signal representative of the object;

an evaluation system for receiving the first and second image signals and determining whether one or both of the received image signals are to be evaluated for determining whether an alarm condition exists;

a brightness sensor coupled to said evaluation system for measuring a background brightness; and

a temperature sensor coupled to said evaluation system for measuring a background temperature (T_R) and the temperature (T_B) of the object, said evaluation system evaluating at least one of said first and second image signals in response to at least one of said brightness sensor and temperature sensor.

6. The device according to claim 5, wherein brightness sensor controls an exposure time of said first image sensor.

7. The device according to claim 5, wherein said evaluation system comprises a plurality of image signal evaluation modes dependent at least in part on the measured values of T_R and T_B.

8. The device according to claim 5, wherein said evaluation system first evaluates the second image signal when T_R is sufficiently different than T_B.

9. The device according to claim 8, further wherein said evaluation system defines a portion of the second image signal corresponding to the object, and then evaluates a portion of the first image signal corresponding to the portion of the second image signal to detect the movement of the object when the background brightness is sufficiently high.

10. The device according to claim 8, wherein said evaluation system evaluates only the second image signal when the measured background brightness is insufficient.

11. The device according to claim 5, wherein said evaluation system evaluates only the first image signal when the difference between T_R and T_B is insufficient and the measured background brightness is sufficient.

12. The device according to claim 5, wherein said evaluation system evaluates both said first and second image signals when the difference between T_R and T_B is insufficient and the measured background brightness is insufficient.

13. The device according to claim 5, further comprising an illumination device.

14. The device according to claim 13, wherein said illumination device is coupled to said evaluation system and is controlled by said brightness sensor.

16. A method for electronic surveillance comprising:

detecting an object with a first image sensor sensitive to a first type of radiation;

detecting the object with a second image sensor sensitive to a second type of radiation, the second image sensor having a resolution lower than that of the first image sensor;

generating a first image signal representing the object from the first image sensor;

generating a second image signal representing the object from the second image sensor;

determining whether one or both of the image signals are to be evaluated to determine whether an alarm condition exists;

measuring a background brightness;

measuring a background temperature (T_R);

measuring the temperature of the object (T_B), and

evaluating one or both of the image signals to determine whether the alarm condition exists, wherein said step of determining whether one or both of the image signals are to be evaluated depends at least in part on the measured values of T_R and T_B.

17. The method according to claim 16, further comprising the step of preprocessing one or both of the first and second image signals.

18. The method according to claim 16, further comprising:

performing an illumination-independent detection and approximate localization of the object; and

classifying the object.

19. The method according to claim 16, wherein said step of determining whether one or both of the image signals are to be evaluated comprises:

determining whether the difference between T_R and T_B is sufficiently high;

determining whether the background brightness is sufficiently high; and

if the difference between T_R and T_B is sufficiently high and the background brightness is insufficiently high, using only the second image signal to determine whether the alarm condition exists.

20. The method according to claim 19, further comprising:

setting a detection threshold corresponding to the second image sensor higher than a detection threshold corresponding to a sufficiently high background brightness; and

determining whether the object is present from the second image signal.

21. The method according to claim 16, wherein said step of determining whether one or both of the image signals are to be evaluated comprises:

determining whether the difference between T_R and T_B is sufficiently high;

determining whether the background brightness is sufficiently high; and

if the difference between T_R and T_B is sufficiently high and the background brightness is sufficiently high, using a portion of the second image signal to determine whether the alarm condition exists.

22. The method according to claim 21, further comprising:

setting a detection threshold corresponding to the second image sensor lower than a detection threshold corresponding to an insufficiently high background brightness;

detecting the movement of the object from a portion of the first image signal corresponding to the portion of the second image signal;

classifying the object; and

determining the presence of an intruder.

23. The method according to claim 22, further comprising:

determining the position of the object from the portion of the second image signal;

determining the size of the object from the portion of the second image signal; and

defining the corresponding portion of the first image signal on the basis of the position and size of the object.

24. The method according to claim 16, wherein said step of determining whether one or both of the image signals are to be evaluated comprises:

determining whether the difference between T_R and T_B is sufficiently high;

determining whether the background brightness is sufficiently high; and

if the difference between T_R and T_B is insufficiently high and the background brightness is sufficiently high, using only the first image signal to determine whether the alarm condition exists.

25. The method according to claim 24, further comprising:

detecting the movement of the object;

classifying the object; and

determining the presence of an intruder.

26. The method according to claim 16, wherein said step of determining whether one or both of the image signals are to be evaluated comprises:

determining whether the difference between T_R and T_B is sufficiently high;

determining whether the background brightness is sufficiently high; and

if the difference between T_R and T_B is insufficiently high and background brightness is insufficiently high, using both the first and second image signals to determine whether the alarm condition exists.

27. The method according to claim 26, further comprising the step of determining whether the object is present in either one or both of the first and second image signals.

28. The method according to claim 16, further comprising the step of illuminating a region covered by at least one of the image sensors.

29. The method according to claim 16, further comprising the step of performing a separate preliminary evaluation of one or both of the first and second image signals prior to the step of determining whether one or both of the image signals are to be evaluated.

30. The method according to claim 16, further comprising the step of storing, in memory, information from the first image sensor corresponding to an alarm decision.

31. A device for detecting the movement of an object, comprising,

a first image sensor for detecting a first radiation type emitted by the object, and for generating a first image signal representative of the object;

a second image sensor for detecting a second radiation type emitted by the object, and for generating a second image signal representative of the object; and

an evaluation system for receiving the first and second image signals and for determining whether an alarm condition exists, said evaluation system comprising means for selecting an appropriate evaluation mode by which one or both of the received image signals are evaluated to determine whether the alarm condition exists, said evaluation system further comprises;

means for processing only the second image signal to determine whether the alarm condition exists;

means for processing the second image signal and a portion of the first image signal to determine whether the alarm condition exists;

means for processing only the first image signal to determine whether the alarm condition exists; and

means for processing the entirety of both the first and second image signals to determine whether the alarm condition exists.

32. The device according to claim 31, further comprising:

a brightness sensor coupled to said evaluation system for measuring a background brightness; and

a temperature sensor coupled to said evaluation system for measuring a background temperature (T_R) and the temperature (T_B) of the object, wherein the background brightness, T_R and T_B are used by said evaluation system to determine whether the alarm condition exists.