Infrared security system and method

• US 7,738,008 B1
• Filed: 11/03/2006
• Issued: 06/15/2010
• Est. Priority Date: 11/07/2005
• Status: Expired due to Fees

• Current Assignee: Global Digital Solutions, Inc.
• Original Assignee: Infrared Systems International, Inc. (Healthcare Solutions Management Group, Inc.)
• Inventors: Ball, Gary Edward
• Primary Examiner(s): CZEKAJ, DAVID J
• Application Number:
  US11/592,639
• Time in Patent Office: 1,320 Days
• Field of Search: 348/143, 348151-159, 348/161, 348/169
• US Class Current: 348/159
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces

Abstract

An infrared (IR) security system and method is disclosed comprising two or more IR cameras directed upon a common surveillance area. Locations of the cameras and their optical fields of view are pre-established and stored in a central computer database. Computer programs harmonize the information into a 3D grid. The camera processors perform image processing on the surveillance area to detect moving objects. Object angular position, size, aspect ratio, and radiometric intensity are simultaneously transmitted to the central computer. The grid position, physical size, and inherent electro-magnetic contrast of the objects are computed. These IR signatures are then compared to the target definitions in the database of IR signatures on pre-defined threats. Alarm criteria can be based on object size, location, and movement over time. When a threat is determined, the user is notified by text message, image or video.

Claims

1. A computer-implemented system for simultaneously discriminating 3D moving objects in a surveillance area comprising, in combination:

at least two IR cameras positioned at pre-established heights and distance apart focused on said surveillance area at pre-determined polar angles that establish optical center lines of site for each of said at least two IR cameras so that measured data from said at least two IR cameras is used to produce target sizes in linear dimensions and physical locations;

at least one microprocessor in electronic communication with said at least two IR cameras;

at least one memory in electronic communication with said at least one microprocessor;

at least one database associated with a user stored in said at least one memory containing data of said pre-determined polar angles, said pre-established heights and distance apart, input data simultaneously captured by said at least two IR cameras and electronically communicated to said microprocessor for storage into said at least one database, and data of pre-defined IR signatures classified as threats by said user; and

a computer program comprising program modules executable by said at least one microprocessor, wherein said at least one microprocessor is directed by said program modules of said computer program to

(a) compute IR signatures of said 3D moving objects using said data of said pre-determined polar angles, said pre-established heights and distance apart, and said input data producing computed IR signatures,

(b) compare said computed IR signatures to said data of pre-defined IR signatures classified as threats by said user, and

(c) electronically notify said user when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

2. The system of claim 1 wherein said computed IR signatures are area sizes of said 3D moving objects.

3. The system of claim 2 wherein said data of pre-defined IR signatures classified as threats by said user further comprises at least one threat area size.

4. The system of claim 1 wherein said computed IR signatures are area sizes and object locations of said 3D moving objects.

5. The system of claim 4 wherein said data of pre-defined IR signatures classified as threats by said user further comprises at least one threat area size and at least one threat object location.

6. The system of claim 1, 2, 3, 4 or 5 wherein said at least one microprocessor is further directed by said program modules of said computer program to electronically notify said user by transmitting an alarm text message when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

7. The system of claim 1, 2, 3, 4 or 5 wherein said at least one microprocessor is further directed by said program modules of said computer program to electronically notify said user by transmitting a real time image of said surveillance area when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

8. The system of claim 1, 2, 3, 4 or 5 wherein said at least one microprocessor is further directed by said program modules of said computer program to electronically notify said user by transmitting a real time video when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

9. The system of claim 1, 2, 3, 4 or 5 wherein said input data simultaneously captured by said at least two IR cameras further comprises a first average apparent intensity data element originating from one of said at least two IR cameras and a second average apparent intensity data element originating from another of said at least two IR cameras, said at least one microprocessor being further directed by said program modules of said computer program to determine a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and to electronically notify said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a malfunction text message.

10. The system of claim 1, 2, 3, 4 or 5 wherein said input data simultaneously captured by said at least two IR cameras further comprises a first average apparent intensity data element originating from one of said at least two IR cameras and a second average apparent intensity data element originating from another of said at least two IR cameras, said at least one microprocessor being further directed by said program modules of said computer program to determine a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and to electronically notify said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a real time image of said surveillance area.

11. The system of claim 1, 2, 3, 4 or 5 wherein said input data simultaneously captured by said at least two IR cameras further comprises a first average apparent intensity data element originating from one of said at least two IR cameras and a second average apparent intensity data element originating from another of said at least two IR cameras, said at least one microprocessor being further directed by said program modules of said computer program to determine a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and to electronically notify said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a real time video of said surveillance area.

12. The system of claim 1, 2, 3, 4 or 5 wherein said pre-determined polar angles that establish optical center lines of site for each of said at least two IR cameras are theta1, ph1, theta2 and phi2, and said input data simultaneously captured by said at least two IR cameras further comprises data for a first sensor assembly id, timestamp, azimuth angle, elevation angle, angular area of said 3D moving object, aspect ratio of said 3D moving object, and average apparent intensity of said 3D moving object originating from one of said at least two IR cameras and a second sensor assembly, azimuth angle, elevation angle, angular area of said 3D moving object, aspect ratio of said 3D moving object, and an average apparent intensity of said 3D moving object originating from another of said at least two IR cameras.

13. The system of claim 12 wherein said at least one microprocessor is further directed by said program modules of said computer program to determine a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and to electronically notify said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a malfunction text message and a real time image of said surveillance area, said at least one microprocessor being further directed by said program modules of said computer program to electronically notify said user by transmitting a real time video when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

14. The system of claim 1, 2, 3, 4 or 5 wherein said at least two IR cameras are further positioned such that at least one of said at least two IR cameras has another of said at least two IR cameras within said at least one of said at least two IR cameras'"'"' field of view and said another of said at least two IR cameras has said at least one of said at least two IR cameras within said another of said at least two IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said at least one and said another of said at least two IR cameras.

15. The system of claim 12 wherein said at least two IR cameras are further positioned such that at least one of said at least two IR cameras has another of said at least two IR cameras within said at least one of said at least two IR cameras'"'"' field of view and said another of said at least two IR cameras has said at least one of said at least two IR cameras within said another of said at least two IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said at least one and said another of said at least two IR cameras.

16. The system of claim 1, 2, 3, 4 or 5 wherein said at least two IR cameras are further positioned such that each IR camera of at least one pair of said at least two IR cameras have a common reference point within said each IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said each IR camera of at least one pair.

17. The system of claim 12 wherein said at least two IR cameras are further positioned such that each IR camera of at least one pair of said at least two IR cameras have a common reference point within said each IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said each IR camera of at least one pair.

18. The system of claim 1, 2, 3, 4 or 5 wherein said at least one microprocessor is further directed by said program modules of said computer program to electronically perform self diagnostic testing and correction at a regular interval and said at least one microprocessor is further directed by said program modules of said computer program to notify said user when manual intervention is required by electronic communication to a cell phone of said user.

19. The system of claim 12 wherein said at least one microprocessor is further directed by said program modules of said computer program to electronically perform self diagnostic testing and correction at a regular interval and said at least one microprocessor is further directed by said program modules of said computer program to notify said user when manual intervention is required by electronic communication to a cell phone of said user.

20. A computer-implemented method for simultaneously discriminating 3D moving objects in a surveillance area, comprising using at least two IR cameras positioned at pre-established heights and distance apart focused on said surveillance area at pre-determined polar angles that establish optical center lines of site for each of said at least two IR cameras so that measured data from said at least two IR cameras is used to produce target sizes in linear dimensions and physical locations, at least one microprocessor in electronic communication with said at least two IR cameras, at least one memory in electronic communication with said at least one microprocessor, at least one database associated with a user stored in said at least one memory containing data of said pre-determined polar angles, said pre-established heights and distance apart, input data simultaneously captured by said at least two IR cameras and electronically communicated to said microprocessor for storage into said at least one database, and data of pre-defined IR signatures classified as threats by said user, and

a computer program comprising program modules executable by said at least one microprocessor, wherein said at least one microprocessor is directed by said program modules of said computer program to perform the following steps:

(a) compute IR signatures of said 3D moving objects using said data of said pre-determined polar angles, said pre-established heights and distance apart, and said input data producing computed IR signatures,

(b) compare said computed IR signatures to said data of pre-defined IR signatures classified as threats by said user, and

(c) electronically notify said user when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

21. The method of claim 20 wherein said computed IR signatures are area sizes of said 3D moving objects.

22. The method of claim 21 wherein said data of pre-defined IR signatures classified as threats by said user further comprises at least one threat area size.

23. The method of claim 20 wherein said computed IR signatures are area sizes and object locations of said 3D moving objects.

24. The method of claim 23 wherein said data of pre-defined IR signatures classified as threats by said user further comprises at least one threat area size and at least one threat object location.

25. The method of claim 20, 21, 22, 23 or 24 wherein said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user by transmitting an alarm text message when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

26. The method of claim 20, 21, 22, 23 or 24 wherein said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user by transmitting a real time image of said surveillance area when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

27. The method of claim 20, 21, 22, 23 or 24 wherein said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user by transmitting a real time video when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

28. The method of claim 20, 21, 22, 23 or 24 wherein said input data simultaneously captured by said at least two IR cameras further comprises a first average apparent intensity data element originating from one of said at least two IR cameras and a second average apparent intensity data element originating from another of said at least two IR cameras, said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of determining a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a malfunction text message.

29. The method of claim 20, 21, 22, 23 or 24 wherein said input data simultaneously captured by said at least two IR cameras further comprises a first average apparent intensity data element originating from one of said at least two IR cameras and a second average apparent intensity data element originating from another of said at least two IR cameras, said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of determining a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a real time image of said surveillance area.

30. The method of claim 20, 21, 22, 23 or 24 wherein said input data simultaneously captured by said at least two IR cameras further comprises a first average apparent intensity data element originating from one of said at least two IR cameras and a second average apparent intensity data element originating from another of said at least two IR cameras, said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of determining a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a real time video of said surveillance area.

31. The method of claim 20, 21, 22, 23 or 24 wherein said pre-determined polar angles that establish optical center lines of site for each of said at least two IR cameras are theta1, ph1, theta2 and phi2, and said input data simultaneously captured by said at least two IR cameras further comprises data for a first sensor assembly id, timestamp, azimuth angle, elevation angle, angular area of said 3D moving object, aspect ratio of said 3D moving object, and average apparent intensity of said 3D moving object originating from one of said at least two IR cameras and a second sensor assembly, azimuth angle, elevation angle, angular area of said 3D moving object, aspect ratio of said 3D moving object, and an average apparent intensity of said 3D moving object originating from another of said at least two IR cameras.

32. The method of claim 31 wherein said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of determining a range adjusted variance value between said first and said second average apparent intensity data elements and to compare said range adjusted variance value to data of pre-defined IR signatures classified as false alarms by said user, and said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user when said range adjusted variance value matches said data of pre-defined IR signatures classified as false alarms by said user by transmitting a malfunction text message and a real time image of said surveillance area, said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically notifying said user by transmitting a real time video when said computed IR signatures match said data of pre-defined IR signatures classified as threats by said user.

33. The method of claim 20, 21, 22, 23 or 24 wherein said at least two IR cameras are further positioned such that at least one of said at least two IR cameras has another of said at least two IR cameras within said at least one of said at least two IR cameras'"'"' field of view and said another of said at least two IR cameras has said at least one of said at least two IR cameras within said another of said at least two IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said at least one and said another of said at least two IR cameras.

34. The method of claim 31 wherein said at least two IR cameras are further positioned such that at least one of said at least two IR cameras has another of said at least two IR cameras within said at least one of said at least two IR cameras'"'"' field of view and said another of said at least two IR cameras has said at least one of said at least two IR cameras within said another of said at least two IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said at least one and said another of said at least two IR cameras.

35. The method of claim 20, 21, 22, 23 or 24 wherein said at least two IR cameras are further positioned such that each IR camera of at least one pair of said at least two IR cameras have a common reference point within said each IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said each IR camera of at least one pair.

36. The method of claim 31 wherein said at least two IR cameras are further positioned such that each IR camera of at least one pair of said at least two IR cameras have a common reference point within said each IR cameras'"'"' field of view for pre-establishing a 3D coordinate grid for common location information between said each IR camera of at least one pair.

37. The method of claim 20, 21, 22, 23 or 24 wherein said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically performing self diagnostic testing and correction at a regular interval and said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of notifying said user when manual intervention is required by electronic communication to a cell phone of said user.

38. The method of claim 31, wherein said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of electronically performing self diagnostic testing and correction at a regular interval and said at least one microprocessor is further directed by said program modules of said computer program to perform an additional step of notifying said user when manual intervention is required by electronic communication to a cell phone of said user.

39. A memory for storing data for access by an application program being executed on a data processing system comprising:

a data structure stored in said memory, said data structure including information resident in a database used by said application program and including,

a first sensor assembly identification field containing information identifying a first sensor assembly as a unique source of a first set of data elements continuously transmitted while a 3D object is moving within its field of view, said first sensor assembly being one of said first set of data elements,

a second sensor assembly identification field containing information identifying a second sensor assembly as a unique source of a second set of data elements continuously transmitted while a 3D object is moving within its field of view, said second sensor assembly being one of said second set of data elements,

a first timestamp identification field containing information identifying a capture time of said first set of data elements, said first timestamp being one of said first set of data elements,

a second timestamp identification field containing information identifying a capture time of said second set of data elements, said second timestamp being one of said second set of data elements,

a first height identification field containing information identifying a pre-established height of said first sensor assembly,

a second height identification field containing information identifying a pre-established height of said second sensor assembly,

an Ro distance identification field containing information identifying a pre-established distance between said first sensor assembly and said second sensor assembly,

a first angle theta identification field containing information identifying an angle theta1 corresponding to said first sensor assembly,

a second angle theta identification field containing information identifying an angle theta2 corresponding to said second sensor assembly,

a first angle phi identification field containing information identifying an angle phi1 corresponding to said first sensor assembly,

a second angle phi identification field containing information identifying and angle phi2 corresponding to said second sensor assembly,

a first azimuth angle identification field containing information identifying an azimuth angle corresponding to said first sensor assembly,

a second azimuth angle identification field containing information identifying an azimuth angle corresponding to said second sensor assembly,

a first elevation angle identification field containing information identifying an elevation angle corresponding to said first sensor assembly,

a second elevation angle identification field containing information identifying an elevation angle corresponding to said second sensor assembly,

a first angular area identification field containing information identifying an angular area corresponding to said first sensor assembly,

a second angular area identification field containing information identifying an angular area corresponding to said second sensor assembly,

a first aspect ratio identification field containing information identifying an aspect ratio corresponding to said first sensor assembly,

a second aspect ratio identification field containing information identifying an aspect ratio corresponding to said second sensor assembly,

pre-defined IR signaturesT identification field containing information identifying pre-defined IR signatures classified as threats,

compIRsigs—

computed IR signatures identification field containing information identifying computed area sizes and locations for 3D moving objects identified as true targets.

40. The memory of claim 39 comprising said data structure, wherein said first timestamp further includes a capture date of said first set of data elements and said second timestamp further includes a capture date of said second set of data elements.

41. The memory of claim 39 or 40 and further including:

a pre-defined IR signaturesF identification field containing information identifying pre-defined IR signatures classified as false alarms.

42. The memory of claim 39 or 40 and further including:

a first average apparent intensity identification field containing information identifying an average apparent intensity of a 3D moving object corresponding to said first sensor assembly,

a second average apparent intensity identification field containing information identifying an average apparent intensity of a 3D moving object corresponding to said second sensor assembly and

a pre-defined IR signaturesF identification field containing information identifying pre-defined IR signatures classified as false alarms.

43. The memory of claim 39 or 40 and further including:

a user account identification field containing information identifying a customer account associated with said first sensor assembly and said second sensor assembly, and

a pre-defined IR signaturesF identification field containing information identifying pre-defined IR signatures classified as false alarms.

44. The memory of claim 39 or 40 and further including

a first average apparent intensity identification field containing information identifying an average apparent intensity of a 3D moving object corresponding to said first sensor assembly,

a second average apparent intensity identification field containing information identifying an average apparent intensity of a 3D moving object corresponding to said second sensor assembly,

a user account identification field containing information identifying a customer account associated with said first sensor assembly and said second sensor assembly, and

a pre-defined IR signaturesF identification field containing information identifying pre-defined IR signatures classified as false alarms.