SYSTEMS AND METHODS FOR INTELLIGENT MONITORING OF THOROUGHFARES USING THERMAL IMAGING

• US 20140112537A1
• Filed: 12/09/2013
• Published: 04/24/2014
• Est. Priority Date: 06/10/2011
• Status: Abandoned Application

• Current Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Frank, Jeffrey D., Hgasten, Nicholas, Hoelter, Theodore R., Strandemar, Katrin
• Application Number:
  US14/101,224
• Publication Number:
  US 20140112537A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G01N 21/17 Systems in which incident light is modified in accordance with the properties of the material investigated where the material investigated is optically excited causing a change in wavelength of the incident light G01N21/63
• CPC Class Codes: G01V 8/10 Detecting, e.g. by using light barriers by reflection from the object G01S17/00
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H05B 47/115 by determining the presence or movement of objects or living beings
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

Various techniques are disclosed for systems and methods using thermal imaging to intelligently monitor thoroughfares. For example, an intelligent monitoring system may include an infrared imaging module, a processor, a communication module, a memory, and an adjustable component. The system may be mounted, installed, or otherwise disposed at various locations along thoroughfares, and capture thermal images of a scene that includes at least a portion of the thoroughfares. Various thermal image processing and analysis operations may be performed on the thermal images to generate comprehensive monitoring information including an indication of detected objects in the scene and at least one attribute associated with the objects. Various actions may be taken, such as generating various alarms and intelligently adjusting operation of various adjustable devices on thoroughfares, based on the monitoring information. The monitoring information may be shared among multiple instances of the system, and may be communicated to external devices.

Claims

1. A system comprising:

an infrared imaging module disposed at a location along a thoroughfare, the infrared imaging module comprising a focal plane array (FPA) configured to capture thermal images of a scene comprising at least a portion of the thoroughfare; and

a processor in communication with the infrared imaging module, the processor configured to;

analyze the thermal images to determine a presence of one or more objects and at least one attribute associated with the objects in the scene, and

generate monitoring information based on the determination of the presence and the attribute.

2. The system of claim 1, wherein:

the processor is co-located with the infrared imaging module at the location along the thoroughfare.

3. The system of claim 1, further comprising:

a communication module configured to transmit the monitoring information to at least one of a central monitoring station, a mobile device, or a networked computer.

4. The system of claim 1, wherein:

the infrared imaging module is located at a street light, a traffic light, a crosswalk light, an inner wall of a tunnel, a street sign, or a road sign.

5. The system of claim 1, wherein:

the processor is further configured to analyze the thermal images to determine a surface condition associated with the portion of the thoroughfare; and

the monitoring information identifies the surface condition.

6. The system of claim 5, wherein:

the surface condition is at least one of a dry, wet, rainy, snowy, or icy condition; and

the processor is further configured to generate an alarm based on the surface condition.

7. The system of claim 1, wherein:

the monitoring information identifies at least one of a type, a count, a location, a direction of travel, and/or a speed associated with the one or more objects.

8. The system of claim 7, wherein:

the object is a person;

the monitoring information further identifies a posture of the person; and

the processor is further configured to;

determine whether the person needs assistance based on the monitoring information, and

generate an alarm based on the determination of the need for assistance.

9. The system of claim 7, wherein:

the processor is further configured to generate a control signal to adjust operation of an adjustable component based on the monitoring information.

10. The system of claim 9, wherein:

the adjustable component is at least one of a street light, a traffic light, or a crosswalk signal.

11. The system of claim 10, wherein:

the control signal is generated to turn on, turn off, or adjust an intensity of the street light.

12. The system of claim 10, wherein:

the street light has a selectable output color;

the control signal is generated to change the output color; and

the output color is selected based on a type of an alarm generated by the processor.

13. The system of claim 9, wherein the infrared imaging module is a first infrared imaging module, the location is a first location, the thermal images captured by the first infrared imaging module are first thermal images, the scene is a first scene, the portion of the thoroughfare is a first portion of the thoroughfare, the processor is a first processor, and the monitoring information is first monitoring information, the system further comprising:

a second infrared imaging module disposed at a second location along the thoroughfare, the second infrared imaging module comprising an FPA configured to capture second thermal images of a second scene comprising at least a second portion of the thoroughfare;

a second processor configured to;

analyze the second thermal images to determine a presence of one or more objects and at least one attribute associated with the objects in the second scene, and

generate second monitoring information based on the determination of the presence and the attribute; and

a communication module configured to transmit the second monitoring information to the first processor, the first processor configured to generate the control signal based at least in part on the second monitoring information.

14. The system of claim 13, wherein

the adjustable component is a street light;

and

the first processor is configured to generate the control signal to increase an intensity of the street light if the second monitoring information indicates that the one or more objects are expected to move into an illumination area of the street light.

15. The system of claim 1, wherein:

the thermal images are unblurred thermal images of the scene;

the infrared imaging module is configured to capture intentionally blurred thermal images of the scene; and

the processor is configured to determine a plurality of non-uniform correction (NUC) terms based on the intentionally blurred thermal images and apply the NUC terms to the unblurred thermal images to remove noise form the unblurred thermal images.

16. A method comprising:

capturing, at a focal plane array (FPA) of an infrared imaging module, thermal images of a scene comprising at least a portion of a thoroughfare, wherein the infrared imaging module is disposed at a location along the thoroughfare such that the portion of the thoroughfare is within a field of view (FOV) of the infrared imaging module;

analyzing the thermal images to determine a presence of one or more objects and at least one attribute associated with the objects in the scene; and

generating monitoring information based on the determination of the presence and the attribute.

17. The method of claim 16, further comprising:

transmitting the monitoring information to at least one of a central monitoring station, a mobile device, or a networked computer.

18. The method of claim 16, wherein:

the analyzing comprises determining a surface condition associated with the portion of the thoroughfare; and

the monitoring information identifies the surface condition.

19. The method of claim 18, further comprising:

generating an alarm based on the surface condition, the surface and weather condition being at least one of a dry, wet, rainy, snowy, or icy condition.

20. The method of claim 16, wherein:

the monitoring information identifies at least one of a type, a count, a position, a direction of travel, and/or a speed associated with the one or more objects.

21. The method of claim 20, wherein the object is a person, and the monitoring information further identifies a posture of the person, the method further comprising:

determining whether the person needs assistance based on the monitoring information; and

generating an alarm based on the determination of the need for assistance.

22. The method of claim 20, further comprising:

generating a control signal to adjust operation of an adjustable component based on the monitoring information.

23. The method of claim 22, wherein:

the adjustable component is at least one of a street light, a traffic light, or a crosswalk signal.

24. The method of claim 23, wherein:

the generating the control signal comprises configuring the control signal for turning on, turning off, or adjusting an intensity of the street light.

25. The method of claim 23, wherein:

the street light has a selectable output color;

the generating the control signal comprises configuring the control signal for changing the output color; and

the output color is selected based on a type of an alarm generated by the processor.

26. The method of claim 22, wherein the infrared imaging module is a first infrared imaging module, the location is a first location, the thermal images captured by the first infrared imaging module are first thermal images, the scene is a first scene, the portion of the thoroughfare is a first portion of the thoroughfare, and the monitoring information is first monitoring information, the method further comprising:

capturing, at an FPA of a second infrared imaging module, second thermal images of a second scene comprising at least a second portion of the thoroughfare, wherein the second infrared imaging module is disposed on a second location along the thoroughfare such that the second portion of the thoroughfare is within an FOV of the second infrared imaging module;

analyzing the second thermal images to determine a presence of one or more objects and at least one attribute associated with the objects in the second scene;

generating second monitoring information based on the determination of the presence and the attribute; and

generating the control signal based at least in part on the second monitoring information.

27. The method of claim 26, wherein

the adjustable component is a street light;

and

the generating the control signal comprises generating the control signal to increase an intensity of the street light if the second monitoring information indicates that the one or more objects are expected to move into an illumination area of the street light.

28. The method of claim 16, wherein the thermal images are unblurred thermal images, the method further comprising:

capturing intentionally blurred thermal images of the scene;

determining a plurality of non-uniform correction (NUC) terms based on the intentionally blurred thermal images; and

applying the NUC terms to the unblurred thermal images to remove noise from the unblurred thermal images.