Intelligent video for building management and automation

• US 20070024708A1
• Filed: 04/04/2006
• Published: 02/01/2007
• Est. Priority Date: 04/05/2005
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: ActivEye, Inc. (Honeywell International Inc.)
• Inventors: Lin, Yun-Ting, Brodsky, Tomas, Lee, Mi-Suen, Ramsey, Carolyn
• Granted Patent: US 7,529,646 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A video processing and analysis system is coupled to a building management and control system. The video processing system provides traffic, occupancy, and other information derived from video images of sections of the building and its environs to the building management and control systems. The building systems use this information in a variety of business management applications, including maintenance scheduling, asset replacement, elevator dispatching, HVAC and lighting control, and so on, to reduce operational or maintenance costs, expedite emergency procedures, improve service levels of building facilities, and regulate the building'"'"'s environmental conditions

Claims

1. A system comprising:

a video processing system that is configured to receive images from one or more video sources, and to produce therefrom video-based information, and

one or more building management systems that are configured to control operation of one or more resources of a building based on the video-based information.

2. The system of claim 1, including

a plurality of video sources that are configured to provide the images to the video processing system.

3. The system of claim 2, wherein

the video sources provide the images in at least one of:

an infrared range and an X-ray range.

4. The system of claim 1, wherein

at least one of the one or more building management systems includes a model of a floor plan of the building, and

the video-based information is correlated to the floor plan.

5. The system of claim 1, wherein

the video-based information includes traffic information.

6. The system of claim 5, wherein

the traffic information includes at least one of:

a count of items, a count of items per unit time, and a directional flow pattern.

7. The system of claim 1, wherein

the video-based information includes a state of at least one object in the images.

8. The system of claim 7, wherein

the at least one object includes at least one of:

a door and a window.

9. The system of claim 1, wherein

the video processing system includes a digital signal processor.

10. The system of claim 1, wherein

the one or more building management systems include a maintenance planning system.

12. The system of claim 10, wherein

the video-based information includes traffic-flow information, and

the maintenance planning system is configured to control asset replacement activities based on the traffic-flow information.

13. The system of claim 10, wherein

the video-based information includes traffic-flow information, and

the maintenance planning system is configured to control replenishment of supplies based on the traffic-flow information.

14. The system of claim 1, wherein

the one or more building management systems include an elevator control system.

15. The system of claim 14, wherein

the video-based information relates to one or more queues at one or more floors of the building, and

the elevator control system is configured to dispatch elevator cars based on the video-based information.

16. The system of claim 15, wherein

the video-based information includes a classification associated with the one or more queues, and

the elevator control system is configured to dispatch elevator cars based on the classification.

17. The system of claim 15, including

one or more video sources located at the one or more floors that are configured to provide the images to the video processing system.

18. The system of claim 14, wherein

the elevator control system is configured to provide a notification of available alternatives based on the video-based information.

19. The system of claim 14, wherein

the video-based information relates to traffic approaching one or more elevators, and

the elevator control system is configured to dispatch elevator cars based on the video-based information.

20. The system of claim 1, wherein

the one or more building management systems include an evacuation system.

21. The system of claim 20, wherein

the video-based information relates to traffic at one or more egress locations, and

the evacuation system is configured to provide notification of available alternatives based on the traffic.

22. The system of claim 21, wherein

the evacuation system is further configured to provide status information to responding personnel.

23. The system of claim 20, wherein

the video-based information relates to occupancy at one or more locations in the building, and

the evacuation system is configured to provide egress directions based on the occupancy.

24. The system of claim 23, wherein

the evacuation system is further configured to provide status information to responding personnel.

25. The system of claim 1, wherein

the one or more building management systems include a facilities monitoring system.

26. The system of claim 25, wherein

the video-based information includes a queue measure associated with each of a plurality of facilities, and

the facilities monitoring system is configured to provide notification of available alternative facilities based on the queue measures.

27. The system of claim 26, wherein

the plurality of facilities includes at least one of:

a plurality of meeting rooms,

a plurality of parking areas,

a plurality of internet access workstations,

a plurality of rest rooms,

a plurality of elevators,

a plurality of ATMs, and

a plurality of restaurants.

28. The system of claim 1, wherein

the one or more building management systems include an HVAC control system.

29. The system of claim 28, wherein

the video-based information includes a measure of occupancy of the building, and

the HVAC control system is configured to control environmental conditions of the building based on the measure of occupancy.

30. The system of claim 29, wherein

the measure of occupancy is based on traffic entering and leaving the building.

31. The system of claim 29, wherein

the measure of occupancy is based on a presence of vehicles in an area associated with the building.

32. The system of claim 29, wherein

the measure of occupancy is based on traffic entering and leaving one or more locations in the building.

33. The system of claim 28, wherein

the video-based information includes a measure of occupancy at each of one or more locations of the building, and

the HVAC control system is configured to control environmental conditions at the one or more locations based on the measure of occupancy.

34. The system of claim 28, wherein

the HVAC control system is configured to operate in accordance with a selection of a scheduled setting from a plurality of scheduled settings, and

the HVAC control system is configured to select the scheduled setting based on the video-based information.

35. The system of claim 28, wherein

the video-based information includes a state of at least one window of the building.

11. The system of claim 11, wherein

the video-based information includes traffic-flow information, and

the maintenance planning system is configured to control maintenance activities based on the traffic-flow information.

36. A method comprising:

receiving images from one or more video sources,

processing the images to produce video-based information, and

controlling one or more resources of a building based on the video-based information.

37. The method of claim 36, wherein

the video-based information is correlated to a floor plan of the building.

38. The method of claim 36, wherein

the video-based information includes traffic information.

39. The method of claim 36, wherein

the video-based information includes a state of at least one object in the images.

40. The method of claim 36, wherein

the video-based information includes traffic-flow information, and

controlling the one or more resources includes controlling maintenance activities based on the traffic-flow information.

41. The method of claim 36, wherein

the video-based information relates to one or more queues at one or more floors of the building, and

controlling the one or more resources includes controlling elevator cars based on the video-based information.

42. The method of claim 36, wherein

the video-based information relates to traffic at one or more egress locations, and

controlling the one or more resources includes providing notification of available alternatives based on the traffic.

43. The method of claim 36, wherein

the video-based information includes a queue measure associated with each of a plurality of facilities, and

controlling the one or more resources includes providing notification of available alternative facilities based on the queue measures.

44. The method of claim 36, wherein

the video-based information includes a measure of occupancy of the building, and

controlling the one or more resources includes controlling environmental conditions of the building based on the measure of occupancy.

45. The method of claim 36, wherein

the video-based information includes a measure of occupancy at each of one or more locations of the building, and

controlling the one or more resources includes controlling environmental conditions at the one or more locations based on the measure of occupancy.

46. A computer program that, when executed on a processing system, causes the processing system to:

receive images from one or more video sources,

process the images to produce video-based information, and

control one or more resources of a building based on the video-based information.

47. The program of claim 46, wherein

the video-based information is correlated to a floor plan of the building.

48. The program of claim 46, wherein

the video-based information includes traffic information.

49. The program of claim 46, wherein

the video-based information includes a state of at least one object in the images.

50. The program of claim 46, wherein

the video-based information includes traffic-flow information, and

control of the one or more resources includes control of maintenance activities based on the traffic-flow information.

51. The program of claim 46, wherein

the video-based information relates to one or more queues at one or more floors of the building, and

control of the one or more resources includes control of elevator cars based on the video-based information.

52. The program of claim 46, wherein

the video-based information relates to traffic at one or more egress locations, and

control of the one or more resources includes providing notification of available alternatives based on the traffic.

53. The program of claim 46, wherein

the video-based information includes a queue measure associated with each of a plurality of facilities, and

control of the one or more resources includes providing notification of available alternative facilities based on the queue measures.

54. The program of claim 46, wherein

the video-based information includes a measure of occupancy of the building, and

control of the one or more resources includes control of environmental conditions of the building based on the measure of occupancy.

55. The program of claim 46, wherein

the video-based information includes a measure of occupancy at each of one or more locations of the building, and

control of the one or more resources includes control of environmental conditions at the one or more locations based on the measure of occupancy.