Virtual sensors

• US 9,064,394 B1
• Filed: 06/21/2012
• Issued: 06/23/2015
• Est. Priority Date: 06/22/2011
• Status: Active Grant

• Current Assignee: Alarm.com Inc. (Alarm.com Holdings, Inc.)
• Original Assignee: Alarm.com Inc. (Alarm.com Holdings, Inc.)
• Inventors: Trundle, Stephen Scott
• Primary Examiner(s): Rao, Andy
• Assistant Examiner(s): EDWARDS, TYLER B
• Application Number:
  US13/529,629
• Time in Patent Office: 1,097 Days
• Field of Search: 348/143
• US Class Current: 1/1
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/08 by opening, e.g. of door, of window, of drawer, of shutter, of curtain, of blind
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19663 Surveillance related processing done local to the camera
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19684 Portable terminal, e.g. mobile phone, used for viewing video remotely
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 17/125 by using a video camera to detect fire or smoke
• CPC Class Codes: G08B 29/046 prevention of tampering with detection circuits
• CPC Class Codes: G08B 29/185 Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

Virtual sensor technology, in which a camera is controlled to capture at least one configuration image of an area monitored by a monitoring system and input is received that defines one or more characteristics of the at least one configuration image that enable sensing of an event in the area. Based on the received input, configuration data used in sensing the event is generated and stored. After storage of the configuration data, the camera is controlled to capture one or more images of the area, the one or more images are analyzed based on the configuration data, and occurrence of the event is detected based on the analysis of the one or more images. Based on detecting occurrence of the event, a transmitting device is controlled to send, to a controller of the monitoring system, a signal that indicates the detection of the occurrence of the event.

Claims

1. An electronic sensor comprising:

a camera configured to capture images of an area monitored by a monitoring system;

an electronic storage device configured to store data;

a transmitting device configured to send signals to a controller of the monitoring system;

a processing device configured to perform operations comprising;

controlling the camera to capture at least one configuration image of the area monitored by the monitoring system;

receiving input defining one or more characteristics of the at least one configuration image that enable sensing of an event in the area monitored by the monitoring system;

based on the received input defining the one or more characteristics of the at least one configuration image, generating configuration data used in sensing the event through image data captured by the camera;

storing, in the electronic storage device, the configuration data used in sensing the event through image data captured by the camera;

after storing the configuration data, controlling the camera to capture one or more images of the area monitored by the monitoring system;

analyzing the one or more images based on the configuration data;

detecting occurrence of the event based on the analysis of the one or more images; and

based on detecting occurrence of the event, controlling the transmitting device to send, to the controller of the monitoring system, a signal that indicates the detection of the occurrence of the event.

2. A monitoring system comprising:

a controller configured to control monitoring operations for a property monitored by the monitoring system; and

an electronic sensor comprising;

a camera configured to capture images of an area monitored by a monitoring system;

an electronic storage device configured to store data;

a transmitting device configured to send signals to the controller of the monitoring system; and

a processing device configured to perform operations comprising;

controlling the camera to capture at least one configuration image of the area monitored by the monitoring system;

receiving input defining one or more characteristics of the at least one configuration image that enable sensing of an event in the area monitored by the monitoring system;

based on the received input defining the one or more characteristics of the at least one configuration image, generating configuration data used in sensing the event through image data captured by the camera;

storing, in the electronic storage device, the configuration data used in sensing the event through image data captured by the camera;

after storing the configuration data, controlling the camera to capture one or more images of the area monitored by the monitoring system;

analyzing the one or more images based on the configuration data;

detecting occurrence of the event based on the analysis of the one or more images; and

based on detecting occurrence of the event, controlling the transmitting device to send, to the controller of the monitoring system, a signal that indicates the detection of the occurrence of the event,

wherein the controller is configured to receive the signal that indicates the detection of the occurrence of the event and perform a monitoring operation based on the signal that indicates the detection of the occurrence of the event.

3. A method comprising:

controlling a camera to capture at least one configuration image of an area monitored by a monitoring system;

receiving input defining one or more characteristics of the at least one configuration image that enable sensing of an event in the area monitored by the monitoring system;

based on the received input defining the one or more characteristics of the at least one configuration image, generating configuration data used in sensing the event through image data captured by the camera;

storing, in an electronic storage device, the configuration data used in sensing the event through image data captured by the camera;

after storing the configuration data, controlling the camera to capture one or more images of the area monitored by the monitoring system;

analyzing the one or more images based on the configuration data;

detecting occurrence of the event based on the analysis of the one or more images; and

based on detecting occurrence of the event, controlling a transmitting device to send, to a controller of the monitoring system, a signal that indicates the detection of the occurrence of the event.

4. The method of claim 3:

wherein receiving input defining one or more characteristics of the at least one configuration image comprises receiving input defining anchor points within the at least one configuration image, the anchor points identifying stationary elements within the at least one configuration image;

wherein generating configuration data used in sensing the event through image data captured by the camera comprises generating configuration data that identifies the anchor points within the at least one configuration image; and

wherein analyzing the one or more images based on the configuration data comprises;

identifying the anchor points in the one or more images based on the configuration data, and

using the identified anchor points to analyze the one or more images for occurrence the event.

5. The method of claim 3:

wherein receiving input defining one or more characteristics of the at least one configuration image comprises receiving input selecting an area of the at least one configuration image in which the event occurs, the selected area being a subset of the at least one configuration image;

wherein generating configuration data used in sensing the event through image data captured by the camera comprises generating configuration data that identifies the selected area; and

wherein analyzing the one or more images based on the configuration data comprises analyzing a portion of the one or more images that corresponds to the selected area.

6. The method of claim 5:

wherein receiving input selecting an area of the at least one configuration image in which the event occurs comprises receiving input indicating an outline of a door within the at least one configuration image;

wherein generating configuration data that identifies the selected area comprises generating configuration data that identifies the outline of the door; and

wherein analyzing a portion of the one or more images that corresponds to the selected area comprises;

determining a portion of the one or more images in which the outline of the door is expected based on the configuration data, and

analyzing the portion of the one or more images to determine whether the outline of the door is present in the portion of the one or more images; and

wherein detecting occurrence of the event based on the analysis of the one or more images comprises detecting a door open event based on the analysis resulting in a determination that the outline of the door is absent from the portion of at least one of the one or more images.

7. The method of claim 3:

wherein receiving input defining one or more characteristics of the at least one configuration image comprises receiving input identifying a state of the event in the at least one configuration image;

wherein generating configuration data used in sensing the event through image data captured by the camera comprises generating configuration data that identifies the state of the event in the at least one configuration image; and

wherein analyzing the one or more images based on the configuration data comprises;

comparing the one or more images with the at least one configuration image;

determining whether the one or more images match the at least one configuration image based on the comparison; and

determining that a present state of the event is the state of the event in the at least one configuration image based on a determination that the one or more images match the at least one configuration image.

8. The method of claim 3:

wherein controlling the camera to capture at least one configuration image of the area monitored by the monitoring system comprises controlling the camera to capture multiple configuration images of the area monitored by the monitoring system, each of the multiple configuration images corresponding to a different state of the event;

wherein receiving input defining one or more characteristics of the at least one configuration image comprises receiving input identifying a state of the event in each of the multiple configuration images;

wherein generating configuration data used in sensing the event through image data captured by the camera comprises generating configuration data that identifies the state of the event in each of the multiple configuration images; and

wherein analyzing the one or more images based on the configuration data comprises;

comparing the one or more images with the multiple configuration images;

determining that the one or more images match one of the multiple configuration images based on the comparison; and

determining a present state of the event as the state associated with the matched configuration image based on the determination that the one or more images match one of the multiple configuration images.

9. The method of claim 3:

wherein controlling the camera to capture at least one configuration image of the area monitored by the monitoring system comprises controlling the camera to capture an image of a door of a property monitored by the monitoring system;

wherein generating configuration data used in sensing the event through image data captured by the camera comprises generating configuration data that enables detection of whether the door is oriented in an open position or a closed position based on an image captured by the camera;

wherein controlling the camera to capture one or more images of the area monitored by the monitoring system comprises controlling the camera to capture a current image of the door;

wherein analyzing the one or more images based on the configuration data comprises analyzing the current image of the door based on the configuration data that enables detection of whether the door is oriented in an open position or a closed position;

wherein detecting occurrence of the event based on the analysis of the one or more images comprises detecting that the door is oriented in an open position based on the analysis of the current image of the door; and

wherein controlling the transmitting device to send, to the controller of the monitoring system, the signal that indicates the detection of the occurrence of the event comprises controlling the transmitting device to send, to the controller of the monitoring system, a door open signal that a traditional door contact sensor sends to the controller, thereby enabling the controller to take action responsive to the door open signal without awareness of whether the door open signal was generated by a traditional door contact sensor or analysis of camera image data.

10. The method of claim 3, wherein generating configuration data used in sensing the event through image data captured by the camera comprises generating configuration data that includes attribute data used in identifying an attribute of an entity that caused the event, further comprising:

evaluating the one or more images based on the attribute data used in identifying the attribute of the entity that caused the event, and

identifying the attribute of the entity that caused the event based on the evaluation of the one or more images.

11. The method of claim 10, wherein detecting occurrence of the event comprises:

accessing a rule that specifies at least one required attribute needed for detection of the event;

comparing the identified attribute of the entity that caused the event with the at least one required attribute;

based on the comparison, determining that the identified attribute of the entity that caused the event matches the at least one required attribute; and

detecting occurrence of the event based on the analysis of the one or more images and the determination that the identified attribute of the entity that caused the event matches the at least one required attribute.

12. The method of claim 11:

wherein accessing the rule that specifies the at least one required attribute needed for detection of the event comprises accessing a rule that recognition of a particular entity is needed for detection of the event;

wherein comparing the identified attribute of the entity that caused the event with the at least one required attribute comprises performing a biometric matching analysis using biometric data for the entity that caused the event and biometric data for the particular entity;

wherein determining that the identified attribute of the entity that caused the event matches the at least one required attribute comprises determining that the entity that caused the event is the particular entity; and

wherein detecting occurrence of the event based on the analysis of the one or more images and the determination that the identified attribute of the entity that caused the event matches the at least one required attribute comprises detecting occurrence of the event based on the analysis of the one or more images and the determination that the entity that caused the event is the particular entity.

13. The method of claim 11:

wherein accessing the rule that specifies the at least one required attribute needed for detection of the event comprises accessing a rule that at least one biometric characteristic is needed for detection of the event, the at least one biometric characteristic describing a non-unique physical attribute of the entity that caused the event;

wherein comparing the identified attribute of the entity that caused the event with the at least one required attribute comprises comparing the identified attribute of the entity that caused the event with the at least one biometric characteristic;

wherein determining that the identified attribute of the entity that caused the event matches the at least one required attribute comprises determining that the entity that caused the event has the at least one biometric characteristic; and

wherein detecting occurrence of the event based on the analysis of the one or more images and the determination that the identified attribute of the entity that caused the event matches the at least one required attribute comprises detecting occurrence of the event based on the analysis of the one or more images and the determination that the entity that caused the event has the at least one biometric characteristic.

14. The method of claim 10, further comprising controlling the transmitting device to send, to the controller of the monitoring system, a report of the identified attribute of the entity as a secondary event associated with the event.

15. The method of claim 3:

wherein receiving input defining one or more characteristics of the at least one configuration image comprises receiving input defining characteristics of the at least one configuration image that enable sensing of multiple, different events in the area;

wherein generating configuration data used in sensing the event through image data captured by the camera comprises;

assigning event identifiers to each of the multiple, different events, and

generating configuration data that is used in sensing the multiple, different events through image data captured by the camera and that associates each of the multiple, different events with the assigned event identifiers; and

wherein analyzing the one or more images based on the configuration data comprises monitoring, based on the configuration data, images captured by the camera to sense occurrence of one or more of the multiple, different events.

16. The method of claim 3, wherein controlling the camera to capture one or more images of the area monitored by the monitoring system comprises:

accessing a rule defining a capture pattern for when the camera is scheduled to monitor for events within captured images;

accessing data collected by the monitoring system that includes the camera;

comparing the accessed data collected by the monitoring system with the accessed rule defining the capture pattern;

based on the comparison, determining whether the accessed rule defining the capture pattern is satisfied;

based on a determination that the rule is satisfied, controlling the camera to capture one or more images of the area monitored by the monitoring system.

17. The method of claim 16:

wherein accessing data collected by the monitoring system that includes the camera comprises accessing sensor data collected by other sensors included in the monitoring system; and

wherein comparing the accessed data collected by the monitoring system with the accessed rule defining the capture pattern comprises comparing the accessed sensor data collected by the other sensors included in the monitoring system with the accessed rule defining the capture pattern.

18. The method of claim 16:

wherein accessing data collected by the monitoring system that includes the camera comprises accessing sensor data collected by other sensors included in the monitoring system and accessing time data collected by the monitoring system; and

wherein comparing the accessed data collected by the monitoring system with the accessed rule defining the capture pattern comprises comparing a combination of the accessed sensor data and the accessed time data with the accessed rule defining the capture pattern.

19. The method of claim 16, wherein controlling the camera to capture one or more images of the area monitored by the monitoring system comprises increasing a frequency at which the camera captures images of the area monitored by the monitoring system from a first frequency to a second frequency, the second frequency being greater than the first frequency and the first frequency being greater than zero.

20. The method of claim 3, further comprising:

monitoring images captured by the camera for an error condition that reduces an ability to detect the event through image data captured by the camera;

based on the monitoring of images captured by the camera, detecting a potential error condition that reduces an ability to detect the event through image data captured by the camera;

determining a degree of severity of the potential error condition; and

handling the potential error condition based on the degree of severity.