Systems and methods for analyzing sensor data to detect property intrusion events

• US 10,388,135 B1
• Filed: 10/02/2015
• Issued: 08/20/2019
• Est. Priority Date: 10/07/2014
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Jordan, II, Jackie O., Donovan, John, Turrentine, David, Wollenschlager, Torri, Nussbaum, Bryan R., Stockweather, Deanna, Stoiber, Jeffrey W., Markwardt, Kerstin, Carlson, Gail L., Schiebel, Kyle C., Winslow, Troy, Harr, Joseph P., Wagner, Ellakate, Harris, Jr., Michael, Sun, Jennylind
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Black-Childress, Rajsheed O
• Application Number:
  US14/873,823
• Time in Patent Office: 1,418 Days
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G06Q 30/01 Customer relationship services
• CPC Class Codes: G06Q 30/018 Certifying business or products
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G06Q 50/163 Real estate management
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G08B 1/02 using only mechanical transmission
• CPC Class Codes: G08B 13/22 Electrical actuation
• CPC Class Codes: G08B 17/10 Actuation by presence of smoke or gases , e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0446 worn on the body to detect changes of posture, e.g. a fall, inclination, acceleration, gait
• CPC Class Codes: G08B 21/0453 worn on the body to detect health condition by physiological monitoring, e.g. electrocardiogram, temperature, breathing detecting, measuring or recording for diagnostic purposes A61B5/00
• CPC Class Codes: G08B 21/0461 integrated or attached to an item closely associated with the person but not worn by the person, e.g. chair, walking stick, bed sensor
• CPC Class Codes: G08B 21/182 Level alarms, e.g. alarms responsive to variables exceeding a threshold
• CPC Class Codes: G08B 21/185 Electrical failure alarms
• CPC Class Codes: G08B 7/062 indicating emergency exits
• CPC Class Codes: G08B 7/066 guiding along a path, e.g. evacuation path lighting strip
• CPC Class Codes: H04L 12/2818 : from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04L 12/2825 : Reporting to a device located outside the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; telephonic communication systems adapted for combination with telemetering systems H04M11/002
• CPC Class Codes: H04L 12/283 : Processing of data at an internetworking point of a home automation network
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: H04W 4/024 : Guidance services
• CPC Class Codes: H04W 4/90 : Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Abstract

The present embodiments relate to identifying property intrusion events based upon sensor data received from smart devices populated about a home. A smart home controller may compare the sensor data to baseline sensor data to dynamically identify an intrusion event that may be occurring. The controller may generate a notification and determine an action to perform to facilitate damage or risk mitigation. Accordingly, an individual associated with the home may be notified of the event, and then select to perform the action, such as via their mobile device. In some implementations, the controller may automatically perform the action. As a result, in response to computer identification of an intrusion event, corrective action may be taken or prompted, or otherwise any damage caused by the intrusion event may be mitigated, reducing insurance claims or claim amounts associated with intrusion events. Insurance discounts may be provided based upon the risk mitigation functionality.

Claims

1. A computer-implemented method of detecting property intrusion within a property, the property populated with a hardware controller in communication with a plurality of sensors disposed within the property, the method comprising:

receiving, by the hardware controller, sensor data from at least one sensor of the plurality of sensors, wherein the sensor data (i) indicates a location of the at least one sensor within the property, and (ii) comprises audio data including a first number of instances of a window breaking sound indicative of a property intrusion event;

identifying, based on the location indicated in the sensor data, an area of the property corresponding to the received sensor data;

analyzing the received audio data to identify a type of the property intrusion event indicated in the received audio data;

accessing, by the hardware controller, baseline audio data indicative of a set of default intrusion attempts, including;

sending a request to a back-end server to access a portion of the baseline audio data corresponding (i) to the type of the property intrusion event, and (ii) to a default intrusion attempt of the set of default intrusion attempts, and including a second number of instances of the window breaking sound, and

receiving, from the back-end server, the portion of the baseline audio data;

comparing, by one or more processors of the hardware controller, the received audio data to the portion of the baseline audio data received from the back-end server, including determining that the received audio data is consistent with the property intrusion event by comparing the first number of instances of the window breaking sound included in the received audio data to the second number of instances of the window breaking sound included in the baseline audio data;

responsive to the comparing;

generating a notification that indicates (i) the property intrusion event, (ii) the area of the property corresponding to the received sensor data, and (iii) a timestamp representing when the sensor data was recorded, and

communicating the notification to an electronic device of an individual associated with the property, the electronic device configured to present the notification and enable the individual to request to activate a set of lights associated with the area of the property;

receiving, from the electronic device, a request initiated by the individual to activate a set of lights associated with the area of the property; and

in response to receiving the request from the electronic device, activating the set of lights associated with the area of the property.

2. The computer-implemented method of claim 1, further comprising:

responsive to the comparing, activating an alarm within the property.

3. The computer-implemented method of claim 1, further comprising:

responsive to the comparing, communicating the notification to a law enforcement entity.

4. The computer-implemented method of claim 1, wherein receiving the sensor data from the at least one sensor comprises:

receiving the sensor data from a microphone disposed within the property.

5. The computer-implemented method of claim 1, wherein receiving the sensor data from the at least one sensor comprises:

receiving the sensor data further comprising motion sensor data generated by a motion sensor disposed within the property.

6. The computer-implemented method of claim 1, wherein receiving the sensor data from the at least one sensor comprises:

receiving the sensor data further comprising digital image data generated by an image sensor disposed within the property.

7. The computer-implemented method of claim 1, wherein comparing the received audio data to the portion of the baseline audio data comprises:

calculating a similarity percentage between the received audio data and the portion of the baseline audio data.

8. A hardware controller for detecting property intrusion within a property, the hardware controller in communication with a set of devices populated within the property, comprising:

a communication module interfacing with the set of devices populated within the property;

a memory storing non-transitory computer executable instructions; and

a processor interfacing with the communication module and the memory, wherein the processor is configured to execute the non-transitory computer executable instructions to cause the processor to;

receive, via the communication module, sensor data from at least one device of the set of devices, wherein the sensor data (i) indicates a location of the at least one sensor within the property, and (ii) comprises audio data including a first number of instances of a window breaking sound indicative of a property intrusion event,

identify, based on the location indicated in the sensor data, an area of the property corresponding to the received sensor data,

analyze the received audio data to identify a type of the property intrusion event indicated in the received audio data,

access baseline audio data indicative of a set of default intrusion attempts, including;

send a request to a back-end server to access a portion of the baseline audio data corresponding (i) to the type of the property intrusion event, and (ii) to a default intrusion attempt of the set of default intrusion attempts, and including a second number of instances of the window breaking sound, and

receive, from the back-end server, the portion of the baseline audio data,

compare the received audio data to the portion of the baseline audio data received from the back-end server, including determining that the received audio data is consistent with the property intrusion event by comparing the first number of instances of the window breaking sound included in the received audio data to the second number of instances of the window breaking sound included in the baseline audio data,

responsive to the comparing;

generate a notification that indicates (i) the property intrusion event, (ii) the area of the property corresponding to the received sensor data, and (iii) a timestamp representing when the sensor data was recorded, and

transmit, via the communication module, the notification to an electronic device of an individual associated with the property, the electronic device configured to present the notification and enable the individual to request to activate a set of lights associated with the area of the property,

receive, from the electronic device via the communication module, a request initiated by the individual to activate a set of lights associated with the area of the property, and

in response to receiving the request from the electronic device, activate the set of lights associated with the area of the property.

9. The hardware controller of claim 8, wherein the processor is further configured to:

responsive to the comparing, activate an alarm within the property.

10. The hardware controller of claim 8, wherein the processor is further configured to:

responsive to the comparing, transmit the notification to a law enforcement entity via the communication module.

11. The hardware controller of claim 8, wherein to receive the sensor data from the at least one device, the processor is configured to:

receive, via the communication module, the sensor data from a microphone disposed within the property.

12. The hardware controller of claim 8, wherein the sensor data further comprises motion sensor data generated by a motion sensor disposed within the property.

13. The hardware controller of claim 8, wherein the sensor data further comprises digital image data generated by an image sensor disposed within the property.

14. The hardware controller of claim 8, wherein to compare the received audio data to the portion of the baseline audio data, the processor is configured to:

calculate a similarity percentage between the received audio data and the portion of the baseline audio data.