System and methods for correlating sound events to security and/or automation system operations

• US 10,255,774 B2
• Filed: 04/09/2018
• Issued: 04/09/2019
• Est. Priority Date: 10/20/2015
• Status: Active Grant

• Current Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Flint, Jason C., Matsuura, Craig, Child, Michael D., Vega, JonPaul, Lyman, Jefferson, Eyring, Matthew J., Warren, Jeremy B., Nye, James Ellis
• Primary Examiner(s): Nwugo, Ojiako K
• Application Number:
  US15/948,933
• Publication Number:
  US 20180301006A1
• Time in Patent Office: 365 Days
• CPC Class Codes: G08B 13/1672 using sonic detecting means, e.g. a microphone operating in the audio frequency range
• CPC Class Codes: G08B 13/196 using television cameras
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 15/002 with occupancy simulation
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: H04M 1/0291 Door telephones
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones

Abstract

A method for security and/or automation systems is described. In one embodiment, the method may include detecting a first sound event at a home entry point using one or more sensors. The method may further include receiving input to associate at least one home automation system operation with the first sound event, and may further include storing the first sound event. The method may further include initiating the at least one home automation system operation associated with the first sound event.

Claims

1. A method for a building automation system, comprising:

detecting a sound event at a building entry point using a sensor;

identifying one or more characteristics of the sound event;

determining an identity of an entity associated with the sound event based at least in part on the one or more characteristics of the sound event; and

initiating a building automation system operation based at least in part on the identity of the entity.

2. The method of claim 1, wherein identifying the one or more characteristics of the sound event further comprises:

identifying one or more temporal characteristics of the sound event; and

identifying one or more frequency characteristics of the sound event, wherein determining the identity of the entity is based at least in part on the one or more temporal characteristics and the one or more frequency characteristics of the sound event.

3. The method of claim 1, wherein identifying the one or more characteristics of the sound event further comprises:

identifying a duration of the sound event, wherein determining the identity of the entity is based at least in part on the duration of the sound event.

4. The method of claim 1, wherein identifying the one or more characteristics of the sound event further comprises:

identifying a number of raps of the sound event, wherein determining the identity of the entity is based at least in part on the number of raps of the sound event.

5. The method of claim 1, wherein identifying the one or more characteristics of the sound event further comprises:

identifying a pattern of raps of the sound event, wherein determining the identity of the entity is based at least in part on the pattern of raps of the sound event.

6. The method of claim 5, further comprising:

identifying a timing for the pattern of raps of the sound event, wherein determining the identity of the entity is based at least in part on the timing of the pattern of raps of the sound event.

7. The method of claim 1, wherein identifying the one or more characteristics of the sound event further comprises:

identifying a surface being struck during the sound event, wherein determining the identity of the entity is based at least in part on the surface being struck during the sound event.

8. The method of claim 7, further comprising:

identifying a frequency of the sound event, wherein identifying the surface being struck is based at least in part on the frequency of the sound event.

9. The method of claim 1, wherein identifying the one or more characteristics of the sound event further comprises:

identifying an amplitude of the sound event, wherein determining the identity of the entity is based at least in part on the amplitude of the sound event.

10. The method of claim 1, further comprising:

comparing the one or more characteristics of the sound event to a library of sound events, wherein determining the identity of the entity is based at least in part on comparing the one or more characteristics of the sound event to the library of sound events.

11. The method of claim 1, further comprising:

determining an occupancy of the building entry point using a second sensor different from the sensor, wherein detecting the sound event is based at least in part on determining that the building entry point is occupied.

12. The method of claim 1, further comprising:

detecting an unknown sound event at the building entry point using the sensor; and

receiving a building automation system operation command in response to detecting the unknown sound event.

13. The method of claim 12, further comprising:

storing the unknown sound event and the building automation system operation in a library of sound events.

14. The method of claim 1, further comprising:

determining that the sound event represents an attempted break-in of a building associated with the building entry point, wherein the building automation system operation causes a component of the building to indicate that the building is occupied by another entity.

15. The method of claim 1, further comprising:

sending a message to a remote computing device associated with a user based at least in part on determining the identity of the entity associated with the sound event; and

receiving a response from the remote computing device, wherein initiating the building automation system operation is based at least in part on receiving the response.

16. The method of claim 1, wherein:

the building automation system operation comprises locking or unlocking a door, deactivating an alarm system, triggering an alarm, turning on or off a light, activating a video monitoring system, broadcasting a prerecorded audio message, displaying a prerecorded video message, communicating the identity of the entity associated with the sound event, or communicating a picture or a video of the entity, or a combination thereof.

17. The method of claim 1, wherein:

the sound event is any of knocking, kicking, rapping, slapping, pounding, hitting, scratching, speaking, yelling, clapping, whistling, car engine running, footsteps, ringing a bell, or a combination thereof.

18. An apparatus for wireless communication, comprising:

a sensor;

a processor;

memory in electronic communication with the processor; and

instructions stored in the memory and operable, when executed by the processor, to cause the apparatus to;

detect a sound event at a building entry point using the sensor;

identify one or more characteristics of the sound event;

determine an identity of an entity associated with the sound event based at least in part on the one or more characteristics of the sound event; and

initiate a building automation system operation based at least in part on the identity of the entity.

19. The apparatus of claim 18, wherein the instructions are further executable by the processor to:

identify one or more temporal characteristics of the sound event; and

identify one or more frequency characteristics of the sound event, wherein determining the identity of the entity is based at least in part on the one or more temporal characteristics and the one or more frequency characteristics of the sound event.

20. A non-transitory computer readable medium storing code for wireless communication, the code comprising instructions executable by a processor to:

detect a sound event at a building entry point using a sensor;

identify one or more characteristics of the sound event;

determine an identity of an entity associated with the sound event based at least in part on the one or more characteristics of the sound event; and

initiate a building automation system operation based at least in part on the identity of the entity.