System and methods for correlating sound events to security and/or automation system operations

• US 9,679,453 B2
• Filed: 10/20/2015
• Issued: 06/13/2017
• Est. Priority Date: 10/20/2015
• Status: Active Grant

• Current Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Flint, Jason C., Matsuura, Craig, Lyman, Jefferson, Child, Michael D., Vega, JonPaul, Eyring, Matthew J., Warren, Jeremy B., Nye, James Ellis
• Primary Examiner(s): NWUGO, OJIAKO K
• Application Number:
  US14/918,300
• Publication Number:
  US 20170109983A1
• Time in Patent Office: 602 Days
• Field of Search: 340541, 340540
• CPC Class Codes: G08B 13/1672 using sonic detecting means, e.g. a microphone operating in the audio frequency range
• CPC Class Codes: G08B 13/196 using television cameras
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 15/002 with occupancy simulation
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: H04M 1/0291 Door telephones
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones

Abstract

A method for security and/or automation systems is described. In one embodiment, the method may include detecting a first sound event at a home entry point using one or more sensors. The method may further include receiving input to associate at least one home automation system operation with the first sound event, and may further include storing the first sound event. The method may further include initiating the at least one home automation system operation associated with the first sound event.

Claims

1. A method for security and/or automation systems, comprising:

detecting a first sound event at a home entry point using one or more sensors;

detecting a pattern of at least one home automation system operation performed in association with the first sound event;

storing the first sound event;

automatically deriving at least one operating instruction based at least in part on the detected pattern;

detecting a second sound event at the home entry point using one or more sensors;

comparing the second sound event with the first sound event; and

initiating the at least one home automation system operation associated with the first sound event based at least in part on the derived at least one operating instruction.

2. The method of claim 1, further comprising:

deriving an identity of an entity associated with the second sound event based, at least in part, on any of facial recognition, voice recognition, or input code recognition, or a combination thereof; and

associating the derived identity of the entity with the second sound event.

3. The method of claim 1, further comprising:

sending a confirmation message to initiate the at least one home automation system operation associated with the first sound event.

4. The method of claim 1, further comprising:

continuously detecting one or more sound events using the one or more sensors.

5. The method of claim 1, wherein detecting the first sound event or the second sound event is triggered based, at least in part, on detecting any of motion, occupancy, light, or vibration, or a combination thereof, at the home entry point.

6. The method of claim 1, wherein the detected first sound event is the result of any of knocking, kicking, rapping, slapping, pounding, hitting, speaking, yelling, clapping, whistling, car engine running, walking, or ringing a bell, or a combination thereof.

7. The method of claim 2, wherein the at least one home automation system operation comprises any of activating or deactivating an audio alarm or chime, locking or unlocking a door, opening or closing a door, activating or deactivating an alarm system, triggering or silencing an alarm, turning on or off a light, activating or deactivating a video monitoring system, activating or deactivating a still photograph monitoring system, activating or deactivating an audio monitoring system, initiating a two-way communication, broadcasting a prerecorded audio message, displaying a prerecorded video message, communicating the identity of the identified entity associated with the first sound event or the second sound event, or communicating a picture or a video of the identified entity, or a combination thereof.

8. The method of claim 1, wherein the first sound event is stored in a sound event library that comprises any of sound clips or sound fingerprints, or a combination thereof.

9. The method of claim 8, wherein the sound fingerprints comprise data related to any of audio input intensity, source, duration, location, or pattern, or a combination thereof.

10. An apparatus for security and/or automation systems, comprising:

a processor;

memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to;

detect a first sound event at a home entry point using one or more sensors;

detecting a pattern of at least one home automation system operation performed in association with the first sound event;

store the first sound event;

automatically derive at least one operation instruction based at least in part on the detected pattern;

detect a second sound event at the home entry point using one or more sensors;

compare the second sound event with the first sound event; and

initiate the at least one home automation system operation associated with the first sound event based at least in part on the derived at least one operating instruction.

11. The apparatus of claim 10, wherein the instructions are further executable by the processor to:

derive an identity of an entity associated with the second sound event based, at least in part, on any of facial recognition, voice recognition, or input code recognition, or a combination thereof; and

associate the derived identity of entity with the second sound event.

12. The apparatus of claim 10, further comprising:

sending a confirmation message to initiate the at least one home automation system operation associated with the first sound event.

13. The apparatus of claim 10, wherein detecting the first sound event or the second sound event is triggered based, at least in part, on detecting any of motion, occupancy, light, or vibration, or a combination thereof, at the home entry point.

14. The apparatus of claim 10, wherein the detected first sound event is the result of any of knocking, kicking, rapping, slapping, pounding, hitting, speaking, yelling, clapping, whistling, car engine running, walking, or ringing a bell, or a combination thereof.

15. The apparatus of claim 11, wherein the at least one home automation system operation comprises any of activating or deactivating an audio alarm or chime, locking or unlocking a door, opening or closing a door, activating or deactivating an alarm system, triggering or silencing an alarm, turning on or off a light, activating or deactivating a video monitoring system, activating or deactivating a still photograph monitoring system, activating or deactivating an audio monitoring system, initiating a two-way communication, broadcasting a prerecorded audio message, displaying a prerecorded video message, communicating an identity of identified entity associated with the first sound event or the second sound event, or communicating a picture or a video of the identified entity, or a combination thereof.

16. The apparatus of claim 10, wherein the first sound event is stored in a sound event library that comprises any of sound clips or sound fingerprints, or a combination thereof.

17. The apparatus of claim 16, wherein the sound fingerprints comprise data related to any of audio input intensity, source, duration, location, or pattern, or a combination thereof.

18. A non-transitory computer-readable medium storing computer-executable code, the code executable by a processor to:

detect a first sound event at a home entry point using one or more sensors;

detect a pattern of at least one home automation system operation performed in association with the first sound event;

store the first sound event;

automatically derive at least one operating instruction based at least in part on the detected pattern;

detect a second sound event at the home entry point using one or more sensors;

compare the second sound event with the first sound event; and

initiate the at least one home automation system operation associated with the first sound event based at least in part on the derived at least one operating instruction.