Detection of authorized user presence and handling of unauthenticated monitoring system commands

• US 10,147,306 B2
• Filed: 11/22/2017
• Issued: 12/04/2018
• Est. Priority Date: 11/23/2016
• Status: Active Grant

• Current Assignee: Alarm.com Inc. (Alarm.com Holdings, Inc.)
• Original Assignee: Alarm.com Inc. (Alarm.com Holdings, Inc.)
• Inventors: Kinney, Abraham Joseph, Kerzner, Daniel Todd, Hutz, David James
• Primary Examiner(s): MURILLO GARCIA, FABRICIO R
• Application Number:
  US15/821,474
• Publication Number:
  US 20180144615A1
• Time in Patent Office: 377 Days
• Field of Search: 340 52
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G07C 9/00 Individual registration on entry or exit
• CPC Class Codes: G07C 9/00571 operated by interacting with a central unit
• CPC Class Codes: G07C 9/00904 for hotels, motels, office buildings or the like
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 19/00 Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system
• CPC Class Codes: G08B 29/02 Monitoring continuously signalling or alarm systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

Techniques are described for detecting and handling unauthenticated commands in a property monitoring system. In some implementations, a monitoring system may include sensors located throughout a property, a monitoring control unit, and an input device. The monitoring control unit may be configured to receive data collected by the sensors, as well as an input command detected by the input device. For an input command that does not include authentication information, the monitoring control unit may generate property state information based on the sensor data, then analyze the property state data and the input command against one or more rules that relate to authorization of unauthenticated commands. Based on the analysis, the monitoring control unit may determine whether to perform the action corresponding to the input command or whether to perform another action, for example, generating and providing a notification or authorization request to a user.

Claims

1. A monitoring system comprising:

one or more sensors that are located throughout a property;

a monitoring control unit that is configured to;

receive data collected by the one or more sensors located throughout the property; and

generate property state information based on the data collected by the one or more sensors; and

an input device that is configured to;

detect an input command to adjust an electronic device, wherein the input command does not include authentication information for the monitoring control unit to authenticate the input command before adjusting the electronic device,

wherein the monitoring control unit is further configured to;

receive, from the input device, data identifying the input command that does not include the authentication information for the monitoring control unit to authenticate the input command before adjusting the electronic device;

analyze the property state information and the input command against one or more rules that are related to authorizing additional input commands that are received by the monitoring system without the authentication information; and

based on analyzing the property state information and the input command against the one or more rules, determine whether to adjust the electronic device or generate (i) an alarm condition or (ii) a notification.

2. The monitoring system of claim 1, wherein:

the monitoring system is in an armed state,

the property state information indicates that an expected number of occupants are located in a particular area of the property,

the input command comprises a command to disarm the monitoring system provided from a location outside of the particular area of the property, and

the monitoring control unit is further configured to;

based on analyzing the property state information and the input command against the one or more rules, determine that the command to disarm the monitoring system is not authorized; and

determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by determining to generate the alarm condition based on determining that the command to disarm the monitoring system is not authorized.

3. The monitoring system of claim 1, wherein:

the property state information indicates that a user is located inside the property,

the data collected by the one or more sensors located throughout the property includes an image of the user,

the input command comprises a voice command uttered by the user located inside the property, and

the monitoring control unit is further configured to;

based on analyzing the property state information and the input command against the one or more rules, determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by;

analyzing an image of the user captured by the monitoring system;

based on analyzing the image of the user, determining that the user is an authorized user; and

based on determining that the user is an authorized user, determining that the voice command is authorized; and

determining to adjust the electronic device based on determining that the voice command is authorized.

4. The monitoring system of claim 1, wherein:

the input command comprises a voice command uttered by a user located inside the property,

the property state information indicates that the user is located inside a bedroom of the property and that the user was likely sleeping before uttering the voice command, and

the monitoring control unit is further configured to;

based on analyzing the property state information and the input command against the one or more rules, determining that the voice command is authorized; and

determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by determining to adjust the electronic device based on determining that the voice command is authorized.

5. The monitoring system of claim 4, wherein:

the monitoring control unit is further configured to adjust the electronic device based on determining that the voice command is authorized by performing one or more of;

disarming the monitoring system;

activating one or more lights that are located in the property;

raising one or more window coverings that are located in the property; and

activating an appliance that is located in the property.

6. The monitoring system of claim 1, wherein:

the property state information indicates that a resident of the property is outside of the property,

the electronic device is located at the property,

the monitoring control unit is further configured to;

determine a security impact of the input command to adjust the electronic device of the property;

based on (i) analyzing the property state information that indicates that the resident of the property is outside of the property, (ii) the security impact of the input command to adjust the electronic device of the property, and (iii) the input command to adjust the electronic device of the property against the one or more rules, generate an authorization request to adjust the electronic device of the property;

provide, to a computing device of the resident of the property, the authorization request to adjust the electronic device of the property;

receive, from the computing device of the resident of the property, authorization to adjust the electronic device of the property; and

determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by determining to adjust the electronic device based on receiving the authorization to adjust the electronic device of the property.

7. The monitoring system of claim 6, wherein:

the command to adjust the electronic device of the property was received locally at the electronic device, and

the monitoring control unit is further configured to;

based on (i) analyzing the property state information that indicates that the resident of the property is outside of the property, (ii) the security impact of the input command to adjust the electronic device of the property, and (iii) the local command to adjust the electronic device of the property against the one or more rules, generate an authorization request to adjust the electronic device of the property.

8. The monitoring system of claim 1, wherein the monitoring control unit is further configured to:

receive additional data collected by the one or more sensors during a period of time before detecting the input command;

determine an activity pattern of persons in the property based on the additional data collected by the one or more sensors during the period of time before detecting the input command;

update the property state information based on the activity pattern of persons in the property;

analyze the property state information and the input command against the one or more rules that are related to authorizing the additional input commands that are received by the monitoring system without authentication information by analyzing the updated property state information and the input command against one or more rules that are related to authorizing the additional input commands that are received by the monitoring system without authentication information; and

based on analyzing the property state information and the input command against the one or more rules, determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by determining whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification based on analyzing the updated property state information and the input command against the one or more rules.

9. The monitoring system of claim 1, wherein the monitoring control unit is further configured to:

determine an energy consumption of the property and conditions in or near a property; and

based on the energy consumption of the property, at least one user-specified setting, and the conditions in or near the property, generate the one or more rules that are related to authorizing the additional input commands that are received by the monitoring system without authentication information.

10. The system of claim 9, wherein the conditions in or near the property include weather, daylight level, air quality, and other environmental conditions.

11. The monitoring system of claim 1, wherein:

the property state information indicates that a resident is leaving the property,

the input command comprises a voice command uttered by the resident while leaving the property, and

the monitoring control unit is further configured to;

based on analyzing the property state information and the input command against the one or more rules, determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by;

based on analyzing the property state information indicating that the resident is leaving the property and the voice command uttered by the resident while leaving the property, determining that the user is an authorized user; and

based on determining that the user is an authorized user, determining that the voice command is authorized; and

determining to adjust the electronic device based on determining that the voice command is authorized by performing one or more of;

arming the monitoring system;

deactivating one or more lights of the property;

locking one or more doors of the property; and

adjusting a thermostat of the property.

12. The monitoring system of claim 1, wherein:

the property state information indicates that a resident is arriving at the property,

the input command comprises a voice command uttered by the resident while arriving at the property, and

the monitoring control unit is further configured to;

based on analyzing the property state information and the input command against the one or more rules, determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by;

based on analyzing the property state information indicating that the resident is arriving at the property and the voice command uttered by the resident while arriving at the property, determining that the user is an authorized user;

based on determining that the user is an authorized user, determining that the voice command is authorized; and

determining to adjust the electronic device based on determining that the voice command is authorized by performing one or more of;

disarming the monitoring system;

activating one or more lights of the property;

opening one or more doors of the property;

adjusting a thermostat of the property; and

activating an applicant located in the property.

13. A computer-implemented method, comprising:

receiving, by a monitoring system that is configured to monitor a property,

property state information that includes data collected by one or more sensors located throughout the property;

receiving, by the monitoring system, an input command to adjust an electronic device does not include authentication information for the monitoring system to authenticate the input command before performing adjusting the electronic device;

analyzing, by the monitoring system, the property state information and the input command against one or more rules that are related to authorizing additional input commands that are received by the monitoring system without authentication information; and

based on analyzing the property state information and the input command against the one or more rules, determining, by the monitoring system, whether to adjust the electronic device or generate (i) an alarm condition or (ii) a notification.

14. The method of claim 13, wherein:

the monitoring system is in an armed state,

the property state information indicates that an expected number of occupants are located in a particular area of the property,

the input command comprises a command to disarm the monitoring system provided from a location outside of the particular area of the property, and

the method further comprises;

based on analyzing the property state information and the input command against the one or more rules, determining that the command to disarm the monitoring system is not authorized; and

determining whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification comprises determining to generate the alarm condition based on determining that the command to disarm the monitoring system is not authorized.

15. The method of claim 13, wherein:

the property state information indicates that a user is located inside the property,

the data collected by the one or more sensors located throughout the property includes an image of the user,

the input command comprises a voice command uttered by the user located inside the property,

the method further comprises;

based on analyzing the property state information and the input command against the one or more rules, determining, by the monitoring system, whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification comprises;

analyzing an image of the user captured by the monitoring system;

based on analyzing the image of the user, determining that the user is an authorized user; and

based on determining that the user is an authorized user, determining that the voice command is authorized, and

determining to adjust the electronic device based on determining that the voice command is authorized.

16. The method of claim 13, wherein:

the input command comprises a voice command uttered by a user located inside the property,

the property state information indicates that the user is located inside a bedroom of the property and that the user was likely sleeping before uttering the voice command,

the method further comprises;

based on analyzing the property state information and the input command against the one or more rules, determining that the voice command is authorized, and

determining whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification comprises determining to adjust the electronic device based on determining that the voice command is authorized.

17. The method of claim 16, wherein:

determining to adjust the electronic device based on determining that the voice command is authorized comprises performing one or more of;

disarming the monitoring system;

activating one or more lights that are located in the property;

raising one or more window coverings that are located in the property; and

activating an appliance that is located in the property.

18. The method of claim 13, wherein:

the property state information indicates that a resident of the property is outside of the property,

the electronic device is located at the property,

the method further comprises;

determining a security impact of the input command to adjust the electronic device of the property;

based on (i) analyzing the property state information that indicates that a resident of the property is outside of the property, (ii) the security impact of the input command to adjust the electronic device of the property, and (iii) the input command to adjust the electronic device of the property against the one or more rules, generating an authorization request to adjust the electronic device of the property;

providing, to a computing device of the resident of the property, the authorization request to adjust the electronic device of the property; and

receiving, from the computing device of the resident of the property, authorization to adjust the electronic device of the property, and

determining whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification comprises determining to adjust the electronic device based on receiving the authorization to adjust the electronic device of the property.

19. The method of claim 13, further comprising:

receiving, by the monitoring system, additional data collected by the one or more sensors during a period of time before detecting the input command;

determining an activity pattern of persons in the property based on the additional data collected by the one or more sensors during the period of time before detecting the input command;

updating the property state information based on the activity pattern of persons in the property;

analyzing the property state information and the input command against the one or more rules that are related to authorizing the additional input commands that are received by the monitoring system without authentication information by analyzing the updated property state information and the input command against one or more rules that are related to authorizing the additional input commands that are received by the monitoring system without authentication information; and

based on analyzing the property state information and the input command against the one or more rules, determine whether to adjust the electronic device or generate (i) the alarm condition or (ii) the notification by determining whether adjust the electronic device or generate (i) the alarm condition or (ii) the notification based on analyzing the updated property state information and the input command against the one or more rules.

20. The method of claim 13, further comprising:

determining an energy consumption of the property and conditions in or near a property; and

based on the energy consumption of the property, at least one user-specified setting, and the conditions in or near the property, generating the one or more rules that are related to authorizing the additional input commands that are received by the monitoring system without authentication information.