Asset management monitoring

• US 10,798,344 B1
• Filed: 02/24/2020
• Issued: 10/06/2020
• Est. Priority Date: 02/03/2017
• Status: Active Grant

• Current Assignee: Alarm.com Inc. (Alarm.com Holdings, Inc.)
• Original Assignee: Alarm.com Inc. (Alarm.com Holdings, Inc.)
• Inventors: Seyfi, Ahmad, Rezvani, Babak
• Primary Examiner(s): Williams, Jeffery A
• Application Number:
  US16/798,854
• Time in Patent Office: 225 Days
• Field of Search: 348144
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2101/31 for surveillance
• CPC Class Codes: B64U 2201/10 autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
• CPC Class Codes: B64U 2201/104 using satellite radio beacon positioning systems, e.g. GPS
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/0202 specially adapted to aircraft
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 15/00 Identifying, scaring or incapacitating burglars, thieves or intruders, e.g. by explosives
• CPC Class Codes: G08B 29/188 Data fusion; cooperative systems, e.g. voting among different detectors
• CPC Class Codes: G08B 7/066 guiding along a path, e.g. evacuation path lighting strip
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

Techniques are described for an autonomous asset management system that integrates autonomous devices, such as drone devices and other robotic devices, with a home security system of a property to enable management, monitoring, and/or tracking of various assets located within the property. In some implementations, an indication of an asset associated with a property is obtained by an autonomous device. Sensor data collected by one or more sensors of the property is obtained by the autonomous device based on the indication of the asset. A present status of the asset is determined by the autonomous device based on the sensor data. A determination that the present status of the asset does not correspond to an expected status of the asset is made by the autonomous device. In response, the autonomous device navigates to the particular location of the property.

Claims

1. A method comprising:

determining, by an autonomous device, that a present status of an asset within a property that is being monitored by the autonomous device does not correspond to an expected status of the asset,

based on determining that the present status does not correspond to the expected status, determining, by the autonomous device, a previous status of the asset that identifies a location of the property where the asset was previously determined to be located;

navigating, by the autonomous device, to the location of the property; and

collecting, by the autonomous device, one or more images of the location of the property.

2. The method of claim 1, wherein:

the expected status identifies a first location of the property where the asset is expected to be located;

the present status identifies a second location of the property where the asset is identified to be presently located based on sensor data collected by one or more sensors of the property; and

determining that the present status does not correspond to the expected status comprises determining that the first location is different from the second location.

3. The method of claim 1, wherein determining the previous status of the asset comprises:

accessing a historical status repository identifying (i) previous monitoring operations performed by the autonomous device in the property, and (ii) a respective previous status determined for the asset during each previously performed monitoring operation; and

based on accessing the historical status repository;

identifying a most recently performed monitoring operation within the historical status repository, and

identifying a previous status of the asset that was determined during the most recently performed monitoring operation.

4. The method of claim 1, further comprising:

determining, by the autonomous device and based on the one or more images, that the asset is not presently located at the location; and

based on determining that the asset is not presently located at the location, providing, by the autonomous device for output to a computing device of a user associated with the property, a communication indicating that the asset is not located at the location of the property.

5. The method of claim 1, wherein:

the expected status identifies an expected physical condition of the asset; and

the method further comprises;

obtaining one or more images collected by a security camera of the property, wherein the one or more images indicate a present physical condition of the asset, and

determining that the present status indicates the present physical condition of the asset; and

determining that the present status does not correspond to the expected status comprises determining that the present physical condition does not match the expected physical condition.

6. The method of claim 5, wherein determining that the present physical condition does not match the expected physical condition comprises determining that the one or more images collected by the security camera indicates that the asset is damaged.

7. The method of claim 1, further comprising:

obtaining, by the autonomous device, data indicating a security breach at the property; and

determining that the present status does not correspond to the expected status of the asset comprises that determining that the present status does not correspond to the expected status of the asset in response to obtaining the data indicating the security breach.

8. A system comprising:

one or more computing devices; and

one or more non-transitory computer-readable storage devices storing instructions that, when executed by the one or more computing devices, cause the one or more computing devices to perform operations comprising;

determining, by an autonomous device, that a present status of an asset within a property that is being monitored by the autonomous device does not correspond to an expected status of the asset,

based on determining that the present status does not correspond to the expected status, determining, by the autonomous device, a previous status of the asset that identifies a location of the property where the asset was previously determined to be located;

navigating, by the autonomous device, to the location of the property; and

collecting, by the autonomous device, one or more images of the location of the property.

9. The system of claim 8, wherein:

the expected status identifies a first location of the property where the asset is expected to be located;

the present status identifies a second location of the property where the asset is identified to be presently located based on sensor data collected by one or more sensors of the property; and

determining that the present status does not correspond to the expected status comprises determining that the first location is different from the second location.

10. The system of claim 8, wherein determining the previous status of the asset comprises:

accessing a historical status repository identifying (i) previous monitoring operations performed by the autonomous device in the property, and (ii) a respective previous status determined for the asset during each previously performed monitoring operation; and

based on accessing the historical status repository;

identifying a most recently performed monitoring operation within the historical status repository, and

identifying a previous status of the asset that was determined during the most recently performed monitoring operation.

11. The system of claim 8, wherein the operations further comprise:

determining, by the autonomous device and based on the one or more images, that the asset is not presently located at the location; and

based on determining that the asset is not presently located at the location, providing, by the autonomous device for output to a computing device of a user associated with the property, a communication indicating that the asset is not located at the location of the property.

12. The system of claim 8, wherein:

the expected status identifies an expected physical condition of the asset; and

the operations further comprise;

obtaining one or more images collected by a security camera of the property, wherein the one or more images indicate a present physical condition of the asset, and

determining that the present status indicates the present physical condition of the asset; and

determining that the present status does not correspond to the expected status comprises determining that the present physical condition does not match the expected physical condition.

13. The system of claim 12, wherein determining that the present physical condition does not match the expected physical condition comprises determining that the one or more images collected by the security camera indicates that the asset is damaged.

14. The system of claim 8, wherein the operations further comprise:

obtaining, by the autonomous device, data indicating a security breach at the property; and

determining that the present status does not correspond to the expected status of the asset comprises that determining that the present status does not correspond to the expected status of the asset in response to obtaining the data indicating the security breach.

15. At least one non-transitory computer-readable storage device storing instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations comprising:

determining, by an autonomous device, that a present status of an asset within a property that is being monitored by the autonomous device does not correspond to an expected status of the asset,

based on determining that the present status does not correspond to the expected status, determining, by the autonomous device, a previous status of the asset that identifies a location of the property where the asset was previously determined to be located;

navigating, by the autonomous device, to the location of the property; and

collecting, by the autonomous device, one or more images of the location of the property.

16. The non-transitory computer-readable storage device of claim 15, wherein:

the expected status identifies a first location of the property where the asset is expected to be located;

the present status identifies a second location of the property where the asset is identified to be presently located based on sensor data collected by one or more sensors of the property; and

determining that the present status does not correspond to the expected status comprises determining that the first location is different from the second location.

17. The non-transitory computer-readable storage device of claim 15, wherein determining the previous status of the asset comprises:

accessing a historical status repository identifying (i) previous monitoring operations performed by the autonomous device in the property, and (ii) a respective previous status determined for the asset during each previously performed monitoring operation; and

based on accessing the historical status repository;

identifying a most recently performed monitoring operation within the historical status repository, and

identifying a previous status of the asset that was determined during the most recently performed monitoring operation.

18. The non-transitory computer-readable storage device of claim 15, wherein the operations further comprise:

determining, by the autonomous device and based on the one or more images, that the asset is not presently located at the location; and

based on determining that the asset is not presently located at the location, providing, by the autonomous device for output to a computing device of a user associated with the property, a communication indicating that the asset is not located at the location of the property.

19. The non-transitory computer-readable storage device of claim 15, wherein:

the expected status identifies an expected physical condition of the asset; and

the operations further comprise;

obtaining one or more images collected by a security camera of the property, wherein the one or more images indicate a present physical condition of the asset, and

determining that the present status indicates the present physical condition of the asset; and

determining that the present status does not correspond to the expected status comprises determining that the present physical condition does not match the expected physical condition.

20. The non-transitory computer-readable storage device of claim 19, wherein determining that the present physical condition does not match the expected physical condition comprises determining that the one or more images collected by the security camera indicates that the asset is damaged.