SYSTEM AND METHOD FOR THREAT MONITORING, DETECTION, AND RESPONSE

• US 20180322749A1
• Filed: 04/18/2018
• Published: 11/08/2018
• Est. Priority Date: 05/05/2017
• Status: Active Grant

• Current Assignee: TG-17, Inc.
• Original Assignee: TG-17, Inc.
• Inventors: KEMPEL, Doron, Asher, Ron
• Granted Patent: US 10,600,295 B2
• Time in Patent Office: Days
• CPC Class Codes: B64U 2101/00 UAVs specially adapted for particular uses or applications
• CPC Class Codes: B64U 2101/31 for surveillance
• CPC Class Codes: B64U 2101/60 for transporting passengers; for transporting goods other than weapons
• CPC Class Codes: B64U 2201/10 autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 50/38 by wireless transmission
• CPC Class Codes: B64U 80/25 for recharging batteries; for refuelling
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 25/016 Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12

Abstract

A drone receives an activation command indicating a user'"'"'s need for monitoring, and is deployed based on the activation command and a set of initial operational parameters. The drone autonomously navigates to a first position with respect to the user and performs a first configured action. A plurality of monitoring data signals corresponding to the user and surrounding environment is captured using sensors on the drone, and is wirelessly transmitted by the drone to a remote monitoring system. The monitoring data signals are continuously analyzed to generate updated operational parameters causing the drone to autonomously navigate to a second position and perform a second configured action. A third configured action is received by the drone from the remote monitoring system, wherein the third configured action is generated based on a threat analysis performed by the remote monitoring system on the monitoring data signals.

Claims

1. A method for threat monitoring with a drone, the method comprising:

receiving, at a first drone, an activation command indicating a given user'"'"'s need for monitoring;

deploying the first drone based on one or more of the activation command and a set of initial operational parameters, such that the first drone autonomously navigates to a first position with respect to the given user and performs a first configured action;

capturing, using one or more sensors on the first drone, a plurality of monitoring data signals corresponding to one or more of the given user and a given environment surrounding the given user;

transmitting, using a wireless transceiver on the first drone, one or more of the plurality of monitoring data signals to a remote monitoring system;

continuously analyzing the plurality of monitoring data signals to generate updated operational parameters causing the first drone to autonomously navigate to at least a second position with respect to the given user and perform at least a second configured action; and

performing at least a third configured action, wherein the third configured action is received at the wireless transceiver on the first drone from the remote monitoring system, and wherein the third configured action is generated based on a threat analysis of the one or more transmitted monitoring data signals performed by the remote monitoring system.

2. The method of claim 1, further comprising capturing a second plurality of monitoring data signals corresponding to a detected threat to the given user, wherein one or more of the updated operational parameters and the third configured action are generated based on the second plurality of monitoring data signals.

3. The method of claim 1, wherein the plurality of monitoring data signals comprises at least sound or image data, and the continuously analyzing comprises analyzing the image data to detect and track the given user in one or more environments surrounding the user.

4. The method of claim 3, wherein the given user is detected and tracked using a machine vision system running on one or more onboard processors on the first drone, wherein the machine vision system is configured with an identifying image data associated with the given user, the identifying image data pre-configured in an onboard memory of the first drone or extracted from the plurality of monitoring data signals.

5. The method of claim 3, wherein the continuously analyzing comprises analyzing the sound or image data to extract one or more user commands initiated by the given user, and wherein the updated operational parameters are generated based on the extracted user commands.

6. The method of claim 5, wherein the one or more user commands comprise voice commands spoken by the given user, gesture commands performed by the given user, or both.

7. The method of claim 1, wherein the continuously analyzing is performed by the remote monitoring system and the updated operational parameters are received by the wireless transceiver on the first drone.

8. The method of claim 1, wherein the continuously analyzing is performed by one or more onboard processors of the first drone and the updated operational parameters are received by a flight controller on the first drone.

9. The method of claim 1, wherein the continuously analyzing is performed by one or more processors of a mobile computing device associated with the given users and the updated operational parameters are received by the wireless transceiver on the first drone.

10. The method of claim 1, wherein the activation command comprises the given user actuating a physical button or switch located on a body of the first drone.

11. The method of claim 10, wherein the first drone is stowed on the person of the given user in a stowed configuration, and wherein deploying the first drone causes the first drone to enter an expanded configuration and activate one or more propulsion units located on the first drone.

12. The method of claim 1, wherein the activation command is determined from one or more external monitoring data signals corresponding to one or more of the user and the environment surrounding the user.

13. The method of claim 12, wherein the activation command is received at the wireless transceiver of the first drone from one or more of the remote monitoring system and a mobile computing device of the given user.

14. The method of claim 12, wherein the activation command is received at the wireless transceiver of the first drone from one or more sources of the external monitoring data signals.

15. The method of claim 13, wherein the activation command contains an indication of a current location of the given user and the first drone autonomously navigates to the first position based at least in part on the indication of the current location of the given user.

16. The method of claim 1, wherein the first position comprises a pre-defined separation between the first drone and a first reference point, wherein the pre-defined separation is measured along at least one dimension.

17. The method of claim 1, wherein the first configured action causes the first drone to autonomously navigate through the given environment in order to dynamically maintain the pre-defined separation between the first drone and the first reference point.

18. The method of claim 16, wherein the first reference point is located on the person of the given user or is associated with a ground point of the given environment.

19. The method of claim 1, wherein the capturing and transmitting the monitoring data signals comprises the first configured action.

20. The method of claim 1, wherein the initial operational parameters are selected from one or more sets of pre-defined initial operational parameters stored in an onboard memory of the first drone, wherein the pre-defined initial operational parameters are input by the given user or are received from the remote monitoring system.

21. The method of claim 1, wherein the third configured action comprises an interaction between one or more payload components of the first drone with the given user or with a threatening entity detected by the threat analysis.

22. The method of claim 1, further comprising deploying a second drone based on one or more of the activation command and the set of initial operational parameters, such that the second drone autonomously navigates to a respective position relative to the given user and performs a respective configured action.

23. The method of claim 22, further comprising:

deploying the first drone with a first set of payload components; and

deploying the second drone with a second set of payload components;

wherein the second set of payload components contains at least one unique payload component that is not contained in the first set of payload components.

24. The method of claim 22, further comprising:

capturing, using one or more of the second set of payload components of the second drone, a plurality of supplemental monitoring data signals corresponding to one or more of the given user and the given environment;

transmitting, using a wireless transceiver on the second drone, the plurality of supplemental monitoring data signals to at least the first drone; and

continuously analyzing, at one or more onboard processors of the first drone, the plurality of monitoring data signals and the plurality of supplemental monitoring data signals in order to generate the updated operational parameters.

25. The method of claim 24, further comprising performing, with the second drone, a configured action received by the second drone from the first drone, wherein the configured action is generated based on the continuous analysis performed by the first drone.

26. The method of claim 22, further comprising:

capturing, using one or more of the second set of payload components of the second drone, a plurality of alternate monitoring data signals corresponding to one or more of the given user and the given environment, wherein the alternate monitoring data signals are captured from a different point of view (POV) than the POV of the sensors on the first drone; and

transmitting, using a wireless transceiver on the second drone, one or more of the alternate monitoring data signals to the remote monitoring system.

27. The method of claim 22, further comprising:

determining that the first drone has failed or has lost the ability to transmit communications via its wireless transceiver; and

in response to the determining, performing the role of the first drone with the second drone.

28. The method of claim 1, wherein the one or more of the plurality of monitoring data signals are transmitted via the wireless transceiver on the drone to at least a first remote monitoring system and a second remote monitoring system, wherein the first remote monitoring system is separate from the second remote monitoring system.

29. The method of claim 28, wherein the third configured action is received at the wireless transceiver on the drone from one or more of the first remote monitoring system and the second remote monitoring system, and wherein the third configured action is generated based on a threat analysis of the one or more transmitted monitoring data signals performed by one or more of the first remote monitoring system and the second remote monitoring system.

30. The method of claim 1, wherein the one or more sensors on the drone comprise one or more of:

a visible light camera, an infrared camera, a microphone, a speaker, a distance sensor, a radar, a lidar, an illuminating light, a strobe light, a radio beacon, a location sensor, a chemical concentration sensor, a biometric sensor, a temperature sensor, an altitude sensor, and a pressure sensor.

31. The method of claim 1, wherein the wireless transceiver on the drone transmits the one or more of the plurality of monitoring data signals to a mobile computing device of the given user and the mobile computing device of the given user subsequently relays the one or more of the plurality of monitoring data signals to the remote monitoring system.

32. The method of claim 22, wherein the second drone is deployed based on one or more second activation commands or a second set of initial operational parameters.

33. The method of claim 22, wherein the second drone is selected from a group comprising a plurality of additional drones, wherein one or more of the plurality of additional drones is substantially identical to the first drone or the second drone.

34. The method of claim 22, further comprising capturing, using one or more of the second set of payload components of the second drone, a plurality of supplemental monitoring data signals corresponding to one or more of the given user and the given environment.

35. The method of claim 34, further comprising continuously analyzing, at one or more onboard processors of the second drone, the plurality of supplemental monitoring data signals in order to generate updated operational parameters for the second drone.

36. The method of claim 34, further comprising transmitting, using a wireless transceiver on the second drone, the plurality of supplemental monitoring data signals to at least the remote monitoring system.

37. The method of claim 35, further comprising performing, with the second drone, a configured action received by the second drone from the remote monitoring system, wherein the configured action is generated based on a continuous analysis performed by the remote monitoring system on one or more of the plurality of supplemental monitoring data signals.