Cascade recognition for personal tracking via unmanned aerial vehicle (UAV)

• US 10,438,062 B1
• Filed: 02/12/2018
• Issued: 10/08/2019
• Est. Priority Date: 03/07/2014
• Status: Active Grant

• Current Assignee: Trace Live Network Inc.
• Original Assignee: Draganfly Innovations Inc. (Frontier Energy Corp.)
• Inventors: Beard, Paul, Chell, Cameron, Clarke, Jamie, McDermott, Craig, Racicot, Erika, Readwin, Paul
• Primary Examiner(s): Jones, Heather R
• Application Number:
  US15/894,292
• Time in Patent Office: 603 Days
• Field of Search: None
• CPC Class Codes: B64U 2101/31 for surveillance
• CPC Class Codes: B64U 2201/00 UAVs characterised by their flight controls
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

Systems and methods for tracking a subject using an unmanned aerial vehicle (UAV) are disclosed. The UAV includes an onboard camera to capture/stream multiple images. The camera captures reference images of a subject to be stored in memory; the reference images may portray gestures performed by the subject and associated with specific command procedures. The camera may capture subsequent images portraying the subject; the control system may, based on cascade recognition, identify the subject and a stored gesture to a determined confidence level. Once the subject and gesture are positively identified, the control system and/or propulsion system of the UAV may execute the associated command procedures to change the position, velocity, or heading of the UAV.

Claims

1. An unmanned aircraft system (UAS), comprising:

an airframe;

a propulsion system coupled to the airframe;

at least one camera attached to the airframe, the camera configured to;

capture at least one first image sequence associated with a subject and a gesture performed by the subject;

and

capture at least one second image sequence, the first image sequence and the second image sequence associated with one or more of a heading of the UAS, a position of the UAS relative to the subject, and an orientation of the UAS;

and

a control system coupled to the propulsion system and to the at least one camera, the control system comprising one or more processors and configured to;

associate the first image sequence with the subject and the gesture;

associate the gesture with at least one command executable by one or more of the control system and the propulsion system;

store the at least one first image sequence to a memory coupled to the control system;

identify one or more of the subject and the gesture within the second image sequence;

and

execute the at least one command associated with the identified gesture via one or more of the control system and the propulsion system.

2. The UAS of claim 1, wherein the at least one subject is a first subject, and executing the at least one associated command includes one or more of:

adjusting the current velocity;

adjusting the current heading;

adjusting the current orientation;

adjusting a position of the UAS relative to the subject;

following the first subject;

identifying a second subject to follow;

and

landing the UAS.

3. The UAS of claim 2, wherein the at least one associated command is executable by one or more of the control system, the propulsion system, and at least one remote user wirelessly linked to the control system.

4. The UAS of claim 2, wherein:

the propulsion system includes at least one rotor configured to rotate at a rotor speed;

and

the at least one associated command includes adjusting the at least one rotor speed.

5. The UAS of claim 1, wherein:

the at least one camera is pivotably attached to the airframe;

and

the at least one associated command includes moving the camera relative to the airframe.

6. The UAS of claim 1, wherein:

the control system is configured to;

identify the subject by identifying within the second image sequence at least one third image sequence associated with the subject;

and

identify the gesture by identifying within the third image sequence at least one fourth image sequence associated with the gesture based on a comparison of the third image sequence to the at least one first image sequence.