Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays

• US 9,809,306 B2
• Filed: 08/05/2015
• Issued: 11/07/2017
• Est. Priority Date: 02/15/2013
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Stark, James Alexander, Wong, Clifford, Trowbridge, Robert Scott
• Primary Examiner(s): Do, Truc M
• Application Number:
  US14/819,048
• Publication Number:
  US 20150338855A1
• Time in Patent Office: 825 Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64D 47/02 Arrangements or adaptations of signal or lighting devices
• CPC Class Codes: B64U 10/10 Rotorcrafts
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/60 for transporting passengers; for transporting goods other than weapons
• CPC Class Codes: B64U 2201/102 adapted for flying in formations
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0808 specially adapted for aircraft
• CPC Class Codes: G05D 1/102 specially adapted for vertical take-off of aircraft
• CPC Class Codes: G05D 1/104 involving a plurality of aircrafts, e.g. formation flying traffic control systems for aircraft G08G5/00
• CPC Class Codes: G08G 5/0008 with other aircraft
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/0034 Assembly of a flight plan
• CPC Class Codes: G08G 5/0039 Modification of a flight plan
• CPC Class Codes: G08G 5/0069 specially adapted for an unmanned aircraft
• CPC Class Codes: G08G 5/04 Anti-collision systems
• CPC Class Codes: G08G 5/045 Navigation or guidance aids, e.g. determination of anti-collision manoeuvers radar or analogous systems specially adapted for anti-collision between aircraft G01S13/933

Abstract

A system for flock-based control of a plurality of unmanned aerial vehicles (UAVs). The system includes UAVs each including a processor executing a local control module and memory accessible by the processor for use by the local control module. The system includes a ground station system with a processor executing a fleet manager module and with memory storing a different flight plan for each of the UAVs. The flight plans are stored on the UAVs, and, during flight operations, each of the local control modules independently controls the corresponding UAV to execute its flight plan without ongoing control from the fleet manager module. The fleet manager module is operable to initiate flight operations by concurrently triggering initiation of the flight plans by the multiple UAVs. Further, the local control modules monitor front and back end communication channels and, when a channel is lost, operate the UAV in a safe mode.

Claims

1. A flight control method, comprising:

at individual ones of a plurality of multicopters, receiving a flight plan that is unique to the individual ones of the multicopters, wherein the flight plans differ from other ones of the flight plans and wherein each of the flight plans includes a plurality of way points, whereby flight of the multicopters is non-random;

concurrently operating the multicopters to execute the flight plans;

providing a communications channel between pairs of the multicopters;

with a first one of the multicopters detecting a second one of the multicopters in a predefined space proximal to the first one of the multicopters; and

with the first one of the multicopters, transmitting an instruction to the second multicopter, over the communication channel between the first and second multicopters, to move out of the predefined space and, with the second multicopter, receiving the instruction and responding by operating the second multicopter to change position to move out of the predefined space.

2. The method of claim 1, wherein the method further includes, during the operating of the multicopters to execute the flight plans, adjusting flight speed or course of one of the multicopters based on comparison of a present position and one of the way points.

3. The method of claim 2, wherein the flight plans further include an elapsed time period for at least some of the way points.

4. The method of claim 3, wherein the adjusting of the flight speed or course is performed when the elapsed time is exceeded by the one of the multicopters.

5. The method of claim 1, further comprising receiving at one of the multicopters control commands from a ground control system and, in response, performing the control commands to operate the one of the multicopters, whereby the ground control system may operate to override local control of the multicopters.

6. The method of claim 1, further including with each of the multicopters, gathering a set of telemetry data, communicating the telemetry data to a ground control system using a back end radio on the multicopter.

7. The method of claim 6, further including when communications with the ground control system via the back end radio is lost for any one of the multicopters, switching operations of the one of the multicopters to a safe operating mode.

8. A flight control method, comprising:

at a plurality of multicopters, receiving a flight plan unique to individual ones of the multicopters, wherein the flight plans comprise a plurality of way points for each of the multicopters, wherein the flight plans differ from one another, and wherein the flight plans include an elapsed time period for the way points;

operating the multicopters to execute the flight plans to provide non-swarming control of the multicopters;

providing a communications channel between pairs of the multicopters;

during the operating of the multicopters to execute the flight plans, adjusting flight speed or course of one of the multicopters based on comparison of a present position and one of the way points;

with a first one of the multicopters detecting a second one of the multicopters in a predefined space proximal to the first one of the multicopters; and

with the first one of the multicopters, transmitting a message to the second multicopter over the communication channel between the first and second multicopters causing the second multicopter to change position to avoid collision.

9. The method of claim 8, wherein the adjusting of the flight speed or course is performed when the elapsed time is exceeded by the one of the multicopters.

10. The method of claim 8, further comprising receiving at one of the multicopters control commands from a ground control system and, in response, performing the control commands to operate the one of the multicopters, whereby the ground control system may operate to override local control of the multicopters.

11. The method of claim 8, further including with each of the multicopters, gathering a set of telemetry data, communicating the telemetry data to a ground control system using a back end radio on the multicopter.

12. The method of claim 11, further including when communications with the ground control system via the back end radio is lost for any one of the multicopters, switching operations of the one of the multicopters to a safe operating mode.

13. A flight control method, comprising:

at a plurality of unmanned aerial vehicles, storing in memory a flight plan unique to each of the UAVs, wherein individual ones of the flight plans comprises a plurality of predefined way points;

with a local control module executed by a processor on individual ones of the UAVs, operating the UAVs to execute the flight plans;

for the UAVs, providing a front end communication channel and a back end communication channel with a ground station system;

with the local control module of each of the UAVs, periodically determining status of the front and back end communication channels;

when the status determination for one of the UAVs indicates a loss of one of the front and back end communication channels, operating the one of the UAVs in a predefined safe operating mode;

with the local control module of each of the UAVs, operating to detect another one of the UAVs within a safety envelope about the UAV and in response, operating a radio to communicate a collision warning message to the detected one of the UAVs to cause the detected one of the UAVs to alter its course to move out of the safety envelope.

14. The method of claim 13, wherein the method further includes, during the operating of the multicopters to execute the flight plans, adjusting flight speed or course of one of the multicopters based on comparison of a present position and one of the way points.

15. The method of claim 14, wherein the flight plans further include an elapsed time period for each of the way points.

16. The method of claim 15, wherein the adjusting of the flight speed or course is performed when the elapsed time is exceeded by the one of the multicopters.

17. The method of claim 13, further comprising with the local control module of each of the UAVs, gathering telemetry data including determining a present position of the UAV and communicating the gathered telemetry data to the ground station system over the back end communication channel.

18. The method of claim 17, further comprising with the ground station system comparing, for each of the UAVs, the present position of the UAV with an expected position of the UAV and, based on the comparing, transmitting an action to control operations for at least one of the UAVs to override the local control module.

19. The method of claim 13, wherein the UAVs are multicopters and wherein the method further comprises detecting, with the local control module of each of the UAVs, pitch and roll of the UAV and, when the pitch or the roll exceeds a predefined maximum, switching operations of the UAV to a safe operating mode.