Method and apparatus for operator supervision and direction of highly autonomous vehicles

• US 9,529,357 B1
• Filed: 06/09/2014
• Issued: 12/27/2016
• Est. Priority Date: 06/17/2013
• Status: Active Grant

• Current Assignee: US Department of The Air Force (U.S. Department Of Defense)
• Original Assignee: United States Of America As Represented By The Secretary Of The Air Force
• Inventors: Eggers, Jeffrey, Draper, Mark, Shaw, Robert, Hamell, Joshua, Ruff, Heath
• Primary Examiner(s): Nguyen, Nga X
• Application Number:
  US14/298,992
• Time in Patent Office: 932 Days
• Field of Search: 701300-302, 701 1- 3
• US Class Current: 1/1
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005

Abstract

A system for automating the control of a Remotely Piloted Vehicle (RPV) includes a computer having a processor and a memory, a display operatively coupled to the computer and configured to display a future operating condition of the RPV and an input device operatively coupled to the computer. A predicted noodle tool is executed by the processor and configured to indicate a predicted future path of the RPV by generating a predicted noodle segment on the display. A directed noodle tool is executed by the processor to indicate a pilot-adjustable proposed future flight path of the RPV by generating a directed noodle segment on the display. Further, an input device mode selector is operatively coupled to the processor and configured to selectively map the input device to either manipulate a control surface of the RPV, or to manipulate the directed noodle segment.

Claims

1. A system for automating the control of a Remotely Piloted Vehicle (RPV), the system comprising:

a computer having a processor and a memory;

a display operatively coupled to the computer and configured to display a future operating condition of the RPV;

an input device operatively coupled to the computer;

a predicted noodle tool executed by the processor and configured to indicate a predicted future path of the RPV by generating a predicted noodle segment on the display;

a directed noodle tool executed by the processor to indicate a pilot-adjustable proposed future flight path of the RPV by generating a directed noodle segment on the display; and

an input device mode selector operatively coupled to the processor and configured to selectively map the input device to either manipulate a control surface of the RPV, or to manipulate the directed noodle segment,

wherein each of the display, input device, predicted noodle tool, directed noodle tool, and input mode selector is configured to interface with a second RPV,

wherein the input device is configured to manipulate the directed noodle segment corresponding to the second RPV concurrently with the execution of the predicted noodle tool corresponding to the RPV.

2. The system of claim 1, further including a confirmation switch operatively coupled to the processor, wherein a second directed noodle segment is disposed adjacent the directed noodle segment, and wherein the confirmation switch is configured to either commit to, or select for a modification of, the directed noodle segment or the second directed noodle segment.

3. The system of claim 2, wherein the modification comprises deleting.

4. The system of claim 1, wherein the input device is configured to manipulate the directed noodle segment corresponding to the second RPV concurrently with the execution of the predicted noodle tool corresponding to second RPV.

5. The system of claim 1, wherein the input device is configured to manipulate the directed noodle segment corresponding to the RPV concurrently with the execution of the predicted noodle tool corresponding to the RPV.

6. A method of controlling a first Remotely Piloted Vehicle (RPV) and a second RPV, in a system including a computer having a processor and a memory, a display operatively coupled to the computer and configured to display a future operating condition of the first and second RPVs, and an input device operatively coupled to the computer, the method comprising:

generating on the display a predicted noodle segment indicative of a predicted future path of the first RPV or the second RPV, and flying the first RPV or the second RPV with an autopilot to conform to the predicted future path corresponding to the first RPV or the second RPV;

generating on the display a directed noodle segment indicative of a proposed future path of the first RPV or the second RPV;

using an input device mode selector to map the input device to manipulate the directed noodle segment corresponding to the first RPV or the Second RPV;

manipulating the directed noodle segment corresponding to the first RPV or to the second RPV with the input device into a desired future path, and committing to the desired future path by actuating a confirmation switch; and

manipulating the directed noodle segment corresponding to the second RPV coincident with execution of the predicted noodle tool corresponding to the first RPV.

7. The system of claim 6, wherein the input device is configured to manipulate the directed noodle segment corresponding to the second RPV concurrently with the execution of the predicted noodle tool corresponding to second RPV.

8. The system of claim 6, wherein the input device is configured to manipulate the directed noodle segment corresponding to the first RPV concurrently with the execution of the predicted noodle tool corresponding to the first RPV.