CONTROL INTERFACE FOR UNMANNED VEHICLES

• US 20110288695A1
• Filed: 05/17/2011
• Published: 11/24/2011
• Est. Priority Date: 05/18/2010
• Status: Abandoned Application

• Current Assignee: Clearpath Robotics, Inc. (Rockwell Automation, Inc.)
• Original Assignee: Clearpath Robotics, Inc. (Rockwell Automation, Inc.)
• Inventors: PURVIS, Michael James, GARIEPY, Ryan
• Application Number:
  US13/109,092
• Publication Number:
  US 20110288695A1
• Time in Patent Office: Days
• US Class Current: 701/2
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: G05D 1/0206 specially adapted to water vehicles

Abstract

An unmanned vehicle system containing one or more vehicles equipped with an autonomous control system. Each vehicle is of navigating on its own when provided with goals. A user is capable of sending and receiving goals from the autonomous control system via a communication link. A unified display interface displays information about the system and accepts commands from the user. The display interface in question is modeless and has a minimum of clutter and distractions. The form of this display interface is that of a set of screens, each of which is able to receive touch inputs from the user. The user is able to monitor and control individual vehicles or the entirety of the UVS solely through their use of a standard touchscreen with no additional peripherals.

Claims

1. A system comprising,

a processor, a display, a communication interface and an input device, the processor enabled to:

communicate with an unmanned vehicle to receive current positional data from the unmanned vehicle and transmit commands to the unmanned vehicle, via the communication interface;

render a control user interface for the unmanned vehicle in a single window at the display, the control user interface comprising a map of a physical location of the unmanned vehicle; and

via the control user interface in the single window;

at least one of generate and edit a mission to designate one or more of paths and areas of movement for the unmanned vehicle via command input;

assign the unmanned vehicle to a given mission via further command input;

provide a representation of the unmanned vehicle on the map based on the current positional data; and

receive input data for controlling the unmanned vehicle,

such that the control user interface operates modelessly, and wherein the control user interface is independent of one or more of aspect ratio and resolution of the display.

2. The system of claim 1, wherein the processor is further enabled to, via the control user interface:

receive new key point data via the control user interface, the new key point data indicative of a position of a key point to be rendered on the map at the display device;

render a representation of the key point on the map;

receive a first indication via the control user interface that the unmanned vehicle be directed to move to the position corresponding to the key point; and

,

render a path of the unmanned vehicle on the map from its current position to the position corresponding to the key point.

3. The system of claim 2 wherein the processor is further enabled to, via the control user interface:

receive a second indication via the control user interface that a given key point has been selected;

receive a third indication via the control user interface that the given key point is to be moved;

receive reassignment key point data via the control user interface, the reassignment key point data indicative of a given position to which the given key point is to be moved;

reassign the given key point to the location corresponding to the reassignment key point data; and

render a representation of the given key point on the map.

4. The system of claim 2 wherein the processor is further enabled to, via the control user interface:

receive additional new key point data via the control user interface, the additional new key point data indicative of a given position of an additional key point to be rendered on the map at the display device;

render a representation of the additional key point on the map at the display device;

receive a second indication via the control user interface that the key point and the additional key point be linked to change the path;

render changes to the path on the map; and

receive a third indication via the control user interface that the unmanned vehicle be directed to follow the changes to the path.

5. The system of claim 4 wherein the processor is further enabled to, via the control user interface:

receive further new key point data via the control user interface, the further new key point data indicative of a further given position of a further key point to be rendered on the map;

render a representation of the further key point on the map;

receive a fourth indication via the control user interface that the key point, the additional key point and the further key point are to be linked to enclose an area;

render a representation of the area on the map; and

receive a fifth indication via the control user interface that the unmanned vehicle be directed to the area thereby further changing the path.

6. The system of claim 1, wherein to provide the representation of the unmanned vehicle on the map based on the current positional data, the processor is further enabled to render a graphical representation of the unmanned vehicle on the map at a current location corresponding to the current location of the unmanned vehicle.

7. The system of claim 1, wherein the processor is further enable to transmit update commands to the unmanned vehicle in response to one or more of generating a mission, editing a mission, assigning the unmanned vehicle to the given mission, and receiving the input data for controlling the unmanned vehicle.

8. The system of claim 1, further comprising the unmanned vehicle.

9. The system of claim 8, wherein the unmanned vehicle comprises:

a sensor enabled to sense at least one aspect of an environment of the unmanned vehicle; and

a transmitter for transmitting sensor data to the processor, the processor further enabled to update the map to reflect the data regarding the at least one aspect of the environment.

10. The system of claim 9 wherein the sensor comprises a GPS sensor.

11. The system of claim 9 wherein the sensor comprises a camera.

12. The system of claim 1 wherein the processor, the display, the communications interface and the input device are incorporated into a handheld device.

13. The system of claim 1, further comprising a plurality of unmanned vehicles, the processor further enabled to

receive current positional data from each of the plurality of unmanned vehicles via the communication interface;

and

render, on the map, a representation of each of the plurality of unmanned vehicles.

14. The system of claim 1 further comprising a controller, wherein communications between the unmanned vehicle and with the processor occurs via the controller.

15. The system of claim 14 wherein the controller comprises wireless communications hardware.

16. The system of claim 14 wherein the controller is located on the unmanned vehicle.

17. The system of claim 14 wherein the controller comprises a software module and the processor is further enabled to execute the software module.

18. The system of claim 1, wherein the control user interface further comprises an auxiliary menu icon which, when actuated, causes the processor to render at least one command interface on the map and wherein the map is otherwise rendered without the at least one command interface.

19. The system of claim 1 wherein the input device comprises at least one of a touch screen, a tablet computer, a mouse and a mobile phone.