Bi-directional communication for control of unmanned systems

• US 9,621,258 B2
• Filed: 02/26/2015
• Issued: 04/11/2017
• Est. Priority Date: 02/26/2014
• Status: Active Grant

• Current Assignee: Sierra Nevada Co. LLC
• Original Assignee: Kutta Technologies, Inc. (Sierra Nevada Co. LLC)
• Inventors: Barnhard, David Howard, Simms, Geoffrey David, Limbaugh, Douglas V.
• Primary Examiner(s): Milord, Marceau
• Application Number:
  US14/632,708
• Publication Number:
  US 20160080539A1
• Time in Patent Office: 775 Days
• Field of Search: 455420, 455 661
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: H04B 7/26 at least one of which is mobile

Abstract

Bi-directional personal communication systems and processes may be utilized to control unmanned systems. Such systems and processes may enable operator interface with unmanned systems as a replacement or a supplement to use of specialized hardware and rich, graphical interfaces. The bi-directional communication systems and methods also may be integrated as a subsystem within a ground control station. The system may include a personal communications device with a native interface for an operator to select command, control and/or communication (C3) messages to interact with the unmanned system, and a communication link operable to send the C3 messages selected by the operator to the unmanned system, wherein the unmanned system includes a receiver that receives the C3 messages over the communication link and an onboard computing device that processes and responds to the C3 messages received by the receiver.

Claims

1. A communication system for interacting with an unmanned system comprising:

a personal communication device with a native interface for an operator to select command, control and/or communication (C3) messages to interact with the unmanned system, the C3 messages selected from the group comprising;

determine status of the unmanned system, prescribe desired actions for the unmanned system, change the current mission of the unmanned system, and change the state of the unmanned system; and

a communication link operable to send the C3 messages selected by the operator to the unmanned system, wherein the unmanned system includes a compatible communication device that receives the C3 messages over the communication link and a processor that processes and responds to the C3 messages received by the receiver, and wherein the unmanned system responds to the C3 messages by adjusting, reacting, changing, altering or maintaining its current status, location, position, task or other unmanned system activity.

2. The communication system of claim 1 wherein the operator is ground-based.

3. The communication system of claim 1 wherein the operator is sea-based.

4. The communication system of claim 1 wherein the operator is underwater-based.

5. The communication system of claim 1 wherein the operator is air-based.

6. The communication system of claim 1 wherein the native interface is selected from the group comprising:

a virtual interface, a physical interface, a generated interface, an augmented reality interface, a voice controlled interface, and combinations thereof.

7. The communication system of claim 1 wherein the communication link is selected from the group comprising:

audio, visual, point-to-point radio, infrastructure radio, a cellular network, optical, DTMF tone, digital message, Wi-Fi, CDMA, GSM, LTE, WiMAX, Internet Protocol (IP) link, other digital packet network link, microwave, and combinations thereof.

8. The communication system of claim 1 wherein the unmanned system responds to the operator through use of pre-recorded voice messages.

9. The communication system of claim 1 wherein the unmanned system responds to the operator through use of a text-to-speech engine.

10. The communication system of claim 1 wherein the unmanned system responds to the operator through the use of digital text.

11. The communication system of claim 1 wherein the unmanned system responds to the operator through the use of other digital information formatted for the native interface of the personal communication device.

12. The communication system of claim 1 wherein the communication system is a supplement to a ground control station or ground data terminal.

13. The communication system of claim 1 wherein the communication system replaces a ground control station or ground data terminal.

14. The communication system of claim 1 wherein the communication system is integrated as a subsystem within a ground control station or ground data terminal.

15. A communication system for controlling an unmanned system, the system comprising:

a communication link;

a first two-way voice device connected to an onboard computing device, the onboard computing device having an interface to an onboard C3 system, wherein the first two-way voice device, the onboard computing device and the onboard C3 system are located on the unmanned system; and

a second two-way voice device with a native interface for an operator to communicate with the unmanned system, wherein the onboard computing device queries the onboard C3 system about the status of the unmanned system and sends a formatted message to the second two-way voice device over the communication link and the second two-way voice device responds to the formatted message over the communication link, and wherein the first two-way voice device receives a response from the second two-way voice device, transmits the response to the onboard computing device that analyzes the response and sends instructions to the onboard C3 system.

16. The communication system of claim 15 wherein the first and second two-way voice devices are selected from the group comprising:

a point-to-point two-way radio, an infrastructure (trunked) two-way radio, and a mobile cellular telephone network device.

17. The communication system of claim 15 wherein the communication link is selected from the group comprising:

direct point-to-point radio, infrastructure (trunked) radio, and the mobile cellular telephone network.

18. The communication system of claim 15 wherein the formatted message is comprised of at least one of the following:

at least one piece of status data about the state of the unmanned system, at least one piece of data from a sensor, at least one question directed at the operator, and at least one menu of response options.

19. The communication system of claim 15 wherein the formatting of the formatted message comprises one or more of the following:

prerecorded voice, text-to-speech synthesized voice, audio tones, and other formatting suitable for the native interface of the two-way voice device.

20. The communication system of claim 16 wherein the second two-way voice device responds using one or more of the mechanisms selected from the group comprising:

voice, pushbuttons, and facilities provided in the native interface.

21. The communication system of claim 15 wherein the instructions to the onboard C3 system are to further query or transition the state of the unmanned system or the state of sensors or actuators in the unmanned system.

22. A communication system for controlling an unmanned system, the system comprising:

a digital packet based network link;

a first networked device connected to an onboard computing device, the onboard computing device having an interface to an onboard C3 system, wherein the first networked device, the onboard computing device and the onboard C3 system are located on the unmanned system; and

a second networked device with a native interface for an operator to communicate with the unmanned system, wherein the onboard computing device queries the onboard C3 system about the status of the unmanned system and sends a formatted message to the second networked device over the digital packet based network link and the second networked device responds to the formatted message over the digital packet based network link, and wherein the first networked device receives a response from the second networked device, transmits the response to the onboard computing device that analyzes the response and sends instructions to the onboard C3 system.

23. The communication system of claim 22 wherein the formatted message is comprised of at least one of the following:

at least one piece of status data about the state of the unmanned system, at least one piece of data from a sensor, at least one question directed at the operator, and at least one menu of response options.

24. The communication system of claim 22 wherein the formatting of the formatted message comprises one or more of the following:

prerecorded voice, text-to-speech synthesized voice, audio tones, and other formatting suitable for the native interface of the networked device.

25. The communication system of claim 22 wherein the second networked device responds using one or more of the mechanisms selected from the group comprising:

voice, pushbuttons, and facilities provided in the native interface.

26. The communication system of claim 22 wherein the instructions to the onboard C3 system are to further query or transition the state of the unmanned system or the state of sensors or actuators in the unmanned system.