Intuitive vehicle and machine control

• US 6,584,382 B2
• Filed: 05/17/2001
• Issued: 06/24/2003
• Est. Priority Date: 05/17/2000
• Status: Expired due to Term

• Current Assignee: The Boeing Co.
• Original Assignee: Abraham E. Karem
• Inventors: Karem, Abraham E.
• Primary Examiner(s): Beaulieu, Yonel
• Application Number:
  US09/861,457
• Publication Number:
  US 20020022909A1
• Time in Patent Office: 768 Days
• Field of Search: 701/3, 701/23, 701/24, 701/120, 340/958, 244/114.R, 342/23
• US Class Current: 701/3
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target

Abstract

A control machine/operator interface and a method for controlling complex machines or moving vehicles are provided. The method uses a high level of automation and the man-machine interface to achieve an intuitive control method and a substantial reduction in required operator skill level and training. The method also makes the operation of such machine or vehicle virtually the same when the operator is in the machine or vehicle as when the machine or vehicle is controlled from a remote location.

Claims

1. A control system interface for programming and controlling the operation of a plurality of different types of devices at different times, wherein each device is selected from the group consisting of manned vehicles and machines capable of automated operation, unmanned vehicles and machines capable of automated operation, and machines including payloads carried by such vehicles, the interface coupled to the device being controlled or programmed and comprising:

a first display displaying information pertinent to the control of the operation of any desired device of said plurality of devices; and

at least one input control for providing input for programming the system for completely automated control of said desired device, and wherein the at least one input control can provide input for manual control of the desired device.

2. A control system interface as recited in claim 1 wherein the display and the at least one input control are housed in a portable unit, wherein the portable unit is releasably coupled to an automated control system of the desired device.

3. A control system interface as recited in claim 2 wherein the unit can be releasably coupled to a rotorcraft to control the operation of the rotorcraft and to an aircraft to control the operation of the aircraft.

4. A control system interface as recited in claim 3 wherein the unit is releasably coupled to a flight management system of said rotorcraft and aircraft.

5. A control system interface as recited in claim 2, wherein the unit is programmable to provide complete automated control of the at least one machine prior to being coupled to the unit.

6. A control system interface as recited in claim 2 further comprising a rotating knob for controlling yawing of the device.

7. A control system interface as recited in claim 1 wherein the interface can control simultaneously a first device selected from the group consisting of manned and unmanned vehicles capable of automatic control, and a second device consisting of payloads carried by the selected device.

8. A control system interface as recited in claim 7 further comprising a second display, wherein the first display provides information relating to the operation of the first device and the second display provides information relating to the operation of the second device.

9. A control system interface as recited in claim 8 wherein the two displays and the at least one input control are housed in a portable unit releasably coupled to the at least one display.

10. A control system interface as recited in claim 1 wherein the interface provides controls for a plurality of device operation parameters, wherein a selected parameter is controlled manually using one of the input controls while the remaining parameters are controlled automatically.

21. A control system as recited in claim 1, wherein the different types of devices comprise a first device having a first control system and a second device having a second control system operationally different from the first control system.

11. A method for programming and controlling the operation of multiple different types of devices, wherein each device is selected from the group consisting of manned vehicles and machines capable of automated operation, unmanned vehicles and machines capable of automated operation, and machines including payloads carried by such vehicles, the method comprising:

creating common controls for the different types of devices to be programmed and controlled;

controlling or programming related functions of the different types of devices using the same controls; and

controlling or programming the operation of a control system of a desired device of said multiple devices using said controls.

12. A method as recited in claim 11 further comprising providing at least one display to display information relating to the desired device.

13. A method as recited in claim 12 further comprising providing the information displayed in common graphics format for the different types of devices.

14. A method as recited in claim 12 further comprising:

providing the common controls and the at least one display in a unit; and

coupling the unit to the desired device.

15. A method as recited in claim 14 wherein the unit can be coupled to desired device, wherein the desired device is an aircraft and wherein the same unit can be coupled to a second desired device, wherein the second desired device is a rotorcraft for controlling and programming the operation of said aircraft and rotorcraft.

16. A method as recited in claim 15 further comprising coupling the unit to a flight management system of the rotorcraft or aircraft whose operation is being controlled or programmed.

17. A method as recited in claim 12 wherein the unit is portable, the method further comprising releasably coupling the unit to a device to be controlled.

18. A method as recited in claim 12 wherein each device to be controlled comprises an automated system for providing for automated operation of the device, the method further comprising coupling the common controls and the at least one display to the automated system of the device whose operation is to be controlled or programmed.

19. A method as recited in claim 18 further comprising:

manipulating the controls for controlling or programming the operation of the device; and

generating information relating to the manipulated control;

sending the information to the automated system; and

controlling the vehicle using the automated system in response to the information received.

20. A method as recited in claim 11 wherein controlling or programming the operation of a device comprises:

controlling or programming the operation of one device using said controls during a first time interval; and

controlling or programming the operation of another device using said controls during a second time interval different from the first time interval.

22. A method as recited in claim 11, wherein the different types of devices comprise a first device having a first control system and a second device having a second control system operationally different from the first control system.

23. A control system interface for programming and controlling the entire operation of a desired device selected from the group of devices consisting of manned vehicles and machines capable of automated operation, unmanned vehicles and machines capable of automated operation, and machines including payloads carried by such vehicles, the interface removably coupled to the device being controlled or programmed and comprising:

a first display displaying information pertinent to the control of the operation of any desired device of said plurality of types of devices; and

at least one input control for providing input for programming the system for completely automated control of said desired device, and wherein the at least one input control can provide input for manual control of the desired device.

24. A method for controlling the operation of a plurality of devices selected from the group of devices consisting of manned vehicles and machines capable of automated operation, unmanned vehicles and machines capable of automated operation, and machines including payloads carried by such vehicles, the method comprising:

providing a unit having common controls for the plurality of devices to be controlled;

controlling related functions of said plurality of devices using common controls;

coupling the unit on a first of said plurality of devices;

controlling the operation of said device of said plurality of devices using said common controls on said unit by manipulating the controls to provide a set of inputs;

coupling the unit a second device of said plurality of devices; and

controlling the operation of said second device of said plurality of devices using said common controls on said unit.