Vision system and method incorporating graphics symbology for use in a tanker refueling system

• US 7,309,048 B2
• Filed: 07/29/2005
• Issued: 12/18/2007
• Est. Priority Date: 07/29/2005
• Status: Expired due to Fees

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: von Thal, German, Benjamin, Ronald G
• Primary Examiner(s): Palo, Frank
• Assistant Examiner(s): Sanderson, Joseph W
• Application Number:
  US11/193,668
• Publication Number:
  US 20070023575A1
• Time in Patent Office: 872 Days
• Field of Search: 244/135.A, 244/135.R, 244/136, 244/137.1, 340/945, 340/958, 340/963, 340/971, 340/980, 340/953, 345/632, 345/633, 345/7, 345/8, 345/9, 701/1, 701/3, 382/103, 382/104
• US Class Current: 244/135.00A
• CPC Class Codes: B64D 39/00 Refuelling during flight filling or emptying fuel tanks B64D37/14

Abstract

A vision system and method for use on a refueling tanker to assist a boom operator in performing an airborne refueling operation on a receiver aircraft. The system includes a digital camera system, a sensor subsystem and a processing system that receives information from the sensor system and the camera system. The processing system includes video processing capability and a graphics generator that generates a two dimensional graphics symbology set that is displayed on a display terminal along with a real time image of the boom and the receiver aircraft. The graphics symbology set includes a plurality of graphic symbols that indicate the position of the refueling boom and the position of the receiver aircraft relative to a desired contact zone within which physical contact between the boom tip and a refueling receptacle on the receiver aircraft can be made. The graphics symbology set also makes use of various colors to indicate warning conditions to the boom operator.

Claims

1. A refueling vehicle having a refueling boom engageable with a refueling receptacle of an airborne receiver vehicle during an airborne refueling operation, the refueling vehicle comprising:

a monitoring system for monitoring a position of said boom relative to a portion of said refueling vehicle;

a processing system for processing information from said monitoring system and for generating graphical information relating to a position of said boom relative to said receiver vehicle;

a display system responsive to said processing system displaying a graphics symbol set illustrating in graphical format a position of said boom relative to said receiver vehicle to assist an operator in performing said airborne refueling operation, said graphics symbol set including;

a contact zone graphic representing a contact zone within which contact between said refueling boom and said refueling receptacle can be made;

a receiver symbol linearly aligned with said contact zone graphic and movable linearly to indicate a relative distance between said refueling receptacle and the contact zone;

a boom symbol linearly aligned with said contact zone graphic and moveable linearly to indicate a relative distance between a free end of the boom and the contact zone; and

wherein a position of said receiver symbol and said boom symbol both within said contact zone indicates that engagement of said refueling boom and said fuel receptacle can be made.

2. The vehicle of claim 1, wherein said monitoring system comprises a sensor system for detecting a real time position of said boom relative to said refueling vehicle and generating signals in accordance therewith to said processing system.

3. The vehicle of claim 1, further comprising a camera for generating signals that enable said processing system to determine a position of said receiver vehicle relative to said refueling vehicle, and an image of said receiver vehicle.

4. The vehicle of claim 1, further comprising a fixed foundation graphic linearly aligned with said contact zone graphic, said receiver symbol and said boom symbol for defining a depth of a boom envelope within which said boom is able to be telescopically extended.

5. The vehicle of claim 1, further comprising a line representing an optimum elevation for said receiver vehicle relative to said refueling vehicle, and positioned adjacent said receiver symbol, said line being able to move towards and away from said receiver symbol in response to a changing elevation of said receiver vehicle to provide a boom operator with a continuous indication of an elevation of said receiver vehicle relative to said refueling vehicle.

6. The vehicle of claim 1, wherein the receiver symbol is designated with a first color while said receiver vehicle is approaching said contact zone at a rate of speed within a predetermined speed limit, and said receiver symbol is changed to a second color if said predetermined speed limit is exceeded by said receiver vehicle.

7. The vehicle of claim 6, wherein said receiver symbol is repeatedly flashed from said first color to said second color when said predetermined speed limit is exceeded.

8. The vehicle of claim 7, wherein a portion of said receiver symbol is changed to a third color to indicate if said receiver vehicle moves outside of said contact zone while said receiver receptacle is in contact with said refueling boom.

9. The vehicle of claim 1, further comprising an indicator moveable along a linear horizontal graphic to indicate a real time lateral position of said boom, relative to said refueling vehicle.

10. An aerial refueling system for use on an airborne refueling vehicle, for facilitating engagement between a refueling boom of the refueling vehicle and a refueling receptacle of an airborne receiver vehicle during an airborne refueling operation, the system comprising:

a monitoring system for monitoring a position of said boom relative to a contact zone with which a refueling operation on said receiver vehicle can be accomplished;

a camera for imaging said boom and said receiver vehicle;

a processing system for processing information from said monitoring system and said camera, for generating graphical information relating to a position of said boom relative to said refueling vehicle;

a display system displaying, in real time;

a graphic symbol of said contact zone;

a graphic symbol of said receiver vehicle; and

a graphic symbol of said refueling boom, scaleable in dimension in accordance with a telescoping length of said refueling boom, and being linearly aligned on said display system with said graphic symbol of said receiver vehicle; and

said graphic symbols of said refueling boom and receiver vehicle moving relative to said contact zone graphic symbol as an airborne refueling operation is performed to provide a two dimensional representation to a boom operator of the positions of said refueling boom and said receiver vehicle, relative to said contact zone, to assist in performing said airborne refueling operation on said receiver vehicle.

11. The system of claim 10, wherein said camera comprises a digital camera for imaging said receiver vehicle and generating a real time image of said receiver vehicle on said display system.

12. The system of claim 10, further comprising an elevation graphic symbol disposed adjacent said symbol of said receiver vehicle, to represent a desired elevation that said receiver vehicle is to maintain during said refueling operation.

13. The system of claim 10, wherein said graphic symbol of said receiver vehicle flashes between a first color and a second color as said receiver vehicle is approaching said contact zone at a speed that exceeds a predetermined maximum closure rate of speed.

14. The system of claim 10, further comprising a graphic symbol moving laterally of said contact zone graphic symbol to indicate a lateral position of said refueling boom relative to said refueling vehicle.

15. A method for assisting an individual in an airborne refueling tanker in refueling an airborne receiver vehicle, comprising:

providing a display system;

monitoring a position of a refueling boom extending from said refueling vehicle and a position of a refueling receptacle of a receiver vehicle approaching the refueling vehicle;

generating a graphic symbol representing said refueling boom on said display system and a position of said refueling boom relative to said refueling vehicle;

generating a graphic symbol representing said receiver vehicle on said display system and a position of said receiver vehicle relative to said refueling boom;

said graphic symbol of said refueling boom being scaleable in dimension in accordance with a telescoping length of said refueling boom, and further being linearly aligned on said display system with said graphic of said receiver vehicle; and

using said symbols to visually indicate when said refueling boom and said receiver receptacle are positioned within a predetermined area in which contact can be made between said boom and said refueling receptacle.

16. The method of claim 15, further comprising using an elevation symbol for indicating whether said receiver vehicle is at a desired elevation for refueling to occur, as said receiver vehicle approaches said predetermined area.

17. The method of claim 15, further comprising designating said refueling boom symbol and said receiver vehicle symbol with different colors on said display system.

18. The method of claim 15, further comprising using a graphic to represent a contact zone indicative of said predetermined area;

and

flashing said receiver vehicle symbol on said display system if said receiver vehicle is approaching said contact zone at a speed that exceeds a predetermined maximum closure speed.