Imaging system for fuel tank analysis

• US 10,326,980 B2
• Filed: 02/04/2016
• Issued: 06/18/2019
• Est. Priority Date: 02/04/2016
• Status: Active Grant

• Current Assignee: Simmonds Precision Products, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Simmonds Precision Products, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Zakrzewski, Radoslaw, Miller, Mark Sherwood, Lynch, Michael A.
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dang, Philip P.
• Application Number:
  US15/015,868
• Publication Number:
  US 20170230635A1
• Time in Patent Office: 1,230 Days
• CPC Class Codes: B64D 37/00 Arrangements in connection with fuel supply for power plant refuelling during flight B64D39/00
• CPC Class Codes: G01F 22/00 Methods or apparatus for measuring volume of fluids or fluent solid material, not otherwise provided for
• CPC Class Codes: G01F 23/2928 using light reflected on the material surface
• CPC Class Codes: G01F 23/804 containing circuits handling parameters other than liquid level
• CPC Class Codes: G01N 21/3504 for analysing gases, e.g. multi-gas analysis
• CPC Class Codes: G01N 9/24 by observing the transmission of wave or particle radiation through the material
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects

Abstract

A method can include illuminating an interior of a fuel tank with one or more light pulses, and receiving reflected returns of the one or more light pulses at a light sensor array. The method can further include producing, by a processing device, three-dimensional image data of the interior of the fuel tank based on the received reflected returns, producing, by the processing device, a fuel measurement value representing an amount of fuel contained in the fuel tank based on the three-dimensional image data, and outputting, by the processing device, an indication of the fuel measurement value.

Claims

1. A method comprising:

illuminating an interior of a fuel tank with one or more light pulses;

receiving reflected returns of the one or more light pulses at a light sensor array;

producing, by a processing device, three-dimensional image data of the interior of the fuel tank based on the received reflected returns;

identifying, based on the three-dimensional image data, physical features of the interior of the fuel tank;

identifying, based on the three-dimensional image data, a location of the interior of the fuel tank corresponding to an interface of fuel and ullage within the interior of the fuel tank;

identifying, based on the three-dimensional image data, an orientation of the interface of fuel and ullage within the interior of the fuel tank;

producing, by the processing device, a fuel measurement value representing an amount of fuel contained in the fuel tank based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank, the orientation of the interface of fuel and ullage within the interior of the fuel tank, and the physical features of the interior of the fuel tank; and

outputting, by the processing device, an indication of the fuel measurement value;

wherein producing the fuel measurement value based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank comprises;

determining, based on a model of a shape of the fuel tank, a volume of fuel contained within the fuel tank;

wherein the fuel tank is disposed within a wing of an aircraft, the method further comprising;

determining an amount of wing bending of the wing of the aircraft; and

determining an adjusted shape of the fuel tank based on the determined amount of wing bending using a model of the shape of the fuel tank;

wherein producing the fuel measurement value comprises determining the volume of fuel within the fuel tank based on the adjusted shape of the fuel tank.

2. The method of claim 1,

wherein producing the three-dimensional image data of the interior of the fuel tank based on the received reflected returns comprises associating each pixel of a plurality of pixels of the three-dimensional image data with an intensity and a distance traveled of a received reflected return associated with the pixel.

3. The method of claim 2,

wherein associating each pixel of the plurality of pixels of the three-dimensional image data with the distance traveled of the received reflected return associated with the pixel comprises determining the distance traveled of the received reflected return based on a time-of-flight of the received reflected return.

4. The method of claim 2,

wherein associating each pixel of the plurality of pixels of the three-dimensional image data with the distance traveled of the received reflected return associated with the pixel comprises determining the distance traveled of the received reflected return based on a phase-shift of the received reflected return.

5. The method of claim 1,

wherein producing the fuel measurement value based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank comprises identifying a location of the interior of the fuel tank corresponding to an intersection of the interface of fuel and ullage with one or more of the physical features of the interior of the fuel tank.

6. The method of claim 1,

wherein determining the amount of wing bending of the wing of the aircraft comprises:

determining a displacement of the one or more of the physical features between a reference location of the one or more of the physical features and a location of the one or more physical features within the three-dimensional image data.

7. The method of claim 1,

wherein producing the fuel measurement value based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank comprises:

determining, by the processing device, an angle of refraction based on the reflected returns of the one or more light pulses after the one or more light pulses passes through the interface of fuel and ullage;

determining, via a temperature probe, a temperature of the fuel within the fuel tank;

determining, by a processing device, a density of the fuel based on the angle of refraction and the temperature of the fuel; and

determining, by the processing device, a mass of fuel within the fuel tank based on the density of the fuel and the volume of fuel contained within the fuel tank.

8. The method of claim 1,

wherein illuminating an interior of a fuel tank with one or more light pulses comprises:

illuminating an interior of a fuel tank with a plurality of light pulses, each light pulse of the plurality of light pulses having a direction that is different than other light pulses of the plurality of light pulses and intersects the interface of fuel and ullage within the interior of the fuel tank to produce a pattern of reflected returns; and

wherein identifying, based on the three-dimensional image data, a location of the interior of the fuel tank corresponding to an interface of fuel and ullage within the interior of the fuel tank comprises;

determining the location of the interior of the fuel tank corresponding to an interface of fuel and ullage within the interior of the fuel tank based on the direction of each light pulse of the plurality of light pulses and the pattern of reflected returns; and

wherein identifying, based on the three-dimensional image data, an orientation of the interface of fuel and ullage within the interior of the fuel tank comprises;

determining the orientation of the interface of fuel and ullage within the interior of the fuel tank based on the direction of each light pulse of the plurality of light pulses and the pattern of reflected returns.

9. The method of claim 1 and further comprising:

producing, by the processing device, a fuel tilt value representing an amount of tilt of an aircraft with respect to a local acceleration vector of the aircraft based on the orientation of the interface of fuel and ullage within the fuel tank and the physical features of the interior of the fuel tank; and

outputting, by the processing device, an indication of the tilt of the aircraft.

10. A system comprising:

a light source;

a light sensor array;

at least one processor; and

a non-transitory computer-readable memory encoded with instructions that, when executed by the at least one processor, cause the system to;

illuminate an interior of a fuel tank with one or more light pulses emitted from the light source;

produce three-dimensional image data of the interior of the fuel tank based on reflected returns of the one or more light pulses received at the light sensor array;

identify, based on the three-dimensional image data, physical features of the interior of the fuel tank;

identify, based on the three-dimensional image data, a location of the interior of the fuel tank corresponding to an interface of fuel and ullage within the interior of the fuel tank;

identify, based on the three-dimensional image data, an orientation of the interface of fuel and ullage within the interior of the fuel tank;

produce a fuel measurement value representing an amount of fuel contained in the fuel tank based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank, the orientation of the interface of fuel and ullage within the interior of the fuel tank, and the physical features of the interior of the fuel tank; and

output an indication of the fuel measurement value;

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to produce the fuel measurement value based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank by at least causing the system to;

determine, based on a model of a shape of the fuel tank, a volume of fuel contained within the fuel tank;

wherein the fuel tank is disposed within a wing of an aircraft;

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to;

determine an amount of wing bending of the wing of the aircraft;

determine an adjusted shape of the fuel tank based on the determined amount of wing bending using a model of the shape of the fuel tank; and

produce the fuel measurement value by determining the volume of fuel within the fuel tank based on the adjusted shape of the fuel tank.

11. The system of claim 10,

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to produce the three-dimensional image data of the interior of the fuel tank by at least causing the system to associate each pixel of a plurality of pixels of the three-dimensional image data with an intensity and a distance traveled of a received reflected return associated with the pixel.

12. The system of claim 11,

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to associate each pixel of the plurality of pixels of the three-dimensional image data with the distance traveled of the received reflected return associated with the pixel by at least causing the system to determine the distance traveled of the received reflected return based on a time-of-flight of the received reflected return.

13. The system of claim 11,

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to associate each pixel of the plurality of pixels of the three-dimensional image data with the distance traveled of the received reflected return associated with the pixel by at least causing the system to determine the distance traveled of the received reflected return based on a phase-shift of the received reflected return.

14. The system of claim 10,

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to produce the fuel measurement value based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank by at least causing the system to identify a location of the interior of the fuel tank corresponding to an intersection of the interface of fuel and ullage with one or more of the physical features of the interior of the fuel tank.

15. The system of claim 10,

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to determine the amount of wing bending of the wing of the aircraft by at least causing the system to:

determine a displacement of the one or more of the physical features between a reference location of the one or more of the physical features and a location of the one or more physical features within the three-dimensional image data.

16. A device comprising:

at least one processor; and

a non-transitory computer-readable memory encoded with instructions that, when executed by the at least one processor, cause the device to;

produce three-dimensional image data of an interior of a fuel tank based on received reflected returns of one or more light pulses used to illuminate the interior of the fuel tank;

identify, based on the three-dimensional image data, physical features of the interior of the fuel tank;

identify, based on the three-dimensional image data, a location of the interior of the fuel tank corresponding to an interface of fuel and ullage within the interior of the fuel tank;

identify, based on the three-dimensional image data, an orientation of the interface of fuel and ullage within the interior of the fuel tank;

produce a fuel measurement value representing an amount of fuel contained in the fuel tank based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank, the orientation of the interface of fuel and ullage within the interior of the fuel tank, and the physical features of the fuel tank; and

output an indication of the fuel measurement value;

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to produce the fuel measurement value based on the location of the interior of the fuel tank corresponding to the interface of fuel and ullage within the interior of the fuel tank by at least causing the system to;

determine, based on a model of a shape of the fuel tank, a volume of fuel contained within the fuel tank;

wherein the fuel tank is disposed within a wing of an aircraft;

wherein the non-transitory computer-readable memory is further encoded with instructions that, when executed by the at least one processor, cause the system to;

determine an amount of wing bending of the wing of the aircraft;

determine an adjusted shape of the fuel tank based on the determined amount of wing bending using a model of the shape of the fuel tank; and

produce the fuel measurement value by determining the volume of fuel within the fuel tank based on the adjusted shape of the fuel tank.