System and method for automated crack inspection and repair

• US 9,414,026 B2
• Filed: 01/25/2013
• Issued: 08/09/2016
• Est. Priority Date: 01/25/2013
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Blanchard, Steven D., Georgeson, Gary E., Hafenrichter, Joseph L., Nelson, Karl E., McCleave, Thomas T.
• Primary Examiner(s): Yenke, Brian
• Assistant Examiner(s): Desir, Jean W
• Application Number:
  US13/749,843
• Publication Number:
  US 20140210997A1
• Time in Patent Office: 1,292 Days
• Field of Search: 348/92, 348/125, 348/128, 348/135, 735/83, 738/658, 356/237.3, 356/237.2
• US Class Current: 1/1
• CPC Class Codes: G01M 11/0278 Detecting defects of the object to be tested, e.g. scratches or dust investigating the presence of flaws or contamination on materials by optical means G01N21/88
• CPC Class Codes: G01M 5/0016 of aircraft wings or blades
• CPC Class Codes: G01M 5/0033 by determining damage, crack or wear
• CPC Class Codes: G01M 5/005 by means of external apparatus, e.g. test benches or portable test systems
• CPC Class Codes: G01M 5/0075 by means of external apparatus, e.g. test benches or portable test systems G01M5/005 takes precedence
• CPC Class Codes: G01M 5/0091 by using electromagnetic excitation or detection
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system for automated inspection of a surface; the system may include a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera positioned to view an object on the surface, and at least of one of a sensor capable of detecting a defect in the surface, a tool for treating the defect, and a sensor for inspecting a repair of the defect; and a computer controller connected to receive image data from the camera, communicate with and selectively actuate the at least of one of a sensor capable of detecting a defect in the surface, a tool for treating the defect, and a sensor for inspecting a repair of the defect, and control the carriage to move on the surface along one or more of a pre-set path and a path to one or more pre-set locations.

Claims

1. A system for automated inspection of a surface, the system comprising:

a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera positioned to view an object on the surface, a tool mounted on the carriage for treating a defect in the surface, and a sensor mounted on the carriage, the sensor selected from a sensor that detects the defect and a sensor that inspects a repair of the defect;

wherein the tool is selected from a device that marks cracked dielectric tops for subsequent repair or removal, and a device that repairs or removes dielectric tops; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the tool for treating the defect, the at least one of the sensor capable of detecting the defect in the surface and the sensor for inspecting a repair of the defect, and control the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations.

2. The system of claim 1, wherein the computer controller includes a database selected from the pre-set path, the path to the one or more pre-set locations, and a location of the defect in the surface;

and the computer controller controls the carriage to move on the surface along a selected one of the pre-set path and the path to the one or more pre-set locations.

3. The system of claim 2, wherein the surface is a wing surface of an aircraft, and the one or more pre-set locations include one or more locations of tops made of dielectric material covering fasteners in the wing surface.

4. The system of claim 1, wherein the tool is selected from a rotating, semi-rigid plastic router that removes the dielectric top from the surface, a pen marker, a sticker dispenser for marking the dielectric top for one of repair and removal, a dispenser of dielectric material, a dispenser of paint to cover dielectric material, and an appliqué

dispenser that places an appliqué

over the dielectric material.

5. The system of claim 1, wherein the sensor for inspecting the repair of the defect includes one or more of a thermal imaging camera that utilizes infra-red thermography (IRT) to detect internal voids, a sensor using a microwave thickness gauge to determine whether a thickness of paint applied to the defect is sufficient, a sensor using an ultrasonic thickness gauge to determine whether the thickness of the paint applied to the defect is sufficient, a high-resolution camera for optical imaging to verify full coverage of dielectric material applied to the defect, a magneto-optical imaging device used as a full-field imaging method of mesh surrounding the defect, and an eddy current array.

6. The system of claim 1, further comprising:

at least a second self-propelled, steerable carriage capable of traversing the surface, the second carriage having a second camera positioned to view an object on the surface, and a second sensor selected from a second sensor that detects the defect in the surface, a second tool, mounted on the second carriage, for treating the defect, and a third sensor for inspecting a repair of the defect;

wherein the computer controller is connected to receive image data from the second camera, communicate with and selectively actuate the second sensor capable of detecting a defect in the surface, the second tool for treating the defect and the second sensor for inspecting a repair of the defect, and control the second carriage to move on the surface along one or more of a pre-set path and a path to one or more pre-set locations, in one of movement independent of and coordinated with the first carriage.

7. The system of claim 1, further comprising a stability mount for fixing the carriage to the surface during operation of the tool, the stability mount communicating with the computer control for selective activation and deactivation thereby.

8. The system of claim 7, wherein the stability mount is a suction device.

9. The system of claim 1, wherein the sensor capable of detecting a defect in the surface is a crack depth sensor.

10. The system of claim 9, wherein the crack depth sensor is selected from a Fourier transform infrared (FTIR) generator, Raman spectroscopy utilizing a laser, ultraviolet fluorescence, laser fluorescence, and forced diffusion thermography to determine a depth of a crack in the surface.

11. The system of claim 1, wherein the tool is a dispenser selected from a dispenser that applies acetone and a dispenser that applies methyl ethyl ketone (MEK).

12. The system of claim 1, further comprising a tether rod connected to the carriage and configured to provide fall arrest in the event that the carriage falls from the surface.

13. The system of claim 12, further comprising a cable connecting at least one of the camera and the at least one of the sensor and the tool to the computer controller;

and the cable being supported at least partly by the tether rod.

14. A system for automated inspection of a surface of an aircraft, the system comprising:

a self-propelled, steerable carriage capable of traversing the wing surface, the carriage having a camera positioned to view an object on the wing surface, a tool mounted on the carriage for treating the defect in the surface, and a sensor mounted on the carriage, the sensor selected from a sensor that detects a defect in the wing surface and a sensor that inspects a repair of the defect;

wherein the tool is selected from a device that marks cracked dielectric tops for subsequent repair or removal, and a device that repairs or removes dielectric tops; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the at least one of the sensor capable of detecting a defect in the wing surface, the tool for treating the defect, and the sensor for inspecting a repair of the defect, and control the carriage to move on the wing surface along one or both of a pre-set path and a path to one or more pre-set locations.

15. A method for automated inspection of a surface, the method comprising:

placing a self-propelled, steerable carriage on the surface, the carriage having a camera positioned to view an object on the surface, a tool mounted on the carriage for treating a defect on the surface, and a sensor mounted on the carriage, the sensor selected from a sensor that detects the defect in the surface, and a sensor that inspects a repair of the defect;

receiving image data from the camera by a computer controller; and

communicating with and selectively actuating the tool for treating the defect, wherein treating the defect by the tool is selected from marking cracked dielectric tops for subsequent repair or removal, and repairing or removing dielectric tops, the sensor capable of detecting a defect in the surface, and the sensor for inspecting a repair of the defect, and controlling the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations by the computer controller.

16. The method of claim 15, wherein controlling the carriage to move on the surface to the one or more pre-set locations thereon includes one or more of accessing a table containing the one or more pre-set locations stored in a database, actuating the carriage to follow a metal foil grid on the surface interconnecting the one or more pre-set locations, and remotely steering the carriage on the surface using the camera.

17. The method of claim 15, wherein selectively actuating the tool for treating the defect and a selected one of the sensor capable of detecting a defect in the surface, and the sensor for inspecting a repair of the defect includes actuating a tool selected from

a rotating, semi-rigid plastic router adapted to remove a dielectric top from the surface;

a pen marker and a sticker dispenser for marking a dielectric top for one of repair and removal;

a dispenser for at least one of dielectric material, paint to cover dielectric material, and an appliqué

configured to be placed over the dielectric material;

a crack depth sensor selected from a Fourier transform infrared generator, Raman spectroscopy utilizing a laser, ultraviolet fluorescence, a laser for laser fluorescence, and forced diffusion thermography to determine a depth of a crack in the surface;

an applicator to apply at least one of acetone and methyl ethyl ketone (MEK) to prepare the surface for repair of the defect;

a thermal imaging camera that utilizes infra-red thermography (IRT) to detect internal voids;

a sensor using a microwave thickness gauge to determine whether a thickness of paint applied to the defect is sufficient;

a sensor using an ultrasonic thickness gauge to determine whether the thickness of the paint applied to the defect is sufficient;

a high-resolution camera for optical imaging to verify full coverage of dielectric material applied to the defect;

a magneto-optical imaging device used as a full-field imaging method of mesh surrounding the defect; and

an eddy current array.

18. A system for automated inspection of a surface, the system comprising:

a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera positioned to view an object on the surface, and at least one of a sensor capable of detecting a defect-in the surface, a tool for treating the defect, and a sensor for inspecting a repair of the defect; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the at least one of the sensor capable of detecting a defect in the surface, the tool for treating the defect and the sensor for inspecting a repair of the defect, and control the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations, wherein the computer controller includes a database selected from the pre-set path, the path to the one or more pre-set locations and a location of the defect in the surface; and

the computer controller controls the carriage to move on the surface along a selected one of the pre-set path and the path to the one or more pre-set locations;

wherein the surface is a wing surface of an aircraft, and the one or more pre-set locations include one or more locations of tops made of dielectric material covering fasteners in the wing surface; and

wherein the sensor capable of detecting a defect in the surface is selected from includes at least one of a crack depth sensor for finding a crack in the tops, wherein the crack depth sensor includes one of high-resolution optical imaging with alternating light emitting diode (LED) side-lighting, a dye penetrant drop-and-wipe device including an ultraviolet lamp and chromatic dye deposition, ultraviolet or infrared laser fluorescence, Raman spectroscopy; and

a crack depth measurement sensor for measuring a depth of the crack, wherein the crack depth measurement sensor includes one of a terahertz measurement device for transmitting terahertz radiation to measure and/or image depth of a crack in the top, a narrow beam laser adapted to scan the crack, and a forced diffusion thermography device for measuring an amount of heat transferred from one side of the crack to the other, the forced diffusion thermography device including a localized heat source to be positioned on one side of the crack and a mini uncooled infrared camera for imaging, a high frequency ultrasound generator adapted to direct one of an angled pitch-catch across the crack and a structural wave across the crack, a fiber optic laser ultrasound generator, a capacitance measurement sensor for measuring capacitance across the crack, a near-field millimeter wave generator, a mini x-ray backscatter device, a Fourier transform infrared (FTIR) generator, Raman spectroscopy utilizing a laser, and a laser for laser fluorescence.

19. A system for automated inspection of a surface, the system comprising:

a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera positioned to view an object on the surface, and at least one of a sensor capable of detecting a defect in the surface, a tool for treating the defect, and a sensor for inspecting a repair of the defect; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the at least one of the sensor capable of detecting a defect in the surface, the tool for treating the defect and the sensor for inspecting a repair of the defect, and control the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations; and

wherein the sensor for inspecting the repair of the defect is selected from a thermal imaging camera that utilizes infra-red thermography (IRT) to detect internal voids, a sensor using a microwave thickness gauge to determine whether a thickness of paint applied to the defect is sufficient, a sensor using an ultrasonic thickness gauge to determine whether the thickness of the paint applied to the defect is sufficient, a high-resolution camera for optical imaging to verify full coverage of dielectric material applied to the defect, a magneto-optical imaging device used as a full-field imaging method of mesh surrounding the defect, and an eddy current array.

20. A system for automated inspection of a surface, the system comprising:

a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera positioned to view an object on the surface, and at least one of a sensor capable of detecting a defect in the surface, a tool for treating the defect, and a sensor for inspecting a repair of the defect; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the at least one of the sensor capable of detecting a defect in the surface, the tool for treating the defect and the sensor for inspecting a repair of the defect, and control the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations;

wherein the sensor capable of detecting a defect in the surface is a crack depth sensor selected from a Fourier transform infrared (FTIR) generator, Raman spectroscopy utilizing a laser, ultraviolet fluorescence, a laser for laser fluorescence, and forced diffusion thermography to determine a depth of a crack in the surface.

21. A system for automated inspection of a surface, the system comprising:

a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera positioned to view an object on the surface, and at least one of a sensor capable of detecting a defect in the surface, a tool for treating the defect, and a sensor for inspecting a repair of the defect; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the at least one of the sensor capable of detecting a defect in the surface, the tool for treating the defect and the sensor for inspecting a repair of the defect, and control the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations;

wherein the tool is a dispenser that performs preparation of the surface for repair of the defect, and is selected from a dispenser to apply acetone and a dispenser to apply methyl ethyl ketone (MEK).

22. A system for automated inspection of a surface, the system comprising:

a self-propelled, steerable carriage capable of traversing the surface, the carriage having a camera mounted thereon and positioned to view an object on the surface, and a tool mounted on the carriage for treating a defect in the surface;

wherein that tool is selected from a device that marks cracked dielectric tops for subsequent repair and removal, and a device that repairs or removes the dielectric tops; and

a computer controller connected to receive image data from the camera, communicate with and selectively actuate the tool for treating the defect, and control the carriage to move on the surface along one or both of a pre-set path and a path to one or more pre-set locations.