Intelligent fastener system

• US 8,978,967 B2
• Filed: 09/02/2009
• Issued: 03/17/2015
• Est. Priority Date: 10/31/2007
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Gamboa, James D., Slesinski, Raymond J., Zanteson, William P., Hoeckelman, Leslie A.
• Primary Examiner(s): Lee, Michael G
• Assistant Examiner(s): GUDORF, LAURA A
• Application Number:
  US12/552,895
• Publication Number:
  US 20110113613A1
• Time in Patent Office: 2,022 Days
• Field of Search: 235/375, 23546201-46249, 294/070.1, 294/070.4
• US Class Current: 235/375
• CPC Class Codes: B25B 13/00 Spanners; Wrenches hand-driven gear-operated B25B17/00; impact wrenches B25B19/00; portable power-driven B25B21/00 ; spanners or wrenches pecially adapted for osteosynthesis A61B17/8875; machines for fitting together or separating metal parts B23P19/00 ; for mounting or dismounting wheels B60B29/003
• CPC Class Codes: B25B 21/00 Portable power-driven screw or nut setting or loosening tools; details or components, e.g. casings, bodies, of portable power-driven tools not particularly related to the operation performed B25F5/00; for mounting or dismounting wheels B60B29/006; Attachments for drilling apparatus serving the same purpose machines B23P19/06
• CPC Class Codes: G05B 19/4183 characterised by data acquisition, e.g. workpiece identification
• CPC Class Codes: G05B 2219/31304 Identification of workpiece and data for control, inspection, safety, calibration
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
• CPC Class Codes: Y10T 29/49769 Using optical instrument [excludes mere human eyeballing]
• CPC Class Codes: Y10T 29/49947 by applying separate fastener
• CPC Class Codes: Y10T 29/53 Means to assemble or disassemble

Abstract

A method and apparatus are used to visually recognize and install fasteners on a structure. An electronic image of the fastener is recorded, and is processed by a computer operated image recognition program to identify the fastener. The computer provides installation instructions and an installation tool based on the identity of the fastener.

Claims

1. A method of installing a fastener on a structure, comprising:

recording an optical image that includes the fastener;

identifying the fastener based on at least one shape of fastener physical features in the recorded image and based on at least one upstanding feature on the structure adjacent to the fastener in the recorded image;

retrieving electronic fastener installation parameters based on the identity of the fastener; and

using the electronic fastener installation parameters to install the fastener on the structure.

2. The method of claim 1, wherein identifying the fastener is performed by a computer operating an image recognition program.

3. The method of claim 1, wherein recording the image is performed electronically.

4. The method of claim 2, wherein retrieving the electronic fastener installation parameters is performed by the computer.

5. The method of claim 1, further comprising:

wirelessly transmitting the recorded image to a computer, and

said identifying the image is performed by the computer.

6. The method of claim 1, further comprising:

identifying the at least one feature on the structure adjacent to the fastener.

7. A method of installing a fastener on a structure using an installation tool, comprising:

recording electronically an optical image of the fastener;

transmitting the recorded image to a computer;

using the computer to identify the fastener based on fastener features in the recorded image;

determining installation instructions for the identified fastener;

transmitting the installation instructions from the computer to a processor on the installation tool;

controlling operation of the installation tool with the processor based on the installation instructions; and

using the installation tool to install the fastener.

8. The method of claim 7, wherein using the computer to identify the fastener includes processing the recorded image using an image recognition program.

9. The method of claim 7, wherein recording the image is performed by a vision system.

10. The method of claim 7, wherein determining the installation instructions is performed by the computer.

11. The method of claim 7, wherein transmitting the recorded image to a computer and transmitting the installation instructions from the computer to the processor on the installation tool are each performed wirelessly.

12. The method of claim 7, further comprising:

recording an optical image of at least one feature on the structure, and

wherein identifying the fastener includes identifying the feature using the recorded image of the feature.

13. The method of claim 7, further comprising:

placing the fastener on the structure at a location where the fastener is to be installed, and

wherein the image of the fastener is recorded after the fastener has been placed on the structure.

14. The method of claim 7, further comprising:

using the installation tool to record at least one parameter related to the fastener installation;

transmitting the recorded parameter to the computer; and

using the computer to store the recorded parameter.

15. Apparatus for installing fasteners in a structure, comprising:

means for recording an optical image of a fastener to be installed;

a programmed computer for identifying the fastener based on fastener features in the recorded image of the fastener and for generating installation instructions for the identified fastener; and

an installation tool for installing the fasteners on the structure according to the installation instructions, wherein the means for recording an optical image and the programmed computer are integrated into the installation tool.

16. The apparatus of claim 15, further comprising:

an image recognition program integrated into the installation tool used by the computer to identify the fastener.

17. The apparatus of claim 15, wherein the recording means includes a camera.

18. The apparatus of claim 15, further comprising:

a database integrated into the installation tool including installation parameters for each of a plurality of fasteners.

19. Apparatus for installing fasteners on an aircraft structure, comprising:

a vision system including a camera for electronically recording an optical image of a fastener to be installed on the structure and the structure adjacent to the fastener;

an image recognition program for recognizing the fastener;

a programmed computer including the image recognition program for identifying the fastener based on at least one shape of fastener physical features and at least one upstanding feature on the structure adjacent to the fastener in the recorded image, the computer further including data files for storing fastener installation instructions and fastener installation parameters;

a display connected to the programmed computer;

an installation tool for installing the fasteners on the structure according to the installation instructions and fastener installation parameters; and

a communication system for wirelessly transmitting the recorded image from the vision system to the computer, for wirelessly transmitting the installation instructions and fastener installation parameters from the computer to the installation tool, and for wirelessly transmitting recorded parameters from the installation tool to the computer, wherein the display displays both the fastener installation parameters and the recorded parameters.