System for characterizing manual welding operations

• US 9,221,117 B2
• Filed: 07/06/2012
• Issued: 12/29/2015
• Est. Priority Date: 07/08/2009
• Status: Active Grant

• Current Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Original Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Inventors: Conrardy, Christopher C., Boulware, Paul C.
• Primary Examiner(s): Egloff, Peter
• Assistant Examiner(s): Fletcher, Jerry-Daryl
• Application Number:
  US13/543,240
• Publication Number:
  US 20120298640A1
• Time in Patent Office: 1,271 Days
• Field of Search: 434/219, 434/234, 434/260, 434/592, 228/176, 345/592, 382/275
• US Class Current: 1/1
• CPC Class Codes: B23K 31/125 Weld quality monitoring
• CPC Class Codes: B23K 37/04 for holding or positioning work
• CPC Class Codes: B23K 37/047 moving work to adjust its position between soldering, welding or cutting steps B23K37/053 takes precedence
• CPC Class Codes: B23K 9/0956 using sensing means, e.g. optical
• CPC Class Codes: B23K 9/16 making use of shielding gas selection of media B23K35/38
• CPC Class Codes: B23K 9/291 the shielding means being a gas
• CPC Class Codes: B23K 9/32 Accessories earthing connections H01R
• CPC Class Codes: G09B 19/24 Use of tools
• CPC Class Codes: G09B 25/02 of industrial processes; of machinery

Abstract

A system for characterizing manual welding exercises and providing valuable training to welders that includes components for generating, capturing, and processing data. The data generating component further includes a fixture, workpiece, at least one calibration devices each having at least two point markers integral therewith, and a welding tool. The data capturing component further includes an imaging system for capturing images of the point markers and the data processing component is operative to receive information from the data capturing component and perform various position and orientation calculations.

Claims

1. A system for characterizing welding operations, comprising:

(a) a data generating component, wherein the data generating component further includes;

(i) a fixture, wherein the geometric characteristics of the fixture are predetermined;

(ii) a workpiece adapted to be mounted on the fixture, wherein the workpiece includes at least one joint to be welded, and wherein the vector extending along the joint to be welded defines an operation path;

(iii) at least one calibration device, wherein each calibration device further includes at least two point markers integral therewith, and wherein the geometric relationship between the point markers and the operation path is predetermined; and

(iv) a welding tool, wherein the welding tool is operative to form a weld at the joint to be welded, wherein the welding tool defines a tool point and a tool vector, and wherein the welding tool further includes a target attached to the welding tool, wherein the target further includes a plurality of point markers mounted thereon in a predetermined pattern, and wherein the predetermined pattern of point markers is operative to define a rigid body; and

(b) a data capturing component, wherein the data capturing component further includes an imaging system for capturing images of the point markers; and

(c) a data processing component, wherein the data processing component is operative to receive information from the data capturing component and then calculate;

(i) the position and orientation of the operation path relative to the three-dimensional space viewable by the imaging system;

(ii) the position of the tool point and orientation of the tool vector relative to the rigid body; and

(iii) the position of the tool point and orientation of the tool vector relative to the operation path,

wherein calibration of the tool point and tool vector of the welding tool is performed using two or more point markers integrated into a removable calibration device, and wherein the point markers in the calibration device are located along a tool vector that has a known offset to the tool point of the welding tool.

2. The system of claim 1, wherein the imaging system further includes a plurality of digital cameras, and wherein at least one filter is incorporated into the optical sequence for each of the plurality of digital cameras for permitting light from only the wavelengths which are reflected or emitted from the point markers for improving image signal-to-noise ratio.

3. The system of claim 2, where in the imaging system further includes at least one dynamic region of interest viewable by the plurality of digital cameras, wherein the dynamic region of interest is determined by use of previously known positions for the rigid body, and wherein image information is gathered and processed only from within the dynamic region of interest.

4. The system of claim 1, wherein the position and orientation of the operation path is calibrated using at least two point markers integral to a calibration device which is placed at a known translational and rotational offset to the fixture, and wherein the fixture holds the workpiece at a known translational and rotational offset to the operation path.

5. The system of claim 1, wherein the position and orientation of the operation path is calibrated using at least two point markers located on a fixture that holds the workpiece at a known translational and rotational offset to the operation path.

6. The system of claim 1, wherein the operation path is non-linear, wherein the position and orientation of the operation path in three-dimensional space may be mapped using a calibration device that includes at least two point markers, and wherein the operation path dictates the placement of the calibration device at multiple, different points thereon.

7. The system of claim 1, wherein the position and orientation of the operation path undergoes a predetermined translational and rotational offset from its original calibration plane based on predetermined sequence steps included in the overall system operation.

8. The system of claim 1, wherein the point markers defining the rigid body are affixed to the welding tool in a multi-faceted configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

9. The system of claim 1, wherein the point markers defining the rigid body are affixed to the welding tool in a spherical configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

10. The system of claim 1, wherein the passive or active point markers are affixed to the welding tool in a ring configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

11. The system of claim 1, wherein the system calculates values for at least one of tool position, orientation, velocity, and acceleration with respect to the operation path, wherein these values are then compared to predetermined preferred values to determine deviations from known and preferred procedures, and wherein such deviations are used for at least one of assessing skill level, providing feedback for training, assessing progress toward a skill goal, and quality control purposes.

12. A system for characterizing manual welding operations, comprising:

(a) a data generating component, wherein the data generating component further includes;

(i) a fixture, wherein the geometric characteristics of the fixture are predetermined;

(ii) a workpiece adapted to be mounted on the fixture, wherein the workpiece includes at least one joint to be welded, and wherein the vector extending along the joint to be welded defines an operation path;

(iii) at least one calibration device, wherein each calibration device further includes at least one point marker integral therewith, and wherein the geometric relationship between the point markers and the operation path is predetermined; and

(iv) a welding tool, wherein the welding tool is operative to form a weld at the joint to be welded, wherein the welding tool defines a tool point and a tool vector, and wherein the welding tool further includes a target attached to the welding tool, wherein the target further includes a plurality of point markers mounted thereon in a predetermined pattern, and wherein the predetermined pattern of point markers is operative to define a rigid body; and

(b) a data capturing component, wherein the data capturing component further includes an imaging system for capturing images of the point markers, wherein the imaging system further includes a plurality of digital cameras, and wherein at least one filter is incorporated into the optical sequence for each of the plurality of digital cameras for permitting light from only the wavelengths which are reflected or emitted from the point markers for improving image signal-to-noise ratio; and

(c) a data processing component, wherein the data processing component is operative to receive information from the data capturing component and then calculate;

(i) the position and orientation of the operation path relative to the three-dimensional space viewable by the imaging system;

(ii) the position of the tool point and orientation of the tool vector relative to the rigid body; and

(iii) the position of the tool point and orientation of the tool vector relative to the operation path,

wherein calibration of the tool point and tool vector of the welding tool is performed using two or more point markers integrated into a removable calibration device, and wherein the point markers in the device are located along a tool vector that has a known offset to the tool point of the welding tool.

13. The system of claim 12, wherein the position and orientation of the operation path is calibrated using at least two point markers integral to a calibration device which is placed at a known translational and rotational offset to the fixture, and wherein the fixture holds the workpiece at a known translational and rotational offset to the operation path.

14. The system of claim 12, wherein the position and orientation of the operation path is calibrated using at least two point markers located on a fixture that holds the workpiece at a known translational and rotational offset to the operation path.

15. The system of claim 12, wherein the operation path is non-linear, wherein the position and orientation of the operation path in three-dimensional space may be mapped using a calibration device that includes at least two point markers, and wherein the operation path dictates the placement of the calibration device at multiple, different points thereon.

16. The system of claim 12, wherein the position and orientation of the operation path undergoes a predetermined translational and rotational offset from its original calibration plane based on predetermined sequence steps included in the overall system operation.

17. The system of claim 12, wherein the point markers defining the rigid body are affixed to the welding tool in a multi-faceted configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

18. The system of claim 12, wherein the point markers defining the rigid body are affixed to the welding tool in a spherical configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

19. The system of claim 12, wherein the point markers are affixed to the welding tool in a ring configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

20. The system of claim 12, wherein the system calculates values for at least one of tool position, orientation, velocity, and acceleration with respect to the operation path, wherein these values are then compared to predetermined preferred values to determine deviations from known and preferred procedures, and wherein such deviations are used for at least one of assessing skill level, providing feedback for training, assessing progress toward a skill goal, and quality control purposes.

21. A system for characterizing welding operations, comprising:

(a) a data generating component, wherein the data generating component further includes;

(i) a fixture, wherein the geometric characteristics of the fixture are predetermined;

(ii) a workpiece adapted to be mounted on the fixture, wherein the workpiece includes at least one joint to be welded, and wherein the vector extending along the joint to be welded defines an operation path;

(iii) at least one calibration device, wherein each calibration device further includes at least two point markers integral therewith, and wherein the geometric relationship between the point markers and the operation path is predetermined; and

(iv) a welding tool, wherein the welding tool is operative to form a weld at the joint to be welded, wherein the welding tool defines a tool point and a tool vector, and wherein the welding tool further includes a target attached to the welding tool, wherein the target further includes a plurality of point markers mounted thereon in a predetermined pattern, and wherein the predetermined pattern of point markers is operative to define a rigid body; and

(b) a data capturing component, wherein the data capturing component further includes an imaging system for capturing images of the point markers; and

(c) a data processing component, wherein the data processing component is operative to receive information from the data capturing component and then calculate;

(i) the position and orientation of the operation path relative to the three-dimensional space viewable by the imaging system;

(ii) the position of the tool point and orientation of the tool vector relative to the rigid body; and

(iii) the position of the tool point and orientation of the tool vector relative to the operation path,

wherein calibration of the tool point of the welding tool is performed by inserting the tip of the welding tool into a calibration device, the position and orientation of which relative to the workpiece is predetermined.

22. The system of claim 21, wherein the imaging system further includes a plurality of digital cameras, and wherein at least one filter is incorporated into the optical sequence for each of the plurality of digital cameras for permitting light from only the wavelengths which are reflected or emitted from the point markers for improving image signal-to-noise ratio.

23. The system of claim 22, where in the imaging system further includes at least one dynamic region of interest viewable by the plurality of digital cameras, wherein the dynamic region of interest is determined by use of previously known positions for the rigid body, and wherein image information is gathered and processed only from within the dynamic region of interest.

24. The system of claim 21, wherein the position and orientation of the operation path is calibrated using at least two point markers integral to a calibration device which is placed at a known translational and rotational offset to the fixture, and wherein the fixture holds the workpiece at a known translational and rotational offset to the operation path.

25. The system of claim 21, wherein the position and orientation of the operation path is calibrated using at least two point markers located on a fixture that holds the workpiece at a known translational and rotational offset to the operation path.

26. The system of claim 21, wherein the operation path is non-linear, wherein the position and orientation of the operation path in three-dimensional space may be mapped using a calibration device that includes at least two point markers, and wherein the operation path dictates the placement of the calibration device at multiple, different points thereon.

27. The system of claim 21, wherein the position and orientation of the operation path undergoes a predetermined translational and rotational offset from its original calibration plane based on predetermined sequence steps included in the overall system operation.

28. The system of claim 21, wherein the point markers defining the rigid body are affixed to the welding tool in a multi-faceted configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

29. The system of claim 21, wherein the point markers defining the rigid body are affixed to the welding tool in a spherical configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

30. The system of claim 21, wherein the passive or active point markers are affixed to the welding tool in a ring configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

31. The system of claim 21, wherein the system calculates values for at least one of tool position, orientation, velocity, and acceleration with respect to the operation path, wherein these values are then compared to predetermined preferred values to determine deviations from known and preferred procedures, and wherein such deviations are used for at least one of assessing skill level, providing feedback for training, assessing progress toward a skill goal, and quality control purposes.

32. A system for characterizing manual welding operations, comprising:

(a) a data generating component, wherein the data generating component further includes;

(i) a fixture, wherein the geometric characteristics of the fixture are predetermined;

(ii) a workpiece adapted to be mounted on the fixture, wherein the workpiece includes at least one joint to be welded, and wherein the vector extending along the joint to be welded defines an operation path;

(iii) at least one calibration device, wherein each calibration device further includes at least one point marker integral therewith, and wherein the geometric relationship between the point markers and the operation path is predetermined; and

(iv) a welding tool, wherein the welding tool is operative to form a weld at the joint to be welded, wherein the welding tool defines a tool point and a tool vector, and wherein the welding tool further includes a target attached to the welding tool, wherein the target further includes a plurality of point markers mounted thereon in a predetermined pattern, and wherein the predetermined pattern of point markers is operative to define a rigid body; and

(b) a data capturing component, wherein the data capturing component further includes an imaging system for capturing images of the point markers, wherein the imaging system further includes a plurality of digital cameras, and wherein at least one filter is incorporated into the optical sequence for each of the plurality of digital cameras for permitting light from only the wavelengths which are reflected or emitted from the point markers for improving image signal-to-noise ratio; and

(c) a data processing component, wherein the data processing component is operative to receive information from the data capturing component and then calculate;

(i) the position and orientation of the operation path relative to the three-dimensional space viewable by the imaging system;

(ii) the position of the tool point and orientation of the tool vector relative to the rigid body; and

(iii) the position of the tool point and orientation of the tool vector relative to the operation path,

wherein calibration of the tool point of the welding tool is performed by inserting the tip of the welding tool into a calibration device, the position and orientation of which relative to the workpiece is predetermined.

33. The system of claim 32, wherein the position and orientation of the operation path is calibrated using at least two point markers integral to a calibration device which is placed at a known translational and rotational offset to the fixture, and wherein the fixture holds the workpiece at a known translational and rotational offset to the operation path.

34. The system of claim 32, wherein the position and orientation of the operation path is calibrated using at least two point markers located on a fixture that holds the workpiece at a known translational and rotational offset to the operation path.

35. The system of claim 32, wherein the operation path is non-linear, wherein the position and orientation of the operation path in three-dimensional space may be mapped using a calibration device that includes at least two point markers, and wherein the operation path dictates the placement of the calibration device at multiple, different points thereon.

36. The system of claim 32, wherein the position and orientation of the operation path undergoes a predetermined translational and rotational offset from its original calibration plane based on predetermined sequence steps included in the overall system operation.

37. The system of claim 32, wherein the point markers defining the rigid body are affixed to the welding tool in a multi-faceted configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

38. The system of claim 32, wherein the point markers defining the rigid body are affixed to the welding tool in a spherical configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

39. The system of claim 32, wherein the point markers are affixed to the welding tool in a ring configuration that accommodates a wide range of rotation and orientation changes of the welding tool when in use.

40. The system of claim 32, wherein the system calculates values for at least one of tool position, orientation, velocity, and acceleration with respect to the operation path, wherein these values are then compared to predetermined preferred values to determine deviations from known and preferred procedures, and wherein such deviations are used for at least one of assessing skill level, providing feedback for training, assessing progress toward a skill goal, and quality control purposes.