Importing and analyzing external data using a virtual reality welding system

• US 9,858,833 B2
• Filed: 02/05/2016
• Issued: 01/02/2018
• Est. Priority Date: 08/21/2008
• Status: Active Grant

• Current Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Original Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Inventors: Zboray, David Anthony, Bennett, Matthew Alan, Wallace, Matthew Wayne, Hennessey, Jeremiah, Dudac, Yvette Christine, Lenker, Zachary Steven, Lundell, Andrew Paul, Dana, Paul, Preisz, Eric A.
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US15/017,561
• Publication Number:
  US 20160155358A1
• Time in Patent Office: 697 Days
• Field of Search: 434234
• CPC Class Codes: A42B 3/042 Optical devices night vision goggles G02B23/12
• CPC Class Codes: A42B 3/30 Mounting radio sets or communication systems
• CPC Class Codes: A61F 9/06 Masks, shields or hoods for welders safety devices for welding in general F16P1/00
• CPC Class Codes: B23K 9/00 Arc welding or cutting electro-slag welding B23K25/00; welding transformers H01F; welding generators H02K
• CPC Class Codes: B23K 9/09 Arrangements or circuits for arc welding with pulsed current or voltage
• CPC Class Codes: B23K 9/095 Monitoring or automatic control of welding parameters
• CPC Class Codes: B23K 9/0953 using computing means
• CPC Class Codes: B23K 9/0956 using sensing means, e.g. optical
• CPC Class Codes: B23K 9/10 Other electric circuits therefor; Protective circuits; Remote controls
• CPC Class Codes: G09B 19/24 Use of tools
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A real-time virtual reality welding system including a programmable processor-based subsystem, a spatial tracker operatively connected to the programmable processor-based subsystem, at least one mock welding tool capable of being spatially tracked by the spatial tracker, and at least one display device operatively connected to the programmable processor-based subsystem. The system is capable of simulating, in virtual reality space, a weld puddle having real-time molten metal fluidity and heat dissipation characteristics. The system is further capable of importing data into the virtual reality welding system and analyzing the data to characterize a student welder'"'"'s progress and to provide training.

Claims

1. A system for simulating GTAW welding activity, comprising:

a GTAW welding tool fora simulated GTAW welding operation;

a simulated GTAW welding electrode;

a tracking unit having at least one sensor, which detects movement and orientation of said GTAW welding tool during said simulated GTAW welding operation;

a welding coupon;

a processor based sub-system having a central processing unit, where said processor based sub-system is operatively coupled to said tracking unit and receives information from said tracking unit related to said movement and orientation of said GTAW welding tool; and

a first display device operatively coupled to said processor based subsystem which displays said simulated GTAW welding operation;

wherein during said simulated GTAW welding operation, said processor based subsystem generates a simulated welding surface for said welding coupon and displays said simulated welding surface on said first display device;

wherein during said simulated welding operation, said processor based subsystem generates a simulated weld puddle having molten metal fluidity and heat dissipation characteristics based on said movement and orientation of said GTAW welding tool during said simulated welding operation;

wherein said processor based subsystem generates a simulated weld bead based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state; and

wherein said first display device displays each of said simulated welding surface, said simulated weld puddle, said simulated weld bead, and said GTAW welding tool during said simulated GTAW welding operation.

2. The system of claim 1, wherein said tracking unit utilizes an optical sensor which is mounted on a helmet to optically track said GTAW welding tool.

3. The system of claim 1, further comprising a helmet which comprises an audio speaker which provides simulated welding sounds in real-time with the simulated GTAW welding operation, and where said first display device is positioned in said helmet.

4. The system of claim 1, further comprising a second display device coupled to said processor based subsystem, where said processor based subsystem generates a plurality of simulated welding parameters based on said movement and orientation of said GTAW welding tool and wherein said second display device displays said plurality of simulated welding parameters during said simulated GTAW welding operation, and wherein at least one of said plurality of simulated welding parameters is displayed in graphical form in real time during said simulated GTAW welding operation.

5. The system of claim 4, wherein said plurality of simulated welding parameters include weld angle, travel angle, and travel speed.

6. The system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated GTAW welding operation and compares said simulated welding parameter to a stored value for said simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device, and wherein said comparison is displayed in graphical form on said second display device.

7. The system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated GTAW welding operation and compares said at least one simulated welding parameter to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device, and wherein said comparison is displayed in graphical form.

8. The system of claim 1, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated GTAW welding operation and provides a score for each of said plurality of simulated welding parameters based on a comparison between said plurality of simulated welding parameters and a desired value for each of said plurality of simulated welding parameters, respectively, and wherein each of said scores is a numerical score.

9. The system of claim 1, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated GTAW welding operation and determines a presence of a discontinuity within said simulated weld bead, where said discontinuity is a presence of at least one of spatter and porosity, and wherein said first display device displays said discontinuity during said simulated GTAW welding operation, in real time, and in said completed simulated weld bead.

10. The system of claim 1, wherein said first display device displays a plurality of visual cues during said simulated GTAW welding operation, where each of said plurality of visual cues is for a distinct simulated welding parameter, and where said plurality of visual cues are displayed based on a deviation of said simulated welding parameters during said simulated GTAW welding operation from a desired value for each of said simulated welding parameters, respectively.

11. The system of claim 1, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated GTAW welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said GTAW welding tool.

12. The system of claim 1, wherein said simulation of said solidification from said molten state to said solid state of said weld puddle is based on a cooling threshold value for said simulated weld puddle.

13. The system of claim 1, wherein said first display device displays a weld bead wake characteristic during creation of said simulated weld bead, where said wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.

14. A system for simulating GTAW welding activity, comprising:

a GTAW welding tool fora simulated GTAW welding operation;

a simulated GTAW welding electrode;

a spatial tracking unit having at least one optical sensor, which detects movement and orientation of said GTAW welding tool during said simulated GTAW welding operation;

a welding coupon;

a helmet comprising said at least one optical sensor and an audio speaker which provides simulated welding sounds during said simulated GTAW welding operation;

a processor based sub-system having a central processing unit, where said processor based sub-system is operatively coupled to said spatial tracking unit and receives information from said spatial tracking unit related to said movement and orientation of said GTAW welding tool; and

a first display device operatively coupled to said processor based subsystem which displays said simulated GTAW welding operation;

wherein during said simulated GTAW welding operation, said processor based subsystem generates a simulated welding surface for said welding coupon and displays said simulated welding surface on said first display device;

wherein during said simulated welding operation, said processor based subsystem generates a simulated weld puddle having real-time molten metal fluidity and real-time heat dissipation characteristics based on said movement and orientation of said GTAW welding tool during said simulated welding operation;

wherein said processor based subsystem models a simulated weld bead based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state; and

wherein said first display device displays each of said simulated welding surface, said simulated weld puddle, said simulated weld bead, and said GTAW welding tool during said simulated GTAW welding operation.

15. The system of claim 14, further comprising a second display device coupled to said processor based subsystem, where said processor based subsystem generates a plurality of simulated welding parameters based on said movement and orientation of said GTAW welding tool and wherein said second display device displays said plurality of simulated welding parameters during said simulated GTAW welding operation, wherein at least one of said plurality of simulated welding parameters is displayed in graphical form in real time during said simulated GTAW welding operation, and wherein said plurality of simulated welding parameters include weld angle, travel angle, and travel speed.

16. The system of claim 14, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated GTAW welding operation and compares said at least one simulated welding parameter to a stored value for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device, and wherein said comparison is displayed in graphical form on said second display device.

17. The system of claim 14, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated GTAW welding operation and compares said at least one simulated welding parameter to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device, and wherein said comparison is displayed in graphical form.

18. The system of claim 14, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated GTAW welding operation and provides a score for each of said plurality of simulated welding parameters based on a comparison between said plurality of simulated welding parameters and a desired value for each of said plurality of simulated welding parameters, respectively, and wherein each of said scores is a numerical score.

19. The system of claim 14, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated GTAW welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said GTAW welding tool.

20. A system for simulating GTAW welding activity, comprising:

a GTAW welding tool fora simulated GTAW welding operation;

a simulated GTAW welding electrode;

a tracking unit having at least one sensor, which detects movement and orientation of said GTAW welding tool during said simulated GTAW welding operation;

a welding coupon;

a processor based sub-system having a central processing unit, where said processor based sub-system is operatively coupled to said tracking unit and receives information from said tracking unit related to said movement and orientation of said GTAW welding tool; and

a first display device operatively coupled to said processor based subsystem which displays said simulated GTAW welding operation;

wherein during said simulated GTAW welding operation, said processor based subsystem generates a simulated welding surface for said welding coupon and displays said simulated welding surface on said first display device;

wherein during said simulated welding operation, said processor based subsystem generates a simulated weld puddle having molten metal fluidity and heat dissipation characteristics based on said movement and orientation of said GTAW welding tool during said simulated welding operation;

wherein said processor based subsystem generates a simulated weld bead based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state;

wherein said first display device displays each of said simulated welding surface, said simulated weld puddle, said simulated weld bead, and said GTAW welding tool during said simulated GTAW welding operation;

wherein said first display device displays at least one visual cue during said simulated GTAW welding operation, where said at least one visual cue is for a simulated welding parameter, and where said at least one visual cue is displayed based on a deviation of said simulated welding parameter from a desired value for said simulated welding parameter, where said simulated welding parameter is either weld angle, travel speed or travel angle, and

wherein said simulation of said solidification from said molten state to said solid state of said weld puddle is based on a cooling threshold value for said simulated weld puddle.

21. A method for simulating GTAW welding activity, said method comprising:

tracking a GTAW welding tool to determine movement and orientation of said GTAW welding tool during a simulated GTAW welding operation;

receiving information related to said movement and orientation of said GTAW welding tool;

displaying said simulated GTAW welding operation on a first display device;

generating a simulated welding surface for a welding coupon;

displaying said simulated welding surface on said first display device;

generating a simulated weld puddle having molten metal fluidity and heat dissipation characteristics based on said information related to said movement and orientation of said GTAW welding tool during said simulated welding operation;

generating a simulated weld bead based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state; and

displaying, on said first display device, each of said simulated welding surface, said simulated weld puddle, said simulated weld bead, and said GTAW welding tool during said simulated GTAW welding operation,

wherein said tracking includes optically tracking said GTAW welding tool using an optical sensor mounted on a helmet.

22. The method of claim 21, further comprising:

simulating welding sounds in real-time with the simulated GTAW welding operation using an audio speaker disposed in said helmet,

wherein said first display device is positioned in said helmet.

23. The method of claim 21, further comprising:

generating a plurality of simulated welding parameters based on said information related to said movement and orientation of said GTAW welding tool;

displaying, on a second display device, said welding parameters during said simulated GTAW welding operation,

wherein at least one of said plurality of simulated welding parameters is displayed in graphical form in real time during said simulated GTAW welding operation.

24. The method of claim 23, wherein said plurality of simulated welding parameters include weld angle, travel angle, and travel speed.

25. The method of claim 21, further comprising:

generating at least one simulated welding parameter during said simulated GTAW welding operation;

comparing said simulated welding parameter to a stored value for said simulated welding parameter; and

displaying said comparison on a second display device,

wherein said comparison is displayed in graphical form on said second display device.

26. The method of claim 21, further comprising:

generating at least one simulated welding parameter during said simulated GTAW welding operation;

comparing said at least one simulated welding parameter to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter; and

displaying said comparison on a second display device,

wherein said comparison is displayed in graphical form.

27. The method of claim 21, further comprising:

generating a plurality of simulated welding parameters during said simulated GTAW welding operation;

providing a score for each of said plurality of simulated welding parameters based on a comparison between said plurality of simulated welding parameters and a desired value for each of said plurality of simulated welding parameters, respectively, and wherein each of said scores is a numerical score.

28. The method of claim 21, further comprising:

generating a plurality of simulated welding parameters during said simulated GTAW welding operation;

determining a presence of a discontinuity within said simulated weld bead, where said discontinuity is a presence of at least one of spatter and porosity;

displaying, on said first display device, said discontinuity during said simulated GTAW welding operation, in real time, and in said completed simulated weld bead.

29. The method of claim 21, further comprising:

displaying, on said first display device, a plurality of visual cues during said simulated GTAW welding operation, where each of said plurality of visual cues is for a distinct simulated welding parameter, and where said plurality of visual cues are displayed based on a deviation of said simulated welding parameters during said simulated GTAW welding operation from a desired value for each of said simulated welding parameters, respectively.

30. The method of claim 21, further comprising:

generating and displaying on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated GTAW welding operation, and where said at least one welding effect is displayed, in real time, based on said information related to movement and orientation of said GTAW welding tool.

31. The method of claim 21, wherein said simulation of said solidification from said molten state to said solid state of said weld puddle is based on a cooling threshold value for said simulated weld puddle.

32. The system of claim 21, wherein said first display device displays a weld bead wake characteristic during creation of said simulated weld bead, where said wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.

33. A method for simulating GTAW welding activity, said method comprising:

tracking a GTAW welding tool to determine movement and orientation of said GTAW welding tool during a simulated GTAW welding operation;

receiving information related to said movement and orientation of said GTAW welding tool;

displaying said simulated GTAW welding operation on a first display device;

generating a simulated welding surface for a welding coupon for defining a weldable surface;

displaying said simulated welding surface on said first display device;

generating a simulated weld puddle for representing a weld puddle that would be formed in a real-world, the simulated weld puddle having molten metal fluidity and heat dissipation characteristics based on said information related to said movement and orientation of said GTAW welding tool during said simulated welding operation;

generating a simulated weld bead based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state for defining a weld on said weldable surface; and

displaying, on said first display device, each of said simulated welding surface, said simulated weld puddle, said simulated weld bead, and said GTAW welding tool during said simulated GTAW welding operation, and

simulating welding sounds in real-time with the simulated GTAW welding operation using an audio speaker disposed in a helmet,

wherein said first display device is positioned in said helmet.