Importing and analyzing external data using a virtual reality welding system

• US 9,779,635 B2
• Filed: 08/07/2015
• Issued: 10/03/2017
• Est. Priority Date: 08/21/2008
• Status: Active Grant

• Current Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Original Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Inventors: Zboray, David Anthony, Bennett, Matthew Alan, Wallace, Matthew Wayne, Hennessey, Jeremiah, Dudac, Yvette Christine, Lenker, Zachary Steven, Lundell, Andrew Paul, Dana, Paul, Preisz, Eric A.
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US14/821,004
• Publication Number:
  US 20150356888A1
• Time in Patent Office: 788 Days
• CPC Class Codes: A42B 3/042 Optical devices night vision goggles G02B23/12
• CPC Class Codes: A42B 3/30 Mounting radio sets or communication systems
• CPC Class Codes: A61F 9/06 Masks, shields or hoods for welders safety devices for welding in general F16P1/00
• CPC Class Codes: B23K 9/00 Arc welding or cutting electro-slag welding B23K25/00; welding transformers H01F; welding generators H02K
• CPC Class Codes: B23K 9/09 Arrangements or circuits for arc welding with pulsed current or voltage
• CPC Class Codes: B23K 9/095 Monitoring or automatic control of welding parameters
• CPC Class Codes: B23K 9/0953 using computing means
• CPC Class Codes: B23K 9/0956 using sensing means, e.g. optical
• CPC Class Codes: B23K 9/10 Other electric circuits therefor; Protective circuits; Remote controls
• CPC Class Codes: G09B 19/24 Use of tools
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A real-time virtual reality welding system including a programmable processor-based subsystem, a spatial tracker operatively connected to the programmable processor-based subsystem, at least one mock welding tool capable of being spatially tracked by the spatial tracker, and at least one display device operatively connected to the programmable processor-based subsystem. The system is capable of simulating, in virtual reality space, a weld puddle having real-time molten metal fluidity and heat dissipation characteristics. The system is further capable of importing data into the virtual reality welding system and analyzing the data to characterize a student welder'"'"'s progress and to provide training.

Claims

1. A system for simulating welding activity;

said system comprising;

a welding tool for a simulated welding operation;

a spatial tracker which tracks a movement and orientation of said welding tool using at least one optical sensor;

a welding coupon;

a helmet comprising a first display device to display a simulated welding operation to a user;

a simulated welding console having a user input system and a second display device to display said simulated welding operation; and

a processor based subsystem located within said simulated welding console which is operatively coupled to said spatial tracker and receives information from said spatial tracker related to said movement and orientation of said welding tool, where said processor based subsystem generates a plurality of simulated welding parameters based on said movement and orientation of said welding tool;

wherein during said simulated welding operation, said processor based subsystem models a simulated welding surface for said welding coupon and displays said simulated welding surface on each of said first and second display devices;

wherein during said simulated welding operation, said processor based subsystem creates a simulated welding arc between an emitting end of said welding tool and said simulated welding surface and simulates a creation of a weld puddle have real-time molten metal fluidity, real-time heat dissipation and real-time heat absorption characteristics during said simulated welding operation;

wherein said processor based subsystem models said simulated weld puddle such that regions of a surface of said simulated weld puddle have both a displacement value and a heat value, where each of said displacement values and heat values are changed dynamically during said simulated welding operation to display on each of said first and second display devices a simulated deposition of material into said simulated weld puddle, and said dynamic changes to each of said displacement and heat values are based on said movement and orientation of said welding tool and on said plurality of simulated welding parameters, where said first and second display devices display a color for each of said regions which is based on said heat values;

wherein said processor based subsystem displays a simulated completed weld bead on said first and second display devices which is based on said movement and orientation of said welding tool, based on said simulated welding parameters and based on a cooling threshold value for a transition of said regions from a molten state to a solid state, and

wherein said displacement values are such that a solidified surface of said simulated completed weld bead is displayed above said welding surface of said welding coupon.

2. The simulated welding system of claim 1, wherein said welding tool is an actual welding tool that can be used for a real world welding operation.

3. The simulated welding system of claim 1, wherein said optical sensor is mounted on said helmet.

4. The simulated welding system of claim 1, wherein said helmet further comprises an audio speaker which provides simulated welding sounds in real-time with the simulated welding operation.

5. The simulated welding system of claim 1, wherein said second display device displays said plurality of simulated welding parameters, in real-time, during said simulated welding operation.

6. The simulated welding system of claim 5, wherein at least one of said simulated welding parameters is displayed in graphical form in real time during said simulated welding operation.

7. The simulated welding system of claim 5, wherein said welding parameters include weld angle, travel angle, and travel speed.

8. The simulated welding system of claim 1, wherein said processor based subsystem compares at least one of said simulated welding parameters to a stored value for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on said second display device.

9. The simulated welding system of claim 8, wherein said comparison is displayed in graphical form.

10. The simulated welding system of claim 1, wherein said processor based subsystem compares at least one of said simulated welding parameters to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on said second display device.

11. The simulated welding system of claim 10, wherein said comparison is displayed in graphical form.

12. The simulated welding system of claim 1, wherein said processor based subsystem provides a score for each of said simulated welding parameters based on a comparison between said simulated welding parameters and a desired value for each of said simulated welding parameters, respectively.

13. The simulated welding system of claim 12, wherein each of said scores is a numerical score.

14. The simulated welding system of claim 1, wherein said processor based subsystem determines the presence of a discontinuity within said simulated weld bead, and where said discontinuity is the presence of at least one of spatter and porosity.

15. The simulated welding system of claim 14, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said completed simulated weld bead.

16. The simulated welding system of claim 1, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of said simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively.

17. The simulated welding system of claim 1, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on at least one of said simulated welding parameters.

18. The simulated welding system of claim 1, wherein at least one of said displacement and heat values are changed dynamically based a distance between said regions and said emitting end of said welding tool.

19. The simulated welding system of claim 1, wherein when said heat value is higher than said cooling threshold value said first and second display devices display said regions in a simulated fluid state and when said heat value is lower than said cooling threshold value said first and second display devices display said regions in a solid state.

20. The simulated welding system of claim 1, wherein said processor based subsystem changes displacement values of at least some regions of said completed weld bead when said welding tool is used to make a second simulated weld bead over said completed weld bead, and where each of said completed weld bead and said second simulated weld bead are displayed on said first and second display devices at the same time.

21. The simulated welding system of claim 1, wherein said real-time molten metal fluidity and said heat dissipation characteristics are generated by a physics model operating on a least one GPU.

22. The simulated welding system of claim 1, wherein said first display device displays a weld bead wake characteristic during creation of said simulated weld bead, where said wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.

23. A system for simulating welding activity;

said system comprising;

a welding tool for a simulated welding operation;

a spatial tracker which tracks a movement and orientation of said welding tool using at least one optical sensor;

a welding coupon;

a helmet comprising a first display device to display a simulated welding operation to a user, and which comprises said at least one optical sensor;

a simulated welding console having a user input system and a second display device to display said simulated welding operation; and

a processor based subsystem located within said simulated welding console which is operatively coupled to said spatial tracker and receives information from said spatial tracker related to said movement and orientation of said welding tool, where said processor based subsystem generates a plurality of simulated welding parameters based on said movement and orientation of said welding tool and displays said plurality of simulated welding parameters on said second display device in real time during said simulated welding operation;

wherein during said simulated welding operation, said processor based subsystem models a simulated welding surface for said welding coupon and displays said simulated welding surface on each of said first and second display devices;

wherein during said simulated welding operation, said processor based subsystem creates a simulated welding arc between an emitting end of said welding tool and said simulated welding surface and simulates the creation of a weld puddle have real-time molten metal fluidity, real-time heat dissipation and real-time heat absorption characteristics during said simulated welding operation;

wherein said processor based subsystem models said simulated weld puddle such that regions of a surface of said simulated weld puddle have both a displacement value and a heat value, where each of said displacement values and heat values are changed dynamically during said simulated welding operation to display on each of said first and second display devices the simulated deposition of material into said simulated weld puddle, and said dynamic changes to each of said displacement and heat values are based on said movement and orientation of said welding tool and on said plurality of simulated welding parameters, where said first and second display devices display a color for each of said regions which is based on said heat values;

wherein said processor based subsystem displays a simulated completed weld bead on said first and second display devices which is based on said movement and orientation of said welding tool, based on said simulated welding parameters and based on a cooling threshold value for a transition of said regions from a molten state to a solid state, and

wherein said displacement values are such that a solidified surface of said simulated completed weld bead is displayed above said welding surface of said welding coupon.

24. The simulated welding system of claim 23, wherein said welding tool is an actual welding tool that can be used for a real world welding operation.

25. The simulated welding system of claim 23, wherein said helmet further comprises an audio speaker which provides simulated welding sounds in real-time with the simulated welding operation.

26. The simulated welding system of claim 23, wherein at least one of said simulated welding parameters is displayed in graphical form in real time during said simulated welding operation.

27. The simulated welding system of claim 23, wherein said welding parameters include weld angle, travel angle, and travel speed.

28. The simulated welding system of claim 23, wherein said processor based subsystem compares at least one of said simulated welding parameters to a stored value for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on said second display device.

29. The simulated welding system of claim 28, wherein said comparison is displayed in graphical form.

30. The simulated welding system of claim 23, wherein said processor based subsystem compares at least one of said simulated welding parameters to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on said second display device.

31. The simulated welding system of claim 30, wherein said comparison is displayed in graphical form.

32. The simulated welding system of claim 23, wherein said processor based subsystem provides a score for each of said simulated welding parameters based on a comparison between said simulated welding parameters and a desired value for each of said simulated welding parameters, respectively.

33. The simulated welding system of claim 32, wherein each of said scores is a numerical score.

34. The simulated welding system of claim 23, wherein said processor based subsystem determines the presence of a discontinuity within said simulated weld bead, and where said discontinuity is the presence of at least one of spatter and porosity.

35. The simulated welding system of claim 34, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said completed simulated weld bead.

36. The simulated welding system of claim 23, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of said simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively.

37. The simulated welding system of claim 23, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on at least one of said simulated welding parameters.

38. The simulated welding system of claim 23, wherein at least one of said displacement and heat values are changed dynamically based a distance between said regions and said emitting end of said welding tool.

39. The simulated welding system of claim 23, wherein when said heat value is higher than said cooling threshold value said first and second display devices display said regions in a simulated fluid state and when said heat value is lower than said cooling threshold value said first and second display devices display said regions in a solid state.

40. The simulated welding system of claim 23, wherein said processor based subsystem changes displacement values of at least some regions of said completed weld bead when said welding tool is used to make a second simulated weld bead over said completed weld bead, and where each of said completed weld bead and said second simulated weld bead are displayed on said first and second display devices at the same time.

41. The simulated welding system of claim 23, wherein said real-time molten metal fluidity and said heat dissipation characteristics are generated by a physics model operating on a least one GPU.

42. The simulated welding system of claim 23, wherein said first display device displays a weld bead wake characteristic during creation of said simulated weld bead, where said wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.