Importing and analyzing external data using a virtual reality welding system

• US 9,818,312 B2
• Filed: 08/07/2015
• Issued: 11/14/2017
• Est. Priority Date: 08/21/2008
• Status: Active Grant

• Current Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Original Assignee: Lincoln Global Incorporated (Lincoln Electric Holdings Incorporated)
• Inventors: Zboray, David Anthony, Bennett, Matthew Alan, Wallace, Matthew Wayne, Hennessey, Jeremiah, Dudac, Yvette Christine, Lenker, Zachary Steven, Lundell, Andrew Paul, Dana, Paul, Preisz, Eric A.
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US14/821,051
• Publication Number:
  US 20150348441A1
• Time in Patent Office: 830 Days
• CPC Class Codes: A42B 3/042 Optical devices night vision goggles G02B23/12
• CPC Class Codes: A42B 3/30 Mounting radio sets or communication systems
• CPC Class Codes: A61F 9/06 Masks, shields or hoods for welders safety devices for welding in general F16P1/00
• CPC Class Codes: B23K 9/00 Arc welding or cutting electro-slag welding B23K25/00; welding transformers H01F; welding generators H02K
• CPC Class Codes: B23K 9/09 Arrangements or circuits for arc welding with pulsed current or voltage
• CPC Class Codes: B23K 9/095 Monitoring or automatic control of welding parameters
• CPC Class Codes: B23K 9/0953 using computing means
• CPC Class Codes: B23K 9/0956 using sensing means, e.g. optical
• CPC Class Codes: B23K 9/10 Other electric circuits therefor; Protective circuits; Remote controls
• CPC Class Codes: G09B 19/24 Use of tools
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A real-time virtual reality welding system including a programmable processor-based subsystem, a spatial tracker operatively connected to the programmable processor-based subsystem, at least one mock welding tool capable of being spatially tracked by the spatial tracker, and at least one display device operatively connected to the programmable processor-based subsystem. The system is capable of simulating, in virtual reality space, a weld puddle having real-time molten metal fluidity and heat dissipation characteristics. The system is further capable of importing data into the virtual reality welding system and analyzing the data to characterize a student welder'"'"'s progress and to provide training.

Claims

1. A system for simulating welding activity, comprising:

a welding tool for a simulated welding operation;

a spatial tracker which tracks a movement and orientation of said welding tool;

a welding coupon;

a helmet having at least one speaker;

a processor based subsystem operatively coupled to said spatial tracker which receives information from said spatial tracker related to said movement and orientation of said welding tool; and

a first display device operatively coupled to said processor based subsystem which displays said simulated welding operation;

wherein during said simulated welding operation, said processor based subsystem models a simulated welding surface for said welding coupon and displays said simulated welding surface on said first display device;

wherein during said simulated welding operation, said processor based subsystem models a simulated weld puddle having real-time molten metal fluidity and real-time heat dissipation characteristics during said simulated welding operation;

wherein said processor based subsystem models a simulated weld bead based on said movement and orientation of said welding tool, and based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state;

wherein said first display device displays said simulated welding surface, said simulated weld puddle, and said simulated weld bead; and

wherein during said simulated welding operation said at least one speaker emits simulated welding sounds, where said processor based subsystem changes said simulated welding sounds, in real-time, during said simulated welding operation based on said movement and orientation of said welding tool.

2. The simulated welding system of claim 1, wherein said spatial tracker utilizes an optical sensor which is mounted on said helmet to optically track said welding tool.

3. The simulated welding system of claim 1, wherein said processor based subsystem is coupled to a user input to allow a user to select a simulated welding process type and said processor based subsystem provides a first simulated welding sound for a first simulated welding process type and a second simulated welding sound for a second simulated welding process type.

4. The simulated welding system of claim 1, further comprising a second display device coupled to said processor based subsystem, where said processor based subsystem generates a plurality of simulated welding parameters based on said movement and orientation of said welding tool and wherein said second display device displays said simulated welding parameters, in real-time, during said simulated welding operation.

5. The simulated welding system of claim 4, wherein at least one of said simulated welding parameters is displayed in graphical form in real time during said simulated welding operation.

6. The simulated welding system of claim 4, wherein said simulated welding parameters include weld angle, travel angle, and travel speed.

7. The simulated welding system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated welding operation and compares said simulated welding parameter to a stored value for said simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device.

8. The simulated welding system of claim 7, wherein said comparison is displayed in graphical form.

9. The simulated welding system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated welding operation and compares said simulated welding parameter to a tolerance window defined by limits around a setpoint for said simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device.

10. The simulated welding system of claim 9, wherein said comparison is displayed in graphical form.

11. The simulated welding system of claim 1, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated welding operation and provides a score for each of said simulated welding parameters based on a comparison between said simulated welding parameters and a desired value for each of said simulated welding parameters, respectively.

12. The simulated welding system of claim 11, wherein each of said scores is a numerical score.

13. The simulated welding system of claim 1, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated welding operation and determines a presence of a discontinuity within said simulated weld bead, where said discontinuity is a presence of at least one of spatter and porosity.

14. The simulated welding system of claim 13, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said simulated weld bead.

15. The simulated welding system of claim 1, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively.

16. The simulated welding system of claim 1, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said welding tool.

17. The simulated welding system of claim 1, wherein said simulation of said solidification from a molten state to a solid state of a surface region of said simulated weld puddle is based on a distance between said distal end of said welding tool and said surface region.

18. The simulated welding system of claim 1, wherein said simulation of said solidification from a molten state to a solid state of said simulated weld puddle is based on a cooling threshold value for said simulated weld puddle.

19. The simulated welding system of claim 1, wherein said real-time molten metal fluidity and said real-time heat dissipation characteristics are generated by a physics model operating on at least one GPU.

20. The simulated welding system of claim 1, wherein said first display device displays a weld bead wake characteristic during creation of said simulated weld bead, where said weld bead wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.

21. A system for simulating welding activity, comprising:

a welding tool for a simulated welding operation;

a spatial tracker which tracks a movement and orientation of said welding tool, said spatial tracker using at least one sensor;

a welding coupon;

a helmet having at least one speaker attached thereto, and said at least one sensor;

a simulated welding console having a user input device and a processor based subsystem operatively coupled to said spatial tracker which receives information from said spatial tracker related to said movement and orientation of said welding tool, where said user input device allows a user to select a welding operation type; and

a first display device operatively coupled to said processor based subsystem which displays said simulated welding operation;

wherein during said simulated welding operation, said processor based subsystem models a simulated welding surface for said welding coupon and displays said simulated welding surface on said first display device;

wherein during said simulated welding operation, said processor based subsystem models a simulated weld puddle having real-time molten metal fluidity and real-time heat dissipation characteristics during said simulated welding operation;

wherein said processor based subsystem models a simulated weld bead based on said movement and orientation of said welding tool, and based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state;

wherein said first display device displays said simulated welding surface, said simulated weld puddle, and said simulated weld bead;

wherein said processor based subsystem causes said at least one speaker to emit a first simulated welding sound from said speaker when a first welding type is selected and a second simulated welding sound when a second welding type is selected; and

wherein during said simulated welding operation said first or second simulated welding sound is changed, in real-time, based on said movement and orientation of said welding tool.

22. The simulated welding system of claim 21, wherein said at least one sensor is an optical sensor.

23. The simulated welding system of claim 21, further comprising a second display device coupled to said processor based subsystem, where said processor based subsystem generates a plurality of simulated welding parameters based on said movement and orientation of said welding tool and wherein said second display device displays said simulated welding parameters, in real-time, during said simulated welding operation.

24. The simulated welding system of claim 23, wherein at least one of said simulated welding parameters is displayed in graphical form in real time during said simulated welding operation.

25. The simulated welding system of claim 23, wherein said simulated welding parameters include weld angle, travel angle, and travel speed.

26. The simulated welding system of claim 21, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated welding operation and compares said simulated welding parameter to a stored value for said simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device.

27. The simulated welding system of claim 26, wherein said comparison is displayed in graphical form.

28. The simulated welding system of claim 21, wherein said processor based subsystem generates at least one simulated welding parameter during said simulated welding operation and compares said simulated welding parameter to a tolerance window defined by limits around a setpoint for said simulated welding parameter, and wherein said processor based subsystem displays said comparison on a second display device.

29. The simulated welding system of claim 28, wherein said comparison is displayed in graphical form.

30. The simulated welding system of claim 21, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated welding operation and provides a score for each of said simulated welding parameters based on a comparison between said simulated welding parameters and a desired value for each of said simulated welding parameters, respectively.

31. The simulated welding system of claim 30, wherein each of said scores is a numerical score.

32. The simulated welding system of claim 21, wherein said processor based subsystem generates a plurality of simulated welding parameters during said simulated welding operation and determines a presence of a discontinuity within said simulated weld bead, where said discontinuity is a presence of at least one of spatter and porosity.

33. The simulated welding system of claim 32, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said simulated weld bead.

34. The simulated welding system of claim 21, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively.

35. The simulated welding system of claim 21, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said welding tool.

36. The simulated welding system of claim 21, wherein said simulation of said solidification from a molten state to a solid state of a surface region of said simulated weld puddle is based on a distance between said distal end of said welding tool and said surface region.

37. The simulated welding system of claim 21, wherein said simulation of said solidification from a molten state to a solid state of said simulated weld puddle is based on a cooling threshold value for said simulated weld puddle.

38. The simulated welding system of claim 21, wherein said real-time molten metal fluidity and said real-time heat dissipation characteristics are generated by a physics model operating on at least one GPU.

39. The simulated welding system of claim 21, wherein said first display device displays a weld bead wake characteristic during creation of said simulated weld bead, where said weld bead wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.

40. The simulated welding system of claim 21, wherein the at least one speaker is within an earbud supported on the helmet.

41. A method for simulating welding activity to be performed by a processor-based apparatus, said method comprising:

tracking a movement and orientation of a welding tool using a spatial tracker;

receiving information from said spatial tracker related to said movement and orientation of said welding tool; and

displaying a simulated welding operation on a first display device;

modeling, during said simulated welding operation, a simulated welding surface for a welding coupon;

displaying said simulated welding surface on said first display device;

modeling, during said simulated welding operation, a simulated weld puddle having real-time molten metal fluidity and real-time heat dissipation characteristics during said simulated welding operation;

modeling a simulated weld bead based on said movement and orientation of said welding tool, and based on a simulation of a solidification of said simulated weld puddle from a molten state to a solid state;

emitting simulated welding sounds from at least one speaker disposed in a helmet; and

changing said simulated welding sounds, in real-time, during said simulated welding operation based on said movement and orientation of said welding tool,

wherein said first display device displays said simulated welding surface, said simulated weld puddle, and said simulated weld bead.

42. The method of claim 41, wherein said spatial tracker utilizes an optical sensor which is mounted on said helmet to optically track said welding tool.

43. The method of claim 41, further comprising:

selecting a simulated welding process type based on a user'"'"'s input; and

providing a first simulated welding sound for a first simulated welding process type and a second simulated welding sound for a second simulated welding process type.

44. The method of claim 41, further comprising:

generating a plurality of simulated welding parameters based on said movement and orientation of said welding tool; and

displaying said simulated welding parameters on a second display device, in real-time, during said simulated welding operation.

45. The method of claim 44, wherein at least one of said simulated welding parameters is displayed in graphical form in real time during said simulated welding operation.

46. The method of claim 44, wherein said simulated welding parameters include weld angle, travel angle, and travel speed.

47. The method of claim 41, further comprising:

generating at least one simulated welding parameter during said simulated welding operation;

comparing said simulated welding parameter to a stored value for said simulated welding parameter; and

displaying said comparison on a second display device.

48. The method of claim 47, wherein said comparison is displayed in graphical form.

49. The method of claim 41, further comprising:

generating at least one simulated welding parameter during said simulated welding operation;

comparing said simulated welding parameter to a tolerance window defined by limits around a setpoint for said simulated welding parameter; and

displaying said comparison on a second display device.

50. The method of claim 49, wherein said comparison is displayed in graphical form.

51. The method of claim 41, further comprising:

generating a plurality of simulated welding parameters during said simulated welding operation; and

providing a score for each of said simulated welding parameters based on a comparison between said simulated welding parameters and a desired value for each of said simulated welding parameters, respectively.

52. The method of claim 51, wherein each of said scores is a numerical score.

53. The method of claim 41, further comprising:

generating a plurality of simulated welding parameters during said simulated welding operation; and

determining a presence of a discontinuity within said simulated weld bead, where said discontinuity is a presence of at least one of spatter and porosity.

54. The method of claim 53, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said simulated weld bead.

55. The method of claim 41, further comprising:

displaying, on said first display device, a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively.

56. The method of claim 41, further comprising:

generating and displaying on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said welding tool.

57. The method of claim 41, wherein said simulation of said solidification from a molten state to a solid state of a surface region of said simulated weld puddle is based on a distance between said distal end of said welding tool and said surface region.

58. The method of claim 41, wherein said simulation of said solidification from a molten state to a solid state of said simulated weld puddle is based on a cooling threshold value for said simulated weld puddle.

59. The method of claim 41, wherein said real-time molten metal fluidity and said real-time heat dissipation characteristics are generated by a physics model operating on at least one GPU.

60. The method of claim 41, further comprising:

displays on said first display device a weld bead wake characteristic during creation of said simulated weld bead, where said weld bead wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.