Voice interaction with and control of inspection equipment

• US 7,240,010 B2
• Filed: 06/14/2004
• Issued: 07/03/2007
• Est. Priority Date: 06/14/2004
• Status: Active Grant

• Current Assignee: Stylwan IP Holding LLC
• Original Assignee: Stylianos Papadimitriou, Wanda G. Papadimitriou
• Inventors: Papadimitriou, Stylianos, Papadimitriou, Wanda G.
• Primary Examiner(s): ABEBE, DANIEL DEMELASH
• Application Number:
  US10/867,004
• Publication Number:
  US 20050275558A1
• Time in Patent Office: 1,114 Days
• Field of Search: 704/275, 379/100.06
• US Class Current: 704/275
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

The non-destructive inspection equipment is provided with voice interaction to interface with the inspector and/or operator who preferably controls the inspection equipment and the inspection process, at least in part, through the use of voice control and by receiving audio and/or video feedback from the inspection equipment. The overall inspection quality is preferably substantially improved when the inspector and/or operator can focus entirely on the material under inspection while maintaining full control of the inspection equipment and the inspection process. The inspection equipment and its interfaces are adapted and fine-tuned for interaction with humans, particularly in a harsh noise industrial environment. Further, the voice interaction preferably allows the inspector and/or operator to operate the inspection equipment while wearing gloves or with dirty hands as he/she will not need to constantly physically manipulate the inspection equipment.

Claims

1. An inspection system interacting with a voice interface through speech and hearing comprising:

at least one imperfection detection sensor with an output;

at least one computer having at least one imperfection detection interface, wherein said output is in communication with the computer, and wherein said at least one computer controls the induction of an excitation into a material being inspected and detects a response from the material, to the induced excitation, with said at least one imperfection detection sensor, and wherein said at least one computer converts said response into an inspection trace; and

at least one sound synthesizer, the computer being in data communication with said at least one sound synthesizer, wherein said inspection trace is communicated to said at least one sound synthesizer, and wherein the sound synthesizer produces, through psychoacoustic modeling, controlled by said at least one computer, audible sound identifying said inspection trace.

2. The inspection system of claim 1, further comprising at least one speaker, wherein said at least one speaker is in communication with the sound synthesizer and allows a sound output to emanate from the sound synthesizer.

3. The inspection system of claim 2, further comprising a headset, wherein said headset comprises said at least one speaker.

4. The inspection system of claim 1, further comprising an inspection unit, the unit being disposed about an element being inspected and in communication with said at least one imperfection detection interface.

5. The inspection system of claim 1, further comprising at least one remote display, wherein said at least one remote display being portable.

6. The inspection system of claim 5, wherein said at least one remote display is carried on a headset.

7. The inspection system of claim 1, further comprising:

storage for the computer; and

inspection results, wherein said inspection results may be stored in said storage.

8. The inspection system of claim 1, wherein said inspection system can be adapted to operate a data acquisition system.

9. An inspection system interacting with a voice interface through speech and hearing comprising:

at least one imperfection detection sensor with an output;

at least one computer having at least one imperfection detection interface, wherein said output is in communication with the computer, and wherein said at least one computer controls the induction of an excitation into a material being inspected and detects a response from the material, to the induced excitation, with said at least one imperfection detection sensor, and wherein said at least one computer converts said response into inspection trace; and

at least one speech synthesizer, the computer being in data communication with said at least one speech synthesizer, wherein said inspection trace is communicated to said at least one speech synthesizer, and wherein the speech synthesizer produces, through psychoacoustic modeling, controlled by said at least one computer, recognizable speech describing said inspection trace.

10. The inspection system of claim 9, further comprising at least one language selector, wherein the speech synthesizer produces voice output in more than one language.

11. The inspection system of claim 9, further comprising at least one speaker, wherein said at least one speaker allows a speech output to emanate from the speech synthesizer.

12. The inspection system of claim 11, further comprising a headset, wherein said headset comprises said at least one speaker.

13. The inspection system of claim 9, further comprising an inspection unit, the unit being disposed about an element being inspected and in communication with said at least one imperfection detection interface.

14. The inspection system of claim 9, further comprising at least one remote display;

wherein said at least one remote display is portable.

15. The inspection system of claim 14, wherein said at least one remote display is carried on a headset.

16. The inspection system of claim 9, further comprising:

storage for the computer; and

inspection results, wherein said inspection results may be stored in said storage.

17. The inspection system of claim 9, wherein said inspection system can be adapted to operate a data acquisition system.

18. An inspection system interacting with a voice interface through speech and hearing comprising:

at least one imperfection detection sensor with an output;

at least one computer having at least one imperfection detection interface, wherein said output is in communication with the computer; and

at least one speech recognition engine, the computer being in data communication with said at least one speech recognition engine, wherein the speech recognition engine accepts and recognizes a voice input.

19. The inspection system of claim 18, further comprising at least one language selector, wherein the speech recognition engine may accept and recognize more than one language.

20. The inspection system of claim 18, further comprising an automatic language selector, wherein the speech recognition engine may automatically accept and recognize more than one language.

21. The inspection system of claim 18, further comprising an automatic language selector, wherein the speech recognition engine may automatically and substantially simultaneously recognize more than one language.

22. The inspection system of claim 18, further comprising voiceprint identification capability to recognize at least one speaker.

23. The inspection system of claim 18, further comprising:

at least one electroacoustic device, wherein said at least one electroacoustic device receives sound input from at least one source; and

at least one device capable of increasing sound magnitude for receiving a sound input.

24. The inspection system of claim 23, wherein said at least one source is an inspector.

25. The inspection system of claim 18, further comprising at least one band-rejection filter, wherein said at least one band-rejection filter suppresses interference.

26. The inspection system of claim 18, further comprising a headset, wherein said headset comprises said at least one electroacoustic device, wherein said at least one electroacoustic device receives sound input from at least one source.

27. The inspection system of claim 18, further comprising an inspection unit, the unit being disposed about an element being inspected and in communication with said at least one imperfection detection interface.

28. The inspection system of claim 18, further comprising at least one remote display, wherein said at least one remote display is portable.

29. The inspection system of claim 28, wherein said at least one remote display is carried on a headset.

30. The inspection system of claim 18, further comprising:

storage for the computer; and

inspection results, wherein said inspection results may be stored in said storage.

31. The inspection system of claim 18, wherein said inspection system can be adapted to operate a data acquisition system.

32. The inspection system of claim 18, further comprising:

at least one speech synthesizer, the computer being in data communication with said at least one speech synthesizer, wherein the speech synthesizer produces a voice output; and

at least one sound synthesizer, the computer being in data communication with said at least one sound synthesizer wherein the sound synthesizer produces audible sound output.

33. The inspection system of claim 32, further comprising a language selector, wherein the speech synthesizer produces voice output in more than one language.

34. The inspection system of claim 32, further comprising at least one speaker, wherein said at least one speaker allows a voice output to emanate from the speech synthesizer.

35. The inspection system of claim 32, further comprising at least one speaker, wherein said at least one speaker allows an audible sound output to emanate from the sound synthesizer.

36. The inspection system of claim 32, further comprising at least one speaker, wherein said at least one speaker allows a voice output to emanate from the speech synthesizer and allows an audible sound output to emanate from the sound synthesizer.

37. The inspection system of claim 32, further comprising a headset, wherein said headset comprises at least one electroacoustic device and at least one speaker.

38. The inspection system of claim 18, further comprising a help menu.

39. A method of operating an inspection system with a voice interface comprising the steps of:

establishing communication between at least one sound synthesizer and at least one computer;

operating an imperfection detection sensor, wherein said at least one computer controls the induction of an excitation into a material being inspected and detects an inspection trace from the material, to the induced excitation, with said at least one imperfection detection sensor, wherein the detection sensor emits an electronic signal characterizing said inspection trace;

converting the electronic signal into a digital signal;

sending an output digital signal from said at least one computer to the sound synthesizer;

using psychoacoustic modeling, controlled by said at least one computer, to convert said output digital signal to an audible sound identifying said inspection trace; and

broadcasting said audible sound through a speaker.

40. The method of claim 39, further comprising the step of connecting a data acquisition system to the computer and operating said data acquisition system with the computer.

41. The method of claim 39, further comprising the steps of:

establishing communication between at least one speech recognition engine and the computer;

speaking a command into at least one electroacoustic device, wherein said at least one electroacoustic device receives sound input from at least one source, and wherein said at least one electroacoustic device is in communication with the speech recognition engine;

converting said spoken command into a digital signal; and

inputting the converted digital signal into the computer, wherein the converted digital signal executes a command in the computer.

42. A method of claim 41, further comprising the step of enabling voiceprint identification capability by the computer.

43. The method of claim 39, further comprising the steps of:

establishing communication between at least one speech synthesizer and the computer;

sending an output digital signal from the computer to the speech synthesizer;

converting said output digital signal to a vocal response; and

broadcasting the vocal sound response through a speaker.

44. A method of operating an inspection system with a voice interface comprising the steps of:

establishing communication between at least one speech synthesizer and at least one computer;

operating an imperfection detection sensor, wherein said at least one computer controls the induction of an excitation into a material being inspected and detects an inspection trace from the material, to the induced excitation, with said at least one imperfection detection sensor, wherein the detection sensor emits an electronic signal characterizing said inspection trace;

converting said electronic signal into a digital signal;

sending an output digital signal from said at least one computer to the speech synthesizer;

using psychoacoustic modeling, controlled by said at least one computer, to convert said output digital signal to a recognizable speech response describing said inspection trace; and

broadcasting said recognizable speech response through a speaker.

45. The method of claim 44, further comprising the step of connecting a data acquisition system to the computer and operating said data acquisition system with the computer.

46. The method of claim 44, further comprising the steps of:

establishing communication between at least one speech recognition engine and the computer;

speaking a command into at least one electroacoustic device, wherein said at least one electroacoustic device receives sound input from at least one source, and wherein said at least one electroacoustic device is in communication with the speech recognition engine;

converting said spoken command into a digital signal; and

inputting the converted digital signal into the computer, wherein the converted digital signal executes a command in the computer.

47. A method of claim 46, further comprising the step of enabling voiceprint identification capability by the computer.

48. The method of claim 44, further comprising the steps of:

establishing communication between at least one sound synthesizer and the computer;

sending an output digital signal from the computer to the sound synthesizer;

converting said output digital signal to an audible sound response; and

broadcasting the audible sound response through a speaker.

49. A method of operating an inspection system with a voice interface comprising the steps of:

establishing communication between at least one speech recognition engine and at least one computer;

operating an imperfection detection sensor, wherein the detection sensor emits an electronic signal regarding an element to be inspected;

converting the electronic signal into a digital signal;

inputting the converted digital signal into the computer,

speaking a command into at least one electroacoustic device, wherein said at least one electroacoustic device receives sound input from at least one source, and wherein said at least one electroacoustic device is in communication with the speech recognition engine;

converting said spoken command into a digital signal; and

inputting the converted digital signal into the computer, wherein the converted digital signal executes a command in the computer.

50. The method of claim 49, further comprising the step of connecting a data acquisition system to the computer and operating said data acquisition system with the computer.

51. The method of claim 49, further comprising the steps of:

establishing communication between at least one speech synthesizer and the computer;

sending an output digital signal from the computer to the speech synthesizer;

converting said output digital signal to a vocal response; and

broadcasting said vocal response through a speaker.

52. A method of claim 49, further comprising the step of enabling voiceprint identification capability by the computer.

53. The method of claim 49, further comprising the steps of:

establishing communication between at least one sound synthesizer and the computer;

sending an output digital signal from the computer to the sound synthesizer;

converting said output digital signal to an audible sound response; and

broadcasting said audible sound through a speaker.