Speech simulation device

• US 10,019,982 B1
• Filed: 10/18/2016
• Issued: 07/10/2018
• Est. Priority Date: 02/20/2012
• Status: Active Grant

• Current Assignee: Mary Elizabeth Mcculloch
• Original Assignee: Mary Elizabeth Mcculloch
• Inventors: McCulloch, Mary Elizabeth
• Primary Examiner(s): Patel, Shreyans
• Application Number:
  US15/296,127
• Time in Patent Office: 630 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/04 Details of speech synthesis systems, e.g. synthesiser structure or memory management
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

A speech simulation system adapted for a user to communicate with others. The system has at least one sensor to sense controlled and coordinated body movement. The system has a computer processor connected to the at least one sensor. The system has a database memory connected to the computer processor. The system has software programming to operate the computer processor. The system has a feedback device connected to the computer processor and directed to the user. The system has an outward audio output device connected to the computer processor to provide sound and a speaker connected to the outward audio output device.

Claims

1. A speech simulation system for a user to communicate with others via word choices selected by the user, comprising:

a sensor positionable at a body part of the user and configured to generate sensor data instances, each sensor data instance being indicative of a controlled action of the body part by the user;

memory configured to store the word choices and prerecorded sounds, each of the prerecorded sounds being associated with at least one word choice, the prerecorded sounds including at least one of;

words, phrases and sentences;

a feedback device configured to present word choices and user selections to the user;

an audio device separate from the feedback device and configured to present audio to the others;

a computer processor couplable to the sensor, the memory, the feedback device and the audio device, the computer processor configured to;

(i) present a first sequence of word choices to the user via the feedback device;

(ii) receive a first sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a first selected word choice in the first sequence of word choices;

(iii) present a second sequence of word choices to the user via the feedback device;

(iv) receive a second sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a second selected word choice in the second sequence of word choices; and

(v) present a prerecorded sound representative of the first selected word choice and the second selected word choice via the audio device,

wherein the sensor is an audio sensor configured to detect intentional grunts or coughing sounds corresponding to a controlled action by the user indicating a user selection to select one of the words of the word choices in a list of word choices.

2. The speech simulation system of claim 1, wherein the feedback device is at least one of:

earphone and a screen with a digital readout.

3. The speech simulation system of claim 1, wherein the computer processor is further configured to:

(vi) while presenting a word choice in the first sequence of word choices to the user via the feedback device, receive third sensor data instance from the sensor corresponding to a controlled action by the user indicating a user command to rearrange the presented word choice in the first sequence of word choices during subsequent presentation of the first sequence of word choices to the user.

4. The speech simulation system of claim 1, wherein the sensor is a position sensor and wherein each sensor data instance is generated by calculating a difference between a current position of the sensor and an average relative position of the sensor, wherein the average relative position of the sensor is based on an average of previous positions of the sensor.

5. The speech simulation system of claim 1, wherein the sensor is an accelerometer.

6. The speech simulation system of claim 1, wherein the sensor is a bend sensor.

7. The speech simulation system of claim 1, wherein the body part of the user is one of:

an elbow and a knee.

8. The speech simulation system of claim 1, wherein the body part of the user is one of:

an arm and a leg.

9. The speech simulation system of claim 1, wherein the body part of the user is one of:

a hand and a foot.

10. The speech simulation system of claim 1, wherein the sensor and the processor are integrated in a portable cellular phone and the portable cellular phone is positionable at the body part of the user.

11. A speech simulation method for a user to communicate with others via word choices selected by the user via a sensor positionable at a body part of the user and configured to generate sensor data instances, each sensor data instance being indicative of a controlled action of the body part by the user, the method comprising:

at a device with memory configured to store the word choices and prerecorded sounds, wherein each of the prerecorded sounds being associated with at least one word choice, the prerecorded sounds including at least one of;

words, phrases and sentences, a feedback device configured to present word choices and user selections to the user, an audio device separate from the feedback device and configured to present audio to the others, and a computer processor couplable to the sensor, the memory, the feedback device and the audio device;

(i) presenting a first sequence of word choices to the user via the feedback device;

(ii) receiving a first sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a first selected word choice in the first sequence of word choices;

(iii) presenting a second sequence of word choices to the user via the feedback device;

(iv) receiving a second sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a second selected word choice in the second sequence of word choices; and

(v) presenting a prerecorded sound representative of the first selected word choice and the second selected word choice via the audio device,

wherein the sensor is an audio sensor configured to detect intentional grunts or coughing sounds corresponding to a controlled action by the user indicating a user selection to select one of the words of the word choices in a list of word choices.

12. The speech simulation method of claim 11, wherein the feedback device is at least one of:

earphone and a screen with a digital readout.

13. The speech simulation method of claim 11, further comprising:

(vi) while presenting a word choice in the first sequence of word choices to the user via the feedback device, receiving third sensor data instance from the sensor corresponding to a controlled action by the user indicating a user command to rearrange the presented word choice in the first sequence of word choices during subsequent presentation of the first sequence of word choices to the user.

14. The speech simulation method of claim 11, wherein the sensor is a position sensor and wherein each sensor data instance is generated by calculating a difference between a current position of the sensor and an average relative position of the sensor, wherein the average relative position of the sensor is based on an average of previous positions of the sensor.

15. The speech simulation method of claim 11, wherein the sensor is an accelerometer.

16. The speech simulation method of claim 11, wherein the sensor is a bend sensor.

17. The speech simulation method of claim 11, wherein the body part of the user is one of:

an elbow and a knee.

18. The speech simulation system of claim 11, wherein the body part of the user is one of:

an arm and a leg.

19. The speech simulation method of claim 11, wherein the body part of the user is one of:

a hand and a foot.

20. The speech simulation method of claim 11, wherein the sensor and the processor are integrated in a portable cellular phone and the portable cellular phone is positionable at the body part of the user.

21. A speech simulation system for a user to communicate with others via word choices selected by the user, comprising:

a sensor positionable at a body part of the user and configured to generate sensor data instances, each sensor data instance being indicative of a controlled action of the body part by the user;

memory configured to store the word choices and prerecorded sounds, each of the prerecorded sounds being associated with at least one word choice, the prerecorded sounds including at least one of;

words, phrases and sentences;

a feedback device configured to present word choices and user selections to the user;

an audio device separate from the feedback device and configured to present audio to the others;

a computer processor couplable to the sensor, the memory, the feedback device and the audio device, the computer processor configured to;

(i) present a first sequence of word choices to the user via the feedback device;

(ii) receive a first sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a first selected word choice in the first sequence of word choices;

(iii) present a second sequence of word choices to the user via the feedback device;

(iv) receive a second sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a second selected word choice in the second sequence of word choices; and

(v) present a prerecorded sound representative of the first selected word choice and the second selected word choice via the audio device,

wherein the sensor is positioned between the teeth of the user.

22. The speech simulation system of claim 21, wherein the feedback device is at least one of:

earphone and a screen with a digital readout.

23. The speech simulation system of claim 21, wherein the computer processor is further configured to:

(vi) while presenting a word choice in the first sequence of word choices to the user via the feedback device, receive third sensor data instance from the sensor corresponding to a controlled action by the user indicating a user command to rearrange the presented word choice in the first sequence of word choices during subsequent presentation of the first sequence of word choices to the user.

24. The speech simulation system of claim 21, wherein the sensor is a position sensor and wherein each sensor data instance is generated by calculating a difference between a current position of the sensor and an average relative position of the sensor, wherein the average relative position of the sensor is based on an average of previous positions of the sensor.

25. The speech simulation system of claim 21, wherein the sensor is an accelerometer.

26. The speech simulation system of claim 21, wherein the sensor is a bend sensor.

27. The speech simulation system of claim 21, wherein the body part of the user is one of:

an elbow and a knee.

28. The speech simulation system of claim 21, wherein the body part of the user is one of:

an arm and a leg.

29. The speech simulation system of claim 21, wherein the body part of the user is one of:

a hand and a foot.

30. The speech simulation system of claim 21, wherein the sensor and the processor are integrated in a portable cellular phone and the portable cellular phone is positionable at the body part of the user.

31. A speech simulation method for a user to communicate with others via word choices selected by the user via a sensor positionable at a body part of the user and configured to generate sensor data instances, each sensor data instance being indicative of a controlled action of the body part by the user, the method comprising:

at a device with memory configured to store the word choices and prerecorded sounds, wherein each of the prerecorded sounds being associated with at least one word choice, the prerecorded sounds including at least one of;

words, phrases and sentences, a feedback device configured to present word choices and user selections to the user, an audio device separate from the feedback device and configured to present audio to the others, and a computer processor couplable to the sensor, the memory, the feedback device and the audio device;

(i) presenting a first sequence of word choices to the user via the feedback device;

(ii) receiving a first sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a first selected word choice in the first sequence of word choices;

(iii) presenting a second sequence of word choices to the user via the feedback device;

(iv) receiving a second sensor data instance from the sensor corresponding to a controlled action by the user indicating a user selection of a second selected word choice in the second sequence of word choices; and

(v) presenting a prerecorded sound representative of the first selected word choice and the second selected word choice via the audio device wherein the sensor is an audio sensor configured to detect intentional grunts or coughing sounds corresponding to a controlled action by the user indicating a user selection to select one of the words of the word choices in a list of word choices,

wherein the sensor is positioned between the teeth of the user.

32. The speech simulation method of claim 31, wherein the feedback device is at least one of:

earphone and a screen with a digital readout.

33. The speech simulation method of claim 31, further comprising:

(vi) while presenting a word choice in the first sequence of word choices to the user via the feedback device, receiving third sensor data instance from the sensor corresponding to a controlled action by the user indicating a user command to rearrange the presented word choice in the first sequence of word choices during subsequent presentation of the first sequence of word choices to the user.

34. The speech simulation method of claim 31, wherein the sensor is a position sensor and wherein each sensor data instance is generated by calculating a difference between a current position of the sensor and an average relative position of the sensor, wherein the average relative position of the sensor is based on an average of previous positions of the sensor.

35. The speech simulation method of claim 31, wherein the sensor is an accelerometer.

36. The speech simulation method of claim 31, wherein the sensor is a bend sensor.

37. The speech simulation method of claim 31, wherein the body part of the user is one of:

an elbow and a knee.

38. The speech simulation system of claim 31, wherein the body part of the user is one of:

an arm and a leg.

39. The speech simulation method of claim 31, wherein the body part of the user is one of:

a hand and a foot.

40. The speech simulation method of claim 31, wherein the sensor and the processor are integrated in a portable cellular phone and the portable cellular phone is positionable at the body part of the user.