Automatic realtime speech impairment correction

• US 8,620,670 B2
• Filed: 09/12/2012
• Issued: 12/31/2013
• Est. Priority Date: 03/14/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Malkin, Peter K., Trewin, Sharon M.
• Primary Examiner(s): He, Jialong
• Application Number:
  US13/611,955
• Publication Number:
  US 20130246058A1
• Time in Patent Office: 475 Days
• Field of Search: 704/270, 704/271, 600/23
• US Class Current: 704/278
• CPC Class Codes: G10L 2021/0575 Aids for the handicapped in speaking
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: G10L 21/057 for improving intelligibility
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

Automatic correcting of user'"'"'s speech impairment in speech may include obtaining the audio signal of a given user'"'"'s speech, and analyzing the obtained audio signal to identify artifacts caused by the user'"'"'s impairment. The obtained audio signal may be modified by eliminating the identified artifacts from it. The modified audio signal may be provided, e.g., to be played or broadcast or transmitted.

Claims

1. A system for correcting effects of a user'"'"'s speech impairment, comprising:

a processor;

a receiver module operable to obtain audio signal of a speech;

an analysis module operable execute on the processor and further operable to analyze the audio signal to identify audio signal artifacts caused by the user'"'"'s speech impairment;

a modifier module operable to modify the audio signal by eliminating the identified audio signal artifacts from the audio signal;

a player module operable to provide the modified audio signal; and

a database of impairment-to-artifact associations including repeated instances of phonemes associated with stuttering, inappropriate verbiage inserted into speech associated with Tourete Syndrome, and slurred pronunciation associated with lisping,

wherein the analysis module is operable to identify the audio signal artifacts caused by the user'"'"'s speech impairment by employing identified differences between audio signals of the user reading a text with a predefined audio signal associated with the text.

2. The system of claim 1, wherein the system corrects the user'"'"'s speech impairments in real time or near real time as the speech is being made.

3. The system of claim 1, further including a module to identify the user'"'"'s speech impairment for correcting.

4. A computer readable storage medium, excluding a signal per se,

storing a program of instructions executable by a machine to perform a method of correcting effects of a user'"'"'s speech impairment, the method comprising:

obtaining audio signal of a speech;

analyzing, by a processor, the audio signal to identify audio signal artifacts caused by the user'"'"'s speech impairment;

modifying, by the processor, the audio signal by eliminating the identified audio signal artifacts from the audio signal;

providing the modified audio signal; and

accessing a database of impairment-to-artifact associations, wherein the database including repeated instances of phonemes associated with stuttering, inappropriate verbiage inserted into speech associated with Tourete Syndrome, and slurred pronunciation associated with lisping,

wherein the analyzing further comprises identifying the audio signal artifacts caused by the user'"'"'s speech impairment by employing identified differences between audio signals of the user reading a text with a predefined audio signal associated with the text.

5. The computer readable storage medium of claim 4, wherein the analyzing, the modifying and the providing are performed in real time or near real time as the speech is being made.

6. The computer readable storage medium of claim 4, further including:

identifying the user'"'"'s speech impairment for correcting.

7. The computer readable storage medium of claim 4, wherein the analyzing, the modifying and the providing are performed in real time while the speech is being made, and the obtaining and the providing occur continuously, with a next speech audio being obtained while previously modified audio signal is provided.

8. The computer readable storage medium of claim 4, wherein the speech impairment includes stuttering, Tourete Syndrome, or lisping, or combinations thereof.

9. The computer readable storage medium of claim 4, further including:

receiving training of which audio signals are artifacts caused by the user'"'"'s speech impairment.

10. The computer readable storage medium of claim 9, wherein the receiving training includes receiving user'"'"'s indication of which audio signals are artifacts associated with the user'"'"'s speech impairment.

11. The computer readable storage medium of claim 9, wherein the receiving training includes:

receiving audio signals of a user reading the text;

comparing the audio signals of the user reading the text with the predefined audio signal associated with the text; and

identifying differences between the audio signals of the user reading the text with the predefined audio signal associated with the text.

12. The computer readable storage medium of claim 4, wherein the obtaining, the analyzing, the modifying and the providing are performed for the speech captured in segments as the user speaks, and the segments are provided in an unbroken manner for a recipient hearing the speech.