Method and device for the processing of sounds for auditory correction for hearing impaired individuals

• US 6,408,273 B1
• Filed: 12/02/1999
• Issued: 06/18/2002
• Est. Priority Date: 12/04/1998
• Status: Expired due to Fees

• Current Assignee: Thomson-CSF (Thales SA)
• Original Assignee: Thomson-CSF (Thales SA)
• Inventors: Quagliaro, Gilles, Guilmin, Gwenaël, Gournay, Philippe, Chartier, Frédéric
• Primary Examiner(s): Banks-Harold, Marsha D.
• Assistant Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US09/453,085
• Time in Patent Office: 929 Days
• Field of Search: 704/207, 704/208, 704/214, 704/270, 704/220, 704/221, 704/230, 704/271, 623/10
• US Class Current: 704/271
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding
• CPC Class Codes: G10L 21/0364 for improving intelligibility
• CPC Class Codes: H04R 25/356 Amplitude, e.g. amplitude shift or compression
• CPC Class Codes: H04R 25/505 using digital signal processing

Abstract

A method for providing auditory correction for a hearing-impaired individual, including extracting pitch, voicing, energy and spectrum characteristics of an input speech signal. The method also includes modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic, modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic, modifying the extracted energy characteristic by applying a compression function to the extracted energy characteristic, and modifying the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic. Further, a speech signal is reconstituted perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics.

Claims

1. A method for providing auditory correction for a hearing-impaired individual, comprising:

extracting pitch, voicing, energy and spectrum characteristics of an input speech signal;

modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic;

modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic;

modifying the extracted energy characteristic by applying a compression function to the extracted energy characteristic;

modifying the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic; and

reconstituting a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics,

wherein the pitch, voicing, energy and spectrum characteristics are modified independently of each other without any reciprocal interaction and are tailored to the hearing-impaired individual.

2. The method according to claim 1, further comprising:

accelerating or slowing down the reconstituted speech signal by modifying a duration of a time interval used in reconstituting the speech signal.

3. The method according to claim 1, further comprising:

converting the input speech signal to a digital speech signal; and

removing background noise from the digital speech signal prior to the extracting step.

4. The method according to claim 1, wherein the pitch and voicing factors are greater than 0.25 and less than 4.0.

5. A system for providing auditory correction for a hearing-impaired individual, comprising:

means for extracting pitch, voicing, energy and spectrum characteristics of an input speech signal;

means for modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic;

means for modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic;

means for modifying the extracted energy characteristic by applying a compression function to the extracted energy characteristic;

means for modifying the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic; and

means for reconstituting a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics,

wherein the pitch, voicing, energy and spectrum characteristics are modified independently of each other without any reciprocal interaction and are tailored to the hearing-impaired individual.

6. The system according to claim 5, further comprising:

means for accelerating or slowing down the reconstituted speech signal by modifying a duration of a time interval used in reconstituting the speech signal.

7. The system according to claim 5, further comprising:

means for converting the input speech signal to a digital speech signal; and

means for removing background noise from the digital speech signal prior to the extracting means extracting the pitch, voicing, energy and spectrum characteristics.

8. The system according to claim 5, wherein the pitch and voicing factors are greater than 0.25 and less than 4.0.

9. An apparatus for providing auditory correction for a hearing-impaired individual, comprising:

an analysis device configured to extract pitch, voicing, energy and spectrum characteristics of an input speech signal; and

a synthesis device including a processor and configured to modify the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic, to modify the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic, to modify the extracted energy characteristic by applying a compression function to the extracted energy characteristic, to modify the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic, and to reconstitute a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics,

wherein synthesis device modifies the pitch, voicing, energy and spectrum characteristics independently of each other without any reciprocal interaction and are tailored to the hearing-impaired individual.

10. The apparatus according to claim 9, wherein the synthesis device accelerates or slows down the reconstituted speech signal by modifying a duration of a time interval used in reconstituting the speech signal.

11. The apparatus according to claim 9, further comprising:

a pre-processing device configured to convert the input speech signal to a digital speech signal, and to remove background noise from the digital speech signal prior to the analysis device extracting the pitch, voicing, energy and spectrum characteristics.

12. The apparatus according to claim 9, wherein the pitch and voicing factors are greater than 0.25 and less than 4.0.

13. The apparatus according to claim 11, further comprising:

a microphone configured to pick-up sounds to be input to the pre-processing device; and

at least one speaker configured to present the reconstituted speech signal to the hearing-impaired individual.

14. A method for providing auditory correction for a hearing-impaired individual, comprising:

converting an input speech signal to a digital speech signal;

removing background noise from the digital speech signal;

extracting pitch, voicing, energy and spectrum characteristics of the input speech signal;

modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic;

modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic;

modifying the extracted energy characteristic by applying a compression function to the extracted energy characteristic;

modifying the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic;

reconstituting a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics; and

accelerating or slowing down the reconstituted speech signal by modifying a duration of a time interval used in reconstituting the speech signal,

wherein the pitch and voicing factors are greater than 0.25 and less than 4.0.

15. A system for providing auditory correction for a hearing-impaired individual, comprising:

means for converting an input speech signal to a digital speech signal;

means for removing background noise from the digital speech signal;

means for extracting pitch, voicing, energy and spectrum characteristics of the input speech signal;

means for modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic;

means for modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic;

means for modifying the extracted energy characteristic by applying a compression function to the extracted energy characteristic;

means for modifying the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic;

means for reconstituting a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics; and

means for accelerating or slowing down the reconstituted speech signal by modifying a duration of a time interval used in reconstituting the speech signal,

wherein the pitch and voicing factors are greater than 0.25 and less than 4.0.

16. An apparatus for providing auditory correction for a hearing-impaired individual, comprising:

a pre-processing device configured to convert the input speech signal to a digital speech signal, and to remove background noise from the digital speech signal prior to the analysis device extracting the pitch, voicing, energy and spectrum characteristics;

an analysis device configured to extract pitch, voicing, energy and spectrum characteristics of an input speech signal; and

a synthesis device including a processor and configured to modify the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic, to modify the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic, to modify the extracted energy characteristic by applying a compression function to the extracted energy characteristic, to modify the extracted spectrum characteristic by applying a homothetical compression function to the extracted spectrum characteristic, and to reconstitute a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics,

wherein the synthesis device accelerates or slows down the reconstituted speech signal by modifying a duration of a time interval used in reconstituting the speech signal, and

wherein the pitch and voicing factors are greater than 0.25 and less than 4.0.

17. A method for providing auditory correction for a hearing-impaired individual, comprising:

extracting pitch, voicing, energy and spectrum characteristics of an input speech signal;

modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic;

modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic;

modifying the extracted energy characteristic by applying a energy factor to the extracted energy characteristic;

modifying the extracted spectrum characteristic by applying a spectrum factor to the extracted spectrum characteristic; and

reconstituting a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics.

18. A system for providing auditory correction for a hearing-impaired individual, comprising:

means for extracting pitch, voicing, energy and spectrum characteristics of an input speech signal;

means for modifying the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic;

means for modifying the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic;

means for modifying the extracted energy characteristic by applying an energy factor to the extracted energy characteristic;

means for modifying the extracted spectrum characteristic by applying a spectrum factor to the extracted spectrum characteristic; and

means for reconstituting a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics.

19. An apparatus for providing auditory correction for a hearing-impaired individual, comprising:

an analysis device configured to extract pitch, voicing, energy and spectrum characteristics of an input speech signal; and

a synthesis device including a processor and configured to modify the extracted pitch characteristic by multiplying a pitch factor times the extracted pitch characteristic, to modify the extracted voicing characteristic by multiplying a voicing factor times the extracted voicing characteristic, to modify the extracted energy characteristic by applying an energy factor to the extracted energy characteristic, to modify the extracted spectrum characteristic by applying a spectrum factor to the extracted spectrum characteristic, and to reconstitute a speech signal perceptible to the hearing-impaired individual based on the modified pitch, voicing, energy and spectrum characteristics.