Ratio of speech to non-speech audio such as for elderly or hearing-impaired listeners

• US 8,494,840 B2
• Filed: 02/12/2008
• Issued: 07/23/2013
• Est. Priority Date: 02/12/2007
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Muesch, Hannes
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US12/526,733
• Publication Number:
  US 20100106507A1
• Time in Patent Office: 1,988 Days
• Field of Search: 704/200.1, 704/203, 704/208, 704/206, 704/207, 704/219, 704500-504, 704/229, 704/233, 704/258, 704/217, 700/94, 370/216, 370/516
• US Class Current: 704/200.1
• CPC Class Codes: H04R 2225/43 Signal processing in hearing aids to enhance the speech intelligibility
• CPC Class Codes: H04R 25/356 Amplitude, e.g. amplitude shift or compression

Abstract

The invention relates to audio signal processing and speech enhancement. In accordance with one aspect, the invention combines a high-quality audio program that is a mix of speech and non-speech audio with a lower-quality copy of the speech components contained in the audio program for the purpose of generating a high-quality audio program with an increased ratio of speech to non-speech audio such as may benefit the elderly, hearing impaired or other listeners. Aspects of the invention are particularly useful for television and home theater sound, although they may be applicable to other audio and sound applications. The invention relates to methods, apparatus for performing such methods, and to software stored on a computer-readable medium for causing a computer to perform such methods.

Claims

1. A method for enhancing speech portions of an audio program having speech and non-speech components, comprising:

receiving the audio program having speech and non-speech components, wherein the audio program when reproduced in isolation does not have audible artifacts that listeners would deem objectionable,

receiving a copy of speech components of the audio program, wherein the copy when reproduced in isolation has audible artifacts that listeners would deem objectionable, and

combining the copy of speech components and the audio program, wherein the ratio of speech to non-speech components in the audio program is increased and the audible artifacts of the copy of speech components are masked by the audio program.

2. A method according to claim 1 wherein the combination of the copy of speech components and the audio program has substantially the same dynamic characteristics as the corresponding speech components in the audio program and the non-speech components in the audio program has a compressed dynamic range relative to the corresponding non-speech components in the audio program.

3. A method according to claim 2 wherein the level of speech components in the resulting audio program is substantially the same as the level of the corresponding speech components in the audio program.

4. A method according to claim 3 wherein the level of non-speech components in the resulting audio program increases more slowly than the level of non-speech components in the audio program increases.

5. A method according to claim 1 wherein the combining is in accordance with complementary scale factors applied, respectively, to the copy of speech components and to the audio program.

6. A method according to claim 1 wherein the combining is an additive combination of the copy of speech components and the audio program in which the copy of speech components is scaled with a scale factor α

and the audio program is scaled with the complementary scale factor (1−

α

), a having a range of 0 to 1.

7. A method according to claim 6 wherein α

is a function of the level of non-speech components of the audio program.

8. A method according to claim 7 wherein α

has a fixed maximum value α

max.

9. A method according to claim 7 wherein α

has a dynamic maximum value α

max.

10. A method according to claim 9 wherein the value α

max is based on a prediction of auditory masking caused by the main audio program.

11. A method according to claim 10 further comprising receiving α

max.

12. A method according to claim 6 wherein α

has a fixed maximum value α

max.

13. A method according to claim 6 wherein α

has a dynamic maximum value α

max.

14. A method according to claim 13 further comprising receiving α

max.

15. A method according to claim 13 wherein the value α

max is based on a prediction of auditory masking caused by the main audio program.

16. A method according to claim 1 wherein the ratio of the combination of the copy of speech components and the audio program is such that the speech components in the combined audio program has a compressed dynamic range relative to the corresponding speech components in the audio program and the non-speech components in the combined audio program has substantially the same dynamic characteristics as the corresponding non-speech components in the audio program.

23. Apparatus adapted to perform the methods of any one of claims 1, 17, 19 and 21.

24. A non-transitory computer-readable medium encoded with a computer program for causing a computer to perform the methods of any one of claims 1, 17, 19 and 21.

17. A method for assembling audio information for use in enhancing speech portions of an audio program having speech and non-speech components, comprising

obtaining an audio program having speech and non-speech components,

encoding the audio program, wherein when decoded and reproduced in isolation the program does not have audible artifacts that listeners would deem objectionable,

obtaining a copy of speech components of the audio program,

encoding the copy, wherein when reproduced in isolation the copy has audible artifacts that listeners would deem objectionable, and

transmitting or storing the encoded audio program and the encoded copy of speech components of the audio program.

18. A method according to claim 17 further comprising multiplexing the audio program and the copy of speech components of the audio program before transmitting or storing them.

19. A method for assembling audio information for use in enhancing speech portions of an audio program having speech and non-speech components, comprising

obtaining an audio program having speech and non-speech components,

encoding the audio program, wherein when decoded and reproduced in isolation the program does not have audible artifacts that listeners would deem objectionable,

deriving a prediction of the auditory masking threshold of the encoded audio program,

obtaining a copy of speech components of the audio program,

encoding the copy, wherein when reproduced in isolation the copy has audible artifacts that listeners would deem objectionable,

deriving a measure of the coding noise of the encoded copy, and

transmitting or storing the encoded audio program, the prediction of its auditory masking threshold, the encoded copy of speech components of the audio program and the measure of its coding noise.

20. A method according to claim 19 further comprising multiplexing the audio program, the prediction of its auditory masking threshold, the copy of speech components of the audio program, and the measure of its coding noise before transmitting or storing them.

21. A method for assembling audio information for use in enhancing speech portions of an audio program having speech and non-speech components, comprising

obtaining an audio program having speech and non-speech components,

encoding the audio program, wherein when decoded and reproduced in isolation the program does not have audible artifacts that listeners would deem objectionable,

deriving a prediction of the auditory masking threshold of the encoded audio program,

obtaining a copy of speech components of the audio program,

encoding the copy, wherein when reproduced in isolation the copy has audible artifacts that listeners would deem objectionable,

deriving a measure of the coding noise of the encoded copy,

deriving a parameter based on a function of the prediction of the auditory masking threshold and the measure of the coding noise, and

transmitting or storing the encoded audio program, the encoded copy of speech components of the audio program and the parameter.

22. A method according to claim 21 further comprising multiplexing the audio program, the copy of speech components of the audio program, and the parameter before transmitting or storing them.