Near-end listening intelligibility enhancement

• US 9,961,441 B2
• Filed: 06/25/2014
• Issued: 05/01/2018
• Est. Priority Date: 06/27/2013
• Status: Active Grant

• Current Assignee: DSP Group Ltd. (Synaptics Incorporated)
• Original Assignee: DSP Group Ltd. (Synaptics Incorporated)
• Inventors: Chen, Yaakov
• Primary Examiner(s): Elahee, Md S
• Application Number:
  US14/314,064
• Publication Number:
  US 20150003628A1
• Time in Patent Office: 1,406 Days
• Field of Search: 381 58, 381 7114, 381 96, 3793901, 700 94, 345174, 704233, 704205, 704500, 704207, 704226
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0316 by changing the amplitude
• CPC Class Codes: G10L 21/043 by changing speed
• CPC Class Codes: H04R 2410/05 Noise reduction with a separate noise microphone
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 3/002 Damping circuit arrangements for transducers, e.g. motional feedback circuits

Abstract

Methods and systems are provided for enhancing listening intelligibility in electronic devices. A vibration sensor may be used to generate feedback corresponding to vibrations caused by the outputting of the acoustic signals, and the feedback may be used in adjusting the listening intelligibility stage. In some instances, a microphone may be used to obtain audio input corresponding to ambient noise affecting intelligibility of audio outputted, as acoustic signals, via a speaker, to a user. The audio input may be used to control a listening intelligibility stage applied to audio content when the acoustic signals are generated for outputting by the speaker. In particular, the listening intelligibility stage may comprise application of dynamic time-scale modifications.

Claims

1. A method, comprising:

outputting acoustic signals via a speaker of an electronic device;

obtaining, via a microphone, input audio corresponding to ambient noise in proximity of a user of the electronic device;

processing the input audio to determine ambient noise data;

adaptively controlling the outputting of the acoustic signals, based on the determined ambient noise data, to enhance listening intelligibility;

wherein the adaptively controlling of the outputting of the acoustic signals comprises applying dynamic time-scale modification to the acoustic signals; and

wherein the applying of the dynamic time-scale modification comprises adjustments at least one of a speed and a duration of the acoustic signals without affecting a pitch of the acoustic signals.

2. The method of claim 1, comprising determining acoustic control data;

wherein the acoustic control data comprise parameters related to an indication of speech intelligibility.

3. The method according to claim 1, comprising obtaining, via a vibration sensor of the electronic device, vibration sensor signals corresponding to outputting of the acoustic signals by the speaker of the electronic device;

and wherein the adaptively controlling the outputting of the acoustic signals is based on the determined ambient noise data and the vibration sensor signals.

4. The method of claim 3, comprising determining acoustic control data;

and adaptively controlling the outputting of the acoustic signals based on the determined acoustic control data by using the acoustic control data to estimate acoustic signals experienced by the user.

5. The method of claim 3, comprising determining acoustic control data;

and detecting, based on the acoustic control data, distortion in one or more particular frequencies.

6. The method of claim 5, wherein the adaptive controlling comprises amplifying frequencies in the outputted acoustic signals other than the one or more particular frequencies.

7. The method of claim 5, comprising generating and/or adjusting, based on the detected distortion, one or more parameters for use in blocking expected distortion in the outputted acoustic signals.

8. The method according to claim 3 wherein the vibration sensor signals do not include or include only a negligible amount of signals that are part of the input audio.

9. The method according to claim 3 wherein the acoustic signals represent speech and wherein the applying of the dynamic time-scale modification comprises dynamically varying a degree of slowing down the speech in proportion to a detected ambient noise.

10. The method according to claim 3 comprises shortening a duration of non-speech parts of the acoustic signals.

11. The method of claim 3, comprising determining acoustic control data;

wherein the acoustic control data comprise parameters related to a metric of difference between the outputted acoustic signals and the vibration sensor signals.

12. The method of claim 3, comprising determining acoustic control data;

wherein the acoustic control data comprise parameters related to one or more of distortion level and distortion associated frequencies.

13. The method according to claim 1 wherein the applying of the dynamic time-scale modification comprises adjustments of the speed and the duration of the acoustic signals without affecting the pitch of the acoustic signals.

14. The method according to claim 1 wherein the applying of the dynamic time-scale modification comprises adjustments of the speed but not the duration of the acoustic signals without affecting the pitch of the acoustic signals.

15. The method according to claim 1 wherein the applying of the dynamic time-scale modification comprises adjustments of the duration but not the speed of the acoustic signals without affecting the pitch of the acoustic signals.

16. A system, comprising:

a speaker of an electronic device that is configured to output acoustic signals;

a microphone that is configured to obtain input audio corresponding to ambient noise in proximity of a user of the electronic device;

at least one processor that is configured to process the input audio to determine ambient noise data; and

an output controller circuit that is configured to adaptively control the outputting of the acoustic signals based on the determined ambient noise data, to enhance listening intelligibility;

wherein the adaptively control of the outputting of the acoustic signals comprises applying dynamic time-scale modification to the acoustic signals; and

wherein the applying of the dynamic time-scale modification comprises adjustments at least one of a speed and a duration of the acoustic signals without affecting a pitch of the acoustic signals.

17. The system of claim 16, wherein the at least one processor is configured to determine acoustic control data;

wherein the acoustic control data comprise parameters related to an indication of speech intelligibility.

18. The system according to claim 16, comprising a vibration sensor that is configured to obtain vibration sensor signals corresponding to outputting of the acoustic signals by the speaker of the electronic device;

and wherein the output controller circuit is configured to adaptively control the outputting of the acoustic signals based on the determined ambient noise data and the vibration sensor signals.

19. The system of claim 18, wherein the at least one processor is configured to determine acoustic control data;

wherein the output controller circuit operable to adaptively control the outputting of the acoustic signals based on the determined acoustic control data by using a sensory base data to estimate the acoustic signals experienced by the user.

20. The system of claim 18, wherein the at least one processor is configured to determine acoustic control data;

wherein the at least one processor is operable to detect, based on the acoustic control data, distortion in one or more particular frequencies.

21. The system of claim 20, wherein the output controller circuit is configured to amplify frequencies in the outputted acoustic signals other than the one or more particular frequencies.

22. The system of claim 20, wherein the output controller circuit is operable to generate and/or adjust, based on the detected distortion, one or more parameters for use in blocking expected distortion in the outputted acoustic signals.

23. The system of claim 18, that is operable to determine acoustic control data based on the input audio obtained via the microphone and the vibration sensor signals.

24. The system according to claim 18 wherein the vibration sensor signals do not include or includes a negligible amount of signals that are part of the input audio.

25. The system according to claim 18 that is configured to apply the dynamic time-scale modification by dynamically varying a degree of slowing down the speech in proportion to a detected ambient noise.

26. The system according to claim 18 that is configured to apply the dynamic time-scale modification by shortening a duration of non-speech parts of the acoustic signals.

27. The system of claim 18, the at least one processor is configured to determine acoustic control data;

wherein the acoustic control data comprise parameters related to a metric of difference between the outputted acoustic signals and the vibration sensor signals.

28. The system of claim 18, the at least one processor is configured to determine acoustic control data;

wherein the acoustic control data comprise parameters related to one or more of distortion level and distortion associated frequencies.

29. The system according to claim 16 wherein the output controller circuit is configured to adjust the speed and the duration of the acoustic signals without affecting the pitch of the acoustic signals.

30. The system according to claim 16 wherein the output controller circuit is configured to adjust the speed but not the duration of the acoustic signals without affecting the pitch of the acoustic signals.

31. The system according to claim 16 wherein the output controller circuit is configured to adjust the duration but not the speed of the acoustic signals without affecting the pitch of the acoustic signals.