Listening assistance function in phone terminals

• US 7,689,248 B2
• Filed: 09/27/2005
• Issued: 03/30/2010
• Est. Priority Date: 09/27/2005
• Status: Active Grant

• Current Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Original Assignee: Nokia Corporation
• Inventors: Sjoberg, Jari, Karkkainen, Leo, Backman, Juha, Valve, Paivi
• Primary Examiner(s): Milord; Marceau
• Application Number:
  US11/238,078
• Publication Number:
  US 20070082612A1
• Time in Patent Office: 1,645 Days
• Field of Search: 455/41.2, 455/556.1, 455/569.1, 455/575.2, 455/570, 455/563, 381/74, 381/370, 381/1, 381/375, 379/38, 379/442, 704/233, 704/225
• US Class Current: 455/556.1
• CPC Class Codes: H04M 1/6008 in the transmitter circuit
• CPC Class Codes: H04M 1/6066 including a wireless connection
• CPC Class Codes: H04M 2250/02 including a Bluetooth interface
• CPC Class Codes: H04R 1/10 Earpieces; Attachments therefor ; Earphones; Monophonic headphones H04R1/28 takes precedence; stereophonic headphones H04R5/033
• CPC Class Codes: H04R 2201/107 Monophonic and stereophonic headphones with microphone for two-way hands free communication
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 25/554 using a wireless connection, e.g. between microphone and amplifier or using Tcoils
• CPC Class Codes: H04R 3/02 for preventing acoustic reaction , i.e. acoustic oscillatory feedback specially adapted for hearing aids H04R25/453
• CPC Class Codes: H04R 3/04 for correcting frequency response

Abstract

The specification and drawings present a new method, apparatus and software product for listening assistance to a user of a phone terminal with a headset or a hearing aid for selective listening of a local acoustic source in a noisy environment by said user utilizing a combination of said phone terminal and said headset. The method for the listening assistance comprises of placing the phone terminal near a desired local acoustic source, switching a mode of the phone terminal to a listening mode, providing to the headset or to the hearing aid a signal (e.g., a wireless signal) generated by the phone terminal in response to an acoustic signal from the local acoustic source, and providing to the user an output acoustic signal generated by the headset or by the hearing aid in response to that signal thus providing said listening assistance to the user.

Claims

1. A method, comprising a user placing a mobile phone terminal near a local acoustic source in an ambient noise situation presenting a hearing challenge to said user in hearing said local acoustic source;

said user switching a mode of the mobile phone terminal from a phone mode to a listening assistance mode;

said mobile phone terminal transmitting to a headset, hearing aid, or earpiece worn by said user a transmitted signal generated by the mobile phone terminal in said listening assistance mode in response to a microphone signal from a microphone of said mobile phone terminal indicative of a local acoustic signal from said local acoustic source; and

providing to the user an output acoustic signal by the headset, the hearing aid, or the earphone in response to said transmitted signal thus providing listening assistance in said ambient noise situation to the user in hearing said local acoustic signal in said listening assistance mode, wherein said switching of the mode of the mobile phone terminal to the listening assistance mode comprises;

providing a listening command signal to a mode switch block of said mobile phone terminal; and

providing, in response to said listening command signal, a switching mode signal to an audio enhancement module of the mobile phone terminal or to a listening audio enhancement module of the mobile phone terminal and providing said listening command signal optionally;

to a receiving and decoding module of the mobile phone terminal, to said microphone or to an analog-to-digital converter of the mobile phone terminal.

2. the method of claim 1, wherein said mobile phone terminal provides said transmitted signal to said headset, hearing aid or earphone worn by the user wirelessly.

3. The method of claim 1, wherein said transmitted signal generated by the mobile phone terminal is in response to a microphone signal from a plurality of microphone signals from corresponding microphones of said mobile phone terminal indicative of said local acoustic signal from said local acoustic source.

4. The method of claim 1, wherein said headset, hearing aid, or earphone provides a sidetone signal to the user for a feedback for user voice control.

5. The method of claim 1, wherein said step of providing to the headset, hearing aid or earphone the transmitted signal comprises:

providing a digital microphone signal by said analog-to-digital converter in response to said microphone signal;

providing an enhanced audio signal by an audio enhancement module or by a listening audio enhancement module in response to said digital microphone signal; and

providing said transmitted signal by a terminal encoding and transmitting block in response to said enhanced audio signal.

6. The method of claim 5, wherein said providing the enhanced audio signal by the audio enhancement module or by the listening audio enhancement module comprises at least one of:

providing an automatic gain control microphone signal by an automatic gain control block in response to said digital microphone signal;

providing a noise suppressed microphone signal by a noise suppression block in response to said automatic gain control microphone signal; and

providing said enhanced audio signal by a dynamic range control block in response to said noise suppressed microphone signal.

7. The method of claim 5, wherein said providing of the transmitted signal by the terminal encoding and transmitting block comprises:

providing an encoded enhanced audio signal by a terminal encoder in response to said enhanced audio signal; and

providing said transmitted signal by a transmitter in response to said encoded enhanced audio signal.

8. The method of claim 7, wherein said terminal encoder is a continuous variable slope delta modulation encoder or a sub-band codec encoder.

9. The method of claim 8, wherein said continuous variable slope delta modulation encoder or said sub-band codec encoder uses a short range radio frequency protocol.

10. The method of claim 1, wherein said providing to the user of said headset, hearing aid, or earphone the output acoustic signal comprises:

providing a decoded audio signal by a receiving and decoding module of said headset, hearing aid, or earphone in response to said transmitted signal;

providing a digital audio signal by a digital-to-analog converter of said headset, hearing aid, or earphone in response to said decoded audio signal, and

providing said output acoustic signal by a speaker of said headset, hearing aid, or earphone in response to said digital audio signal.

11. The method of claim 10, wherein said providing the decoded audio signal by the receiving and decoding module comprises:

providing an audio receiver signal by a receiver in response to said transmitted signal; and

providing said decoded audio signal by a terminal decoder in response to said audio receiver signal.

12. The method of claim 11, wherein said decoding module includes a continuous variable slope delta modulation decoder or a sub-band codec decoder.

13. The method of claim 12, wherein said continuous variable slope delta modulation decoder or said sub-band codec decoder uses a short range radio frequency protocol.

14. The method of claim 1, further comprising:

switching the phone terminal to a phone mode back from said listening assistance mode.

15. The method of claim 1, wherein said switching from the phone mode to the listening mode is provided by a mode switch block of the phone terminal, by a mode switch block of the headset, hearing aid, or earphone or by both a mode switch block of the phone terminal and by a mode switch block of the headset, hearing aid, or earphone.

16. A computer program product comprising:

a computer readable storage structure embodying computer program code thereon for execution by a computer processor with said computer program code wherein said code includes instructions for performing the method of claim 1.

17. A system, comprising:

a mobile phone terminal, for placing near a local acoustic source in an ambient noise situation presenting a hearing challenge to a user of the mobile phone terminal in hearing said local acoustic source, for switching to a listening assistance mode, transmitting a signal in response to a microphone signal from a microphone of said phone terminal indicative of a local acoustic signal from said local acoustic source; and

a headset, hearing aid, or earpiece, responsive to said transmitted signal, for providing to said user an output acoustic signal generated by said headset, hearing aid, or earpiece in response to said transmitted signal, thus providing listening assistance to the user in said listening assistance mode of said mobile phone terminal, wherein said switching to the listening assistance mode comprises;

providing a listening command signal to a mode switch block of said mobile phone terminal; and

providing, in response to said listening command signal, a switching mode signal to an audio enhancement module of the mobile phone terminal or to a listening audio enhancement module of the mobile phone terminal and providing said listening command signal optionally;

to a receiving and decoding module of the mobile phone terminal, to said microphone or to an analog-to-digital converter of the mobile phone terminal.

18. The system of claim 17, wherein said mobile phone terminal is wirelessly connected with said headset, hearing aid, or earpiece.

19. The system of claim 17, wherein said microphone signal comprises a plurality of microphone signals from a corresponding plurality of microphones of said mobile phone terminal indicative of said local acoustic source.

20. The system of claim 17, wherein said headset, hearing aid, or earpiece provides a sidetone signal to the user for a feedback for user voice control.

21. The system of claim 17, wherein said phone terminal uses a short range radio protocol to encode said transmitted signal and said headsets, hearing aid, or earpiece uses said short range radio protocol to decode said transmitted signal.

22. A mobile phone terminal, comprising a mode switch block, responsive to a listening command signal for switching to a listening assistance mode, for providing in an ambient noise situation presenting a hearing challenge to a user of the mobile phone terminal in hearing a local acoustic source, in response to said listening command signal, a switching mode signal for switching to said listening assistance mode;

and at least one microphone, responsive to a local acoustic signal from said local acoustic source, for generating at least one microphone signal indicative of a local acoustic signal which is used by said phone terminal for providing a transmitted signal to a headset, hearing aid, or earpiece for providing listening assistance to said user, wherein said transmitted signal is generated by said mobile phone terminal using said switching mode signal, wherein said switching of the mode of the mobile phone terminal to the listening assistance mode comprises;

providing a listening command signal to a mode switch block of said mobile phone terminal; and

providing, in response to said listening command signal, a switching mode signal to an audio enhancement module of the mobile phone terminal or to a listening audio enhancement module of the mobile phone terminal and providing said listening command signal optionally;

to a receiving and decoding module of the mobile phone terminal, to said microphone or to an analog-to-digital converter of the mobile phone terminal.

23. The mobile phone terminal of claim 22, further comprising:

an analog-to-digital converter, responsive to said microphone signal, for providing a digital microphone signal;

an audio enhancement module or a listening audio enhancement module, responsive to said digital microphone signal and to said switching mode signal, for providing an enhanced audio signal; and

a terminal encoding and transmitting block, responsive to said enhanced audio signal, for providing said transmitted signal.

24. The mobile phone terminal of claim 22, wherein said terminal encoding and transmitting block comprises:

a terminal encoder, for providing an encoded enhanced audio signal in response to said enhanced audio signal; and

a transmitter, for providing said transmitted signal in response to said encoded enhanced audio signal.

25. The mobile phone terminal of claim 24, wherein said terminal encoder is a continuous variable slope delta modulation encoder or a sub-band codec encoder.

26. The mobile phone terminal of claim 25, wherein said continuous variable slope delta modulation encoder or said sub-band codec encoder uses a short range radio protocol.