Portable terminal for controlling hearing aid and method therefor

• US 9,549,264 B2
• Filed: 02/14/2014
• Issued: 01/17/2017
• Est. Priority Date: 02/15/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Jung-Soo, Kim, Ik-Soo
• Primary Examiner(s): Nguyen, Duc
• Assistant Examiner(s): Nguyen, Sean H
• Application Number:
  US14/180,985
• Publication Number:
  US 20140233774A1
• Time in Patent Office: 1,068 Days
• Field of Search: 381/315
• US Class Current: 1/1
• CPC Class Codes: H04R 2225/41 Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
• CPC Class Codes: H04R 2225/55 Communication between hearing aids and external devices via a network for data exchange
• CPC Class Codes: H04R 25/30 Monitoring or testing of hearing aids, e.g. functioning, settings, battery power
• CPC Class Codes: H04R 25/552 Binaural
• CPC Class Codes: H04R 25/554 using a wireless connection, e.g. between microphone and amplifier or using Tcoils
• CPC Class Codes: H04R 25/556 External connectors, e.g. plugs or modules H04R25/607 takes precedence
• CPC Class Codes: H04R 25/558 Remote control, e.g. of amplification, frequency

Abstract

A method for controlling a hearing aid using a portable terminal is provided. The method includes taking a photo, generating a control signal to control a hearing mode of the hearing aid according to an analysis of a surrounding condition based on the photo, and transmitting the control signal to the hearing aid.

Claims

1. A method for controlling a hearing aid using an electronic device, the method comprising:

capturing an image;

detecting at least one object in the image by extracting features of the captured image;

analyzing the at least one object to determine a surrounding situation;

generating a control signal based on the determined surrounding situation to control a hearing mode of the hearing aid; and

transmitting the control signal to the hearing aid,

wherein the extracted features comprise points formed along a contour of the detected at least one object.

2. The method of claim 1,

wherein the control signal is generated by using the surrounding situation and a surrounding sound detected by the electronic device, and

wherein the control signal is used to select a proper hearing mode suitable for the surrounding situation from among multiple hearing modes that the hearing aid offers.

3. The method of claim 1, further comprising:

running an application to control change of the hearing mode,

wherein the application includes at least one of an image shoot menu to capture the image, an analysis menu to analyze the captured image, a volume menu to control a volume of the hearing aid, a threshold menu to adjust thresholds to be set for analysis of the captured image, and a hearing mode menu to select a proper hearing mode suitable for the surrounding situation.

4. The method of claim 3,

wherein the application includes at least one menu, and

wherein the at least one menu is automatically or manually established based on analysis of the surrounding situation.

5. The method of claim 3, wherein the hearing mode is newly added or removed based on the surrounding situation of the image.

6. The method of claim 1, wherein the generating of the control signal comprises:

comparing the at least one object, which has an outline formed by the extracted features, with a stored object; and

determining the surrounding situation based on the comparison.

7. The method of claim 6, wherein the features are formed along an outline of the at least one object based on at least one of brightness and color to distinguish a size and type of the at least one object.

8. The method of claim 6, further comprising:

determining whether the determined surrounding situation matches a surrounding sound detected by the electronic device.

9. The method of claim 1, wherein the hearing mode comprises at least one of silent mode, concert mode, crowd mode, landscape mode, rainy mode, and class mode.

10. The method of claim 2, wherein the control signal comprises at least one of absolute sound level information, signal envelope information, spectral content information, and directional microphone information.

11. An electronic device for controlling a hearing aid, the electronic device comprising:

a camera configured to capture an image;

a controller configured to;

detect at least one object in the image by extracting features of the image,

analyze the at least one object to determine a surrounding situation, and

generate a control signal based on the determined surrounding situation to control a hearing mode of the hearing aid; and

a transceiver configured to transmit the control signal to the hearing aid,

wherein the extracted features comprise points formed along a contour of the detected at least one object.

12. The electronic device of claim 11, further comprising:

a microphone to detect a surrounding sound to generate the control signal.

13. The electronic device of claim 11, wherein the controller is further configured to:

compare the at least one object, which has an outline formed by the extracted features, with a stored object, and

determine the surrounding situation based on the comparison.

14. The electronic device of claim 13, wherein the controller is further configured to determine whether the determined surrounding situation matches a surrounding sound detected by the electronic device.

15. The electronic device of claim 12,

wherein the control signal is generated by using the surrounding situation and the surrounding sound, and

wherein the control signal is used to select a proper hearing mode suitable for the surrounding situation from among multiple hearing modes the hearing aid offers.

16. The electronic device of claim 12, wherein the controller is further configured to:

determine whether a hearing mode determined from the surrounding sound matches the determined surrounding situation, and

if the hearing mode determined from the surrounding sound does not match the determined surrounding situation, change the hearing mode to a hearing mode corresponding to the surrounding situation.

17. A method of changing a hearing mode in a hearing aid, the method comprising:

receiving a control signal that is based on a determined surrounding situation to control the hearing mode of the hearing aid from an electronic device, the surrounding situation being determined by detecting at least one object in an image by extracting features of the image and analyzing the at least one object;

extracting a hearing mode according to an analysis of the control signal; and

changing the hearing mode of the hearing aid to the extracted hearing mode,

wherein the extracted features comprise points formed along a contour of the detected at least one object.

18. The method of claim 17, further comprising:

capturing the image;

determining if the surrounding situation matches the extracted hearing mode; and

changing the hearing mode of the hearing aid to a hearing mode suitable for the surrounding situation if the surrounding situation does not match the extracted hearing mode.

19. The method of claim 17, wherein the control signal controls a hearing mode of the hearing aid according to an analysis of the surrounding situation from the image captured by the electronic device.

20. The method of claim 17, wherein the control signal controls a hearing mode of the hearing aid according to an analysis of the image captured by the electronic device and a surrounding sound detected by the electronic device.

21. A hearing aid comprising:

a radio frequency (RF) unit configured to;

transmit to an electronic device at least one hearing mode that the hearing aid offers, and

receive from the electronic device a control signal based on a determined surrounding situation to change a hearing mode of the hearing aid to another hearing mode, the surrounding situation being determined by detecting at least one object in an image by extracting features of the image and analyzing the at least one object; and

a controller configured to;

extract a hearing mode from the control signal, and

control a hearing mode of the hearing aid to be changed to the hearing mode extracted from the control signal,

wherein the extracted features comprise points formed along a contour of the detected at least one object.

22. The hearing aid of claim 21, further comprising:

an image shoot unit configured to capture the image.

23. The hearing aid of claim 22, wherein the controller is further configured to change a hearing mode of the hearing aid to a hearing mode suitable for the surrounding situation if the determined surrounding situation does not match the extracted hearing mode.

24. The hearing aid of claim 21, wherein the control signal controls a hearing mode of the hearing aid according to an analysis of the determined surrounding situation from the image captured by the electronic device.

25. The hearing aid of claim 21, wherein the control signal controls a hearing mode of the hearing aid according to an analysis of the determined surrounding situation and a surrounding sound detected by the electronic device.

26. A method for changing a hearing mode in a hearing aid, the method comprising:

capturing an image;

detecting at least one object in the image by extracting features of the image;

determining a surrounding situation by analyzing the detected at least one object of the image;

generating a control signal based on the determined surrounding situation;

changing the hearing mode of the hearing aid according to the control signal; and

outputting a sound in the hearing mode,

wherein the extracted features comprise points formed along a contour of the detected at least one object.

27. The method of claim 26, wherein the determining of the surrounding situation comprises:

comparing the extracted features with a stored object; and

determining the surrounding situation based on the comparison.

28. The method of claim 27, wherein the features are formed along an outline of the at least one object based on at least one of brightness and color to distinguish a size and type of the at least one object.

29. The method of claim 27, further comprising:

determining if the determined surrounding situation matches a surrounding sound detected by the hearing aid.

30. The method of claim 26, wherein the hearing mode comprises at least one of silent mode, concert mode, crowd mode, landscape mode, rainy mode, and class mode.

31. The method of claim 30, wherein the hearing mode is determined based on at least one of absolute sound level information, signal envelope information, spectral content information, and directional microphone information.

32. A hearing aid comprising:

an image shoot unit configured to capture an image;

a controller configured to;

detect at least one object in the image by extracting features of the image,

analyze the at least one object to determine a surrounding situation,

generate a control signal based on the determined surrounding situation, and

control a hearing mode of the hearing aid according to the control signal; and

an output unit configured to output a sound in the hearing mode,

wherein the extracted features comprise points formed along a contour of the detected at least one object.

33. The hearing aid of claim 32, wherein the controller is further configured to compare the extracted features with a stored object.

34. The hearing aid of claim 33, wherein the controller is further configured to determine if the determined surrounding situation matches a surrounding sound detected by the hearing aid.