Multimedia playing apparatus and method for outputting modulated sound according to hearing characteristic of user

• US 9,420,381 B2
• Filed: 01/14/2013
• Issued: 08/16/2016
• Est. Priority Date: 01/13/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Jong-min, Bae, Sang-uk, Uhm, Jun-whon, Kim, Dong-wook, Sohn, Jun-il, Ku, Yun-seo, Kim, Jong-jin, Lee, Heun-chul
• Primary Examiner(s): Dinh, Tan X
• Application Number:
  US13/740,798
• Publication Number:
  US 20130182855A1
• Time in Patent Office: 1,310 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 5/121 evaluating hearing capacity
• CPC Class Codes: H04R 2205/041 Adaptation of stereophonic signal reproduction for the hearing impaired
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2430/03 Synergistic effects of band splitting and sub-band processing
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04R 25/30 Monitoring or testing of hearing aids, e.g. functioning, settings, battery power
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S

Abstract

Multimedia playing apparatuses and methods of measuring hearing characteristics of a user and outputting a sound modulated according to the hearing characteristics of the user are provided. A multimedia playing apparatus includes a sound output unit configured to output a sound comprising of one or more phonemes, and a user interface configured to receive a user response to the phonemes. The multimedia playing apparatus further includes a processor configured to acquire hearing characteristics of a user based on the user response, and determine an output level and/or an output time of the sound for each of frequency bands based on the hearing characteristics of the user. The sound output unit is further configured to output the sound according to the output level and/or the output time of the sound for each of the frequency bands.

Claims

1. A multimedia playing apparatus comprising:

a sound output unit configured to output a sound comprising one or more phonemes;

a user interface configured to receive a user response to the phonemes; and

a processor configured to

acquire hearing characteristics of a user based on the user response, and

determine an output level and an output time of the sound for each of frequency bands based on the hearing characteristics of the user,

wherein

the sound output unit is further configured to output the sound according to the output level and the output time of the sound for each of the frequency bands,

the sound output unit comprises two or more channels,

the processor is further configured to

acquire hearing characteristics of a right ear and a left ear, respectively, based on the user response,

determine the output level of the sound for each of the frequency bands for each of the channels based on the respective hearing characteristics of the right ear and the left ear,

compare the hearing characteristics of the right ear and the left ear with each other, and

determine an output level difference and an output time difference between the channels for each of the frequency bands based on a result of the comparison, and

the sound output unit is further configured to output the sound according to the output level difference and the output time difference between the channels for each of the frequency bands.

2. The multimedia playing apparatus of claim 1, wherein:

the sound output is further configured to output the sound toward the user from a direction through one or more of the channels;

the user response comprises a direction of the sound that is input by the user; and

the processor is further configured to compare the direction of the output sound and the direction of the sound that is input by the user to determine whether the user recognizes the direction of the output sound.

3. The multimedia playing apparatus of claim 2, wherein the processor is further configured to:

determine an output time difference between the channels for each of the frequency bands based on whether the user recognizes the direction of the output sound.

4. The multimedia playing apparatus of claim 1, wherein:

each of the hearing characteristics of the right ear and the left ear comprise a hearing threshold of a corresponding ear for each of the frequency bands; and

the processor is further configured to

determine a frequency band comprising the hearing threshold exceeding a predetermined permissible range based on the hearing characteristics of the right ear and the left ear, and

compare the hearing characteristics of the right ear and the left ear with each other at the frequency band.

5. The multimedia playing apparatus of claim 4, wherein the processor is further configured to:

increase the output level difference between the channels for a high frequency band if the frequency band is a low frequency band.

6. The multimedia playing apparatus of claim 4, wherein the processor is further configured to:

increase the output time difference between the channels for a low frequency band if the frequency band is a high frequency band.

7. The multimedia playing apparatus of claim 1, wherein:

the user interface comprises a sound level meter configured to measure a sound pressure of the sound;

the processor is further configured to calibrate the sound pressure of the sound based on the measured sound pressure; and

the sound output unit is further configured to output the sound according to the calibrated sound pressure.

8. The multimedia playing apparatus of claim 1, further comprising:

a memory configured to store the hearing characteristics of the user, and the output level of the sound for each of the frequency bands.

9. The multimedia playing apparatus of claim 1, further comprising:

a memory configured to store a history of hearing characteristics of each user,

wherein the processor is further configured to acquire the hearing characteristics of the user based on the history of the hearing characteristics of the user.

10. The multimedia playing apparatus of claim 1, wherein:

the processor is further configured to acquire a hearing threshold of the user for the phonemes; and

the hearing characteristics of the user comprise a hearing threshold of the user for each of the frequency bands corresponding to the phonemes.

11. The multimedia playing apparatus of claim 1, further comprising:

a memory configured to store groups of phonemes, the phonemes being classified into the groups based on peak frequencies of the phonemes.

12. A method of outputting a sound according to hearing characteristics of a user in a multimedia playing apparatus, the method comprising:

outputting a sound comprising one or more phonemes;

receiving a user response to the phonemes;

acquiring, at a processing device and with respect to a medical reference range determining normality of hearing ability, the hearing characteristics of the user based on the user response;

determining, at the processing device, an output level and an output time of the sound for each of frequency bands based on the hearing characteristics of the user;

outputting the sound according to the output level and the output time of the sound for each of the frequency bands so as to compensate loss of normality of hearing of the user;

outputting the sound through two or more channels;

acquiring hearing characteristics of a right ear and a left ear, respectively, based on the user response;

determining the output level of the sound for each of the frequency bands for each of the channels based on the respective hearing characteristics of the right ear and the left ear;

comparing the hearing characteristics of the right ear and the left ear with each other;

determining an output level difference and an output time difference between the channels for each of the frequency bands based on a result of the comparison; and

outputting the sound according to the output level difference and the output time difference between the channels for each of the frequency bands.

13. The method of claim 12, wherein:

each of the hearing characteristics of the right ear and the left ear comprise a hearing threshold of a corresponding ear for each of the frequency bands; and

the method further comprises

determining a frequency band comprising the hearing threshold exceeding the medical reference range based on the hearing characteristics of the right ear and the left ear, and

comparing the hearing characteristics of the right ear and the left ear with each other at the frequency band.

14. The method of claim 12, further comprising

measuring a sound pressure of the sound;

calibrating the sound pressure of the sound based on the measured sound pressure; and

outputting the sound according to the calibrated sound pressure.

15. The method of claim 12, further comprising:

acquiring a hearing threshold of the user for the phonemes,

wherein the hearing characteristics of the user comprise a hearing threshold of the user for each of the frequency bands corresponding to the phonemes.

16. A non-transitory computer-readable storage medium storing a program comprising instructions to cause a computer to perform the method of claim 12.

17. The method of claim 12, further comprising:

outputting the sound toward the user from a direction through one or more channels of the multimedia playing apparatus;

receiving the user response comprising a direction of the sound that is input by the user; and

comparing the direction of the output sound and the direction of the sound that is input by the user to determine whether the user recognizes the direction of the output sound.

18. The method of claim 17, further comprising:

determining an output time difference between the channels for each of frequency bands based on whether the user recognizes the direction of the output sound; and

outputting the sound according to the output time difference between the channels for each of the frequency bands.