Method and apparatus for customizing audio signal processing for a user

• US 9,894,441 B2
• Filed: 11/18/2016
• Issued: 02/13/2018
• Est. Priority Date: 09/21/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Bang, Kyoungho, Kim, Yangsu, Oh, Kyungseok, Kim, Juntai, Yoon, Gunhyuk, Choi, Chulmin
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US15/355,732
• Publication Number:
  US 20170070818A1
• Time in Patent Office: 452 Days
• Field of Search: 381 56, 381 79, 381 943, 381 98, 381314, 381315, 381330, 381 57, 381 74, 381104, 455296, 455563, 600554
• CPC Class Codes: A61B 5/123 subjective methods
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 2430/03 Synergistic effects of band splitting and sub-band processing
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 25/70 Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
• CPC Class Codes: H04R 29/00 Monitoring arrangements; Testing arrangements for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/04 for correcting frequency response

Abstract

A method and an apparatus for customizing audio data processing are provided. The method includes receiving audio data through a wireless communication channel from an external device; decoding the received audio data; reducing noise of the decoded audio data; identifying hearing characteristics of a user by testing hearing abilities of the user at a plurality of frequency bands; adjusting a dynamic range of each of the plurality of frequency bands based on the hearing characteristics; processing the noise-reduced audio data based on the adjusted dynamic range of each of the plurality of frequency bands; and outputting the processed audio data.

Claims

1. A method for customizing audio data processing, the method comprising:

receiving audio data through a wireless communication channel from an external device;

decoding the received audio data;

reducing noise of the decoded audio data;

identifying hearing characteristics of a user by testing hearing abilities of the user at a plurality of frequency bands;

adjusting a dynamic range of each of the plurality of frequency bands based on the hearing characteristics;

processing the noise-reduced audio data based on the adjusted dynamic range of each of the plurality of frequency bands; and

outputting the processed audio data.

2. The method of claim 1, wherein reducing the noise of the decoded audio data comprises:

determining whether or not audio quality optimization is to be performed;

if the audio quality optimization is not to be performed, suppressing the noise included in the decoded audio data; and

if the audio quality optimization is to be performed, suppressing the noise included in the decoded audio data and removing noise outside of the dynamic range from the decoded audio data.

3. The method of claim 1, wherein testing the hearing abilities comprises identifying an auditory threshold for each of the plurality of frequency bands.

4. The method of claim 3, wherein identifying the auditory threshold for each of the plurality of frequency bands comprises:

selecting one of the plurality of frequency bands as a test frequency;

selecting a test sound pressure from a test sound pressure region of the test frequency;

outputting a test sound corresponding to the selected test frequency and the selected test sound pressure;

receiving a user response to the test sound;

dividing the test sound pressure region of the test frequency into an auditory threshold absence region and an auditory threshold presence region, based on the received user response and the selected test sound pressure;

determining if the auditory threshold presence region is within a predetermined minimum range; and

determining the auditory threshold based on the auditory threshold presence region, when the auditory threshold presence region is within the predetermined minimum range.

5. The method of claim 4, wherein when the auditory threshold presence region is not within the predetermined minimum range, testing the hearing abilities of the user further comprises:

repeatedly reconfiguring the auditory threshold presence region as a reconfigured test sound pressure region of the test frequency, selecting a second test sound pressure from the reconfigured test sound pressure region of the test frequency, outputting a second test sound corresponding to the selected test frequency and the selected second test sound pressure, receiving a second user response to the second test sound, and dividing the reconfigured test sound pressure region of the test frequency into the auditory threshold absence region and the auditory threshold presence region, based on the received second user response and the selected second test sound pressure, until the auditory threshold presence region is within the predetermined minimum range; and

determining the auditory threshold based on the auditory threshold presence region, when the auditory threshold presence region is within the predetermined minimum range.

6. The method of claim 4, wherein determining the auditory threshold based on the auditory threshold presence region comprises setting the auditory threshold as one of a lower limit of the auditory threshold presence region, an upper limit of the auditory threshold presence region, and an average of the lower limit of the auditory threshold presence region and the upper limit of the auditory threshold presence region.

7. The method of claim 4, wherein determining the auditory threshold based on the auditory threshold presence region comprises setting the auditory threshold as one of a lower limit of the auditory threshold presence region, an upper limit of the auditory threshold presence region, and an average of the lower limit of the auditory threshold presence region and the upper limit of the auditory threshold presence region.

8. The method of claim 1, wherein adjusting the dynamic range of each of the plurality of frequency bands comprises adjusting one of an upper limit and a lower limit of the dynamic range of each of the plurality of frequency bands, based on the auditory threshold for each of the plurality of frequency bands, respectively.

9. The method of claim 8, further comprising receiving a user input to adjust the decoded audio data based on the adjusted dynamic range of each of the plurality of frequency bands.

10. An apparatus for customizing audio data processing, the apparatus comprising:

a radio communication unit which receives audio data through a wireless communication channel from an external device;

a speaker; and

a controller configured to decode the audio data received by the radio communication unit, reduce noise of the decoded audio data, test hearing characteristics of a user at a plurality of frequency bands, adjust a dynamic range of each of the plurality of frequency bands based on results of the testing, adjust the noise-reduced audio data based on the adjusted dynamic range of each of the plurality of frequency bands, and output the adjusted audio data to the user via the speaker.

11. The apparatus of claim 10, wherein the controller is further configured to reduce the noise of the decoded audio data by:

determining whether or not audio quality optimization is to be performed;

if the audio quality optimization is not to be performed, suppressing the noise included in the decoded audio data; and

if the audio quality optimization is to be performed, suppressing the noise included in the decoded audio data and removing noise outside of the dynamic range from the decoded audio data.

12. The apparatus of claim 10, wherein the results of the testing comprise an auditory threshold for each of the plurality of frequency bands.

13. The apparatus of claim 12, wherein the controller is configured to test the hearing characteristics of the user by:

selecting one of the plurality of frequency bands as a test frequency;

selecting a test sound pressure from a test sound pressure region of the test frequency;

outputting a test sound corresponding to the selected test frequency and the selected test sound pressure;

receiving a user response to the test sound;

dividing the test sound pressure region of the test frequency into an auditory threshold absence region and an auditory threshold presence region, based on the received user response and the selected test sound pressure;

determining if the auditory threshold presence region is within a predetermined minimum range; and

determining the auditory threshold based on the auditory threshold presence region, when the auditory threshold presence region is within the predetermined minimum range.

14. The apparatus of claim 13, wherein when the auditory threshold presence region is not within the predetermined minimum range, the controller is configured to test the hearing characteristics of the user by:

repeatedly reconfiguring the auditory threshold presence region as a reconfigured test sound pressure region of the test frequency, selecting a second test sound pressure from the reconfigured test sound pressure region of the test frequency, outputting a second test sound corresponding to the selected test frequency and the selected second test sound pressure, receiving a second user response to the second test sound, and dividing the reconfigured test sound pressure region of the test frequency into the auditory threshold absence region and the auditory threshold presence region, based on the received second user response and the selected second test sound pressure, until the auditory threshold presence region is within the predetermined minimum range; and

determining the auditory threshold based on the auditory threshold presence region, when the auditory threshold presence region is within the predetermined minimum range.

15. The apparatus of claim 13, wherein the controller is configured to determine the auditory threshold based on the auditory threshold presence region by setting the auditory threshold as one of a lower limit of the auditory threshold presence region, an upper limit of the auditory threshold presence region, and an average of the lower limit of the auditory threshold presence region and the upper limit of the auditory threshold presence region.

16. The apparatus of claim 13, wherein the controller is configured to determine the auditory threshold based on the auditory threshold presence region by setting the auditory threshold as one of a lower limit of the auditory threshold presence region, an upper limit of the auditory threshold presence region, and an average of the lower limit of the auditory threshold presence region and the upper limit of the auditory threshold presence region.

17. The apparatus of claim 10, wherein controller is configured to adjust the dynamic range of each of the plurality of frequency bands by adjusting one of an upper limit and a lower limit of the dynamic range of each of the plurality of frequency bands, based on the auditory threshold for each of the plurality of frequency bands, respectively.

18. The apparatus of claim 10, further comprising an input device configured to receive a user input commanding the controller to adjust the decoded audio data based on the adjusted dynamic range of each of the plurality of frequency bands.