Conversation assistance audio device personalization

• US 10,795,638 B2
• Filed: 10/19/2018
• Issued: 10/06/2020
• Est. Priority Date: 10/19/2018
• Status: Active Grant

• Current Assignee: Bose Corporation
• Original Assignee: Bose Corporation
• Inventors: Sabin, Andrew Todd, Eichfeld, Jahn Dmitri, Parker, Benjamin Davis
• Primary Examiner(s): Goins, Davetta W
• Assistant Examiner(s): Ganmavo, Kuassi A
• Application Number:
  US16/165,055
• Publication Number:
  US 20200125317A1
• Time in Patent Office: 718 Days
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04B 17/309 Measuring or estimating channel quality parameters
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 25/70 Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 3/04 for correcting frequency response

Abstract

Various implementations include conversation assistance audio devices with settings that are adjustable based upon user feedback. In some cases, the conversation assistance audio device is configured to use a set of simulated audio environments to personalize audio settings for a user. In other cases, the conversation assistance audio device is configured to iteratively adjust audio settings from a baseline set of audio settings in response to user commands.

Claims

1. A computer-implemented method of personalizing a conversation assistance audio device, the method comprising:

presenting a user of the conversation assistance audio device with a set of simulated audio environments played back at the conversation assistance audio device,

wherein each simulated audio environment comprises playback at the conversation assistance audio device of a person speaking along with playback at the conversation assistance audio device of background audio

wherein each simulated audio environment in the set of simulated audio environments

comprises background audio playback at a background noise level, wherein the background noise level in all of the simulated audio environments comprises audio playback at a signal-to-noise (SNR) variation of approximately 5 decibels (dB) SNR or less, wherein the set of simulated audio environments comprises at least two simulated audio environments;

receiving feedback from the user about each simulated audio environment in the set of simulated audio environments; and

adjusting at least one audio setting at the conversation assistance audio device based upon the feedback from the user and known audio characteristics of the set of simulated audio environments and the conversation assistance audio device;

wherein adjusting the at least one audio setting comprises selecting a best-fit audio setting for the conversation assistance audio device based upon the feedback received from the user about all of the simulated audio environments in the set of simulated audio environments;

wherein each simulated audio environment in the set of simulated audio environments comprises audio playback at a signal-to-noise (SNR) range in which audibility limits intelligibility.

2. The computer-implemented method of claim 1, wherein playback of the person speaking in each simulated audio environment in the set of simulated audio environments is at a decibel level that is greater than the background noise level.

3. The computer-implemented method of claim 1, further comprising:

providing an interface for receiving the feedback from the user, wherein the interface comprises at least one actuatable mechanism for adjusting the at least one audio setting on the conversation assistance audio device, and wherein the interface is located on the conversation assistance audio device or a computing device connected with the conversation assistance audio device.

4. The computer-implemented method of claim 3, wherein the at least one actuatable mechanism comprises at least one of:

a weighted scoring mechanism, a volume adjustor or a treble/bass adjustor.

5. The computer-implemented method of claim 3, wherein the at least one audio setting on the conversation assistance audio device is adjusted in response to the user modifying the at least one actuatable mechanism on the interface.

6. The computer-implemented method of claim 5, further comprising:

scaling the adjustment to the at least one audio setting on the conversation assistance audio device based upon a scaling factor.

7. The computer-implemented method of claim 6, wherein the scaling factor comprises an inference between audio characteristics of each of the simulated audio environments in the set of simulated audio environments and a model of real-world audio characteristics.

8. The computer-implemented method of claim 6, wherein the scaling factor comprises a positive scaling factor, and wherein scaling the adjustment to the at least one audio setting comprises positively scaling the at least one audio setting on the conversation assistance audio device.

9. The computer-implemented method of claim 1, further comprising:

creating a set of distinct audio modes based upon the feedback from the user and known audio characteristics of the set of simulated audio environments and the conversation assistance audio device.

10. The computer-implemented method of claim 9, wherein the set of distinct audio modes comprises a set of user-selectable audio modes each correlated with distinct audio filters configured to enhance audibility of a range of frequencies for specific acoustic environments.

11. The computer-implemented method of claim 9, further comprising:

switching between distinct audio modes in the set of distinct audio modes in response to detecting a change in an acoustic signature of ambient sound detected at the conversation assistance audio device.

12. The computer-implemented method of claim 1, wherein adjusting the at least one audio setting on the conversation assistance audio device comprises adjusting a directivity of a microphone array in the conversation assistance audio device, adjusting a microphone array filter on the microphone array in the conversation assistance audio device, adjusting a volume of audio provided to the user at the conversation assistance audio device, adjusting parameters controlling wide dynamic range compression or adjusting gain parameters controlling the shape of the frequency versus gain function.

13. The computer-implemented method of claim 1, further comprising:

providing a suggested audio mode for the conversation assistance audio device to the user based upon the feedback from the user and the known audio characteristics of the set of simulated audio environments and the conversation assistance audio device, prior to adjusting the at least one setting on the conversation assistance audio device.

14. The computer-implemented method of claim 1, wherein adjusting the at least one audio setting at the conversation assistance audio device comprises applying a signal processing modification in at least one of the conversation assistance audio device or a computing device connected with the conversation assistance audio device.

15. The computer-implemented method of claim 1, wherein the SNR range comprises a value between approximately −

5 and approximately 20.

16. A computer-implemented method of personalizing a conversation assistance audio device, the method comprising:

presenting a user of the conversation assistance audio device with a set of simulated audio environments played back at the conversation assistance audio device,

wherein the set of simulated audio environments comprises at least three distinct simulated audio environments,

wherein each simulated audio environment comprises playback at the conversation assistance audio device of a person speaking along with playback at the conversation assistance

audio device of background audio,

wherein each simulated audio environment in the set of simulated audio environments comprises audio playback at a signal-to-noise (SNR) range in which audibility limits intelligibility, the SNR range comprising a value between approximately −

5 and approximately 20;

receiving feedback from the user about each simulated audio environment in the set of simulated audio environments; and

adjusting at least one audio setting at the conversation assistance audio device based upon the feedback from the user and known audio characteristics of the set of simulated audio environments and the conversation assistance audio device,

wherein adjusting the at least one audio setting comprises selecting a best-fit audio setting for the conversation assistance audio device based upon the feedback received from the user about all of the simulated audio environments in the set of simulated audio environments.

17. The computer-implemented method of claim 16, wherein each simulated audio environment in the set of simulated audio environments comprises background audio playback at a background noise level, wherein the background noise level in all of the simulated audio environments comprises audio playback at a signal-to-noise (SNR) variation of approximately 5 decibels (dB) SNR or less.

18. The computer-implemented method of claim 17, wherein playback of the person speaking in each simulated audio environment in the set of simulated audio environments is at a decibel level that is greater than the background noise level.