Audio enhancement for head-mounted speakers

• US 10,009,705 B2
• Filed: 01/12/2017
• Issued: 06/26/2018
• Est. Priority Date: 01/19/2016
• Status: Active Grant

• Current Assignee: Boomcloud 360, Inc.
• Original Assignee: Boomcloud 360, Inc.
• Inventors: Seldess, Zachary, Tracey, James, Kraemer, Alan
• Primary Examiner(s): Bernardi, Brenda C
• Application Number:
  US15/404,948
• Publication Number:
  US 20170230777A1
• Time in Patent Office: 530 Days
• CPC Class Codes: H04R 3/04 for correcting frequency response
• CPC Class Codes: H04R 3/14 Cross-over networks
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04S 1/005 For headphones
• CPC Class Codes: H04S 2400/13 Aspects of volume control, not necessarily automatic, in stereophonic sound systems
• CPC Class Codes: H04S 2420/07 Synergistic effects of band splitting and sub-band processing
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Embodiments herein are primarily described in the context of a system, a method, and a non-transitory computer readable medium for producing a sound with enhanced spatial detectability and a crosstalk simulation. The audio processing system receives a left and right input channel of an audio input signal, and performs an audio processing to generate an output audio signal. The system generates left and right spatially enhanced signals by gain adjusting side subband components and mid subband components of the left and right input channels. The audio processing system generates left and right crosstalk channels such as by applying a filter and time delay to the left and right input channels, and mixes the spatially enhanced channels with the crosstalk channels. In some embodiments, the system includes high/low frequency enhancement channels and passthrough channels derived from the input channels, which can be mixed with the output audio signal.

Claims

1. A method, comprising:

receiving an input audio signal comprising a left input channel and a right input channel;

generating a spatially enhanced left channel and a spatially enhanced right channel by gain adjusting side subband components and mid subband components of the left and right input channels;

generating a left crosstalk channel by filtering and time delaying the left input channel;

generating a right crosstalk channel by filtering and time delaying the right input channel;

generating a left output channel by mixing the spatially enhanced left channel and the right crosstalk channel; and

generating a right output channel by mixing the spatially enhanced right channel and the left crosstalk channel.

2. The method of claim 1, wherein:

the method further includes generating a left low frequency channel and a right low frequency channel by;

applying a first band-pass filter to the left input channel and the right input channel;

applying a second band-pass filter to output of the first band-pass filter; and

applying a gain to output of the second band-pass filter;

generating the left output channel includes mixing the spatially enhanced left channel, the right crosstalk channel, and the left low frequency channel; and

generating the right output channel includes mixing the spatially enhanced right channel, the left crosstalk channel, and the right low frequency channel.

3. The method of claim 2, wherein the first and second band-pass filters each have a center frequency and adjustable quality (Q) factor.

4. The method of claim 1, wherein:

the method further includes generating a left high frequency channel and a right high frequency channel by;

applying a high-pass filter to the left input channel and the right input channel; and

applying a gain to output of the high-pass filter;

generating the left output channel includes mixing the spatially enhanced left channel, the right crosstalk channel, and the left high frequency channel; and

generating the right output channel includes mixing the spatially enhanced right channel, the left crosstalk channel, and the right high frequency channel.

5. The method of claim 4, wherein the high-pass filter is a second order Butterworth high-pass filter.

6. The method of claim 1, wherein:

the method further includes generating a left passthrough channel and a right passthrough channel by applying a gain to the left and right input channels;

generating the left output channel includes mixing the spatially enhanced left channel, the right crosstalk channel, and the left passthrough channel; and

generating the right output channel includes mixing the spatially enhanced right channel, the left crosstalk channel, and the right passthrough channel.

7. The method of claim 1, wherein:

the method further includes generating a mid channel by;

adding the left input channel and the right input channel; and

applying a gain to the added left and right input channels;

generating the left output channel includes mixing the spatially enhanced left channel, the right crosstalk channel, and the mid channel; and

generating the right output channel includes mixing the spatially enhanced right channel, the left crosstalk channel, and the mid channel.

8. The method of claim 1, wherein generating the spatially enhanced left channel and the spatially enhanced right channel by gain adjusting side subband components and mid subband components of the left and right input channels includes:

separating the left input channel into left subband components, each of the left subband components corresponding to one frequency band from a group of frequency bands;

separating a right input channel into right subband components, each of the right subband components corresponding to one frequency band from the group of frequency bands;

generating the mid subband and the side subband components from the left and right subband components;

adjusting a gain of the side subband components relative to the mid subband components; and

recombining the gain adjusted mid subband and side subband components to generate the left spatially enhanced channel and the right spatially enhanced channel.

9. The method of claim 1, wherein:

generating the spatially enhanced left channel and the spatially enhanced right channel includes applying a first gain to the side subband components and mid subband components of the left and right input channels;

generating the left crosstalk channel includes applying a second gain to the filtered and time delayed left input channel;

generating the right crosstalk channel includes applying the second gain to the filtered and time delayed right input channel;

the method further includes;

generating a left low frequency channel and a right low frequency channel by;

applying a first band-pass filter to the left input channel and the right input channel;

applying a second band-pass filter to output of the first band-pass filter; and

applying a third gain to output of the second band-pass filter;

generating a left high frequency channel and a right high frequency channel by;

applying a high-pass filter to the left input channel and the right input channel; and

applying a fourth gain to output of the high-pass filter;

generating a left passthrough channel and a right passthrough channel by applying a fifth gain to the left and right input channels; and

generating a mid channel by;

adding the left input channel and the right input channel; and

applying a sixth gain to the added left and right input channels;

generating the left output channel includes mixing the spatially enhanced left channel, the right crosstalk channel, the left low frequency channel, the left high frequency channel, the left passthrough channel, and the mid channel; and

generating the right output channel includes mixing the spatially enhanced right channel, the left crosstalk channel, the right low frequency channel, the right high frequency channel, the right passthrough channel, and the mid channel.

10. The method of claim 9, wherein:

the first gain is in the range of a −

12 to 6 dB gain;

the second gain is in the range of a −

infinity to 0 dB gain;

the third gain is in the range of a 0 to 20 dB gain;

the fourth gain is in the range of a 0 to 20 dB gain;

the fifth gain is in the range of a −

infinity to 0 dB gain; and

the sixth gain is in the range of a −

infinity to 0 dB gain.

11. An audio processing system, comprising:

a subband spatial enhancer configured to generate a spatially enhanced left channel and a spatially enhanced right channel by gain adjusting side subband components and mid subband components of a left input channel and a right input channel;

a crosstalk simulator configured to;

generate a left crosstalk channel by filtering and time delaying the left input channel; and

generate a right crosstalk channel by filtering and time delaying the right input channel; and

a mixer configured to;

generate a left output channel by mixing the spatially enhanced left channel and the right crosstalk channel; and

generate a right output channel by mixing the spatially enhanced right channel and the left crosstalk channel.

12. The system of claim 11, wherein:

the system further includes a frequency booster configured to generate a left low frequency channel and a right low frequency channel, the frequency booster including;

a first band-pass filter configured to filter the left input channel and the right input channel;

a second band-pass filter configured to filter output of the first band-pass filter; and

a low frequency filter gain to apply a gain to output of the second band-pass filter;

the mixer configured to generate the left output channel includes the mixer being configured to mix the spatially enhanced left channel, the right crosstalk channel, and the left low frequency channel; and

the mixer configured to generate the right output channel includes the mixer being configured to mix the spatially enhanced right channel, the left crosstalk channel, and the right low frequency channel.

13. The system of claim 12, wherein the first and second band-pass filters each have a center frequency and adjustable quality (Q) factor.

14. The system of claim 11, wherein:

the system further includes a frequency booster configured to generate a left high frequency channel and a right high frequency channel, the frequency booster including;

a high-pass filter configured to filter the left input channel and the right input channel; and

a high frequency filter gain to apply a gain to output of the high-pass filter;

the mixer configured to generate the left output channel includes the mixer being configured to mix the spatially enhanced left channel, the right crosstalk channel, and the left high frequency channel; and

the mixer configured to generate the right output channel includes the mixer being configured to mix the spatially enhanced right channel, the left crosstalk channel, and the right high frequency channel.

15. The system of claim 14, wherein the high-pass filter is a second order Butterworth high-pass filter.

16. The system of claim 11, wherein:

the system further includes a passthrough configured to generate a left passthrough channel and a right passthrough channel, the passthrough including a passthrough gain configured to apply a gain to the left and right input channels;

the mixer configured to generate the left output channel includes the mixer being configured to mix the spatially enhanced left channel, the right crosstalk channel, and the left passthrough channel; and

the mixer configured to generate the right output channel includes the mixer being configured to mix the spatially enhanced right channel, the left crosstalk channel, and the right passthrough channel.

17. The system of claim 11, wherein:

the system further includes a passthrough configured to generate a mid channel, the passthrough including;

a combiner configured to add the left input channel and the right input channel; and

a mid gain configured to apply a gain to the added left and right input channels;

the mixer configured to generate the left output channel includes the mixer being configured to mix the spatially enhanced left channel, the right crosstalk channel, and the left mid channel; and

the mixer configured to generate the right output channel includes the mixer being configured to mix the spatially enhanced right channel, the left crosstalk channel, and the right mid channel.

18. The system of claim 11, wherein the subband spatial enhancer configured to generate the spatially enhanced left channel and the spatially enhanced right channel by gain adjusting side subband components and mid subband components of the left input channel and the right input channel includes the subband spatial enhancer being configured to:

separate the left input channel into left subband components, each of the left subband components corresponding to one frequency band from a group of frequency bands;

separate a right input channel into right subband components, each of the right subband components corresponding to one frequency band from the group of frequency bands;

generate the mid subband and the side subband components from the left and right subband components;

adjust a gain of the side subband components relative to the mid subband components; and

recombine the gain adjusted mid subband and side subband components to generate the left spatially enhanced channel and the right spatially enhanced channel.

19. The system of claim 11, wherein:

the subband spatial enhancer configured to generate the spatially enhanced left channel and the spatially enhanced right channel includes the subband spatial enhancer being configured to apply a first gain to the side subband components and mid subband components of the left and right input channels;

the crosstalk simulator configured to generate the left crosstalk channel includes the crosstalk simulator being configured to apply a second gain to the filtered and time delayed left input channel;

the crosstalk simulator configured to generate the right crosstalk channel includes the crosstalk simulator being configured to apply the second gain to the filtered and time delayed right input channel;

the system further includes;

a frequency booster configured to generate a left low frequency channel, a right low frequency channel, a left high frequency channel, and a right high frequency channel, the frequency booster including;

a first band-pass filter configured to filter the left input channel and the right input channel;

a second band-pass filter configured to filter output of the first band-pass filter;

a low frequency filter gain configured to apply a third gain to output of the second band-pass filter to generate the left low frequency channel and the right low frequency channel;

a high-pass filter configured to filter the left input channel and the right input channel; and

a high frequency filter gain configured to apply a fourth gain to output of the high-pass filter to generate the left high frequency channel and the right high frequency channel;

a passthrough configured to generate a left passthrough channel, a right passthrough channel, and a mid channel, the passthrough including;

a passthrough gain configured to apply a fifth gain to the left and right input signals to generate the left passthrough channel and the right passthrough channel;

a combiner configured to add the left input channel and the right input channel; and

a mid gain configured to apply a sixth gain to the added left and right input channels to generate the left mid channel and the right mid channel;

the mixer configured to generate the left output channel includes the mixer being configured to mix the spatially enhanced left channel, the right crosstalk channel, the left low frequency channel, the left high frequency channel, the left passthrough channel, and the mid channel; and

the mixer configured to generate the right output channel includes the mixer being configured to mix the spatially enhanced right channel, the left crosstalk channel, the right low frequency channel, the right high frequency channel, the right passthrough channel, and the mid channel.

20. A non-transitory computer readable medium configured to store program code, the program code comprising instructions that when executed by a processor cause the processor to:

receive an input audio signal comprising a left input channel and a right input channel;

generate a spatially enhanced left channel and a spatially enhanced right channel by gain adjusting side subband components and mid subband components of the left and right input channels;

generate a left crosstalk channel by filtering and time delaying the left input channel;

generate a right crosstalk channel by filtering and time delaying the right input channel;

generate a left output channel by mixing the spatially enhanced left channel and the right crosstalk channel; and

generate a right output channel by mixing the spatially enhanced right channel and the left crosstalk channel.