Adaptive audio capturing

• US 9,692,379 B2
• Filed: 12/31/2012
• Issued: 06/27/2017
• Est. Priority Date: 12/31/2012
• Status: Active Grant

• Current Assignee: Spreadtrum Communications USA
• Original Assignee: Spreadtrum Communications USA
• Inventors: Jiang, Bin, Wu, Sheng, Lin, Fuhuei, Xu, Jingming
• Primary Examiner(s): CHIN, VIVIAN C
• Assistant Examiner(s): Tran, Con P
• Application Number:
  US14/758,026
• Publication Number:
  US 20150341006A1
• Time in Patent Office: 1,639 Days
• Field of Search: 381107, 381122, 381 91, 381 92, 381123, 381104, 381 56, 381110, 381111, 455 79, 455 78, 455 73
• CPC Class Codes: G10L 2021/02165 Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H03G 3/20 Automatic control H03G3/005 takes precedence; combined with volume compression or expansion H03G7/00
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

Embodiments of the present invention relate to adaptive audio capturing. A method for adaptive audio capturing is disclosed. The method comprising obtaining an audio signal through an audio channel associated with an audio capturing element on a user terminal; calculating a signal amplitude for the audio channel by processing the obtained audio signal; and determining a functionality of the audio capturing element based on the signal amplitude and a further signal amplitude for at least one further audio channel associated with at least one further audio capturing element on the user terminal. Corresponding apparatus, computer program product, and user terminal are also disclosed.

Claims

1. A method for adaptive audio capturing, the method comprising:

obtaining an audio signal through an audio channel associated with an audio capturing element on a user terminal;

detecting whether a voice activity exists on one or more audio channels of the user terminal; and

if the voice activity exists on the one or more audio channels, determining a functionality of the audio capturing element, which comprises;

calculating a signal amplitude for the audio channel by processing the obtained audio signal; and

wherein determining the functionality of the audio capturing element based on the signal amplitude and a further signal amplitude for at least one further audio channel associated with at least one further audio capturing element on the user terminal;

wherein determining the functionality of the audio capturing element comprises;

classifying the audio capturing element into a primary group of audio capturing elements used to capture foreground audio signals or an auxiliary group of audio capturing elements used to capture background audio signals;

the user terminal has a primary audio channel;

calculating the signal amplitude comprises calculating a relative amplitude of the audio channel with respect to the primary audio channel and averaging the relative amplitude of the audio channel within a time period to acquire an average relative amplitude of the audio channel;

the further signal amplitude comprises a further average relative amplitude of the at least one further audio channel with respect to the primary audio channel; and

determining the functionality of the audio capturing element comprises comparing the average relative amplitude with the further average relative amplitude;

wherein calculating the relative amplitude of the audio channel with respect to the primary audio channel comprises;

acquiring a ratio of a difference between a first intermediate signal amplitude of the audio channel and a second intermediate signal amplitude of the primary audio channel to a summation of the first intermediate signal amplitude and the second intermediate signal amplitude, wherein the first intermediate signal amplitude and the second intermediate signal amplitude are obtained by processing the obtained audio signal.

2. The method according to claim 1,

wherein calculating the signal amplitude comprises calculating a time domain amplitude or a frequency domain amplitude by processing the obtained audio signal.

3. The method according to claim 2, wherein the time domain amplitude includes a root-mean-square value;

the frequency domain amplitude includes a spectrum amplitude or a power spectrum.

4. The method according to claim 1,

wherein calculating the signal amplitude comprises calculating an average signal amplitude for the audio channel within a time interval;

the further signal amplitude comprises a further average signal amplitude for the at least one further audio channel within the time interval; and

determining the functionality of the audio capturing element comprises comparing the average signal amplitude with the further average signal amplitude.

5. The method according to claim 1,

wherein

the further signal amplitude comprises a further relative amplitude of the at least one further audio channel with respect to the primary audio channel;

and

determining the functionality of the audio capturing element comprises comparing the relative amplitude of the audio channel with respect to the primary audio channel with the further relative amplitude.

6. The method according to claim 1,

wherein averaging the relative amplitude of the audio channel within the time period comprises:

summating the relative amplitude of the audio channel over a set of frequencies within the time period.

7. An apparatus for adaptive audio capturing, the apparatus comprising:

an obtaining unit configured to obtain an audio signal through an audio channel associated with an audio capturing element of the obtaining unit;

a voice activity detecting unit configured to detect whether a voice activity exists on one or more audio channels associated with the obtaining unit;

a calculating unit configured to, if the voice activity exists on the one or more audio channels, calculate a signal amplitude for the audio channel by processing the obtained audio signal; and

a determining unit configured to determine a functionality of the audio capturing element based on the signal amplitude and a further signal amplitude for at least one further audio channel associated with at least one further audio capturing element of the obtaining unit;

wherein the determining unit comprises;

a classifying unit configured to classify the audio capturing element into a primary group of audio capturing elements used to capture foreground audio signals or an auxiliary group of audio capturing elements used to capture background audio signals;

the apparatus has a primary audio channel;

the calculating unit comprises a relative amplitude calculating unit configured to calculate a relative amplitude of the audio channel with respect to the primary audio channel; and

an averaging unit configured to average the relative amplitude of the audio channel within a time period to acquire an average relative amplitude of the audio channel;

the further signal amplitude comprises a further average relative amplitude of the at least one further audio channel with respect to the primary audio channel; and

the determining unit comprises an average relative amplitude comparing unit configured to compare the average relative amplitude with the further average relative amplitude;

wherein the relative amplitude calculating unit calculating the relative amplitude comprises acquiring a ratio of a difference between a first intermediate signal amplitude of the audio channel and a second intermediate signal amplitude of the primary audio channel to a summation of the first intermediate signal amplitude and the second intermediate signal amplitude, wherein the first intermediate signal amplitude and the second intermediate signal amplitude are obtained by processing the obtained audio signal.

8. The apparatus according to claim 7, wherein the calculating unit comprises at least one of:

a time domain amplitude calculating unit configured to calculate a time domain amplitude by processing the obtained audio signal; and

a frequency domain amplitude calculating unit configured to calculate a frequency domain amplitude by processing the obtained audio signal.

9. The apparatus according to claim 8, wherein the time domain amplitude includes a root-mean-square value;

the frequency domain amplitude includes a spectrum amplitude or a power spectrum.

10. The apparatus according to claim 7,

wherein the calculating unit comprises an average amplitude calculating unit configured to calculate an average signal amplitude for the audio channel within a time interval;

the further signal amplitude comprises a further average signal amplitude for the at least one further audio channel within the time interval; and

the determining unit comprises an average amplitude comparing unit configured to compare the average signal amplitude with the further average signal amplitude.

11. The apparatus according to claim 7,

wherein

the further signal amplitude comprises a further relative amplitude of the at least one further audio channel with respect to the primary audio channel;

and

the determining unit comprises a relative amplitude comparing unit configured to compare the relative amplitude of the audio channel with respect to the primary audio channel with the further relative amplitude.

12. The apparatus according to claim 7,

wherein the averaging unit is configured to summate the relative amplitude of the audio channel over a set of frequencies within the time period.