Sound source characteristic determining device

• US 8,290,178 B2
• Filed: 01/25/2008
• Issued: 10/16/2012
• Est. Priority Date: 07/26/2005
• Status: Active Grant

• Current Assignee: Nihon Onkyo Engineering Co., Ltd. (Hibino Corp.)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Nakadai, Kazuhiro, Tsujino, Hiroshi, Nakajima, Hirofumi
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): GRAHAM, ANDREW R
• Application Number:
  US12/010,553
• Publication Number:
  US 20080199024A1
• Time in Patent Office: 1,726 Days
• Field of Search: 381/56, 381/92, 367/121, 367/124, 367/129
• US Class Current: 381/92
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/00 Indicating arrangements; Control arrangements, e.g. balance control

Abstract

There is provided a sound source characteristic determining device (10) capable of being applied in an environmental where the type of a sound source is unknown. The device includes a plurality of beamformers (21-1 to 21-M) used when a sound source signal generated from a sound source at an arbitrary position in a space is inputted to a plurality of microphones (14-1 to 14-N), for weighting the acoustic signal detected by each of the microphones by using a function for correcting the difference of the sound source signals generated between the microphones and outputting a totaled signal. Each of the beamformers (21-1 to 21-M) contains a function having a unit directivity characteristic corresponding to one arbitrary direction in the space and is arranged for each of the directions corresponding to an arbitrary position in the space and the unit directivity characteristic. The sound source characteristic determining device (10) further includes means (23) for estimating the position and the direction in the space corresponding to the beamformer outputting a maximum value as the position and the direction of the sound source when the microphone (14) detects a sound source signal.

Claims

1. A sound source characteristic determining device, comprising:

a plurality of beamformers each of which, responsive to a plurality of microphones capturing a sound produced by a sound source at any given position in a predetermined space, weights signals detected by the respective microphones using a filter function and produces a sum of the weighted signals, each of the beamformers having a filter function of a cardioid-directivity pattern corresponding to an orientation at an assumed sound source position in the space, one beamformer being provided for each of different positions and different orientations in the space;

means, responsive to the microphones detecting the sound, for estimating a position and orientation of the sound source in the space based on the beamformer that produces a highest output value wherein the position and orientation corresponding to the beamformer that has produced the highest output value is estimated to be the position and orientation of the sound source; and

means for summing outputs from a plurality of beamformers that correspond to the estimated position of the sound source and that have different cardioid-directivity, a summed value of the outputs from the plurality of beamformers being determined to be a sound signal from the sound source.

3. The device according to claim 1, further comprising:

means for determining outputs of the beamformers at the selected position to estimate directivity of the sound source in terms of a set of outputs from the beamformers.

4. The device according to claim 3, further comprising:

means for comparing the estimated directivity with a database containing data on a plurality of directivity patterns according to types of sound source, wherein the type that is closest to the estimated directivity is determined to be the type of the sound source.

5. The device according to claim 4, further comprising:

sound source tracking means which compares the estimated position, orientation, and type of the sound source with a position, orientation and type of the sound source estimated one time step earlier and classifies the sound sources into a same group by regarding the sound sources as identical if deviations in the position and orientation fall within predetermined ranges and if the types are identical.

2. A sound source characteristic determining device, comprising:

a plurality of microphones for capturing a sound produced by a sound source at any given position in a predetermined space;

a plurality of beamformers associated with different positions and different orientations in the space, each beamformer including a plurality of filters associated with said plurality of microphones for performing a filter function of cardioid-directivity pattern corresponding to an orientation at an assumed sound source position in the space, said each beamformer producing a sum of the outputs of said plurality of filters as an output of said each beamformer, wherein each of said filters weights signals detected by a microphone associated with the filter;

means for determining the beamformer providing a highest output to select the position associated with said beamformer as the position of the sound source; and

means for determining outputs of the beamformers at the selected position with various orientations and determining directivity of the sound source in terms of a set of outputs from the beamformers; and

means for summing the outputs from a plurality of beamformers that correspond to the position of the sound source and that have different cardioid-directivity, a summed value of the outputs from the plurality of beamformers being determined to be a sound signal from the sound source.

6. A sound source characteristic determining device, implemented in hardware at least in part, comprising:

a plurality of beamformers each of which, responsive to a plurality of microphones capturing a sound produced by a sound source at any given position in a predetermined space, weights signals detected by the respective microphones using a filter function and produces a sum of the weighted signals, each of the beamformers having a filter function of a cardioid-directivity pattern corresponding to an orientation at an assumed sound source position in the space, one beamformer being provided for each of different positions and different orientations in the space;

a sound source estimation unit, responsive to the microphones detecting the sound, configured to estimate a position and orientation of the sound source in the space based on the beamformer that produces a highest output value wherein the position and orientation corresponding to the beamformer that has produced the highest output value is estimated to be the position and orientation of the sound source; and

a summation unit configured to sum outputs from a plurality of beamformers that correspond to the estimated position of the sound source and that have different cardioid-directivity, a summed value of the outputs from the plurality of beamformers being determined to be a sound signal from the sound source.

8. The device according to claim 6, further comprising:

a sound source determining device configured to determine outputs of the beamformers at the selected position to estimate directivity of the sound source in terms of a set of outputs from the beamformers.

9. The device according to claim 8, further comprising:

a source type estimation unit configured to compare the estimated directivity with a database containing data on a plurality of directivity patterns according to types of sound source, wherein the type that is closest to the estimated directivity is determined to be the type of the sound source.

10. The device according to claim 9, further comprising:

a sound source tracking unit configured to compare the estimated position, orientation, and type of the sound source with a position, orientation and type of the sound source estimated one time step earlier and classifies the sound sources into a same group by regarding the sound sources as identical if deviations in the position and orientation fall within predetermined ranges and if the types are identical.

7. A sound source characteristic determining device, comprising:

a plurality of microphones configured to capture a sound produced by a sound source at any given position in a predetermined space;

a plurality of beamformers associated with different positions and different orientations in the space, each beamformer comprising a plurality of filters associated with said plurality of microphones to perform a filter function of cardioid-directivity pattern corresponding to an orientation at an assumed sound source position in the space, wherein said each beamformer producing a sum of the outputs of said plurality of filters as an output of said each beamformer, wherein each of said filters weights signals detected by a microphone associated with the filter;

a determining device configured to determine the beamformer providing a highest output to select the position associated with said beamformer as the position of the sound source;

a sound source determining device configured to determine outputs of the beamformers at the selected position with various orientations and configured to determine directivity of the sound source in terms of a set of outputs from the beamformers; and

a summation unit configured to sum the outputs from a plurality of beamformers that correspond to the position of the sound source and that have different cardioid-directivity, a summed value of the outputs from the plurality of beamformers being determined to be a sound signal from the sound source.