Voice actuated switching system

• US 5,561,737 A
• Filed: 05/09/1994
• Issued: 10/01/1996
• Est. Priority Date: 05/09/1994
• Status: Expired due to Term

• Current Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Bowen, Donald J.
• Primary Examiner(s): TUNG, KEE M
• Application Number:
  US08/239,771
• Time in Patent Office: 876 Days
• Field of Search: 395/2.84, 395/2.35-2.37, 395/2.42, 395/2.2, 381/110, 381/92, 379/202, 379/206
• US Class Current: 704/275
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 9/10 with switching of direction of transmission by voice frequency
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2201/401 2D or 3D arrays of transducers
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

A voice-actuated switching system connects one or more microphones to an audio line in accordance with the output signal levels from each of the microphones. To reduce the effects of degradation of speech signals due to reverberation and noise pickup, the switching system uses directional microphones housed in a circular enclosure and arranged in a conference array configuration with response patterns aimed outwardly from the center of the enclosure. The switching system also uses a voting algorithm to select for activation the appropriate microphones indicative of the position of one or more people speaking and a variable weighting factor for gradually turning on or off the signal from each activated microphone that is coupled to the audio line. Typically one microphone will be selected to monitor a person speaking. Since its response pattern is normally pointed in the direction of the person speaking, it is less sensitive to speaker echo due to reverberation. If two people are simultaneously speaking on opposite sides of the array of directional microphones, however, two generally opposed microphones are selected, and the amount of reverberation increases only slightly over the amount of reverberation that would be present if just a single microphone were employed.

Claims

1. A voice-actuated switching system comprising:

a plurality of circuits for receiving a plurality of speech signals;

means for selecting at least one of the plurality of speech signals for coupling to an output line, said selecting means selecting for coupling to the output line speech signals that exceed a predetermined minimum threshold;

means for assigning a variable weighting factor to each one of the received speech signals, each weighting factor being assigned responsive to the selecting means for controlling a level that its assigned speech signal is coupled to the output line; and

means for commonly connecting the plurality of received speech signals to the output line, each one of said plurality of speech signals being either gradually added to or removed from the output line in accordance with the assigned weighting factor for each one of said plurality of speech signals.

2. The system in accordance with claim 1 wherein the plurality of received speech signals are commonly connected to the output line as a weighted sum.

3. The system in accordance with claim 1 wherein the selecting means includes measuring means for determining a magnitude of a speech energy level in each one of the plurality of received speech signals.

4. The system in accordance with claim 3 wherein said at least one of the plurality of speech signals selected by the selecting means has the greatest magnitude of speech energy level among the received speech signals.

5. The system in accordance with claim 3 wherein the measuring means further includes means for determining the relative magnitude of the energy level in each one of the plurality of received speech signals by comparing the energy level in each of the plurality of received speech signals with the energy level in each other of the plurality of received speech signals.

6. The system in accordance with claim 5 wherein the selecting means further includes means for sorting the received speech signals according to their relative energy levels for obtaining minimum and maximum tracked signal values in the plurality of received speech signals.

7. The system in accordance with claim 6 wherein the selecting means includes means for continually selecting a first selected speech signal associated with a first microphone when said selected first speech signal has a tracked signal value within a predetermined threshold amount of the maximum tracked signal value and a second speech signal associated with a second microphone disposed generally opposite to said first microphone has a tracked signal value within a predetermined threshold amount of the minimum tracked signal value.

8. The system in accordance with claim 7 wherein the selecting means includes means for continually selecting said first selected speech signal when said maximum tracked signal value exceeds said minimum tracked signal value by a predetermined threshold amount.

9. The system in accordance with claim 7 wherein the selecting means includes means for selecting a third speech signal in place of said first selected speech signal, said third speech signal being associated with a third microphone and selected when said third speech signal has a tracked signal value within a predetermined threshold amount of the maximum tracked signal value and a fourth speech signal associated with a fourth microphone disposed generally opposite to said third microphone has a tracked signal value within a predetermined threshold amount of the minimum tracked signal value.

10. The system in accordance with claim 7 wherein the selecting means further includes means for selecting a third speech signal along with the selected first speech signal, the third speech signal being associated with a third microphone and being selected when said third speech signal has a tracked signal value within a predetermined threshold amount of the maximum tracked signal value and a fourth speech signal associated with a fourth microphone disposed generally opposite to said third microphone has a tracked signal value within a predetermined threshold amount of of the minimum tracked signal value.

11. The system in accordance with claim 6 wherein the selecting means includes means for selecting for coupling to the output line a first received speech signal having a tracked signal value that exceeds by at least a predetermined threshold amount the tracked signal value of a second received speech signal.

12. The system in accordance with claim 11 wherein the tracked signal value for the second received speech signal is the minimum tracked signal value in the plurality of received speech signals.

13. The system in accordance with claim 6 further comprising monitoring means for continually monitoring the plurality of received speech signals for determining the tracked signal values for each of the plurality of received speech signals.

14. The system in accordance with claim 1 further including means for varying an assigned weighting factor for a received speech signal over a range between one and zero, the received speech signal being coupled unattenuated to the output line when the weighting factor has a value of one, and the received speech signal being attenuated and not coupled to the output line when the weighting factor has a value of zero.

15. The system in accordance with claim 14 wherein the received speech signal is coupled to the output line attenuated in an amount directly proportional to a product of the assigned weighting factor and the level of the received speech signal when said weighting factor has a value greater than zero and less than one.

16. The system in accordance with claim 15 further including clocking means for periodically adjusting the weighting factor for the received speech signal during a first time period that said speech signal is selected by the selecting means, the weighting factor either increasing from zero toward the value of one or remaining at the value of one during said first time period.

17. The system in accordance with claim 16 wherein the clocking means periodically adjusts the weighting factor for the received speech signal during a second time period that said speech signal is not selected by the selecting means, the weighting factor either decreasing from a value of one toward zero or remaining at zero during said second time period.

18. The system in accordance with claim 17 wherein the clocking means adjusts the weighting factors in first incremental steps during said first time period and in second incremental steps during said second time period, each of said first incremental steps being larger than said second incremental steps.

19. The system in accordance with claim 15 further including clocking means for periodically adjusting the weighting factor for the received speech signal during a first time period that said speech signal is selected by the selecting means, the weighting factor either increasing from some value less than one toward a value of one or remaining at the value of one during said first time period.

20. The system in accordance with claim 19 wherein the clocking means periodically adjusts the weighting factor for the received speech signal during a second time period that said speech signal is not selected by the selecting means, the weighting factor either decreasing from some value less than one toward zero or remaining at zero during said second time period.

21. The system in accordance with claim 20 wherein the clocking means adjusts the weighting factors in first incremental steps during said first time period and in second incremental steps during said second time period, each of said first incremental steps being larger than said second incremental steps.

22. A method of connecting speech signals from a plurality of speech circuits to an output line, the method comprising the steps of:

receiving a plurality of speech signals in the plurality of circuits;

selecting at least one of the plurality of speech signals for coupling to an output line, said selecting step selecting for coupling to the output line speech signals that exceed a predetermined minimum threshold;

assigning a variable weighting factor to each one of the received speech signals, each weighting factor being assigned responsive to the selecting step for controlling a level that its assigned speech signal is coupled to the output line;

commonly connecting the plurality of received speech signals to the output line, and

gradually adding or removing each one of said plurality of speech signals from the output line in accordance with the assigned weighting factor for each one of said plurality of speech signals.

23. The method of claim 22 wherein the plurality of received speech signals are commonly connected to the output line as a weighted sum.

24. The method of claim 23 wherein the selecting step includes the step of measuring a magnitude of a speech energy level in each one of the plurality of received speech signals.

25. The method of claim 24 wherein the measuring step further include the step of determining the relative magnitude of the energy level in each one of the plurality of received speech signals by comparing the energy level in each of the plurality of received speech signals with the energy level in each other of the plurality of received speech signals.

26. The method of claim 25 wherein the selecting step further includes the step of sorting the received speech signals according to their relative energy levels for obtaining minimum and maximum tracked signal values in the plurality of received speech signals.

27. The method of claim 26 wherein the selecting step further includes the step of selecting for coupling to the output line a first selected speech signal associated with a first microphone when said selected first speech signal has a tracked signal value within a predetermined threshold amount of the maximum tracked signal value and a second speech signal associated with a second microphone disposed generally opposite to said first microphone has a tracked signal value within a predetermined threshold amount of the minimum tracked signal value.

28. The method of claim 27 further including the step of selecting for coupling to the output line a third speech signal in place of said first selected speech signal, said third speech signal being associated with a third microphone and selected when said third speech signal has a tracked signal value within a predetermined threshold amount of the maximum tracked signal value and a fourth speech signal associated with a fourth microphone disposed generally opposite to said third microphone has a tracked signal value within a predetermined threshold amount of the minimum tracked signal value.

29. The method of claim 27 further including the step of selecting for coupling to the output line a third speech signal along with the selected first speech signal, the third speech signal being associated with a third microphone and being selected when said third speech signal has a tracked signal value within a predetermined threshold amount of the maximum tracked signal value and a fourth speech signal associated with a fourth microphone disposed generally opposite to said third microphone has a tracked signal value within a predetermined threshold amount of the minimum tracked signal value.

30. The method of claim 22 further including the step of varying an assigned weighting factor for a received speech signal over a range between one and zero, the received speech signal being coupled unattenuated to the output line when the weighting factor has a value of one, and the received speech signal being attenuated and not coupled to the output line when the weighting factor has a value of zero.

31. The method of claim 30 further including the step of coupling the received speech signal to the output line attenuated in an amount directly proportional to a product of the assigned weighting factor and the level of the received speech signal when said weighting factor has a value greater than zero and less than one.

32. The method of claim 31 further including the step of periodically adjusting the weighting factor for the received speech signal during a first time period that said speech signal is selected by the selecting step, the weighting factor either increasing from zero toward the value of one or remaining at the value of one during said first time period.

33. The method of claim 32 further including the step of periodically adjusting the weighting factor for the received speech signal during a second time period that said speech signal is not selected by the selecting step, the weighting factor either decreasing from a value of one toward zero or remaining at zero during said second time period.

34. The method of claim 22 further including the steps of:

selecting one from a plurality of microphones for connecting speech signals received therein to the output line, each one of said plurality of microphones being respectively associated with one of said plurality of circuits;

determining both a long and short term energy average for the speech signal in each of the plurality of speech circuits, each one of the plurality of circuits being respectively associated with one in a plurality of microphones, and the long term energy average being indicative of a noise signal and the short term energy average being indicative of both the noise signal and a speech signal;

subtracting the long term energy average from the short term energy average for determining a tracked speech signal value;

sorting the tracked speech signal value for each microphone for determining minimum and maximum tracked signal values among the microphones;

periodically examining the tracked speech signal value of each microphone for determining when at least a predetermined minimum difference exists between minimum and maximum tracked signal values; and

connecting the speech signal from the microphone having the maximum tracked signal value to the output line.

35. The method of claim 34 wherein the microphone having the maximum tracked signal value is indicative of a direction of the source of the speech signal.

36. The method of claim 22 further including the steps of:

selecting a variable number from a plurality of microphones for connecting speech signals received therein to the output line, each one of said plurality of microphones being respectively associated with one of said plurality of circuits;

determining both a long and short term energy average for the speech signals in each of the plurality of speech circuits, the long term energy average being indicative of a noise signal and the short term energy average being indicative of both the noise signal and a speech signal;

subtracting the long term energy average from the short term energy average for determining a tracked speech signal value;

sorting the tracked signal value for each microphone for determining minimum and maximum tracked signal values among the microphones;

periodically examining the tracked signal value of each microphone for determining when at least a predetermined minimum difference exists between minimum and maximum tracked signal values, each microphone having a tracked signal value exceeding the predetermined minimum difference being indicative of a direction of a source of speech signals; and

connecting to the output line the speech signals from the microphones having the tracked signal values that exceed the predetermined minimum difference.

37. A voice-actuated switching apparatus comprising:

a plurality of circuits for receiving a plurality of speech signals;

means for selecting at least one of the plurality of speech signals for coupling to an output line, said selecting means selecting for coupling to the output line speech signals that exceed a predetermined minimum threshold;

means responsive to the selecting means for assigning a variable weighting factor to each one of the received speech signals, each weighting factor controlling a level that its assigned speech signal is coupled to the output line; and

means for providing a weighted sum of the plurality of received speech signals to the output line in accordance with the assigned weighting factor for each of the plurality of speech signals.

38. The apparatus in accordance with claim 37 further including means for varying an assigned weighting factor for a received speech signal over a range between one and zero, the received speech signal being coupled unattenuated to the output line when the weighting factor has a value of one, and the received speech signal being attenuated and not coupled to the output line when the weighting factor has a value of zero.

39. The apparatus in accordance with claim 38 wherein the received speech signal is coupled to the output line attenuated in an amount directly proportional to a product of the assigned weighting factor and the level of the received speech signal when said weighting factor has a value greater than zero and less than one.

40. A voice-actuated switching system comprising:

a plurality of circuits for receiving a plurality of speech signals;

means for selecting at least one of the plurality of speech signals for coupling to an output line, said selecting means identifying a stronger one of the speech signals by comparing the energy level in each of the plurality of received speech signals with the energy level in each other of the plurality of received speech signals;

means for assigning a variable weighting factor to each one of the received speech signals, each weighting factor being assigned responsive to the selecting means for controlling a level that its assigned speech signal is coupled to the output line; and

means for commonly connecting the plurality of received speech signals to the output line, each of said plurality of speech signals being either gradually added to or removed from the output line in accordance with the assigned weighting factor for each one of said plurality of speech signals.