Systems and methods for intelligent control of microphones for speech recognition applications

• US 8,140,325 B2
• Filed: 01/04/2007
• Issued: 03/20/2012
• Est. Priority Date: 01/04/2007
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kanevsky, Dimitri, Viswanathan, Mahesh, Nahamoo, David, Sicconi, Roberto
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US11/619,793
• Publication Number:
  US 20080167868A1
• Time in Patent Office: 1,902 Days
• Field of Search: 704/226, 704/233
• US Class Current: 704/226
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems

Abstract

Systems and methods for intelligent control of microphones in speech processing applications, which allows the capturing, recording and preprocessing of speech data in the captured audio in a way that optimizes speech decoding accuracy.

Claims

1. An audio processing system, comprising;

a microphone system, comprising a microphone for capturing audio input to the microphone system;

a microphone manager to (i) control capturing of audio input to the microphone system, (ii) control recording of captured audio, (iii) detect speech activity events, (iv) determine speech segments of captured audio comprising speech data based on timing of one or more detected speech activity events, (v) selectively output speech segments within captured, audio to a speech decoding system; and

to (vi) detect an environmental condition regarding capturing of audio, which can result in captured audio with acoustic characteristics that adversely affect a decoding accuracy of the captured audio;

a sensor system comprising one or more sensor devices to generate sensor data which is processed by the microphone manager to detect speech activity events and environmental conditions,

wherein the microphone manager selectively activates one of a plurality of different types of microphones of the microphone system according to the environmental condition regarding capturing of audio,

wherein the microphone manager detects an environmental condition where a speaker uses a microphone in the microphone system which is different from a microphone used by the speaker for training the speech decoding system, and

wherein a selectively activated one of a plurality different types of microphones of the microphone system is the same or similar to the training microphone.

2. The audio system of claim 1, wherein the microphone manager automatically adjusts one or more microphone parameters and speech decoding parameters to compensate the degraded acoustic characteristics of the captured audio.

3. The system of claim 2, wherein the microphone manager maintains and periodically updates a sample of an environmental static noise level and a stored voice sample of a speaker, and automatically adjusts microphone volume sensitivity for the speaker based on a current sample of the environmental static noise level and the voice sample of the speaker.

4. The system of claim 3, wherein the sensor system, comprises a sensor device which generates sensor data which is used to determine a distance between a microphone and a speaker'"'"'s mouth, wherein the microphone manager automatically adjusts microphone volume level based on a current distance between the microphone and the speaker'"'"'s month, and automatically adjusts microphone volume sensitivity by transforming a volume parameter of the stored voice sample of a speaker based on the current distance, and transforming the speaker'"'"'s speech input to a microphone to adapt the microphone volume sensitivity based on the stored voice sample of the speaker and a scored sample of the current environmental static noise level.

5. The system of claim 1, wherein the microphone manager modulates an audio input to the microphone to substantially catch an audio signal of the training microphone.

6. The system of claim 1, wherein the one or more detected speech activity events include detection of microphone switch button actions and detection of speech in captured audio.

7. The system of claim 1, wherein the one or more detected speech activity events include detection of user intention to speak into the microphone and detection of speech in captured audio.