SYSTEMS AND METHODS FOR ASSISTING AUTOMATIC SPEECH RECOGNITION

• US 20170206898A1
• Filed: 01/12/2017
• Published: 07/20/2017
• Est. Priority Date: 01/14/2016
• Status: Abandoned Application

• Current Assignee: Knowles Electronics Llc (Knowles Corporation)
• Original Assignee: Knowles Electronics Llc (Knowles Corporation)
• Inventors: Bernard, Alexis, Rao, Chetan S.
• Application Number:
  US15/404,958
• Publication Number:
  US 20170206898A1
• Time in Patent Office: Days
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 15/34 Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 2021/02165 Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: G10L 25/60 for measuring the quality of voice signals

Abstract

Systems and methods for assisting automatic speech recognition (ASR) are provided. An example method includes generating, by a mobile device, a plurality of instantiations of a speech component in a captured audio signal, each instantiation of the plurality of instantiations being in support of a particular hypothesis regarding the speech component. At least two instantiations of the plurality of instantiations are then sent to a remote ASR engine. The remote ASR engine is configured to recognize at least one word based on the at least two of the plurality of instantiations and a user context, according to various embodiments. This recognition can include selecting one of the instantiations of the speech component from the plurality of instantiations. The plurality of instantiations may be generated by noise suppression of the captured audio signal with different degrees of aggressiveness. In some embodiments, the plurality of instantiations is generated by synthesizing the speech component from synthetic speech parameters obtained by a spectral analysis of the captured audio signal.

Claims

1. A method for assisting automatic speech recognition (ASR), the method comprising:

generating a plurality of instantiations of a speech component in an audio signal, each instantiation of the plurality of instantiations being generated by a different pre-processing performed on the audio signal; and

sending at least two of the plurality of instantiations to a remote ASR engine that is configured to recognize at least one word based on the at least two of the plurality of instantiations.

2. The method of claim 1, wherein generating the plurality of instantiations includes performing noise suppression on the audio signal with different levels of attenuation.

3. The method of claim 2, wherein each of the different levels of attenuation corresponds to a different voice quality of speech (VQOS).

4. The method of claim 3, wherein sending includes sending the at least two of the plurality of instantiations serially in order from best VQOS to worst VQOS.

5. The method of claim 2, wherein performing noise suppression includes performing echo cancellation.

6. The method of claim 1, wherein generating the plurality of instantiations includes generating a plurality of spectral representations of the audio signal.

7. The method of claim 6, wherein generating the plurality of instantiations further includes:

deriving feature data from the plurality of spectral representations; and

generating a plurality of parameters based at least partially on the derived feature data, the parameters including one or both of voice envelope and excitation.

8. The method of claim 7, wherein the plurality of parameters are used by the remote ASR engine to synthesize a plurality of estimates of clean speech.

9. The method of claim 1, wherein the plurality of instantiations comprise a plurality of clean speech estimates.

10. The method of claim 1, wherein generating the plurality of instantiations includes estimating attributes associated with different sources of sound in the audio signal.

11. The method of claim 10, wherein generating the plurality of instantiations further includes assigning a probability to each of the different sources of sound.

12. The method of claim 1, wherein generating the plurality of instantiations includes generating a noise suppressed audio signal from the audio signal that has been captured with a pair of microphones using one or both of differences of waveforms and time of arrival of the audio signal at each of the microphones in the pair.

13. The method of claim 1, wherein the remote ASR engine is configured to recognize at least one word in the audio signal based on the at least two of the plurality of instantiations and a user context.

14. The method of claim 13, wherein the user context includes information related to a user.

15. The method of claim 14, wherein the information includes one or more of location, e-mail, search history and recently recognized words.

16. A device for assisting automatic speech recognition (ASR), the device comprising:

audio processing circuitry adapted to generate a plurality of instantiations of a speech component in an audio signal, each instantiation of the plurality of instantiations corresponding to a particular pre-processing performed on the audio signal; and

a communications interface adapted to send at least two of the plurality of instantiations to a remote ASR engine that is configured to recognize at least one word based on the at least two of the plurality of instantiations.

17. The device of claim 16, wherein the device comprises a mobile device.

18. The device of claim 16, wherein the device comprises a control for an appliance.

19. The device of claim 16, further comprising a microphone adapted to capture the audio signal and provide the captured audio signal to the audio processing circuitry.

20. The device of claim 16, wherein the audio processing circuitry includes noise suppression circuitry adapted to perform noise suppression of the audio signal with different levels of attenuation, wherein each instantiation of the plurality of instantiations corresponds to a different one of the levels of attenuation.

21. The device of claim 20, wherein each of the different levels of attenuation corresponds to a different voice quality of speech (VQOS).