Multiple speech locale-specific hotword classifiers for selection of a speech locale
First Claim
1. A computer-implemented method, comprising:
- receiving an utterance of a user by a device;
obtaining acoustic features from an initial portion of the utterance, wherein the initial portion of the utterance includes a hotword that is associated with waking the device from a low power state;
providing the acoustic features from the initial portion of the utterance to multiple speech locale-specific hotword classifiers of the device that process the acoustic features from the initial portion of the utterance in parallel, wherein each speech locale-specific hotword classifier is a speech recognition process using an acoustic model of a single language or a single dialect of a language and (i) is associated with a respective speech locale, (ii) is configured to classify acoustic features associated with an initial portion of an utterance as either corresponding to, or as not corresponding to, an utterance of a respective predefined term without one or more of transcribing or semantically interpreting acoustic features of any portion of the utterance, and (iii) is associated with a respective set of automatic speech recognition parameters;
obtaining speech locale-specific hotword confidence scores from the speech locale-specific hotword classifiers of the device, wherein each of the speech locale-specific hotword confidence scores obtained from a corresponding speech locale-specific hotword classifier reflects a likelihood that the initial portion of the utterance includes the respective predefined term corresponding to the speech locale-specific hotword classifier;
selecting a speech locale for use in generating a transcription of a subsequent portion of the utterance based on comparing speech locale-specific hotword confidence scores obtained from the multiple speech locale-specific hotword classifiers in response to the parallel processing of the acoustic features from the initial portion of the utterance by the multiple speech locale-specific hotword classifiers;
selecting the set of automatic speech recognition parameters associated with the selected speech locale; and
generating, by an automated speech recognizer, the transcription of the subsequent portion of the utterance using the selected set of automatic speech recognition parameters associated with the selected speech locale.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for recognizing speech in an utterance. The methods, systems, and apparatus include actions of receiving an utterance and obtaining acoustic features from the utterance. Further actions include providing the acoustic features from the utterance to multiple speech locale-specific hotword classifiers. Each speech locale-specific hotword classifier (i) may be associated with a respective speech locale, and (ii) may be configured to classify audio features as corresponding to, or as not corresponding to, a respective predefined term. Additional actions may include selecting a speech locale for use in transcribing the utterance based on one or more results from the multiple speech locale-specific hotword classifiers in response to providing the acoustic features from the utterance to the multiple speech locale-specific hotword classifiers. Further actions may include selecting parameters for automated speech recognition based on the selected speech locale.
-
Citations
25 Claims
-
1. A computer-implemented method, comprising:
-
receiving an utterance of a user by a device; obtaining acoustic features from an initial portion of the utterance, wherein the initial portion of the utterance includes a hotword that is associated with waking the device from a low power state; providing the acoustic features from the initial portion of the utterance to multiple speech locale-specific hotword classifiers of the device that process the acoustic features from the initial portion of the utterance in parallel, wherein each speech locale-specific hotword classifier is a speech recognition process using an acoustic model of a single language or a single dialect of a language and (i) is associated with a respective speech locale, (ii) is configured to classify acoustic features associated with an initial portion of an utterance as either corresponding to, or as not corresponding to, an utterance of a respective predefined term without one or more of transcribing or semantically interpreting acoustic features of any portion of the utterance, and (iii) is associated with a respective set of automatic speech recognition parameters; obtaining speech locale-specific hotword confidence scores from the speech locale-specific hotword classifiers of the device, wherein each of the speech locale-specific hotword confidence scores obtained from a corresponding speech locale-specific hotword classifier reflects a likelihood that the initial portion of the utterance includes the respective predefined term corresponding to the speech locale-specific hotword classifier; selecting a speech locale for use in generating a transcription of a subsequent portion of the utterance based on comparing speech locale-specific hotword confidence scores obtained from the multiple speech locale-specific hotword classifiers in response to the parallel processing of the acoustic features from the initial portion of the utterance by the multiple speech locale-specific hotword classifiers; selecting the set of automatic speech recognition parameters associated with the selected speech locale; and generating, by an automated speech recognizer, the transcription of the subsequent portion of the utterance using the selected set of automatic speech recognition parameters associated with the selected speech locale. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system comprising:
-
one or more computers; and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising; receiving an utterance of a user by a device; obtaining acoustic features from an initial portion of the utterance, wherein the initial portion of the utterance includes a hotword that is associated with waking the device from a low power state; providing the acoustic features from the initial portion of the utterance to multiple speech locale-specific hotword classifiers of the device that process the acoustic features from the initial portion of the utterance in parallel, wherein each speech locale-specific hotword classifier is a speech recognition process using an acoustic model of a single language or a single dialect of a language and (i) is associated with a respective speech locale, (ii) is configured to classify acoustic features associated with an initial portion of an utterance as either corresponding to, or as not corresponding to, an utterance of a respective predefined term without one or more of transcribing or semantically interpreting acoustic features of any portion of the utterance, and (iii) is associated with a respective set of automatic speech recognition parameters; obtaining speech locale-specific hotword confidence scores from the speech locale-specific hotword classifiers of the device, wherein each of the speech locale-specific hotword confidence scores obtained from a corresponding speech locale-specific hotword classifier reflects a likelihood that the initial portion of the utterance includes the respective predefined term corresponding to the speech locale-specific hotword classifier; selecting a speech locale for use in generating a transcription of a subsequent portion of the utterance based on comparing speech locale-specific hotword confidence scores obtained from the multiple speech locale-specific hotword classifiers in response to the parallel processing of the acoustic features from the initial portion of the utterance by the multiple speech locale-specific hotword classifiers selecting the set of automatic speech recognition parameters associated with the selected speech locale; and generating, by an automated speech recognizer, the transcription of the subsequent portion of the utterance using the selected set of automatic speech recognition parameters associated with the selected speech locale. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. A non-transitory computer-readable medium storing instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
-
receiving an utterance of a user by a device; obtaining acoustic features from an initial portion of the utterance, wherein the initial portion of the utterance includes a hotword that is associated with waking the device from a low power state; providing the acoustic features from the initial portion of the utterance to multiple speech locale-specific hotword classifiers of the device that process the acoustic features from the initial portion of the utterance in parallel, wherein each speech locale-specific hotword classifier is a speech recognition process using an acoustic model of a single language or a single dialect of a language and (i) is associated with a respective speech locale, (ii) is configured to classify acoustic features associated with an initial portion of an utterance as either corresponding to, or as not corresponding to, an utterance of a respective predefined term without one or more of transcribing or semantically interpreting acoustic features of any portion of the utterance, and (iii) is associated with a respective set of automatic speech recognition parameters; obtaining speech locale-specific hotword confidence scores from the speech locale-specific hotword classifiers of the device, wherein each of the speech locale-specific hotword confidence scores obtained from a corresponding speech locale-specific hotword classifier reflects a likelihood that the initial portion of the utterance includes the respective predefined term corresponding to the speech locale-specific hotword classifier; selecting a speech locale for use in generating a transcription of a subsequent portion of the utterance based on comparing speech locale-specific hotword confidence scores obtained from the multiple speech locale-specific hotword classifiers in response to the parallel processing of the acoustic features from the initial portion of the utterance by the multiple speech locale-specific hotword classifiers selecting the set of automatic speech recognition parameters associated with the selected speech locale; and generating, by an automated speech recognizer, the transcription of the subsequent portion of the utterance using the selected set of automatic speech recognition parameters associated with the selected speech locale. - View Dependent Claims (24, 25)
-
Specification