Automatic Language Model Update

• US 20130246065A1
• Filed: 05/07/2013
• Published: 09/19/2013
• Est. Priority Date: 04/03/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Cohen, Michael H., Baluja, Shumeet, Moreno, Pedro J.
• Granted Patent: US 9,159,316 B2
• Time in Patent Office: Days
• US Class Current: 704/244
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/0635 updating or merging of old and new templates; Mean values; Weighting

Abstract

A method for generating a speech recognition model includes accessing a baseline speech recognition model, obtaining information related to recent language usage from search queries, and modifying the speech recognition model to revise probabilities of a portion of a sound occurrence based on the information. The portion of a sound may include a word. Also, a method for generating a speech recognition model, includes receiving at a search engine from a remote device an audio recording and a transcript that substantially represents at least a portion of the audio recording, synchronizing the transcript with the audio recording, extracting one or more letters from the transcript and extracting the associated pronunciation of the one or more letters from the audio recording, and generating a dictionary entry in a pronunciation dictionary.

Claims

1-17. -17. (canceled)

18. A computer-implemented method, comprising:

receiving, by a computing system and as having been transmitted by a computing device, a textual search query that was specified by user input at the computing device, the search query including a textual search term;

causing search results that correspond to the textual search query to be generated and provided for receipt by the computing device;

determining, by the computing system and as a result of having received the textual search query, whether the textual search term exists in a dictionary of terms for a speech recognition system; and

adding, by the computing system and as a result of determining that the textual search term is not in the dictionary of terms for the speech recognition model, the textual search term to the dictionary of terms for the speech recognition model, in order to generate an updated dictionary of terms for the speech recognition model.

19. The computer-implemented method of claim 18, wherein determining whether the textual search term exists in the dictionary of terms for the speech recognition system includes splitting the textual search term into multiple textual search terms and determining whether each of the multiple textual search terms exists in the dictionary of terms.

20. The computer-implemented method of claim 18, further comprising:

receiving, by the computing system, a verbal query that specified by user input at a second computing device and that includes a verbal representation of the textual search term; and

translating, by the computing system and using the updated dictionary of terms for the speech recognition model, the verbal query into a textual representation of the verbal query, the textual representation of the verbal query including the textual search term.

21. The computer-implemented method of claim 18, further comprising:

providing, by the computing system, the updated dictionary of terms for the speech recognition model to a second computing device, wherein the second computing device uses the updated dictionary of terms to translate a verbal query that was received by user input specified at the second computing device into a textual representation of the verbal query, the textual representation of the verbal query including the textual search term.

22. The computer-implemented method of claim 18, further comprising:

assigning a probability value to a dictionary entry for the textual search term within the updated dictionary of terms based on a chronological receipt of the textual search term with respect to terms being received in other search queries.

23. The computer-implemented method of claim 18, further comprising:

assigning a probability value to a dictionary entry for the textual search term within the updated dictionary of terms based on a number of times that the textual search term is received within search queries.

24. The computer-implemented method of claim 18, further comprising:

identifying an acoustic model for the textual search term from a captioned video broadcast that includes captioned text that includes the textual search term.

25. The computer-implemented method of claim 18, further comprising:

adding, by the computing system and in response to receiving the textual search query, other terms that are associated with the textual search term to the dictionary of terms for the speech recognition model, wherein the other terms would not have otherwise been included in the dictionary of terms for the speech recognition model without receipt of the textual search query.

26. One or more machine-readable storage devices that are programmed with instructions that, when executed by one or more programmable processors, cause performance of operations that comprise:

receiving, by a computing system and as having been transmitted by a computing device, a textual search query that was specified by user input at the computing device, the search query including a textual search term;

causing search results that correspond to the textual search query to be generated and provided for receipt by the computing device;

determining, by the computing system and as a result of having received the textual search query, whether the textual search term exists in a dictionary of terms for a speech recognition system; and

adding, by the computing system and as a result of determining that the textual search term is not in the dictionary of terms for the speech recognition model, the textual search term to the dictionary of terms for the speech recognition model, in order to generate an updated dictionary of terms for the speech recognition model.

27. The one or more machine-readable storage devices of claim 26, wherein determining whether the textual search term exists in the dictionary of terms for the speech recognition system includes splitting the textual search term into multiple textual search terms and determining whether each of the multiple textual search terms exists in the dictionary of terms.

28. The one or more machine-readable storage devices of claim 26, wherein the operations further comprise:

receiving, by the computing system, a verbal query that specified by user input at a second computing device and that includes a verbal representation of the textual search term; and

translating, by the computing system and using the updated dictionary of terms for the speech recognition model, the verbal query into a textual representation of the verbal query, the textual representation of the verbal query including the textual search term.

29. The one or more machine-readable storage devices of claim 26, wherein the operations further comprise:

providing, by the computing system, the updated dictionary of terms for the speech recognition model to a second computing device, wherein the second computing device uses the updated dictionary of terms to translate a verbal query that was received by user input specified at the second computing device into a textual representation of the verbal query, the textual representation of the verbal query including the textual search term.

30. The one or more machine-readable storage devices of claim 26, wherein the operations further comprise:

assigning a probability value to a dictionary entry for the textual search term within the updated dictionary of terms based on a chronological receipt of the textual search term with respect to terms being received in other search queries.

31. The one or more machine-readable storage devices of claim 26, wherein the operations further comprise:

assigning a probability value to a dictionary entry for the textual search term within the updated dictionary of terms based on a number of times that the textual search term is received within search queries.

32. The one or more machine-readable storage devices of claim 26, wherein the operations further comprise:

identifying an acoustic model for the textual search term from a captioned video broadcast that includes captioned text that includes the textual search term.

33. The one or more machine-readable storage devices of claim 26, wherein the operations further comprise:

adding, by the computing system and in response to receiving the textual search query, other terms that are associated with the textual search term to the dictionary of terms for the speech recognition model, wherein the other terms would not have otherwise been included in the dictionary of terms for the speech recognition model without receipt of the textual search query.