System and method for combining geographic metadata in automatic speech recognition language and acoustic models

• US 9,373,326 B2
• Filed: 11/14/2014
• Issued: 06/21/2016
• Est. Priority Date: 12/15/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Bocchieri, Enrico, Caseiro, Diamantino Antonio
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US14/541,738
• Publication Number:
  US 20150073793A1
• Time in Patent Office: 585 Days
• Field of Search: 704/270
• US Class Current: 1/1
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 15/197 Probabilistic grammars, e.g. word n-grams
• CPC Class Codes: G10L 2015/081 Search algorithms, e.g. Baum-Welch or Viterbi
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G10L 25/54 for retrieval

Abstract

Disclosed herein are systems, methods, and computer-readable storage media for a speech recognition application for directory assistance that is based on a user'"'"'s spoken search query. The spoken search query is received by a portable device and portable device then determines its present location. Upon determining the location of the portable device, that information is incorporated into a local language model that is used to process the search query. Finally, the portable device outputs the results of the search query based on the local language model.

Claims

1. A method comprising:

receiving a spoken query at a portable device;

determining a present location of the portable device;

incorporating a granularity description of the present location into a local language model, the granularity description using topologically concentric locations to determine weights, wherein the weights are used to determine probabilities;

combining the local language model with a global language model according to the weights, to yield a combined language model; and

outputting, using the combined language model, results associated with the spoken query based on the present location and a term in the spoken user search query.

2. The method of claim 1, wherein the granularity description uses business density to determine the weights.

3. The method of claim 1, further comprising processing the spoken query using the local language model, to yield the results, wherein the local language model comprises the granularity description.

4. The method of claim 1, further comprising:

incorporating the present location into a local acoustic model used to process the spoken user query.

5. The method of claim 1 wherein the present location of the portable device is determined using one of a global positioning system, triangulation, and automatic number identification.

6. The method of claim 1, wherein incorporating of the granularity description into the language model further comprises:

partitioning training data into geographical areas;

estimating models for each partition; and

selecting a portioned model based on the location of the portable device.

7. The method of claim 6, further comprising generating a user model by combining two models using interpolation.

8. The method of claim 1, wherein entities in the local language model are related at one of a city, an area code, and a state level.

9. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, result in operations comprising;

receiving a spoken query at a portable device;

determining a present location of the portable device;

incorporating a granularity description of the present location into a local language model, the granularity description using topologically concentric locations to determine weights, wherein the weights are used to determine probabilities;

combining the local language model with a global language model according to the weights, to yield a combined language model; and

outputting, using the combined language model, results associated with the spoken query based on the present location and a term in the spoken user search query.

10. The system of claim 9, wherein the granularity description uses business density to determine the weights.

11. The system of claim 9, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising processing the spoken query using the local language model, to yield the results, wherein the local language model comprises the granularity description.

12. The system of claim 9, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising:

incorporating the present location into a local acoustic model used to process the spoken user query.

13. The system of claim 9, wherein the present location of the portable device is determined using one of a global positioning system, triangulation, and automatic number identification.

14. The system of claim 9, wherein incorporating of the granularity description into the language model further comprises:

partitioning training data into geographical areas;

estimating models for each partition; and

selecting a portioned model based on the location of the portable device.

15. The system of claim 14, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising generating a user model by combining two models using interpolation.

16. The system of claim 9, wherein entities in the local language model are related at one of a city, an area code, and a state level.

17. A computer-readable storage device having instructions stored which, when executed by a computing device, result in operations comprising:

receiving a spoken query at a portable device;

determining a present location of the portable device;

incorporating a granularity description of the present location into a local language model, the granularity description using topologically concentric locations to determine weights, wherein the weights are used to determine probabilities;

combining the local language model with a global language model according to the weights, to yield a combined language model; and

outputting, using the combined language model, results associated with the spoken query based on the present location and a term in the spoken user search query.

18. The computer-readable storage device of claim 17, wherein the granularity description uses topologically concentric locations to determine the weights.