Language Detection Service

• US 20090326918A1
• Filed: 06/26/2008
• Published: 12/31/2009
• Est. Priority Date: 06/26/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Guzman, Gerardo Villarreal, Ye, Shenghua, Snyder, Kieran, Georgiev, Dimiter, Sayed, Tarek M., Lin, Yung-Shin, Feinberg, Yaniv, Cavalcante, Ryan M.
• Granted Patent: US 8,073,680 B2
• Time in Patent Office: Days
• US Class Current: 704/8
• CPC Class Codes: G06F 40/263 Language identification

Abstract

Language detection techniques are described. In implementation, a method comprises determining which human writing system is associated with text characters in a string based on values representing the text characters. When the values are associated with more than one human language, the string is compared with a targeted dictionary to identify a corresponding human language associated with the string.

Claims

1. A method comprising:

determining which human writing system is associated with text characters in a string of one or more text characters based on values representing the text characters; and

when said values are associated with more than one human language, comparing the string with a targeted dictionary to identify a particular said human language associated with the string.

2. The method of claim 1, further comprising ascertaining which said human language is associated with the string based on which said human language is associated with a substring in the string.

3. The method of claim 2, wherein the substring is one or more of a prefix or a suffix.

4. The method of claim 1, further comprising assigning a text including the string the particular said human language.

5. The method of claim 1, wherein the targeted dictionary includes strings individually associated with a single said human language.

6. The method of claim 1, wherein individual strings in the targeted dictionary are associated with a single human language and is one or more of a determiner, a preposition, a connector or a pronoun.

7. The method of claim 1, further comprising selecting which of a plurality of strings in the targeted dictionary are to be compared based on said values representing the text characters in the string.

8. The method of claim 1, wherein in said values are Unicode said values.

9. A system comprising:

a language detection service to identify which human writing system is associated with a string of text characters in a text, in which the language detection service identifies a human language by comparing the string with a targeted dictionary including a plurality of strings associated with said human language.

10. The system of claim 9, wherein the language detection service is independent of an application providing the text.

11. The system of claim 9, wherein the language detection service is further configured to select which of the plurality of strings in the targeted dictionary are to be compared based on values representing the text characters in the string.

12. The system of claim 9, wherein the plurality of strings in the targeted dictionary are individually associated with a single said human language.

13. The system of claim 9, wherein the plurality of strings includes individual said strings that are one or more of a determiner, a preposition, a connector or a pronoun.

14. The system of claim 9, wherein the language detection service is further configured to ascertain which said human language is associated with the string from which said human language is associated with a substring in the string.

15. One or more computer-readable media comprising instructions that are executable by a computer to:

determine which human writing system is associated with a string of text characters based on values representing the text characters in the string; and

when the values are associated with more than one human language, compare the string with a targeted dictionary, including a plurality of strings, in which individual said strings in the targeted dictionary are associated with a corresponding said human language, to identify the corresponding said human language associated with the string.

16. One or more computer-readable media as described in claim 15, wherein the instructions are further executable to ascertain which human language is associated with a substring in the string to identify which said human language is associated with the string.

17. One or more computer-readable media as described in claim 15, wherein the instructions are further executable to select which of the plurality of strings in the targeted dictionary are to be compared based on the values.

18. One or more computer-readable media as described in claim 15 wherein the targeted dictionary includes individual said strings that are associated with a single said human language.

19. One or more computer-readable media as described in claim 15, wherein the plurality of strings include one of more of a determiner, a preposition, a connector or a pronoun.

20. One or more computer-readable media as described in claim 15, wherein each string in the targeted dictionary is associated with a single human language.