Name classifier algorithm

• US 20070005597A1
• Filed: 11/18/2005
• Published: 01/04/2007
• Est. Priority Date: 11/23/2004
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Williams, Charles
• Application Number:
  US11/281,885
• Publication Number:
  US 20070005597A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/33 Querying

Abstract

A particular algorithm for classifying a name includes accessing a name and dividing the name into a series of n-grams including at least a first n-gram and a second n-gram. At least the first n-gram and the second n-gram are concatenated to form a concatenated n-gram, and a likelihood is determined that the concatenated n-gram belongs to a first language. A likelihood is also determined that the name belongs to the first language based on the likelihood that the concatenated n-gram belongs to the first language.

Claims

1. A method comprising:

accessing a name;

dividing the name into a series of n-grams including at least a first n-gram and a second n-gram;

concatenating at least the first n-gram and the second n-gram to form a concatenated n-gram;

determining a likelihood that the concatenated n-gram belongs to a first language; and

determining a likelihood that the name belongs to the first language based on the likelihood that the concatenated n-gram belongs to the first language.

2. The method of claim 1 further comprising classifying the name as belonging to the first language based on the likelihood that the name belongs to the first language.

3. The method of claim 1 wherein the first n-gram and the second n-gram are not sequential.

4. The method of claim 1 wherein the first n-gram and the second n-gram overlap.

5. The method of claim 1 wherein the first n-gram and the second n-gram are separated in the name.

6. The method of claim 1 further comprising normalizing the likelihood that the name belongs to the first language.

7. The method of claim 1 further comprising determining likelihoods that each of a series of concatenated n-grams belong to the first language, and wherein determining the likelihood that the name belongs to the first language is based on the determined likelihoods that each of the series of concatenated n-grams belongs to the first language.

8. The method of claim 7 wherein determining the likelihood that the name belongs to the first language comprises adding up the likelihoods that each of the series of concatenated n-grams belong to the first language.

9. The method of claim 8 wherein determining the likelihood that the name belongs to the first language further comprises dividing the sum of the likelihoods by the number of concatenated n-grams added up.

10. The method of claim 1 further comprising determining a likelihood that the concatenated n-gram belongs to a second language.

11. The method of claim 10 further comprising determining a likelihood that the name belongs to the second language based on the likelihood that the concatenated n-gram belongs to the second language.

12. The method of claim 11 further comprising classifying the name as belonging to either the first language or second language based on the likelihoods that the name belongs to the first language and the second language.

13. The method of claim 1 wherein determining the likelihood that the concatenated n-gram belongs to the first language comprises basing the determination on the following term:

0.5+(0.5*(number of times the n-gram occurs in the first language))/(number of times the most common n-gram occurs in the first language)

14. The method of claim 1 wherein determining the likelihood that the concatenated n-gram belongs to the first language comprises basing the determination on an indication of relative frequency of occurrences of the concatenated n-gram in (a) the first language, versus (b) multiple languages.

15. The method of claim 14 wherein basing the determination on an indication of relative frequency of occurrences comprises basing the determination on the following term:

(number of times the concatenated n-gram occurs in the first language)/(number of times the concatenated n-gram occurs in all languages under consideration)

16. The method of claim 1 wherein determining the likelihood that the concatenated n-gram belongs to the first language comprises basing the determination on the following term:

(0.5+(0.5*(number of times the n-gram occurs in the first language))/(number of times the most common n-gram occurs in the first language))* (number of times the concatenated n-gram occurs in the first language)/(number of times the concatenated n-gram occurs in all languages under consideration)

17. The method of claim 1 further comprising:

determining that the name is a surname;

assigning a surname weight to the name based on the determination that the name is a surname;

determining a weighted likelihood that the surname belongs to the first language by multiplying the likelihood that the surname belongs to the first language by the surname weight;

accessing a given name that corresponds to the surname, wherein the given name and the surname form a complete name;

determining a likelihood that the given name belongs to the first language;

assigning a given-name weight to the given name;

determining a weighted likelihood that the given name belongs to the first language by multiplying the likelihood that the given name belongs to the first language by the given-name weight; and

determining a likelihood that the complete name belongs to the first language by adding the weighted likelihood that the given name belongs to the first language and the weighted likelihood that the surname belongs to the first language.

18. The method of claim 1 further comprising:

determining that the name occupies a given name field of a larger name;

determining that a second name occupies a second given name field of the larger name, wherein the name and the second name form a complete given name;

accessing the second name;

determining a likelihood that the second name belongs to the first language; and

determining a likelihood that the complete given name belongs to the first language by averaging the two likelihoods.