Method for the automatic classification of a text with the aid of a computer system

• US 20100205525A1
• Filed: 01/29/2010
• Published: 08/12/2010
• Est. Priority Date: 01/30/2009
• Status: Abandoned Application

• Current Assignee: Attensity Europe GmbH (Attensity Group Incorporated)
• Original Assignee: Living-e AG (Attensity Group Incorporated)
• Inventors: Konrad, Karsten
• Application Number:
  US12/656,450
• Publication Number:
  US 20100205525A1
• Time in Patent Office: Days
• US Class Current: 715/256
• CPC Class Codes: G06F 16/353 into predefined classes

Abstract

In one embodiment of the present invention, a method is disclosed for the automatic classification of a text contained in an incoming electronic information. At least one qualitative characteristic of at least one word of the text to be classified is determined and the frequency of occurrence of the qualitative characteristic in the text to be classified is also determined. The text to be classified is converted into a sequence of alphanumerical characters, the sequence of alphanumerical characters is dismantled in at least one specified way to form so-called character shingles, and the frequency of occurrence of the character shingle in the text to be classified is determined. A vector is formed from the qualitative characteristic and the associated frequency as well as from the character shingle and the associated frequency. The determined vector is then compared to vectors which are formed ahead of time with the aid of known example texts and in the same way, wherein each of the example texts is assigned to a class. The text to be classified is assigned in dependence of this comparison to one of the classes to which the example text is assigned.

Claims

1. A method for the automatic classification of a text that is contained in an incoming electronic information with the aid of a computer system, the method comprising:

determining at least one qualitative characteristic of at least one word of the text to be classified;

determining a frequency of occurrence of the at least one qualitative characteristic in the text to be classified;

converting the text to be classified to a sequence of alphanumerical characters;

dismantling the sequence of alphanumerical characters in at least one specified way into a character shingle;

determining a frequency of occurrence of the character shingle in the text to be classified;

determining a vector from the at least one qualitative characteristic and an associated frequency of occurrence, and the character shingle and the associated frequency of occurrence;

comparing the determined vector to previously determined vectors of known example texts that are determined in the same way, wherein each of the example texts is assigned to a class; and

assigning the text to be classified in dependence of the comparison to one of the classes to which the example texts are assigned.

2. The method according to claim 1, wherein during the conversion of the text to be classified into a sequence of alphanumerical characters, special characters are deleted.

3. The method according to claim 1, wherein during the conversion of the text to be classified into a sequence of alphanumerical characters, the capitalization is removed.

4. The method according to claim 1, wherein during the conversion of the text to be classified into a sequence of alphanumerical characters, specific characters are replaced with other characters.

5. The method according to claim 1, wherein during the conversion of the text to be classified into a sequence of alphanumerical characters, specific letters at the end of a word are removed.

6. The method according to claim 1, wherein during the conversion of the text to be classified into a sequence of alphanumerical characters, the complete text is encoded in view of existing delimitations.

7. The method according to claim 1, wherein following the dismantling of the sequence of alphanumerical characters to form a so-called character shingle, a number of successively following characters of the sequence are combined.

8. The method according to claims 7, wherein during the combining of successively following characters at least one character of the sequence is omitted.

9. The method according to claim 7, wherein the combining of successively following characters is realized across encoded delimitations of the text, if applicable.

10. The method according to claim 7, wherein a best possible combination of shingles is determined.

11. The method according to claim 1, wherein a weighting of the vectors is carried out.

12. A computer program with program code for realizing the method according to claim 1 if the program code is run on a computer system.

13. A computer program product with a program code that is stored on a machine-readable data carrier for realizing the method according to claim 1 if the program code of the computer program product is run on a computer system.

14. A computer system for the automatic classification of a text contained in an incoming electronic information, wherein a computer program according to claim 12 is present.

15. The method according to claim 2, wherein the special characters include at least one of blank spaces, line/paragraph breaks, and sentence/word separating hyphens.

16. The method according to claim 3, wherein the capitalization is removed at the start of a word.

17. The method according to claim 4, wherein the specific characters being replaced with other characters includes at least one of ä



a;

ae 

a;

ü



u;

ue

u;

ö



o;

oe

o;





s;

ss

s;

ph

f and y

i.

18. The method according to claim 5, wherein the specific letters at the end of a word being removed include at least one of -s, -e, -e, and -en.

19. The method according to claim 6, wherein the complete text being encoded in view of existing delimitations is done by capitalizing respectively the first and the last character of a character chain that corresponds to a word of the text.

20. A computer readable medium including program segments for, when executed on a computer device, causing the computer device to implement the method of claim 1.