Text-classification code, system and method
First Claim
1. A computer-executed method for classifying a target document in the form of a digitally encoded natural-language text into one or more of two or more different classes, comprising the steps of:
- (a) for each of a plurality of terms selected from one of (i) non-generic words in the document, (ii) proximately arranged word groups in the document, and (iii) a combination of (i) and (ii), determining a selectivity value calculated as the frequency of occurrence of the term in a library of texts in one field, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively,(b) representing the document as a vector of terms, where the coefficient assigned to each term is a function of the selectivity value determined for the term,(c) determining for each of a plurality of sample texts, a match score related to the number of descriptive terms present in or derived from the text that match those in the target document, where each of the plurality of sample texts has an associated classification identifier that identifies the one of more different classes to which the text belongs,(d) selecting one or more of the sample texts having the highest match scores,(e) recording the one or more classification identifiers associated with the one or more sample texts having the highest match scores, and(f) associating the one or more classification identifiers from step (e) with the target document, thereby to classify the target document as belonging to one or more classes represented by at least one of the classification identifiers from step (e).
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are a computer-readable code, system and method for classifying a target document in the form of a digitally encoded natural-language text as belonging to one or more of two or more different classes. For each of a plurality of non-generic words and/or words groups characterizing the target document, there is determined a selectivity value calculated as the frequency of occurrence of that term in a library of texts in one field, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively, and the document is represented as a vector of terms, where the coefficient assigned to each term is a function of the selectivity value determined for that term. There is then determined, for each of the plurality of sample texts having associated classification identifiers, a match score related to the number of descriptive terms present in or derived from that text that match those in the target text. From the selected matched texts, and the associated classification identifiers, a classification determination of the target document is made.
-
Citations
22 Claims
-
1. A computer-executed method for classifying a target document in the form of a digitally encoded natural-language text into one or more of two or more different classes, comprising the steps of:
-
(a) for each of a plurality of terms selected from one of (i) non-generic words in the document, (ii) proximately arranged word groups in the document, and (iii) a combination of (i) and (ii), determining a selectivity value calculated as the frequency of occurrence of the term in a library of texts in one field, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively, (b) representing the document as a vector of terms, where the coefficient assigned to each term is a function of the selectivity value determined for the term, (c) determining for each of a plurality of sample texts, a match score related to the number of descriptive terms present in or derived from the text that match those in the target document, where each of the plurality of sample texts has an associated classification identifier that identifies the one of more different classes to which the text belongs, (d) selecting one or more of the sample texts having the highest match scores, (e) recording the one or more classification identifiers associated with the one or more sample texts having the highest match scores, and (f) associating the one or more classification identifiers from step (e) with the target document, thereby to classify the target document as belonging to one or more classes represented by at least one of the classification identifiers from step (e). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. An automated system for classifying a target document in the form of a digitally encoded text as belonging to one or more of a plurality of different classes comprising
(1) a computer, (2) accessible by said computer, a database of word records, where each record includes text identifiers of the library texts that contain the word, associated library and classification identifiers for each text, and optionally, one or more selectivity values for each word, where the selectivity value of a term in a library of texts in a field is related to the frequency of occurrence of the term in said library, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively, (3) a computer readable code which is operable, under the control of said computer, to perform steps comprising: -
(a) for each of a plurality of terms selected from one of (i) non-generic words in the document, (ii) proximately arranged word groups in the document, and (iii) a combination of (i) and (ii), determining a selectivity value calculated as the frequency of occurrence of the term in a library of texts in one field, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively, (b) representing the document as a vector of terms, where the coefficient assigned to each term is a function of the selectivity value determined for the term, (c) determining for each of a plurality of sample texts, a match score related to the number of descriptive terms present in or derived from the text that match those in the target document, where each of the plurality of sample texts has an associated classification identifier that identifies the one of more different classes to which the text belongs, (d) selecting one or more of the sample texts having the highest match scores, (e) recording the one or more classification identifiers associated with the one or more sample texts having the highest match scores, and (f) associating the one or more classification identifiers from step (e) with the target document, thereby to classify the target document as belonging to one or more classes represented by at least one of the classification identifiers from step (e). - View Dependent Claims (17, 18, 19, 20, 21)
-
-
22. Computer readable code for use with an electronic computer and a database word records in classifying a target document in the form of a digitally encoded text as belonging to one or more of a plurality of different classes, where each record in the word records database includes text identifiers of the library texts that contain the word, an associated library identifier for each text, an associated classification identifier for each text, and optionally, one or more selectivity values for each word, where the selectivity value of a term in a library of texts in a field is related to the frequency of occurrence of the term in said library, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively, said code being operable, under the control of said computer, to perform steps comprising:
-
(a) for each of a plurality of terms selected from one of (i) non-generic words in the document, (ii) proximately arranged word groups in the document, and (iii) a combination of (i) and (ii), determining a selectivity value calculated as the frequency of occurrence of the term in a library of texts in one field, relative to the frequency of occurrence of the same term in one or more other libraries of texts in one or more other fields, respectively, (b) representing the document as a vector of terms, where the coefficient assigned to each term is a function of the selectivity value determined for the term, (c) determining for each of a plurality of sample texts, a match score related to the number of descriptive terms present in or derived from the text that match those in the target document, where each of the plurality of sample texts has an associated classification identifier that identifies the one of more different classes to which the text belongs, (d) selecting one or more of the sample texts having the highest match scores, (e) recording the one or more classification identifiers associated with the one or more sample texts having the highest match scores, and (f) associating the one or more classification identifiers from step (e) with the target document, thereby to classify the target document as belonging to one or more classes represented by at least one of the classification identifiers from step (e).
-
Specification