Device, method, and program for document classification

• US 20060112040A1
• Filed: 10/07/2005
• Published: 05/25/2006
• Est. Priority Date: 10/13/2004
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Oda, Hiromi
• Application Number:
  US11/245,123
• Publication Number:
  US 20060112040A1
• Time in Patent Office: Days
• US Class Current: 706/20
• CPC Class Codes: G06F 16/3347 using vector based model
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A document classifying device, including (a) a vector creating element for creating a document feature vector from an input document to be classified, based upon frequencies with which predetermined collocations occur in the input document; and (b) a classifying element for classifying the input document into one of a number of categories using the document feature vector.

Claims

1. A document classifying device, comprising:

(a) vector creating means for creating a document feature vector from an input document to be classified, based upon frequencies with which predetermined collocations occur in the input document; and

(b) classifying means for classifying the input document into one of a number of categories using the document feature vector.

2. The device according to claim 1, wherein each of the collocations is a consecutive N-gram or a skip N-gram including at least one intermediate word in a middle of the N-grams.

3. The device according to claim 1, wherein the vector creating means further comprises means for reducing the number of the collocations by means of a statistically analyzing method.

4. The device according to claim 1, wherein the vector creating means further comprises means for reducing the number of dimensions of the document feature vector by means of singular value decomposition.

5. The device according to claim 1, wherein the document feature vector includes values obtained from the input document based upon frequencies of appearance of connotation expressions having semantic orientations toward the respective categories.

6. The device according to claim 1, wherein the classifying means classifies the input document according to a discriminant function and further comprises means for modifying the discriminant function by means of a machine learning method using training documents.

7. A document classifying method, comprising:

a step of creating a document feature vector from an input document to be classified based upon frequencies with which predetermined collocations occur in the input document; and

a step of classifying the input document into one of a number of categories using the document feature vector.

8. The method according to claim 7, wherein the step of creating the document feature vector further comprises a step of reducing the number of the collocations by means of a statistically analyzing method.

9. The method according to claim 7, wherein the step of creating the document feature vector further comprises a step of reducing the number of dimensions of the document feature vector by means of singular value decomposition.

10. The method according to claim 7, wherein the document feature vector includes values obtained from the input document based upon the frequencies of appearance of connotation expressions which have semantic orientations toward the respective categories.

11. The method according to claim 7, wherein in the step of classifying the input document, the input document is classified according to a discriminant function, and the step of classifying the input document further comprises a step of modifying the discriminant function by means of a machine learning method using training documents.

16. A processor arrangement for performing the method of claim 7.

12. A computer-readable medium storing therein a program for execution by a computer to perform a document classifying process, said program comprising:

(a) a vector creating processing for creating a document feature vector from an input document to be classified based upon frequencies with which predetermined collocations occur in the input document; and

(b) a classifying processing for classifying the input document into one of a number of categories using the document feature vector.

13. The medium according to claim 12, wherein the vector creating processing further comprises a processing for reducing the number of dimensions of the document feature vector by means of singular value decomposition.

14. The medium according to claim 12, wherein the document feature vector includes values obtained from the input document based upon frequencies of appearance of connotation expressions which have semantic orientations toward the respective categories.

15. The medium according to claim 12, wherein the classifying processing classifies the input document according to a discriminant function and further comprises a processing for modifying the discriminant function by means of a machine learning method using a training document.

17. A document classifying device, comprising:

(a) a vector creating element for creating a document feature vector from an input document to be classified, based upon frequencies with which predetermined collocations occur in the input document; and

(b) a classifying element for classifying the input document into one of a number of categories using the document feature vector.