Method of learning associations between documents and data sets

• US 20060282442A1
• Filed: 04/20/2006
• Published: 12/14/2006
• Est. Priority Date: 04/27/2005
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Doan, Khanh Phi Van, Mariadassou, Joe, Lennon, Alison Joan
• Application Number:
  US11/407,238
• Publication Number:
  US 20060282442A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

A method of learning associations between classes of documents and one or more structured data sets comprises a step of classifying an input document into a class selected from a predefined set of classes (step 115). One or more structured data sets are displayed (step 130), wherein the displayed structured data sets are dependent on association information for the class. One or more indications of changes to the displayed structured data sets are received (steps 815, 830, 845) and the association information for the class is amended (step 850) based on the received indications.

Claims

1. A method of learning associations between classes of documents and one or more structured data sets, said method comprising the steps of:

classifying a document into a class selected from a predefined set of classes;

displaying one or more structured data sets, wherein the displayed structured data sets are dependent on association information for the class;

receiving one or more indications of changes to the displayed structured data sets;

amending the association information for the class based on the received indications.

2. A method according to claim 1 wherein the association information comprises at least one query defining a structured data set.

3. A method according to claim 2 wherein the query comprises information extracted from the document.

4. A method according to claim 2 or 3 wherein the received indication results in a query being added to the association information for the class.

5. A method according to claim 2 or 3 wherein the received indication results in a query being modified in the association information for the class.

6. A method according to claim 2 or 3 wherein the received indication results in a query being deleted from the association information for the class.

7. A method according to claim 2 or 3 wherein the received indication results in a query being deleted from the association information for the class and wherein the query is deleted from the association information for the class if a predetermined number of indications to delete the query have been received.

8. A method according to any one of claims 1 to 3 wherein said classifying of the document is based on one or more information components extracted from the document.

9. A method according to any one of claims 1 to 3 wherein the document is classified into more than one class.

10. A method according to any one of claims 1 to 3 wherein said classification step comprises the steps of:

identifying one or more information components in the document;

calculating a membership score for the document in each class in the set of classes, based on the identified information components; and

classifying the document based on the membership scores.

11. A method according to any one of claims 1 to 3, wherein said classifying step is based on an analysis of previously classified documents.

12. A method according to claim 1 comprising the further step of:

extracting at least one item of information from a displayed data set for use in a task associated with the document.

13. A method according to any one of claims 1 to 3 further comprising the step of:

verifying information in the document using data in a displayed data set.

14. A method according to any one of claims 1 to 3 wherein the document is an unstructured document without a predefined format.

15. A method of extracting information for processing a document;

the method comprising the steps of;

classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

extracting data from the document and the data set to process the document according to one or more tasks associated with the class.

16. A method of verifying information for processing a document, the method comprising the steps of:

classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

verifying information in the document using the identified data set;

extracting information from the document to process the document according to one or more tasks associated with the class.

17. An apparatus for learning associations between classes of documents and one or more structured data sets, said apparatus comprising:

means for classifying a document into a class selected from a predefined set of classes;

means for displaying one or more structured data sets, wherein the displayed structured data sets are dependent on association information for the class;

means for receiving one or more indications of changes to the displayed structured data sets; and

means for amending the association information for the class based on the received indications.

18. An apparatus for extracting information for processing a document, said apparatus comprising:

means for classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

means for identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

means for extracting data from the document and the data set to process the document according to one or more tasks associated with the class.

19. An apparatus for verifying information for processing a document, the apparatus comprising:

means for classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

means for identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

means for verifying information in the document using the identified data set;

means for extracting information from the document to process the document according to one or more tasks associated with the class.

20. A computer program product comprising machine-readable program code recorded on a machine-readable recording medium, for controlling the operation of a data processing apparatus on which the program code executes to perform a method of learning associations between classes of documents and one or more structured data sets, said method comprising the steps of:

classifying a document into a class selected from a predefined set of classes;

displaying one or more structured data sets, wherein the displayed structured data sets are dependent on association information for the class;

receiving one or more indications of changes to the displayed structured data sets; and

amending the association information for the class based on the received indications.

21. A computer program product comprising machine-readable program code recorded on a machine-readable recording medium, for controlling the operation of a data processing apparatus on which the program code executes to perform a method of extracting information for processing a document;

the method comprising the steps of;

classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

extracting data from the document and the data set to process the document according to one or more tasks associated with the class.

22. A computer program product comprising machine-readable program code recorded on a machine-readable recording medium, for controlling the operation of a data processing apparatus on which the program code executes to perform a method of verifying information for processing a document, the method comprising the steps of:

classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

verifying information in the document using the identified data set;

extracting information from the document to process the document according to one or more tasks associated with the class.

23. A computer program comprising machine-readable program code for controlling the operation of a data processing apparatus on which the program executes to perform a method of learning associations between classes of documents and one or more structured data sets, said method comprising the steps of:

classifying a document into a class selected from a predefined set of classes;

displaying one or more structured data sets, wherein the displayed structured data sets are dependent on association information for the class;

receiving one or more indications of changes to the displayed structured data sets;

amending the association information for the class based on the received indications.

24. A computer program comprising machine-readable program code for controlling the operation of a data processing apparatus on which the program executes to perform a method of extracting information for processing a document;

the method comprising the steps of;

classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

extracting data from the document and the data set to process the document according to one or more tasks associated with the class.

25. A computer program comprising machine-readable program code for controlling the operation of a data processing apparatus on which the program executes to perform a method of verifying information for processing a document, the method comprising the steps of:

classifying the document into a class selected from a predefined set of classes, wherein said classifying is dependent on first information in the document;

identifying a data set based on second information in the document, wherein said identifying is dependent on association information adaptively obtained through processing other documents in the class;

verifying information in the document using the identified data set;

extracting information from the document to process the document according to one or more tasks associated with the class.

26. A system for learning associations between classes of documents and one or more structured data sets, said system comprising:

data storage for storing at least one document, association information for a predefined set of classes of documents, and one or more databases; and

a processor in communication with the data storage and adapted to;

classify a document into a corresponding class selected from the predefined set of classes;

display one or more structured data sets derived from the one or more databases based on the association information for the corresponding class;

receive one or more indications of changes to the displayed structured data sets; and

amend the association information for the corresponding class based on the received indications.