System and method for displaying relationships between electronically stored information to provide classification suggestions via injection

• US 8,515,957 B2
• Filed: 07/09/2010
• Issued: 08/20/2013
• Est. Priority Date: 07/28/2009
• Status: Active Grant

• Current Assignee: Nuix North America Inc. (Nuix Ltd.)
• Original Assignee: FTI Consulting Incorporated
• Inventors: Knight, William C., Nussbaum, Nicholas I.
• Primary Examiner(s): Wong, Leslie
• Application Number:
  US12/833,872
• Publication Number:
  US 20110029536A1
• Time in Patent Office: 1,138 Days
• Field of Search: 707/E17.046, 707/E17.047, 707/E17.089, 707/E17.09, 707/E17.91, 707/E17.92, 707/737, 707/999.006, 707/999.107
• US Class Current: 707/737
• CPC Class Codes: G06F 16/287 Visualization; Browsing
• CPC Class Codes: G06F 16/3322 using system suggestions G06F16/3325 takes precedence
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/353 into predefined classes
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06F 16/358 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G06N 5/047 Pattern matching networks; Rete networks
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks

Abstract

A system and for providing reference documents as a suggestion for classifying uncoded documents is provided. A reference set of electronically stored information items, each associated with a classification code, is designated. Clusters of uncoded electronically stored information items are designated. One or more of the uncoded electronically stored information items from at least one cluster is compared to the reference set. At least one of the electronically stored information items in the reference set is identified as similar to the one or more uncoded electronically stored information items. The similar electronically stored information items are injected into the at least one cluster. Relationships are visually depicted between the uncoded electronically stored information items and the similar electronically stored information items in the at least one cluster as suggestions for classifying the uncoded electronically stored information items.

Claims

1. A system for providing coded reference electronically stored information items as a suggestion for classifying uncoded electronically stored information, comprising:

a database to store a coded reference set comprising electronically stored information items each associated with a classification code;

a cluster module to designate clusters of uncoded electronically stored information items;

a similarity module to compare one or more of the uncoded electronically stored information items from at least one cluster of the uncoded electronically stored information items to the coded reference set of the coded electronically stored information items and to identify at least one of the coded electronically stored information items in the coded reference set that is similar to the one or more uncoded electronically stored information items;

an injection module to inject the similar coded electronically stored information items into the at least one cluster of the uncoded electronically stored information items; and

a display to visually depict relationships between the uncoded electronically stored information items and the similar coded electronically stored information items in the at least one cluster as suggestions for classifying the uncoded electronically stored information items, wherein each of the uncoded electronically stored information items are displayed via a first symbol and each of the similar coded electronically stored information items are displayed via a second symbol.

2. The system according to claim 1, wherein the comparison of the one or more uncoded electronically stored information items and the coded reference set of the coded electronically stored information items comprises identifying a cluster center for the at least one cluster of the uncoded electronically stored information items based on the one or more uncoded electronically stored information items and comparing the cluster center to the reference set of the coded electronically stored information items.

3. The system according to claim 1, wherein the comparison of the one or more uncoded electronically stored information items and the coded reference set of the coded electronically stored information items comprises identifying a sample comprising the one or more uncoded electronically stored information items in the at least one cluster of the uncoded electronically stored information items and comparing the sample to the coded reference set of the coded electronically stored information items.

4. The system according to claim 1, wherein the comparison of the one or more uncoded electronically stored information items and the coded reference set of the coded electronically stored information items comprises identifying a cluster center for the at least one cluster of the uncoded electronically stored information items, identifying a sample comprising the one or more uncoded electronically stored information items in the at least one cluster, and comparing the cluster center and the sample to the coded reference set of the coded electronically stored information items.

5. The system according to claim 1, wherein the comparison of the one or more uncoded documents and the coded reference document set of the coded electronically stored information items comprises identifying a spine along which the at least one cluster of the uncoded electronically stored information items is located, wherein the spine comprises one or more other clusters, and comparing the uncoded electronically stored information items along the spine to the coded electronically stored information items in the coded reference set.

6. The system according to claim 1, further comprising:

a scoring module to form a score vector for the one or more uncoded electronically stored information items and each coded electronically stored information item in the coded reference set; and

a metric module to calculate a similarity metric by comparing the score vector for the one or more uncoded electronically stored information items with the score vectors for each of the coded electronically stored information items in the coded reference set to determine the similar coded electronically stored information items.

7. A method for providing coded reference electronically stored information items as a suggestion for classifying uncoded electronically stored information, comprising:

designating a coded reference set comprising electronically stored information items each associated with a classification code;

designating clusters of uncoded electronically stored information items;

comparing one or more of the uncoded electronically stored information items from at least one uncoded cluster to the coded reference set of the coded electronically stored information items;

identifying at least one of the coded electronically stored information items in the coded reference set that is similar to the one or more uncoded electronically stored information items;

injecting the similar coded electronically stored information items into the at least one cluster of the uncoded electronically stored information items; and

visually depicting relationships between the uncoded electronically stored information items and the similar coded electronically stored information items in the at least one cluster as suggestions for classifying the uncoded electronically stored information items, wherein each of the uncoded electronically stored information items are displayed via a first symbol and each of the similar coded electronically stored information items are displayed via a second symbol.

8. The method according to claim 7, further comprising:

performing the comparison of the one or more uncoded electronically stored information items and the coded reference set of the coded electronically stored information items, comprising;

calculating a cluster center for the at least one cluster of the uncoded electronically stored information items based on the one or more uncoded electronically stored information items; and

comparing the cluster center to the coded reference set of the coded electronically stored information items.

9. The method according to claim 7, further comprising:

performing the comparison of the one or more uncoded electronically stored information items and the coded reference set of the coded electronically stored information items, comprising;

identifying a sample comprising the one or more uncoded electronically stored information items in the at least one cluster of the uncoded electronically stored information items; and

comparing the sample to the coded reference set of the coded electronically stored information items.

10. The method according to claim 7, further comprising:

performing the comparison of the one or more uncoded electronically stored information items and the reference set, comprising;

calculating a cluster center for the at least one cluster of the uncoded electronically stored information items;

identifying a sample comprising the one or more uncoded electronically stored information items in the at least one cluster of the uncoded electronically stored information items; and

comparing the cluster center and the sample to the coded reference set of the coded electronically stored information items.

11. The method according to claim 7, further comprising:

performing the comparison of the one or more uncoded electronically stored information items and the reference set, comprising;

identifying a spine along which the at least one cluster of the uncoded electronically stored information items is located, wherein the spine comprises one or more other clusters; and

comparing the uncoded electronically stored information items along the spine to the coded electronically stored information items in the coded reference set.

12. The method according to claim 7, further comprising:

determining the similar coded electronically stored information items based on a similarity metric, comprising;

forming a score vector for the one or more uncoded electronically stored information items and each coded electronically stored information item in the coded reference set; and

calculating the similarity metric by comparing the score vector for the one or more uncoded electronically stored information items with the score vectors for each of the coded electronically stored information items in the coded reference set.

13. A system for injecting electronic coded reference documents into a cluster set as suggestions for classifying electronic uncoded documents, comprising:

a database to store a electronic coded set of reference documents each associated with a classification code;

a cluster module to designate clusters of electronic uncoded documents;

a comparison module to compare one or more of the electronic uncoded documents in at least one of the clusters of the electronic uncoded documents to the electronic coded reference document set of the electronic coded reference documents and selecting the electronic coded reference documents that satisfy a similarity threshold with the at least one cluster;

an injection module to inject the selected electronic coded reference documents into the at least one cluster of the electronic uncoded documents; and

a display to display relationships between the electronic uncoded documents and the selected electronic coded reference documents in the at least one cluster as suggestions for classifying the electronic uncoded documents, wherein each of the electronic uncoded documents are displayed via a first symbol and each of the selected electronic coded reference documents are displayed via a second symbol.

14. The system according to claim 13, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises calculating a cluster center for the at least one cluster of the electronic uncoded documents based on the one or more electronic uncoded documents and comparing the cluster center to the electronic coded reference document set to identify the similar electronic coded reference documents.

15. The system according to claim 13, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises identifying a sample comprising at least one electronic uncoded document in the at least one cluster of the electronic uncoded documents and comparing the sample to the electronic coded reference document set.

16. The system according to claim 13, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises calculating a cluster center for the at least one cluster of the electronic uncoded documents based on the electronic uncoded documents in that cluster, identifying a sample comprising one or more of the electronic uncoded documents in the at least one cluster, and comparing the cluster center and the sample to the electronic coded reference document set.

17. The system according to claim 13, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises identifying a spine along which the at least one cluster is located, wherein the spine comprises one or more other clusters, and comparing the electronic uncoded documents along the spine to the electronic coded documents in the electronic coded reference document set.

18. The system according to claim 13, further comprising:

a score module to form a score vector for the one or more electronic uncoded documents in the at least one cluster of the electronic uncoded documents and each electronic coded reference document in the electronic coded reference document set; and

a similarity metric module to calculate a similarity metric by comparing the score vector for the one or more electronic uncoded documents with the score vector for one of the electronic coded reference documents as an inner product.

19. A method for injecting electronic coded reference documents into a cluster set as suggestions for classifying electronic uncoded documents, comprising:

designating a electronic coded set of reference documents each associated with a classification code;

designating clusters of electronic uncoded documents;

comparing one or more of the electronic uncoded documents in at least one of the clusters of the electronic uncoded documents to the electronic coded reference document set and selecting the electronic coded reference documents that satisfy a similarity threshold with the one or more electronic uncoded documents;

injecting the selected electronic coded reference documents into the at least one cluster of the electronic uncoded documents; and

displaying relationships between the electronic uncoded documents and the selected electronic coded reference documents in the at least one cluster as suggestions for classifying the electronic uncoded documents, wherein each of the electronic uncoded documents are displayed via a first symbol and each of the selected electronic coded reference documents are displayed via a second symbol.

20. The method according to claim 19, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises:

calculating a cluster center for the at least one cluster based on the one or more electronic uncoded documents and comparing the cluster center to the electronic coded reference document set.

21. The method according to claim 19, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises:

identifying a sample comprising at least one electronic uncoded document in the at least one cluster of the electronic uncoded documents and comparing the sample to the electronic coded reference document set.

22. The method according to claim 19, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises:

calculating a cluster center for the at least one cluster of the electronic uncoded documents based on the electronic uncoded documents in that cluster;

identifying a sample comprising one or more electronic uncoded documents in the at least one cluster of the electronic uncoded documents; and

comparing the cluster center and the sample to the electronic coded reference document set.

23. The method according to claim 19, wherein the comparison of the one or more electronic uncoded documents and the electronic coded reference document set comprises:

identifying a spine along which the at least one cluster of the electronic uncoded documents is located, wherein the spine comprises one or more other clusters;

comparing the electronic uncoded documents along the spine to the documents in the electronic coded reference document set.

24. The method according to claim 19, further comprising:

determining the selected electronic coded reference documents based on a similarity metric, comprising;

forming a score vector for the one or more electronic uncoded documents in the at least one cluster of the electronic uncoded documents and each reference document in the electronic coded reference document set; and

calculating the similarity metric by comparing the score vector for the one or more electronic uncoded documents with the score vector for one of the electronic coded reference documents as an inner product.