SYSTEM AND METHOD FOR PROVIDING TECHNOLOGY ASSISTED DATA REVIEW WITH OPTIMIZING FEATURES

• US 20140280070A1
• Filed: 02/26/2014
• Published: 09/18/2014
• Est. Priority Date: 03/13/2013
• Status: Active Grant

• Current Assignee: Open Text Holdings, Inc. (Open Text Corporation)
• Original Assignee: Daegis Incorporated (Open Text Corporation)
• Inventors: George, Duane, Stewart, Douglas Wayne
• Granted Patent: US 9,886,500 B2
• Time in Patent Office: Days
• US Class Current: 707/722
• CPC Class Codes: G06F 16/345 Summarisation for human users
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

The invention provided is a system configured to use a topic-related generative model to build a document map from a plurality of documents in a storage medium and generate a control set from the plurality of documents including at least two stratified document sets. The system then receives a set of control set metrics regarding the control set from a user. The system selects a machine call responsive document from a document map based on a determined predictive responsiveness for that document. The system receives a responsiveness call from a user through the task/queue framework regarding a machine call document. Finally, the system compares the responsiveness of the machine call document to the control set metrics and rebuilds the document map based on the results of the comparison between the machine call document responsiveness and the control set metrics.

Claims

1. A data review method including a system containing

a plurality of documents;

a storage medium including a relational database;

a relational database management system;

a distributed file system;

a task/queue framework;

a messaging framework;

a distributed file system parallel processing unit; and

a topic-related generative model and comprising the steps of;

using the topic-related generative model in order to build a document map of the plurality of documents within the storage medium;

generating a control set from the plurality of documents that includes at least 2 stratified document sets;

sending the control set to a user;

receiving a set of control set metrics regarding the control set from the user;

selecting a machine call responsive document from the document map based on the determined predictive responsiveness;

receiving a responsiveness call from a user regarding a machine call document;

comparing the responsiveness of the machine call document to the control set metrics;

rebuilding the document map based on the results of the comparison between the machine call document responsiveness and the control set metrics.

2. The method as set in claim 1, further comprising the step of randomly sampling documents within each stratified document set in order to generate the control set.

3. The method as set in claim 1, wherein the steps of producing a machine call responsive document from the document map based on the determined predictive responsiveness;

receiving a responsiveness call from a user regarding a machine call document;

comparing the responsiveness of the machine call document to the control set metrics; and

rebuilding the document map based on the results of the comparison between the machine call document responsiveness and the control set metrics constitute a review cycle and further comprising the steps of;

generating at least two review cycles, a first cycle and a second cycle;

generating a confidence score based on the comparison between the machine call document responsiveness and the control set metrics;

taking the average between the confidence score of the first cycle and the confidence score of the second cycle and generating a confidence score average.

4. A system comprising:

a plurality of documents;

a storage medium including a relational database;

a relational database management system;

a distributed file system;

a task/queue framework;

a messaging framework;

a distributed file system parallel processing unit; and

a topic-related generative model wherein

the topic-related generative model is used to build a document map of the plurality of documents within the storage medium;

the system generates a control set from the plurality of documents that includes at least 2 stratified document sets;

the system sends the control set to a user through the task/queue framework;

the system receives a set of control set metrics regarding the control set from the user;

the system selects a machine call responsive document from the document map based on the determined predictive responsiveness;

the system receives a responsiveness call from a user through the task/queue framework regarding a machine call document;

the system compares the responsiveness of the machine call document to the control set metrics;

the system rebuilds the document map based on the results of the comparison between the machine call document responsiveness and the control set metrics.

5. The system as set in claim 4, wherein the system randomly samples documents within each stratified document set in order to generate the control set.

6. The system as set in claim 4, wherein the system generates a review cycle consisting of producing a machine call responsive document from the document map based on the determined predictive responsiveness;

receiving a responsiveness call from a user regarding a machine call document;

comparing the responsiveness of the machine call document to the control set metrics; and

rebuilding the document map based on the results of the comparison between the machine call document responsiveness and the control set metrics and wherein;

the system generates at least two review cycles, a first cycle and a second cycle;

the system generates a confidence score based on the comparison between the machine call document responsiveness and the control set metrics;

the system takes the average between the confidence score of the first cycle and the confidence score of the second cycle and generating a confidence score average.

7. A non-transitory information recording medium on which a computer readable program is recorded that causes a computer to function as a system comprising:

a plurality of documents;

a storage medium including a relational database;

a relational database management system;

a distributed file system;

a task/queue framework;

a messaging framework;

a distributed file system parallel processing unit; and

a topic-related generative model wherein

the topic-related generative model is used to build a document map of the plurality of documents within the storage medium;

the system generates a control set from the plurality of documents that includes at least 2 stratified document sets;

the system sends the control set to a user through the task/queue framework;

the system receives a set of control set metrics regarding the control set from the user;

the system selects a machine call responsive document from the document map based on the determined predictive responsiveness;

the system receives a responsiveness call from a user through the task/queue framework regarding a machine call document;

the system compares the responsiveness of the machine call document to the control set metrics;

the system rebuilds the document map based on the results of the comparison between the machine call document responsiveness and the control set metrics.