SYSTEM, METHOD, AND APPARATUS FOR COORDINATING DISTRIBUTED ELECTRONIC DISCOVERY PROCESSING

• US 20150254109A1
• Filed: 03/04/2015
• Published: 09/10/2015
• Est. Priority Date: 03/05/2014
• Status: Active Grant

• Current Assignee: ONE Discovery, Inc.
• Original Assignee: Driven, Inc. (Xplenty Ltd.)
• Inventors: Chandramouli, Arvinth, Ramia, Roger, Francis, Elias, Soto, Anthony, Zinzuwadia, Hitesh
• Granted Patent: US 9,354,936 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06F 9/5066 Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs mappping at compile time, see G06F8/451
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

The present invention relates to a method, system, and apparatus for coordinating distributed electronic discovery processing. The method may comprise the steps of receiving electronic discovery data comprising a plurality of electronic files, determining, with at least one processor, a plurality of discrete tasks for processing the electronic discovery data, determining, with at least one processor, a coordinated distribution of the plurality of discrete tasks to a plurality of computers, and assigning at least a portion of the plurality of discrete tasks to the plurality of computers based on the coordinated distribution such that at least one discrete task is assigned to each computer at any given time or during any given time period. A system and apparatus configured to perform the method is also disclosed.

Claims

1. A computer-implemented method for coordinating distributed electronic discovery processing, comprising:

receiving electronic discovery data for each of a plurality of discovery processing sessions, the electronic discovery data comprising a plurality of electronic files, wherein each session is associated with a priority;

determining, with at least one processor, a plurality of discrete tasks for processing the electronic discovery data for each session of the plurality of discovery processing sessions;

determining, with at least one processor, a coordinated distribution of the plurality of discrete tasks to a plurality of available worker machines based at least partially on the priority of each session of the plurality of discovery processing sessions, wherein the plurality of available worker machines comprise a plurality of virtual machines hosted by at least one physical host computer;

assigning the plurality of discrete tasks to the plurality of available worker machines based on the coordinated distribution; and

recording, in at least one database, processed data resulting from a performance of each discrete task by a worker machine.

2. The method of claim 1, wherein the electronic discovery data comprises compressed email archive files and/or compressed hard-drive images.

3. The method of claim 1, wherein the processed data is the result of at least one of the following:

extracting at least a portion of a file from the electronic discovery data, extracting metadata from at least one file from the electronic discovery data, optically recognizing characters in at least one image, or any combination thereof.

4. The method of claim 1, wherein the processed data comprises at least one of the following:

a file, an image rendition, metadata, or any combination thereof.

5. The method of claim 1, wherein assigning the plurality of discrete tasks to the plurality of available worker machines comprises assigning at least one discrete task to each available worker machine.

6. The method of claim 1, further comprising generating at least one user interface, the at least one user interface comprising selectable options configured to facilitate user selection of a data source and initiation of an electronic discovery processing session.

7. The method of claim 1, further comprising generating at least one user interface, the at least one user interface comprising selectable options configured to facilitate user input of the priority factor for each discovery processing session.

8. The method of claim 7, wherein the priority factor comprises at least one of the following:

a low priority, a normal priority, a high priority, a configurable priority, or any combination thereof.

9. The method of claim 1, further comprising generating at least one user interface, the at least one user interface comprising selectable options configured to facilitate user input of a bias for the electronic discovery processing session, wherein the coordinated distribution of tasks is determined based at least partially on the bias.

10. The method of claim 1, further comprising:

determining that a file in the plurality of electronic files is duplicative of a previously processed file;

creating a new record for the file;

generating a clone of the previously processed file; and

storing the clone in the new record.

11. A system for distributed electronic discovery processing, comprising:

(a) at least one data storage device comprising electronic discovery data;

(b) a plurality of worker machines, wherein each worker machine comprises at least one of a virtual machine and a physical computer programmed or configured to;

(i) receive a discrete processing task to process data from the electronic discovery data;

(ii) perform the discrete processing task, resulting in processed data; and

(iii) record the processed data to at least one data storage device;

(c) an electronic discovery distribution engine executing on at least one computer and in communication with the at least one data storage device and the plurality of worker machines, the electronic discovery distribution engine configured to;

(i) determine a plurality of discrete processing tasks for processing the electronic discovery data; and

(ii) automatically coordinate a distribution of the plurality of discrete processing tasks to available worker machines of the plurality of worker machines.

12. The system of claim 11, wherein at least one discrete processing task is assigned to a single worker machine at a given time or during any given time period.

13. The system of claim 11, wherein each worker machine is further programmed or configured to:

(iv) transmit an indication that the at least one discrete processing task is completed, and

wherein the electronic discovery distribution engine is further programmed or configured to;

(iii) receive the indication from a worker machine; and

(iv) distribute a next task to the worker machine after receiving the indication.

14. The system of claim 11, wherein the electronic discovery data comprises compressed email archive files and/or compressed hard-drive images, and wherein the compressed hard-drive images comprise multiple different file types.

15. The system of claim 11, wherein the plurality of discrete processing tasks comprise at least one of the following:

extracting at least a portion of an electronic file from the electronic discovery data, extracting metadata from at least one file from the electronic discovery data, optically recognizing characters in at least one image, or any combination thereof.

16. The system of claim 11, wherein the plurality of worker machines comprise a plurality of virtual machines executing on at least one physical host computer.

17. The system of claim 11, further comprising at least one user interface comprising selectable options configured to facilitate user selection of a data source and initiation of an electronic discovery processing session.

18. The system of claim 17, wherein the at least one user interface further comprises at least one selectable option configured to facilitate user input of a priority factor for the electronic discovery processing session, and wherein the coordinated distribution of tasks is determined based at least partially on the priority factor.

19. The system of claim 17, wherein the at least one user interface further comprises at least one selectable option configured to facilitate user input of a bias for the electronic discovery processing session, wherein the coordinated distribution of tasks is based at least partially on an allocation of available worker machines, and wherein the allocation of available worker machines is based at least partially on the bias for the electronic discovery processing session.

20. The system of claim 19, wherein the allocation of available worker machines is based at least partially on biases for a plurality of electronic discovery sessions having a same priority.

21. A computer program product for coordinating distributed electronic discovery processing for a plurality of discovery processing sessions, comprising at least one non-transitory computer-readable medium including program instructions that, when executed by at least one processor, cause the at least one processor to:

receive electronic discovery data for each of a plurality of discovery processing sessions, the electronic discovery data comprising a plurality of electronic files, wherein each session is associated with a priority;

determine a plurality of discrete tasks for processing the electronic discovery data for each session of the plurality of discovery processing sessions;

determine a coordinated distribution of the plurality of discrete tasks to a plurality of available worker machines based at least partially on the priority of each session of the plurality of discovery processing sessions, wherein the plurality of available worker machines comprise a plurality of virtual machines hosted by at least one physical host computer;

assign the plurality of discrete tasks to the plurality of worker machines based on the coordinated distribution; and

record processed data resulting from a performance of each discrete task by a worker machine.