Systems and methods for processing complex data sets

• US 20040225443A1
• Filed: 05/08/2003
• Published: 11/11/2004
• Est. Priority Date: 05/08/2003
• Status: Active Grant

• Current Assignee: Tsunami Development LLC
• Original Assignee: MOAC LLC
• Inventors: Kamps, Bill
• Granted Patent: US 6,915,212 B2
• Time in Patent Office: Days
• US Class Current: 702/14
• CPC Class Codes: G01V 1/28 Processing seismic data, e.g. for interpretation or for event detection G01V1/48 takes precedence
• CPC Class Codes: G01V 2210/57 Trace interpolation or extrapolation, e.g. for virtual receiver; Anti-aliasing for missing receivers

Abstract

Various systems and methods of the present invention provide for distributing access to a dataset to a plurality of processing nodes where the dataset is processed to produce node specific outputs. Distribution can be accomplished by a chain, or star-chain distribution model. Some systems and methods of the present invention provide for check-pointing and restarting improperly terminated processes. Other systems and methods provide for computing a coherent result using a cluster of heterogeneous nodes.

Claims

1. A processing cluster, the processing cluster comprising:

a database comprising a dataset;

a first node communicably coupled to the database;

a second node communicably coupled to the first node, wherein the second node is configured to receive at least a portion of the dataset from the first node; and

a third node communicably coupled to the second node, wherein the third node is configured to receive at least a portion of the dataset from the second node.

2. The processing cluster of claim 1, wherein the second node is communicably coupled to the first node, and the third node is communicably coupled to the second node via a network switch.

3. The processing cluster of claim 2, wherein the third node is further communicably coupled to the first node via the network switch.

4. The processing cluster of claim 1, wherein the dataset comprises a first data section and a second data section, and wherein the second node is configured to receive the first data section from the first node, the processing cluster further comprising:

a fourth node communicably coupled to the first node, wherein the fourth node is configured to receive the second data section from the first node; and

a fifth node communicably coupled to the fourth node, wherein the fifth node is configured to receive at least a portion of the second data section from the fourth node.

5. The processing cluster of claim 1, wherein the first node comprises a computer readable medium, and wherein the computer readable medium includes:

instructions executable by the first node to determine if the second node and the third node terminate properly.

6. The processing cluster of claim 5, wherein the computer readable medium further includes:

instructions executable by the first node to identify a processing checkpoint of the second node; and

instructions to restart the second node at the processing checkpoint.

7. The processing cluster of claim 1, wherein the first node comprises a computer readable medium, and wherein the computer readable medium includes:

instructions executable by the first node to convert at least a portion of the dataset to a global type.

8. The processing cluster of claim 7, wherein the computer readable medium is a first computer readable medium, wherein the second node comprises a second computer readable medium, and wherein the second computer readable medium includes:

instructions executable by the second node to convert at least a portion of the dataset to a local type.

9. The processing cluster of claim 1, wherein the processing cluster comprises heterogeneous nodes.

10. The processing cluster of claim 9, wherein the first node is a workstation, and the second node is a personal computer.

11. The processing cluster of claim 1, wherein the dataset comprises input seismic trace data, and wherein the second node is configured to create an image of a first region based at least in part on the input seismic trace data, and the third node is configured to create an image of a second region based at least in part on the input seismic trace data.

12. A data processing system, the system comprising:

a database comprising input data;

a master node communicably coupled to a chain of at least two sub-nodes, wherein the chain of at least two sub-nodes includes at least one sub-node configured to receive the input data from a preceding sub-node.

14. A seismic data processing cluster, the processing cluster comprising:

a database comprising a dataset of input seismic trace data;

a first node communicably coupled to the database;

a second node communicably coupled to the first node, wherein the second node is configured to receive at least a portion of the dataset from the first node; and

a third node communicably coupled to the second node, wherein the third node is configured to receive at least a portion of the dataset from the second node.

15. The seismic data processing cluster of claim 14, wherein the second node is communicably coupled to the first node, and the third node is communicably coupled to the second node via a network switch.

16. The seismic data processing cluster of claim 15, wherein the third node is further communicably coupled to the first node via the network switch.

17. The seismic data processing cluster of claim 14, wherein the dataset comprises a first data section and a second data section, and wherein the second node is configured to receive the first data section from the first node, the processing cluster further comprising:

a fourth node communicably coupled to the first node, wherein the fourth node is configured to receive the second data section from the first node; and

a fifth node communicably coupled to the fourth node, wherein the fifth node is configured to receive at least a portion of the second data section from the fourth node.

18. The seismic data processing cluster of claim 14, wherein the first node comprises a computer readable medium, and wherein the computer readable medium includes:

instructions executable by the first node to determine if the second node and the third node terminate properly.

19. The seismic data processing cluster of claim 18, wherein the computer readable medium further includes:

instructions executable by the first node to identify a processing checkpoint of the second node; and

instructions to restart the second node at the processing checkpoint.

20. The seismic data processing cluster of claim 14, wherein the first node comprises a computer readable medium, and wherein the computer readable medium includes:

instructions executable by the first node to convert at least a portion of the dataset to a global type.

21. The seismic data processing cluster of claim 20, wherein the computer readable medium is a first computer readable medium, wherein the second node comprises a second computer readable medium, and wherein the second computer readable medium includes:

instructions executable by the second node to convert at least a portion of the dataset to a local type.

22. The seismic data processing cluster of claim 14, wherein the processing cluster comprises heterogeneous nodes.

23. The seismic data processing cluster of claim 22, wherein the first node is a workstation, and the second node is a personal computer.

24. The seismic data processing cluster of claim 14, wherein the second node is configured to create an image of a first region based at least in part on the input seismic trace data, and the third node is configured to create an image of a second region based at least in part on the input seismic trace data.

25. A seismic data imaging system, the system comprising:

a database comprising input trace data;

a master node communicably coupled to a chain of at least two sub-nodes, wherein the chain of at least two sub-nodes includes at least one sub-node configured to receive the input trace data from a preceding sub-node.

13. The system of claim 25, wherein the chain of at least two sub-nodes is a first chain, and wherein the master node is communicably coupled to a second chain of at least two sub-nodes.

26. The system of claim 25, wherein the chain of at least two sub-nodes is a first chain, and wherein the master node is communicably coupled to a second chain of at least two sub-nodes.

27. A computer readable medium, the computer readable medium comprising computer executable instructions to:

receive input seismic data from an upstream node, wherein the upstream node is one of a chain of nodes communicably coupled to a master node; and

compute an image of a physical location based at least in part on the input seismic data.

28. The computer readable medium of claim 27, wherein the computer readable medium further comprises computer executable instructions to:

monitor a termination characteristic of a downstream node, wherein the downstream node is one of the chain of nodes.

29. The computer readable medium of claim 28, wherein the computer readable medium further comprises computer executable instructions to:

identify a checkpoint of the downstream node; and

restart the downstream node at the checkpoint.

30. The computer readable medium of claim 27, wherein the computer readable medium further comprises computer executable instructions to:

convert the input seismic data to a global type.

31. The computer readable medium of claim 27, wherein the computer readable medium further comprises computer executable instructions to:

convert the input seismic data to a local type.

32. The computer readable medium of claim 27, wherein the computer readable medium further comprises computer executable instructions to:

receive job parameters; and

transfer the image to the master node.

33. A computer readable medium, the computer readable medium comprising computer executable instructions to:

access an output trace file, wherein the output trace file identifies a plurality of output traces to be computed;

access a node file, wherein the node file includes an attribute about each node in a chain of nodes; and

assign each of the plurality of output traces to a node in the chain of nodes, wherein computation of each of the plurality of output traces on the assigned nodes completes within a balanced time.

34. The computer readable medium of claim 33, the computer readable medium further comprising computer executable instructions to:

determine a time required to compute an output trace selected from the plurality of output traces on a node selected from the chain of nodes.

35. The computer readable medium of claim 33, the computer readable medium further comprising computer executable instructions to:

monitor computation of an output trace on an assigned node.

36. The computer readable medium of claim 35, the computer readable medium further comprising computer executable instructions to:

identify a checkpoint of the assigned node; and

restart the assigned node at the checkpoint.

37. The computer readable medium of claim 33, the computer readable medium further comprising computer executable instructions to:

receive the computed output traces from the respective assigned nodes.

38. The computer readable medium of claim 33, wherein the plurality of output traces is a first plurality of output traces, wherein the chain of nodes is a first chain of nodes, and wherein the first plurality of output traces is a subset of a group of output traces, the computer readable medium further comprising computer executable instructions to:

segregate the group of output traces into at least the first plurality of output traces and a second plurality of output traces;

access an output trace file, wherein the output trace file identifies a plurality of output traces to be computed;

access a node file, wherein the node file includes an attribute about each node in a chain of nodes; and

assign each of the second plurality of output traces to a node in a second chain of nodes.

39. A method of computing, the method comprising:

accessing a dataset;

designating a plurality of nodes as a node chain, wherein the node chain comprises a first node, a second node, and a third node;

transferring the dataset from the first node to the second node, and from the second node to the third node;

processing the dataset on the first node to create a first output, on the second node to create a second output, and on the third node to create a third output; and

assembling the first, second and third outputs to form a coherent output.

40. The method of claim 39, wherein the coherent output is an image of a geologic structure.