SYSTEM AND METHOD FOR PARALLEL STREAM PROCESSING
First Claim
1. A computer implemented system for parallel processing which includes at least one process group which, during execution of the parallel process, includes:
- (a) a first digital data stream generated by a first process;
(b) a second digital data stream generated by a second process; and
,(c) a third process for controllably receiving said first and second data streams and in response thereto generating a third digital data stream,wherein said first, second and third processes are defined by a common unique communication context associated with said at least one group.
1 Assignment
0 Petitions
Accused Products
Abstract
We describe the design of a lightweight library using MPI to support stream-processing on acyclic process structures. The design can be used to connect together arbitrary modules where each module can be its own parallel MPI program. We make extensive use of MPI groups and communicators to increase the flexibility of the library, and to make the library easier and safer to use. The notion of a communication context in MPI ensures that libraries do not conflict where a message from one library is mistakenly received by another. The library is not required to be part of any larger workflow environment and is compatible with existing MPI execution environments. The library is part of MarketMiner, a system for executing financial workflows.
-
Citations
16 Claims
-
1. A computer implemented system for parallel processing which includes at least one process group which, during execution of the parallel process, includes:
-
(a) a first digital data stream generated by a first process; (b) a second digital data stream generated by a second process; and
,(c) a third process for controllably receiving said first and second data streams and in response thereto generating a third digital data stream, wherein said first, second and third processes are defined by a common unique communication context associated with said at least one group. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer implemented method for parallel processing wherein the method comprises:
-
providing a process group which during execution of the parallel process, comprises; (a) a first digital data stream generated by a first process; (b) a second digital data stream generated by a second process; (c) a third process for controllably receiving said first and second data streams and in response thereto generating a third digital data stream and defining said first, second and third processes by a common unique communication context associated with said at least one group. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
Specification