Methods and systems for dynamic parallel processing
First Claim
Patent Images
1. A computer-implemented method comprising:
- performing dynamic parallel processing of a plurality of subprocesses of a process initiated by a parallel processing framework, each of the plurality of subprocesses including processing of one or more data objects in a computer system comprising a plurality of servers for processing the plurality of data objects by the plurality of subprocesses;
building, by using a processor of the computer system, work packages from the plurality of data objects according to a process-specific scheme and by using a wildcard to associate a range of the data objects to one of the work packages, wherein a size of one of the work packages is chosen based on a predefined granularity, the predefined granularity causing all available servers from the plurality of servers to execute at least one work package during runtime when the work packages are procurable;
setting a process specific execution order of the work packages, the work packages including a first work package and a second work package;
dynamically distributing the work packages among the plurality of servers according to the process-specific execution order, the plurality of servers including a first server and a second server, wherein processing of the work packages is performed by the plurality of servers in a semantically arbitrary order based on predefined process-specific parameters; and
generating a graphical display indicating that the first work package is assigned to the first server and that the second work package is assigned to the second server, wherein the graphical display includes a name of the first work package, a name of the second package, a name of the first server, a name of the second server, and a status indicating that the first work package is currently being processed by the first server.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are disclosed for dynamic parallel processing of a plurality of subprocesses of a process initiated by a parallel processing framework. The plurality of subprocesses may include processing of one or more data objects in a computer system including a plurality of servers for processing the plurality of data objects by the plurality of subprocesses. The method may include building work packages from the plurality of data objects according to a process-specific scheme, and dynamically distributing the work packages of the plurality of data objects among the plurality of servers according to a process-specific execution order.
-
Citations
24 Claims
-
1. A computer-implemented method comprising:
-
performing dynamic parallel processing of a plurality of subprocesses of a process initiated by a parallel processing framework, each of the plurality of subprocesses including processing of one or more data objects in a computer system comprising a plurality of servers for processing the plurality of data objects by the plurality of subprocesses; building, by using a processor of the computer system, work packages from the plurality of data objects according to a process-specific scheme and by using a wildcard to associate a range of the data objects to one of the work packages, wherein a size of one of the work packages is chosen based on a predefined granularity, the predefined granularity causing all available servers from the plurality of servers to execute at least one work package during runtime when the work packages are procurable; setting a process specific execution order of the work packages, the work packages including a first work package and a second work package; dynamically distributing the work packages among the plurality of servers according to the process-specific execution order, the plurality of servers including a first server and a second server, wherein processing of the work packages is performed by the plurality of servers in a semantically arbitrary order based on predefined process-specific parameters; and generating a graphical display indicating that the first work package is assigned to the first server and that the second work package is assigned to the second server, wherein the graphical display includes a name of the first work package, a name of the second package, a name of the first server, a name of the second server, and a status indicating that the first work package is currently being processed by the first server. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer system for dynamic parallel processing of a plurality of subprocesses of a process, the plurality of subprocesses including processing of one or more data objects, comprising:
-
a computing unit providing a parallel processing framework, each of the plurality of subprocesses including processing of one or more data objects; a plurality of servers for processing the plurality of data objects by the plurality of subprocesses; and an adapter unit interconnecting the computing unit and the plurality of servers, the adapter unit being arranged and constructed to; automatically build work packages of the plurality of data objects based on predefinable rules and by using a wildcard to associate a range of the data objects to one of the work packages, wherein a size of one of the work packages is chosen based on a predefined granularity, the predefined granularity causing all available servers from the plurality of servers to execute at least one work package during runtime when the work packages are procurable; set a process specific execution order of the work packages, the work packages including a first work package and a second work package; dynamically distribute the work packages of the plurality of data objects among the plurality of servers according to the process-specific execution order, the plurality of servers including a first server and a second server, wherein processing of the work packages is performed by the plurality of servers in a semantically arbitrary order based on predefined process-specific parameters; and generate a graphical display indicating that the first work package is assigned to the first server and that the second work package is assigned to the second server, wherein the graphical display includes a name of the first work package, a name of the second package, a name of the first server, a name of the second server, and a status indicating that the first work package is currently being processed by the first server. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A non-transitory computer readable storage medium comprising program code instructions which, when executed on a processor, causes the processor to perform a method, the method being executed by the processor comprising:
-
performing dynamic parallel processing of a plurality of subprocesses of a process initiated by a parallel processing framework, the plurality of subprocesses including processing of one or more data objects in a computer system comprising a plurality of servers for processing the plurality of data objects by the plurality of subprocesses; building work packages from the plurality of data objects according to a process-specific scheme and by using a wildcard to associate a range of the data objects to one of the work packages, wherein a size of one of the work packages is chosen based on a predefined granularity, the predefined granularity causing all available servers from the plurality of servers to execute at least one work package during runtime when the work packages are procurable; setting a process specific execution order of the work packages, the work packages including a first work package and a second work package; dynamically distributing the work packages among the plurality of servers according to the process-specific execution order, the plurality of servers including a first server and a second server, wherein processing of the work packages is performed by the plurality of servers in a semantically arbitrary order based on predefined process-specific parameters; and generating a graphical display indicating that the first work package is assigned to the first server and that the second work package is assigned to the second server, wherein the graphical display includes a name of the first work package, a name of the second package, a name of the first server, a name of the second server, and a status indicating that the first work package is currently being processed by the first server. - View Dependent Claims (22, 23, 24)
-
Specification