Systems and Methods for Processing Machine Learning Algorithms in a MapReduce Environment
First Claim
1. A computer implemented method for processing Machine Learning (ML) algorithms in a MapReduce environment, comprising:
- receiving a ML algorithm to be executed in the MapReduce environment;
parsing the ML algorithm into a plurality of statement blocks in a sequence, wherein each statement block comprises a plurality of basic operations (hops);
automatically determining an execution plan for each statement block, wherein at least one of the execution plans comprises one or more low-level operations (lops); and
implementing the execution plans in the sequence of the plurality of the statement blocks.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for processing Machine Learning (ML) algorithms in a MapReduce environment are described. In one embodiment of a method, the method includes receiving a ML algorithm to be executed in the MapReduce environment. The method further includes parsing the ML algorithm into a plurality of statement blocks in a sequence, wherein each statement block comprises a plurality of basic operations (hops). The method also includes automatically determining an execution plan for each statement block, wherein at least one of the execution plans comprises one or more low-level operations (lops). The method further includes implementing the execution plans in the sequence of the plurality of the statement blocks.
-
Citations
26 Claims
-
1. A computer implemented method for processing Machine Learning (ML) algorithms in a MapReduce environment, comprising:
-
receiving a ML algorithm to be executed in the MapReduce environment; parsing the ML algorithm into a plurality of statement blocks in a sequence, wherein each statement block comprises a plurality of basic operations (hops); automatically determining an execution plan for each statement block, wherein at least one of the execution plans comprises one or more low-level operations (lops); and implementing the execution plans in the sequence of the plurality of the statement blocks. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A computer program product comprising a computer useable storage medium to store a computer readable program, wherein the computer readable program, when executed on a computer, causes the computer to perform operations for processing Machine Learning (ML) algorithms in a MapReduce environment, comprising:
-
receiving a ML algorithm to be executed in the MapReduce environment; parsing the ML algorithm into a plurality of statement blocks in a sequence, wherein each statement block comprises a plurality of basic operations (hops); automatically determining an execution plan for each statement block, wherein at least one of the execution plans comprises one or more low-level operations (lops); and implementing the execution plans in the sequence of the plurality of the statement blocks. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A system for processing Machine Learning (ML) algorithms in a MapReduce environment, comprising:
-
means for receiving a ML algorithm to be executed in the MapReduce environment; means for parsing the ML algorithm into a plurality of statement blocks in a sequence, wherein each statement block comprises a plurality of basic operations (hops); means for automatically determining an execution plan for each statement block, wherein at least one of the execution plans comprises one or more low-level operations (lops); and means for implementing the execution plans in the sequence of the plurality of the statement blocks. - View Dependent Claims (26)
-
Specification