Method and apparatus for parallel processing aggregates using intermediate aggregate values
First Claim
1. A computer-implemented method for parallel processing aggregate functions in a computing system, said aggregate functions being performed on a set of data, the computer-implemented method comprising the steps of:
- partitioning said set of data stored in an external type format into multiple subsets of data;
assigning each of said multiple subsets of data to one of a plurality of processes;
said plurality of processes performing intermediate aggregations and conversions in parallel on each of said multiple subsets of data, each of said intermediate aggregations yielding at least one intermediate value, wherein said at least one intermediate value is represented in an internal type format; and
merging said at least one intermediate value from each of said imtermediate aggregations and converting into a final aggregation value stored in said external type format.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention performs parallel processing of aggregate functions in a computing system. Partitioned into multiple subsets of data and each of the multiple subsets of data is allocated to one of a plurality of processes. Intermediate aggregations are performed in parallel by the plurality of processes on each of the multiple subsets of data. Each intermediate aggregation yields at least one intermediate value, wherein the at least one intermediate value is represented in an internal type format. The intermediate values from each of the intermediate aggregations are merged into a final aggregation value.
-
Citations
20 Claims
-
1. A computer-implemented method for parallel processing aggregate functions in a computing system, said aggregate functions being performed on a set of data, the computer-implemented method comprising the steps of:
-
partitioning said set of data stored in an external type format into multiple subsets of data; assigning each of said multiple subsets of data to one of a plurality of processes; said plurality of processes performing intermediate aggregations and conversions in parallel on each of said multiple subsets of data, each of said intermediate aggregations yielding at least one intermediate value, wherein said at least one intermediate value is represented in an internal type format; and merging said at least one intermediate value from each of said imtermediate aggregations and converting into a final aggregation value stored in said external type format. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer system for parallel processing aggregate functions, said aggregate functions being performed on a set of data stored in an external type format, said computer system comprising:
-
a processor; a plurality of process spawned by the processor;
processing logic for,partitioning said set of data into multiple subsets of data; assigning each of said multiple subsets of data to one of said plurality of processes; said plurality of processes performing intermediate aggregations and conversions in parallel on each of said multiple subsets of data, each of said intermediate aggregations yielding at least one intermediate value, wherein said at least one intermediate value is represented in an internal type format; and merging said at least one intermediate value from each of said intermediate aggregations and converting into a final aggregation value stored in said external type format. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A machine readable medium having stored thereon data representing, sequences of instructions, which when executed by a computer system, cause said computer system to perform the steps of:
-
partitioning a set of data stored in an external type format into multiple subsets of data; assigning each of said multiple subsets of data to one of a plurality of precesses; said plurality of precesses performing intermediate aggregations and conversions in parallel on each of said multiple subsets of data, each of said intermediate aggregations yielding at least one intermediate value, wherein said at least one intermediate value is represented in an internal type format; and merging said at least one intermediate value from each of said intermediate aggregations and converting into a final aggregation value stored in said external type format. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification