Parallel processing system for traversing a transactional database
First Claim
1. In a system including two or more processors, a computer implemented method for traversing one or more logical files, the logical files including two or more physical files of a transactional database, the method comprising the steps of:
- generating one or more sets of parameters for processing the two or more physical files of the transactional database;
assigning a respective thread to each of the two or more physical files of the transactional database, each respective thread including instructions for processing its respective one of the two or more files of the transactional database in accordance with preselected ones of the one or more sets of processing parameters;
sequentially traversing each of the two or more files of the transactional database once in accordance with its respective thread, at least two of the threads operating in parallel;
retrieving, in accordance with the instructions for each thread, information from the respective one of the two or more physical files of the transactional database associated with said thread based upon the preselected ones of the one or more sets of processing parameters associated with said thread;
storing the information retrieved by each thread in an output file.
2 Assignments
0 Petitions
Accused Products
Abstract
A parallel processing system is provided which traverses logical records of an events or transactional database contained in two or more physical files in accordance with one or more view definitions specified by the user. Each view definition includes a set of processing parameters and may reference one or more of the physical files. The one or more view definitions are transformed into entries of a logic table, the logic table including a plurality of sets, each set corresponding to a respective physical file and containing entries corresponding to the view definitions which reference its respective physical file. Each set of the logic table is transformed into machine code instructions for a separate thread of the parallel processing system. Each thread operates on its respective physical file in parallel with one or more of the other threads to traverse the physical file, to retrieve information based upon the view definitions corresponding to the thread, and to store the retrieved information in extract files designated by the view definitions in formats designated by the view definitions.
46 Citations
20 Claims
-
1. In a system including two or more processors, a computer implemented method for traversing one or more logical files, the logical files including two or more physical files of a transactional database, the method comprising the steps of:
-
generating one or more sets of parameters for processing the two or more physical files of the transactional database; assigning a respective thread to each of the two or more physical files of the transactional database, each respective thread including instructions for processing its respective one of the two or more files of the transactional database in accordance with preselected ones of the one or more sets of processing parameters; sequentially traversing each of the two or more files of the transactional database once in accordance with its respective thread, at least two of the threads operating in parallel; retrieving, in accordance with the instructions for each thread, information from the respective one of the two or more physical files of the transactional database associated with said thread based upon the preselected ones of the one or more sets of processing parameters associated with said thread; storing the information retrieved by each thread in an output file. - View Dependent Claims (2, 3, 4)
-
-
5. In a system including two or more processors, a computer implemented method for traversing two or more physical files of a transactional database which correspond to a logical file based upon one or more view definitions, the method comprising the steps of:
-
a) creating one or more view definitions, each view definition defining a set of processing parameters for selected ones of the two or more physical files of the transactional database; b) creating a logic table, the logic table including a logic table set for each of the two or more physical files of the transactional database; c) transforming the set of parameters for each view definition into a respective plurality of logic table entries, the plurality of logic table entries being copied into the logic table sets which correspond to the selected ones of the two or more physical files which correspond to the sets of parameters defined by each view definition; d) associating a respective one of a plurality of threads with each logic table set; e) transforming the logic table entries of each one of the plurality of threads, which correspond to each view definition associated with said each thread, into a set of instructions for said each thread; f) operating each thread in accordance with its set of instructions; to access each entry of its respective one of the two or more physical files of the transactional database, to retrieve information from said entry based upon the view definitions associated with said thread, and to store said retrieved information in one or more extract flies based upon the view definitions associated with said thread, at least two of the plurality of threads operating in parallel. - View Dependent Claims (6, 7, 8, 9, 10)
-
-
11. A parallel processing system for traversing a logical file of a transactional database, the logical file including two or more physical files, the parallel processing system comprising:
-
an input buffer for retrieving blocks of data from the two or more physical files of the transactional database; an output buffer for storing blocks of data in one or more extract files; a logic table storing one or more sets of processing parameters, each set of processing parameters corresponding to a respective view definition, each view definition defining criteria for retrieving information from one or more files of the logical record, each view definition further defining a format of a designated one of the extract files, the logic table including at least two logic table sets, each logic table set associated with a respective file of the two or more files of the transactional database, each logic table set including the respective set of processing parameters associated with each view definition which defines criteria for retrieving information from the respective file associated with said logic table set; a corresponding thread associated with each logic table set, each thread implementing the sets of processing parameters associated with its respective logic table set, each thread sequentially accessing entries from the file of the transactional database associated with its respective logic table set, each thread applying each of its sets of processing parameters to each accessed entry such that each entry is accessed only once, each thread retrieving information from each accessed entry in accordance with its sets of processing parameters and storing the retrieved information in the designated extract files, via the output buffer, in the respective formats defined by the view definitions corresponding to the sets of processing parameters. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification