COMPUTER-READABLE RECORDING MEDIUM, EXECUTION CONTROL METHOD, AND INFORMATION PROCESSING APPARATUS

• US 20140101213A1
• Filed: 10/08/2013
• Published: 04/10/2014
• Est. Priority Date: 10/09/2012
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: UEDA, Haruyasu, MAEDA, Takamitsu
• Granted Patent: US 10,095,699 B2
• Time in Patent Office: Days
• US Class Current: 707/827
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

A slave computer reads a plurality of input files that have different formats and generates, for each of the input files, an intermediate file that has added thereto, as a join key, data in a type of column that is common to the input files. The slave computer sorts data in each intermediate file in accordance with the join key. The slave computer extracts, from each intermediate file that has data sorted therein, data that has the format of each of the input files so as to generate a plurality of output files that have data sorted therein with respect to each of the input files. The slave computer inputs the plurality of output files generated to a join program that joins data.

Claims

1. A non-transitory computer-readable recording medium having stored therein an execution control program that causes a computer to execute a process comprising:

inputting a plurality of input files that have different formats;

generating, for each of the input files, an intermediate file that has added thereto, as a join key, data in a type of column that is common to the input files;

sorting data in each intermediate file in accordance with the join key;

extracting, from each intermediate file that has data sorted therein, data that has a format of each of the input files and generating a plurality of output files that have data sorted therein with respect to each of the input files; and

inputting the plurality of output files generated to a join program that processes joining data.

2. The non-transitory computer-readable recording medium according to claim 1, wherein

the generating includes extracting data that has a format of each of the input files from each record of the intermediate file, and

the inputting includes, each time data that has the format is extracted from a record of the intermediate file, outputting the data extracted to the join program via a inter-process communication.

3. The non-transitory computer-readable recording medium according to claim 1, wherein the process further comprises:

storing an operation result of the join program in a shared-file system that a plurality of computers including the computer share on a distributed processing system that performs distributed processing on data stored in the plurality of computers in a distributed manner.

4. The non-transitory computer-readable recording medium according to claim 3, wherein the storing includes, each time the join program outputs an operation result, storing the operation result in the shared-file system via a inter-process communication.

5. An execution control method comprising:

reading a plurality of input files that have different formats;

generating, for each of the input files, an intermediate file that has added thereto, as a join key, data in a type of column that is common to the input files;

sorting data in each intermediate file in accordance with the join key;

extracting, by a computer, from each intermediate file that has data sorted therein, data that has a format of each of the input files and generating the plurality of output files that have data sets sorted therein with respect to each of the input files; and

inputting the plurality of output files generated to a join program that joins data.

6. An information processing apparatus comprising:

a memory; and

a processor coupled to the memory, wherein the processor executes a process comprising;

reading a plurality of input files that have different formats;

generating, for each of the input files, an intermediate file that has added thereto, as a join key, data in a type of column that is common to the input files;

sorting data in each intermediate file in accordance with the join key;

extracting, from each intermediate file that has data sorted therein, data that has a format of each of the input files and generating a plurality of output files that have data sorted therein with respect to each of the input files; and

inputting the plurality of output files generated to a join program that joins data.