PARALLEL TRANSFORMATION OF FILES

• US 20090276448A1
• Filed: 04/30/2008
• Published: 11/05/2009
• Est. Priority Date: 04/30/2008
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Coleman, Andrew J.
• Application Number:
  US12/112,923
• Publication Number:
  US 20090276448A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats

Abstract

A message brokering system includes a file input node configured to receive a file and divide the received file into a plurality of file portions for processing in the message brokering system, a plurality of transformation nodes configured to transform the plurality of file portions independently and in parallel, and a collector node configured to collect the plurality of transformed file portions and combine the plurality of transformed file portions into a single combined file based on header information associated with each of the plurality of file portions. The file input node is configured to divide the received file based on at least one user-configurable attribute, and the file input node is configure to associate the header information with the received file or each file portion of the plurality of file portions.

Claims

1. A message brokering system, comprising:

a file input node configured to receive a file and divide the received file into a plurality of file portions for processing in the message brokering system;

a plurality of transformation nodes configured to transform the plurality of file portions independently and in parallel; and

a collector node configured to collect the plurality of transformed file portions and combine the plurality of transformed file portions into a single combined file based on header information associated with each of the plurality of file portions;

wherein,

the file input node is configured to divide the received file based on at least one user-configurable attribute; and

the file input node is configured to associate the header information with the received file or each file portion of the plurality of file portions.

2. The system of claim 1, further comprising:

a file output node configured to output the single combined file to an appropriate application residing on the computer system, wherein,

the plurality of transformation nodes is configured to transform each file portion of the plurality of file portions into a format suitable for the appropriate application.

3. The system of claim 1, wherein the at least one user-configurable attribute includes one of:

dividing the received file based on fixed length of file portions;

dividing the received file based on delimited separations within the received file; and

dividing the file based on repeating fields of the received file.