SYSTEM FOR COPYBOOK FLAT DATA CONVERSION AND INLINE TRANSFORMATION

• US 20170103078A1
• Filed: 10/09/2015
• Published: 04/13/2017
• Est. Priority Date: 10/09/2015
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Parida, Prasant Kumar, Awasthi, Umashankar, Greenblatt, Jonathan Roger, Krishnan, Sundar R., Rea, James J., Watson, David J., Pathak, Amit Ashok, Khan, M. Ehsan
• Granted Patent: US 10,303,753 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/149 Adaptation of the text data for streaming purposes, e.g. Efficient XML Interchange [EXI] format
• CPC Class Codes: G06F 40/154 Tree transformation for tree-structured or markup documents, e.g. XSLT, XSL-FO or stylesheets
• CPC Class Codes: G06F 40/221 Parsing markup language streams streaming G06F40/149

Abstract

The present invention provides copybook flat data conversion with inline transformation. Specifically, a streaming intermediary formatted data message is generated as a result of converting/transforming a flat file format (non-XML (Extensible Markup Language) format), such as raw fixed-length field COBOL (Common Business-Oriented Language) copybook format or the like. The streaming intermediary format is not fully held in memory, but rather is directly transformed/converted, using XSLT (Extensible Stylesheet Language Transformations) processing, into a target format, such as structured XML or the like. By directly streaming the intermediary format to the XSLT process without holding the entire data message in memory, the present invention utilizes less memory and, as such, less memory is needed to be reclaimed.

Claims

1. A system for transformation of data request messages, the system comprising:

a source system comprising a first computing platform having a first memory and at least one first processor in communication with the first memory, wherein the source system is configured to generate and communicate data request messages; and

a platform event processing system comprising;

a second computing platform having a second memory and at least one second processor in communication with the second memory, and

a data transformation module stored in the second memory, executable by the second processor and configured to;

receive a portion of the data request messages in a first file format,

transform the portion of the data request messages from the first file format into a streaming intermediary format, and

as the streaming intermediary format is being generated, apply an XSLT (Extensible Stylesheet Language Transformations) process to the streaming intermediary format to transform the streaming intermediary format to a target format, wherein an entirety of a streaming intermediary formatted data request message is not held in memory prior to applying the XSLT process.

2. The system of claim 1, wherein the data transformation module is further configured to receive the portion of the data request messages in the first file format, wherein the first file format is a flat file format.

3. The system of claim 2, wherein the data transformation module is further configured to receive the portion of the data request messages in the flat file format, wherein the flat file format is raw fixed-length field COBOL (Common Business-Oriented Language) copybook formatted data.

4. The system of claim 1, wherein the data transformation module is further configured to transform the first file format into the streaming intermediary format, wherein the streaming intermediary format is a streaming XML (Extensible Markup Language) format.

5. The system of claim 1, wherein the data transformation module is further configured to (1) receive a request in the first file format, wherein the first file format is raw fixed-length field COBOL (Common Business-Oriented Language) copybook formatted data and (2) transform the first file format into the streaming intermediary format, wherein the streaming intermediary format is a simple XML (Extensible Markup Language) format, wherein transforming the raw fixed-length field COBOL copybook formatted data into the streaming XML format includes using a basic configuration file that defines a length and offset of each data element and applying a simple XML tag name to each data element.

6. The system of claim 1, wherein the data transformation module is further configured to transform the streaming intermediary format to the target format, wherein the target format is a structured XML (Extensible Markup Language) format.

7. The system of claim 1, wherein the data transformation module is further configured to, as the streaming intermediary format is being generated, apply an XSLT (Extensible Stylesheet Language Transformations) process to the streaming intermediary format to transform the streaming intermediary format to a target format, wherein the XSLT process provides for a graphical mapping of the intermediary formatted data to a logical structure used by a target application.

8. The system of claim 1, wherein the platform event processing system is configured to receive and process the data request messages uni-directionally without having to receive and process corresponding data response messages.

9. A computer-implemented method for transformation of data request messages, the method comprising:

receiving, from a source computing system, data request messages in a first file format, processing, by a computing device processor, the data request messages by;

transforming the data request messages from the first file format into a streaming intermediary format, and

as the streaming intermediary format is being generated, applying an XSLT (Extensible Stylesheet Language Transformations) process to the streaming intermediary format to transform the streaming intermediary format to a target format, wherein an entirety of the streaming intermediary formatted data request message is not held in memory prior to applying the XSLT process.

10. The method of claim 9, wherein receiving the data request messages in the first file format, further comprises receiving the data request messages in a flat file format.

11. The method of claim 10, wherein receiving the data request messages in the flat file format, further comprises receiving the data request messages in a raw fixed-length field COBOL (Common Business-Oriented Language) copybook format.

12. The method of claim 9, wherein transforming the data request messages from the first file format into a streaming intermediary format, further comprises transforming the data request messages from the first file format into a streaming XML (Extensible Markup Language) format.

13. The method of claim 9, wherein (1) receiving the data request messages in the first file format, further comprises receiving the data request messages in a raw fixed-length field COBOL (Common Business-Oriented Language) copybook format and (2) transform the data request messages from the first file format into a streaming intermediary format further comprises transforming the data request messages from the raw fixed-length field COBOL (Common Business-Oriented Language) copybook format into a simple XML (Extensible Markup Language) format, wherein transforming the raw fixed-length field COBOL copybook formatted data into the streaming XML format includes using a basic configuration file that defines a length and offset of each data element and applying a simple XML tag name to each data element.

14. The method of claim 9, wherein applying the XSLT (Extensible Stylesheet Language Transformations) process further comprises applying the XSLT (Extensible Stylesheet Language Transformations) process to the streaming intermediary format to transform the streaming intermediary format to a structured XML (Extensible Markup Language) format.

15. The method of claim 9, wherein applying an XSLT (Extensible Stylesheet Language Transformations) process further comprises applying the XSLT (Extensible Stylesheet Language Transformations) process to the streaming intermediary format to transform the streaming intermediary format to the target format, wherein the XSLT process provides for a graphical mapping of the intermediary formatted data to a logical structure used by a target application.

16. A computer program product comprising:

a non-transitory computer-readable medium comprising;

a first set of codes for causing a computer to receive, from a source computing system, data request messages; and

a second set of codes for causing a computer to process the data request messages by (i) transforming the data request messages from the first file format into a streaming intermediary format, and (ii) as the streaming intermediary format is being generated, applying an XSLT (Extensible Stylesheet Language Transformations) process to the streaming intermediary format to transform the streaming intermediary format to a target format, wherein an entirety of the streaming intermediary formatted data request message is not held in memory prior to applying the XSLT process.

17. The computer program product of claim 16, wherein the first set of codes is further configured to receive the data request messages in the first file format, wherein the first file format is a raw fixed-length field COBOL (Common Business-Oriented Language) copybook format.

18. The computer program product of claim 17, wherein the second set of codes is further configured to process the data request messages by (i) transforming the data request messages from the first file format into the streaming intermediary file format, wherein the intermediary format is a streaming XML (Extensible Markup Language) format.

19. The computer program product of claim 16, wherein the second set of codes is further configured to process the data request messages by (ii) applying the XSLT (Extensible Stylesheet Language Transformations) to the streaming intermediary format to transform the streaming intermediary format to the target format, wherein the target format is a structured XML (Extensible Markup Language) format.

20. The computer program product of claim 16, wherein the second set of codes is further configured to process the data request messages by (ii) applying the XSLT (Extensible Stylesheet Language Transformations) to the streaming intermediary format to transform the streaming intermediary format to the target format, wherein the XSLT process provides for a graphical mapping of the intermediary formatted data to a logical structure used by a target application.