SYSTEMS, METHODS, AND APPARATUSES FOR CREATING A SHARED FILE SYSTEM BETWEEN A MAINFRAME AND DISTRIBUTED SYSTEMS

• US 20170048317A1
• Filed: 08/10/2015
• Published: 02/16/2017
• Est. Priority Date: 08/10/2015
• Status: Active Grant

• Current Assignee: American Express Travel Related Services Company, Inc. (American Express Company), VelociData, Inc. (Openvault LLC)
• Original Assignee: American Express Travel Related Services Company, Inc. (American Express Company), VelociData, Inc. (Openvault LLC)
• Inventors: Bishop, Fred, Ganguly, Tapan, Henrichs, Michael, Howard, Curtis, Indeck, Ron, Prakash, Rajiv R., Shah, Imran, Vetrady, Robin Thomas
• Granted Patent: US 9,898,484 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The disclosed system may comprise a mainframe computing resource, a data library, a data processing appliance, and a distributed system. The data library may be securely connected to the mainframe computing resource. The data library may be configured to receive data from the mainframe computing resource via a first interface. The data processing appliance may be configured to read and write data to the data library via a second user interface. The distributed system may be configured to receive data from the data processing appliance. The distributed system may be further configured to process the data based on a workflow from the mainframe computing system.

Claims

1. A method, comprising:

receiving, by the data processing appliance, a workflow from at least one of a mainframe computing resource or a distributed computing resource;

receiving, by the data processing appliance, data from at least one of the mainframe computing resource or the distributed computing resource;

preparing, by the data processing appliance and in real-time as the data is received, the data for at least one of the mainframe computing resource and the distributed computing resource; and

streaming, by the data processing appliance and contemporaneously with the preparing, the data for at least one of the mainframe computing resource and the distributed computing resource.

2. The method of claim 1, wherein the preparing includes the data in a first format in response to the data being transmitted to the mainframe computing resource or in a second format in response to the data being transmitted to the distributed computing resource.

3. The method of claim 2, wherein the to the mainframe computing appliance is configured to stream the data in at least one of the first format to the mainframe computing appliance or the second format to the distributed computing resource.

4. The method of claim 1, wherein the data processing appliance comprises at least one of a plurality of hardware accelerators, or a plurality of computer processing units.

5. The method of claim 4, wherein the data processing appliance is configured to parse the data for parallel processing of portions of the data by the plurality of logic gates, the plurality of graphical processing units, and the plurality of computer processing units.

6. The method of claim 4, wherein the plurality of hardware accelerators comprises at least one of a plurality of logic gates or a plurality of graphical processing units.

7. The method of claim 2, further comprising:

receiving, by the data processing appliance, processed data from the distributed computing resource in the second format,

wherein the processed data is the data in the second format that has been processed by the distributed computing resource;

converting, by the data processing appliance, the processed data from the second format to the first format;

writing, by the data processing appliance and contemporaneously with the converting, to at least one of a data library or the mainframe computing resource,

wherein the processed data is written in the first format.

8. The method of claim 2, further comprising:

receiving, by the data processing appliance, processed data from the mainframe computing resource in the first format,

wherein the processed data is the data in the first format that has been processed by the mainframe computing resource;

converting, by the data processing appliance, the processed data from the first format to the second format;

writing, by the data processing appliance and contemporaneously with the converting, to at least one of a data library or the distributed computing resource,

wherein the processed data is written in the second format.

9. The method of claim 1, wherein the mainframe computing resource is configured to communicate with the data library through a first interface.

10. The method of claim 9, wherein the data processing appliance is configured to communicate with the data library through a second interface.

11. The method of claim 10, wherein the first interface is isolated form the second interface.

12. A system comprising:

a processor,

a tangible, non-transitory memory configured to communicate with the processor,

the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to be capable of performing operations comprising;

receiving, by the data processing appliance, a workflow from at least one of a mainframe computing resource or a distributed computing resource;

receiving, by the data processing appliance, data from at least one of the mainframe computing resource or the distributed computing resource;

preparing, by the data processing appliance and in real-time as the data is received, the data for at least one of the mainframe computing resource and the distributed computing resource; and

streaming, by the data processing appliance and contemporaneously with the preparing, the data for at least one of the mainframe computing resource and the distributed computing resource.

13. The system of claim 12, wherein the preparing includes the data in a first format in response to the data being transmitted to the mainframe computing resource or in a second format in response to the data being transmitted to the distributed computing resource.

14. The system of claim 13, wherein the to the mainframe computing appliance is configured to stream the data in at least one of the first format to the mainframe computing appliance or the second format to the distributed computing resource.

15. The system of claim 12, wherein the data processing appliance comprises at least one of a plurality of hardware accelerators, or a plurality of computer processing units.

16. The system of claim 15, wherein the data processing appliance is configured to parse the data for parallel processing of portions of the data by the plurality of logic gates, the plurality of graphical processing units, and the plurality of computer processing units.

17. The system of claim 15, wherein the plurality of hardware accelerators comprises at least one of a plurality of logic gates or a plurality of graphical processing units.

18. The system of claim 12, further comprising:

receiving, by the data processing appliance, processed data from the distributed computing resource in the second format,

wherein the processed data is the data in the second format that has been processed by the distributed computing resource;

converting, by the data processing appliance, the processed data from the second format to the first format;

writing, by the data processing appliance and contemporaneously with the converting, to at least one of a data library or the mainframe computing resource,

wherein the processed data is written in the first format.

19. The system of claim 12, further comprising:

receiving, by the data processing appliance, processed data from the mainframe computing resource in the first format,

wherein the processed data is the data in the first format that has been processed by the mainframe computing resource;

converting, by the data processing appliance, the processed data from the first format to the second format;

writing, by the data processing appliance and contemporaneously with the converting, to at least one of a data library or the distributed computing resource,

wherein the processed data is written in the second format.

20. The system of claim 19, wherein the mainframe computing resource is configured to communicate with the data library through a first interface and the data processing appliance is configured to communicate with the data library through a second interface.