Systems, methods, and apparatuses for creating a shared file system between a mainframe and distributed systems

• US 9,898,484 B2
• Filed: 08/10/2015
• Issued: 02/20/2018
• Est. Priority Date: 08/10/2015
• Status: Expired

• Current Assignee: American Express Travel Related Services Company, Inc. (American Express Company), VelociData, Inc. (Openvault LLC)
• Original Assignee: American Express Travel Related Services Company, Inc. (American Express Company)
• Inventors: Bishop, Fred, Ganguly, Tapan, Henrichs, Michael, Howard, Curtis, Indeck, Ron, Prakash, Rajiv R., Shah, Imran, Vetrady, Robin Thomas
• Primary Examiner(s): Serrao, Ranodhi
• Assistant Examiner(s): Fiorillo, James
• Application Number:
  US14/822,770
• Publication Number:
  US 20170048317A1
• Time in Patent Office: 925 Days
• Field of Search: 709219, 709227, 712 30
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The disclosed system may comprise a mainframe computing resource, a data library, a data processing appliance, and a distributed system. The data library may be securely connected to the mainframe computing resource. The data library may be configured to receive data from the mainframe computing resource via a first interface. The data processing appliance may be configured to read and write data to the data library via a second user interface. The distributed system may be configured to receive data from the data processing appliance. The distributed system may be further configured to process the data based on a workflow from the mainframe computing system.

Claims

1. A method, comprising:

receiving, by a data processing appliance, a workflow from at least one of a mainframe computing resource or a distributed computing resource;

receiving, by the data processing appliance, data from at least one of the mainframe computing resource or the distributed computing resource;

preparing, by the data processing appliance and in real-time as the data is received, the data for at least one of the mainframe computing resource or the distributed computing resource;

streaming, by the data processing appliance and contemporaneously with the preparing, the data for at least one of the mainframe computing resource or the distributed computing resource;

receiving, by the data processing appliance, the data that has been processed in a second format by the distributed computing resource;

converting, by the data processing appliance, the processed data from the second format to a first format;

receiving, by the data processing appliance, the data that has been processed in the first format by the mainframe computing resource;

converting, by the data processing appliance, the processed data from the first format to the second format; and

writing, by the data processing appliance and contemporaneously with the converting, the processed data in the second format to at least one of a data library or the distributed computing resource, wherein;

the mainframe computing resource is configured to communicate securely with the data library through a first interface and the data processing appliance is configured to communicate with the data library through a second interface, and

the processed data in the second format is stored in a first portion of the data library that is segregated from a second portion of the data library that had been processed in the first format by the mainframe computing resource.

2. The method of claim 1, wherein the data processing appliance comprises at least one of a plurality of hardware accelerators, or a plurality of computer processing units.

3. The method of claim 2, wherein the data processing appliance is configured to parse the data for parallel processing of portions of the data by the plurality of logic gates, the plurality of graphical processing units, and the plurality of computer processing units.

4. The method of claim 2, wherein the plurality of hardware accelerators comprises at least one of a plurality of logic gates or a plurality of graphical processing units.

5. The method of claim 1, wherein the preparing includes preparing the data in the first format in response to the data being transmitted to the mainframe computing resource or preparing the data in the second format in response to the data being transmitted to the distributed computing resource.

6. The method of claim 5, wherein the mainframe computing appliance is configured to stream the data in at least one of the first format to the mainframe computing appliance or the second format to the distributed computing resource.

7. The method of claim 1, wherein the first interface is isolated form the second interface.

8. A system comprising:

a data processing appliance having a processor,

a tangible, non-transitory memory configured to communicate with the processor,

the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to be capable of performing operations comprising;

receiving, by the data processing appliance, a workflow from at least one of a mainframe computing resource or a distributed computing resource;

receiving, by the data processing appliance, data from at least one of the mainframe computing resource or the distributed computing resource;

preparing, by the data processing appliance and in real-time as the data is received, the data for at least one of the mainframe computing resource or the distributed computing resource;

streaming, by the data processing appliance and contemporaneously with the preparing, the data for at least one of the mainframe computing resource or the distributed computing resource;

receiving, by the data processing appliance, the data that has been processed in a second format by the distributed computing resource;

converting, by the data processing appliance, the processed data from the second format to a first format;

writing, by the data processing appliance and contemporaneously with the converting, the processed data in the first format to at least one of a data library or the mainframe computing resource;

receiving, by the data processing appliance, the data that has been processed in the first format by the mainframe computing resource;

converting, by the data processing appliance, the processed data from the first format to the second format; and

writing, by the data processing appliance and contemporaneously with the converting, the processed data in the second format to at least one of a data library or the distributed computing resource, wherein;

the mainframe computing resource is configured to communicate securely with the data library through a first interface and the data processing appliance is configured to communicate with the data library through a second interface, and

the processed data in the second format is stored in a first portion of the data library that is segregated from a second portion of the data library that had been processed in the first format by the mainframe computing resource.

9. The system of claim 8, wherein the data processing appliance comprises at least one of a plurality of hardware accelerators, or a plurality of computer processing units.

10. The system of claim 9, wherein the data processing appliance is configured to parse the data for parallel processing of portions of the data by the plurality of logic gates, the plurality of graphical processing units, and the plurality of computer processing units.

11. The system of claim 9, wherein the plurality of hardware accelerators comprises at least one of a plurality of logic gates or a plurality of graphical processing units.

12. The system of claim 8, wherein the preparing includes preparing the data in a first format in response to the data being transmitted to the mainframe computing resource or preparing the data in a second format in response to the data being transmitted to the distributed computing resource.

13. The system of claim 12, wherein the mainframe computing appliance is configured to stream the data in at least one of the first format to the mainframe computing appliance or the second format to the distributed computing resource.