Independent storage and processing of data with centralized event control

• US 10,437,643 B2
• Filed: 11/10/2017
• Issued: 10/08/2019
• Est. Priority Date: 11/10/2017
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Zott, Jerome M., Azfar, Faisal, Anusuri, Vijaya M., Ramaswamy, Sridhar, Nicholson, Robert J., Yarlagadda, Sitaram C.
• Primary Examiner(s): Tecklu, Isaac T
• Application Number:
  US15/809,683
• Publication Number:
  US 20190146838A1
• Time in Patent Office: 697 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: H04L 63/0807 using tickets, e.g. Kerberos cryptographic mechanisms or cryptographic arrangements for entity authentication using tickets or tokens H04L9/3213
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Aspects of the disclosure relate to enabling independent storage and processing of data with centralized event control. An event control computing platform may receive an indicator of a processing task associated with processing a dataset. Subsequently, the event control computing platform may authenticate the indicator of the processing task. Then the event control computing platform may identify and allocate resources for executing the processing task and storing the dataset. Finally, the event control computing platform may generate and transmit a series of commands to cause the dataset to be accessed by the processing platform, cause the processing task associated with the dataset to be executed, and cause the processed dataset to be stored on the storage platform.

Claims

1. A computing platform, comprising:

at least one processor;

a communication interface communicatively coupled to the at least one processor; and

memory storing computer-readable instructions that, when executed by the at least one processor, cause the computing platform to;

receive, via the communication interface, an indicator of a processing task associated with processing a dataset;

authenticate the indicator of the processing task associated with the dataset;

identify a first level of resources required for executing the processing task;

allocate the first level of resources required for executing the processing task on a processing platform;

identify a second level of resources required for storing the dataset;

allocate the second level of resources required for storing the dataset on a storage platform independent of the first level of resources allocated for executing the processing task;

authorize execution of the processing task by the processing platform;

generate a first command configured to cause the dataset to be accessed by the processing platform from the storage platform;

transmit, via the communication interface, the first command to the processing platform;

generate a second command configured to cause the processing task associated with the dataset to be executed;

transmit, via the communication interface, the second command to the processing platform;

generate a third command configured to cause the processed dataset to be stored on the storage platform; and

transmit, via the communication interface, the third command to the storage platform identify a modified level of resources required for executing the processing task; and

allocate the modified level of resources required for executing the processing task on the processing platform.

2. The computing platform of claim 1, wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, cause the computing platform to:

generate a fourth command to cause the processed dataset to be analyzed by a data analysis platform.

3. The computing platform of claim 1, wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, cause the computing platform to:

transmit, via the communication interface, the fourth command to the data analysis platform.

4. The computing platform of claim 1, wherein the processing platform includes a plurality of data processing clusters.

5. The computing platform of claim 1, wherein the storage platform includes encrypted storage zones.

6. The computing platform of claim 1, wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, cause the computing platform to:

identify a modified level of resources required for storing the dataset.

7. The computing platform of claim 6, wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, cause the computing platform to:

allocate the modified level of resources required for storing the dataset.

8. The computing platform of claim 1, wherein the storage platform comprises a distributed file system.

9. The computing platform of claim 1, wherein the processing platform is configured to perform Monte Carlo simulations on the dataset.

10. The computing platform of claim 1, wherein the storage platform and the processing platform use a same security layer.

11. A method, comprising:

at a computing platform comprising at least one processor, memory, and a communication interface;

receiving, via the communication interface, an indicator of a processing task associated with processing a dataset;

authenticating the indicator of the processing task associated with the dataset;

identifying a first level of resources required for executing the processing task;

allocating the first level of resources required for executing the processing task on a processing platform;

identifying a second level of resources required for storing the dataset;

allocating the second level of resources required for storing the dataset on a storage platform independent of the first level of resources allocated for executing the processing task;

authorizing execution of the processing task by the processing platform;

generating a first command configured to cause the dataset to be accessed by the processing platform from the storage platform;

transmitting, via the communication interface, the first command to the processing platform;

generating a second command configured to cause the processing task associated with the dataset to be executed;

transmitting, via the communication interface, the second command to the processing platform;

generating a third command configured to cause the processed dataset to be stored on the storage platform; and

transmitting, via the communication interface, the third command to the storage platform identity a modified level of resources required for executing the processing task; and

allocate the modified level of resources required for executing the processing task on the processing platform.

12. The method of claim 11, further comprising:

generating a fourth command to cause the processed dataset to be analyzed by a data analysis platform.

13. The method of claim 11, wherein the storage platform comprises a distributed file system.

14. The method of claim 13, wherein the storage platform includes encrypted storage zones.

15. The method of claim 11, further comprising:

identifying a modified level of resources required for executing the processing task.

16. The method of claim 11, further comprising:

identifying a modified level of resources required for storing the dataset.

17. The method of claim 11, wherein the processing platform is configured to perform Monte Carlo simulations on the dataset.

18. One or more non-transitory computer-readable media storing instructions that, when executed by a computing platform comprising at least one processor, memory, and a communication interface, cause the computing platform to:

receive, via a communication interface, an indicator of a processing task associated with processing a dataset;

authenticate the indicator of the processing task associated with the dataset;

identify a first level of resources required for executing the processing task;

allocate the first level of resources required for executing the processing task on a processing platform;

identify a second level of resources required for storing the dataset;

allocate the second level of resources required for storing the dataset on a storage platform independent of the first level of resources allocated for executing the processing task;

authorize execution of the processing task by the processing platform;

generate a first command configured to cause the dataset to be accessed by the processing platform from the storage platform;

transmit, via the communication interface, the first command to the processing platform;

generate a second command configured to cause the processing task associated with the dataset to be executed;

transmit, via the communication interface, the second command to the processing platform;

generate a third command configured to cause the processed dataset to be stored on the storage platform; and

transmit, via the communication interface, the third command to the storage platform identify a modified level of resources required for executing the processing task; and

allocate the modified level of resources required for executing the processing task on the processing platform.