System for distributed data processing with automatic caching at various system levels

• US 10,067,869 B2
• Filed: 02/12/2016
• Issued: 09/04/2018
• Est. Priority Date: 02/12/2016
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Cassell, Erin, Gunsolley, Shawn Cart, Potla, Siva Shankar, Desautels, Adam Nathaniel, Poore, Jeffrey Scott, Thompson, Marshall Bright
• Primary Examiner(s): THAI, TUAN V
• Application Number:
  US15/042,333
• Publication Number:
  US 20170235676A1
• Time in Patent Office: 935 Days
• Field of Search: 711100, 711117, 711118, 711126, 711154
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0842 for multiprocessing or multitasking
• CPC Class Codes: G06F 2212/1008 Correctness of operation, e.g. memory ordering
• CPC Class Codes: G06F 2212/1024 Latency reduction
• CPC Class Codes: G06F 2212/1041 Resource optimization
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 2212/284 being distributed
• CPC Class Codes: G06F 2212/608 Details relating to cache mapping
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 9/4831 with variable priority
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]

Abstract

Embodiments enable distributed data processing with automatic caching at multiple system levels by accessing a master queue of data processing work comprising a plurality of data processing jobs stored in a long term memory cache; selecting at least one of the plurality of data processing jobs from the master queue of data processing work; pushing the selected data processing jobs to an interface layer including (i) accessing the selected data processing jobs from the long term memory cache; and (ii) saving the selected data processing jobs in an interface layer cache of data processing work; and pushing at least a portion of the selected data processing jobs to a memory cache of a first user system for minimizing latency in user data processing of the pushed data processing jobs.

Claims

1. A data processing system for distributed data processing with automatic caching at multiple system levels, the data processing system comprising:

a memory device with computer-readable program code stored thereon;

a communication device;

a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute the computer-readable program code to;

access a master queue of data processing work comprising a plurality of data processing jobs stored in a long term memory cache;

select at least one of the plurality of data processing jobs from the master queue of data processing work;

push the selected data processing jobs to an interface layer, comprising;

accessing the selected data processing jobs from the long term memory cache;

saving the selected data processing jobs in an interface layer cache of data processing work;

pushing at least a first portion of the selected data processing jobs to a memory cache of a first user system associated with a first user for minimizing latency in user data processing of the pushed data processing jobs; and

pushing at least a second portion of the selected data processing jobs to the memory cache of the first user system before the first user system has finished processing the first portion of the selected data processing jobs.

2. The data processing system of claim 1, wherein selecting comprises:

determining which of the plurality of data processing jobs are high priority; and

storing those data processing jobs of high priority in an in-flight data table;

wherein the processing device is further configured to execute the computer-readable program code to push the selected data processing jobs to the interface layer from the in-flight data table based on their relative priorities.

3. The data processing system of claim 1, wherein the processing device is further configured to execute the computer-readable program code to:

receive, from the first user system, some or all the pushed data processing jobs;

re-store the received data processing jobs in the interface layer cache; and

push the re-stored data processing jobs from the interface layer cache to a memory cache of a second user system.

4. The data processing system of claim 1, wherein the processing device is further configured to execute the computer-readable program code to:

provide access to the selected data processing jobs in the interface layer to at least one user system; and

wherein pushing the at least a portion of the selected data processing jobs is executed in response to a request from the first user system.

5. The data processing system of claim 4, wherein the request is received from a browser application running on the first user system and the selected data processing jobs are pushed to the browser application.

6. The data processing system of claim 1, wherein the interface layer memory cache comprises a network of clustered servers running a caching algorithm for minimizing latency of access to the stored data processing jobs by the at least one user systems.

7. The data processing system of claim 1, wherein the processing device is further configured to execute computer-readable program code to:

allocate the at least a portion of the selected data processing jobs to the first user system.

8. The data processing system of claim 7, wherein processing device is further configured to execute computer-readable program code to:

determine that the first user system is ready for processing a data processing job; and

the allocation is executed in response to determining.

9. The data processing system of claim 1, wherein the processing device is further configured to execute computer-readable program code to:

monitor the interface layer cache; and

determine whether more or less data processing jobs should be moved from the long term memory cache to the interface layer memory cache in a given time period.

10. A computer program product for distributed data processing with automatic caching at multiple system levels, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:

an executable portion configured for accessing a master queue of data processing work comprising a plurality of data processing jobs stored in a long term memory cache;

an executable portion configured for selecting at least one of the plurality of data processing jobs from the master queue of data processing work;

an executable portion configured for pushing the selected data processing jobs to an interface layer, comprising;

accessing the selected data processing jobs from the long term memory cache;

saving the selected data processing jobs in an interface layer cache of data processing work;

pushing at least a first portion of the selected data processing jobs to a memory cache of a first user system associated with a first user for minimizing latency in user data processing of the pushed data processing jobs by the first user system; and

pushing at least a second portion of the selected data processing jobs to the memory cache of the first user system before the first user system has finished processing the first portion of the selected data processing jobs.

11. The computer program product of claim 10, wherein selecting comprises:

determining which of the plurality of data processing jobs are high priority; and

storing those data processing jobs of high priority in an in-flight data table;

wherein the processing device is further configured to execute the computer-readable program code to push the selected data processing jobs to the interface layer from the in-flight data table based on their relative priorities.

12. The computer program product of claim 10, wherein the computer-readable program code portions further comprise:

an executable portion configured for receiving, from the first user system, some or all the pushed data processing jobs;

an executable portion configured for re-storing the received data processing jobs in the interface layer cache; and

an executable portion configured for pushing the re-stored data processing jobs from the interface layer cache to a memory cache of a second user system.

13. The computer program product of claim 10, wherein the computer-readable program code portions further comprise:

an executable portion configured for providing access to the selected data processing jobs in the interface layer to at least one user system; and

wherein pushing the at least a portion of the selected data processing jobs is executed in response to a request from the first user system.

14. The computer program product of claim 13, wherein the request is received from a browser application running on the first user system and the selected data processing jobs are pushed to the browser application.

15. The computer program product of claim 10, wherein the interface layer memory cache comprises a network of clustered servers running a caching algorithm for minimizing latency of access to the stored data processing jobs by the at least one user systems.

16. The computer program product of claim 10, wherein the computer-readable program code portions further comprise:

an executable portion configured for allocating the at least a portion of the selected data processing jobs to the first user system.

17. The computer program product of claim 16, wherein the computer-readable program code portions further comprise:

an executable portion configured for determining that the first user system is ready for processing a data processing job; and

the allocation is executed in response to determining.

18. The computer program product of claim 10, wherein the computer-readable program code portions further comprises:

an executable portion configured for monitoring the interface layer cache; and

an executable portion configured for determining whether more or less data processing jobs should be moved from the long term memory cache to the interface layer memory cache in a given time period.

19. A computer-implemented method for distributed data processing with automatic caching at multiple system levels, the method comprising:

accessing a master queue of data processing work comprising a plurality of data processing jobs stored in a long term memory cache;

selecting at least one of the plurality of data processing jobs from the master queue of data processing work;

pushing the selected data processing jobs to an interface layer, comprising;

accessing the selected data processing jobs from the long term memory cache; and

saving the selected data processing jobs in an interface layer cache of data processing work;

pushing at least a first portion of the selected data processing jobs to a memory cache of a first user system associated with a first user for minimizing latency in user data processing of the pushed data processing jobs by the first user system; and

pushing at least a second portion of the selected data processing jobs to the memory cache of the first user system before the first user system has finished processing the first portion of the selected data processing jobs.

20. The method of claim 19, wherein selecting comprises:

determining which of the plurality of data processing jobs are high priority; and

storing those data processing jobs of high priority in an in-flight data table;

wherein the processing device is further configured to execute the computer-readable program code to push the selected data processing jobs to the interface layer from the in-flight data table based on their relative priorities.