Dynamically determining a mode of a data processing application

• US 10,261,801 B2
• Filed: 12/12/2014
• Issued: 04/16/2019
• Est. Priority Date: 12/13/2013
• Status: Active Grant

• Current Assignee: Ab Initio Technology LLC (Ab Initio Software Corporation)
• Original Assignee: Ab Initio Technology LLC (Ab Initio Software Corporation)
• Inventors: Fisher, Ben
• Primary Examiner(s): Lu, Kuen S
• Application Number:
  US14/568,605
• Publication Number:
  US 20150169332A1
• Time in Patent Office: 1,586 Days
• Field of Search: 707769
• CPC Class Codes: G06F 13/385 for adaptation of a particular data processing system to different peripheral devices
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 9/441 Multiboot arrangements, i.e. selecting an operating system to be loaded
• CPC Class Codes: G06F 9/44521 Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
• CPC Class Codes: G06F 9/44536 Selecting among different versions
• CPC Class Codes: G06F 9/4494 data driven

Abstract

A method includes receiving a request to process a set of data using a data processing application. The method includes, based on a feature associated with the set of data, selecting between (i) a first mode in which one or more running processes of the data processing application are used to process the set of data and (2) a second mode in which one or more new processes of the data processing application are started up. The method includes causing the data processing application to be executed according to the selected mode to process the set of data.

Claims

1. A method including:

receiving a request to process a set of data using a data processing application;

responsive to the received request, and based on at least a size of the set of data, selecting either (i) a first mode in which one or more running processes of the data processing application are used to process the set of data based at least on the size of the set of data being equal to or less than a threshold size or (ii) a second mode in which one or more new processes of the data processing application are started up based at least on the size of the set of data exceeding the threshold size;

causing the data processing application to be executed according to the selected mode to process the set of data, including;

when the first mode is selected, processing the data using the one or more running processes, code corresponding to the one or more running processes having been compiled prior to receiving the request to process the set of data, and

when the second mode is selected, compiling code corresponding to the one or more new processes and processing the data using the one or more new processes; and

determining an adjusted threshold size during execution of the data processing application, including;

decreasing the threshold size if the data processing application executed according to the first mode executes more slowly than a reference rate, and

increasing the threshold size if the data processing application executed according to the second mode executes more slowly than a reference rate.

2. The method of claim 1, wherein the one or more running processes are loaded into a memory prior to receiving the request to process the set of data.

3. The method of claim 1, wherein the one or more running processes are in a standby mode prior to receiving the request to process the set of data.

4. The method of claim 1, including, when the second mode is selected, loading the new processes into a memory.

5. The method of claim 1, in which selecting either the first mode or the second mode includes selecting based further on one or more of a format of the set of data or a complexity of the set of data.

6. The method of claim 1, wherein the threshold size is based on a format of the set of data, and at least two different formats are each associated with a different threshold size.

7. The method of claim 1, wherein the threshold size is based on a processing requirement associated with the set of data, and at least two different processing requirements are each associated with a different threshold size.

8. The method of claim 1, wherein the threshold size is based on historical data indicative of the operation of the data processing application.

9. The method of claim 1, including determining the size of the set of data.

10. The method of claim 9, wherein the set of data includes a file, and wherein determining the size of the set of data includes determining the size of the file.

11. The method of claim 9, wherein the set of data includes data stored in a database, and wherein determining the size of the set of data includes querying the database.

12. The method of claim 1, in which selecting either the first mode or the second mode includes selecting based further on a processing requirement associated with the set of data.

13. The method of claim 12, wherein the processing requirement includes an allowed time for processing the set of data.

14. The method of claim 1, wherein in the first mode, the one or more running processes are executed serially, and in the second mode, at least some of the one or more new processes are executed concurrently.

15. The method of claim 1, in which the size of the set of data includes a volume of the set of data.

16. The method of claim 1, in which the size of the set of data includes a number of records in the set of data.

17. A non-transitory computer-readable medium storing instructions for causing a computing system to:

receive a request to process a set of data using a data processing application;

responsive to the received request, and based on at least a size of the set of data, select either (i) a first mode in which one or more running processes of the data processing application are used to process the set of data based at least on the size of the set of data being equal to or less than a threshold size or (ii) a second mode in which one or more new processes of the data processing application are started up based at least on the size of the set of data exceeding the threshold size;

cause the data processing application to be executed according to the selected mode to process the set of data, including;

when the first mode is selected, processing the data using the one or more running processes, code corresponding to the one or more running processes having been compiled prior to receiving the request to process the set of data, and

when the second mode is selected, compiling code corresponding to the one or more new processes and processing the data using the one or more new processes; and

determine an adjusted threshold size during execution of the data processing application, including;

decreasing the threshold size if the data processing application executed according to the first mode executes more slowly than a reference rate, and

increasing the threshold size if the data processing application executed according to the second mode executes more slowly than a reference rate.

18. The non-transitory computer readable medium of claim 17, wherein the one or more running processes are loaded into a memory prior to receiving the request to process the set of data.

19. The non-transitory computer readable medium of claim 17, wherein the one or more running processes are in a standby mode prior to receiving the request to process the set of data.

20. The non-transitory computer readable medium of claim 17, the instructions causing the computing system to, when the second mode is selected, load the new processes into a memory.

21. The non-transitory computer readable medium of claim 17, in which selecting either the first mode or the second mode includes selecting based further on one or more of a format of the set of data or a complexity of the set of data.

22. The non-transitory computer readable medium of claim 17, in which selecting either the first mode or the second mode includes selecting based further on a processing requirement associated with the set of data.

23. The non-transitory computer readable medium of claim 17, wherein in the first mode, the one or more running processes are executed serially, and in the second mode, at least some of the one or more new processes are executed concurrently.

24. A computing system including:

at least one processor configured to;

receive a request to process a set of data using a data processing application;

responsive to the received request, and based on at least a size of the set of data, selecting either (i) a first mode in which one or more running processes of the data processing application are used to process the set of data based at least on the size of the set of data being equal to or less than a threshold size or (ii) a second mode in which one or more new processes of the data processing application are started up based at least on the size of the set of data exceeding the threshold size;

cause the data processing application to be executed according to the selected mode to process the set of data, including;

when the first mode is selected, processing the data using the one or more running processes, code corresponding to the one or more running processes having been compiled prior to receiving the request to process the set of data, and

when the second mode is selected, compiling code corresponding to the one or more new processes and processing the data using the one or more new processes; and

determining an adjusted threshold size during execution of the data processing application, including;

decreasing the threshold size if the data processing application executed according to the first mode executes more slowly than a reference rate, and

increasing the threshold size if the data processing application executed according to the second mode executes more slowly than a reference rate.

25. The computing system of claim 24, wherein the one or more running processes are loaded into a memory prior to receiving the request to process the set of data.

26. The computing system of claim 24, wherein the one or more running processes are in a standby mode prior to receiving the request to process the set of data.

27. The computing system of claim 24, the at least one processor configured to, when the second mode is selected, load the new processes into a memory.

28. The computing system of claim 24, in which selecting either the first mode or the second mode includes selecting based further on one or more of a format of the set of data or a complexity of the set of data.

29. The computing system of claim 24, in which selecting either the first mode or the second mode includes selecting based further on a processing requirement associated with the set of data.

30. The computing system of claim 24, wherein in the first mode, the one or more running processes are executed serially, and in the second mode, at least some of the one or more new processes are executed concurrently.

31. A computing system including:

means for receiving a request to process a set of data using a data processing application;

means for, responsive to the received request, and based on at least a size of the set of data, selecting either (i) a first mode in which one or more running processes of the data processing application are used to process the set of data based at least on the size of the set of data being equal to or less than a threshold size or (ii) a second mode in which one or more new processes of the data processing application are started up based at least on the size of the set of data exceeding the threshold size;

means for causing the data processing application to be executed according to the selected mode to process the set of data, including;

when the first mode is selected, processing the data using the one or more running processes, code corresponding to the one or more running processes having been compiled prior to receiving the request to process the set of data, and

when the second mode is selected, compiling code corresponding to the one or more new processes and processing the data using the one or more new processes; and

means for determining an adjusted threshold size during execution of the data processing application, including;

decreasing the threshold size if the data processing application executed according to the first mode executes more slowly than a reference rate, and

increasing the threshold size if the data processing application executed according to the second mode executes more slowly than a reference rate.