System for Managing Data Collection Processes

• US 20130104139A1
• Filed: 12/14/2012
• Published: 04/25/2013
• Est. Priority Date: 02/21/2007
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Honigfort, Ed
• Granted Patent: US 8,719,297 B2
• Time in Patent Office: Days
• US Class Current: 718/103
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A system and process for managing data collection processes is disclosed. An apparatus that incorporates teachings of the present disclosure can include, a data collection system having a controller element that assigns to each of the processes a query interval according to a priority level of the data collection process for requesting use of processing resources, receiving one or more requests from the processes, once per respective query interval, for use of at least a portion of available processing resources, releases at least a portion of the available processing resources to a requesting one of the processes when the use of the available processing resources exceeds a utilization threshold. Additional embodiments are disclosed.

Claims

1. A method comprising:

assigning, by a system comprising a processor, a respective priority level to each data collection process of a plurality of data collection processes for collecting data from one or more remote computing devices;

assigning, by the system, a query interval to a data collection process of the plurality of data collection processes at least in part according to a priority level of the data collection process;

receiving, by the system, one or more requests from the data collection process for use of at least a portion of available processing resources of a controller, wherein the one or more requests are sent by the data collection process once per the query interval;

releasing, by the system, the portion of the available processing resources of the controller to the requesting data collection process when the use of the available processing resources exceeds a first utilization threshold; and

modifying the query interval of the data collection process after occurrence of a triggering event,

wherein the query interval comprises a frequency for requesting the available processing resources.

2. The method of claim 1, wherein the releasing of the portion of the available processing resources is repeated at the query interval.

3. The method of claim 1, comprising determining, by the system, a computed query interval of the data collection process according to a sum of a default query interval and an additional delay time assigned to each one of the plurality of data collection processes assigned a priority level exceeding the respective priority level assigned to the data collection process.

4. The method of claim 3, comprising determining, by the system, a re-computed query interval of the data collection process according to a sum of an additional delay time assigned to each one of one or more of the plurality of data collection processes assigned a priority level exceeding the respective priority level assigned to the data collection process and a system delay time determined from the available processing resources of the controller.

5. The method of claim 1, comprising determining, by the system, a computed query interval of the data collection process according to a sum of a default query interval and a system delay time determined from the available of processing resources of the controller.

6. The method of claim 1, comprising applying, by the system, a release criteria to the release step, wherein the release criteria comprises having available processing resources sufficient for processing the request from the data collection process and one or more of the plurality of data collection processes assigned a priority level exceeding the respective priority level of a requesting one of the plurality of data collection processes.

7. The method of claim 1, wherein the triggering event comprises at least one of an interval of time, the use of the available processing resources of the data collection system exceeding the first utilization threshold, or a quantity of the plurality of data collection processes pending execution exceeding a quantity threshold.

8. A processor comprising:

a memory to store computer instructions; and

a controller coupled to the memory, wherein the controller, responsive to executing the computer instructions performs operations comprising;

assigning a query interval to a data collection process of a plurality of data collection processes at least in part according to a priority level of the data collection process, wherein each data collection process of the plurality of data collection processes, responsive to being executed, collects data from one or more remote computing devices;

receiving one or more requests from the data collection process for use of at least a portion of available processing resources of the controller, wherein the one or more requests are sent by the data collection process once per the query interval;

releasing the portion of the available processing resources of the controller to the requesting data collection process when the use of the available processing resources exceeds a first utilization threshold; and

modifying the query interval of the data collection process after occurrence of a triggering event,

wherein the query intervals comprise a frequency for requesting the available processing resources.

9. The processor of claim 8, wherein the operations further comprise repeating the release step at the query interval.

10. The processor of claim 8, wherein the operations further comprise determining a computed query interval of the data collection process according to a sum of a default query interval and an additional delay time assigned to each one of the plurality of data collection processes having a priority level exceeding a respective priority level of the data collection process.

11. The processor of claim 8, wherein the operations further comprise determining a computed query interval of the data collection process according to a sum of a default query interval and a system delay time determined from the available of processing resources of the controller.

12. The processor of claim 8, wherein the operations further comprise determining a re-computed query interval of the data collection process according to a sum of an additional delay time assigned to each one of one or more of the plurality of data collection processes having a priority level exceeding a respective priority level of the data collection process and a system delay time determined from the available processing resources of the controller.

13. The processor of claim 8, wherein the operations further comprise applying a release criteria to the release step, wherein the release criteria comprises having available processing resources sufficient for processing the request from the data collection process and one or more of the plurality of data collection processes having a priority level exceeding a respective priority level of a requesting one of the plurality of data collection processes.

14. The processor of claim 8, wherein the triggering event comprises at least one of an interval of time, the use of the available processing resources of the data collection system exceeding the first utilization threshold, or a quantity of the plurality of data collection processes pending execution exceeding a quantity threshold.

15. A computer-readable storage medium, comprising computer instruction, which when executed by a processor cause the processor to perform operations comprising:

determining a frequency for requesting available processing resources for each of a plurality of processes according to their respective priority level to generate a query interval;

receiving one or more requests from a process of the plurality of processes for use of at least a portion of the available processing resources, wherein the one or more requests are sent by the process once per the query interval;

releasing at least a portion of the available processing resources to the requesting process according to release criteria;

re-computing the determined frequency of one or more processes upon occurrence of one or more triggering events to generate an updated query interval; and

determining available processing resources of the processor,

wherein the release criteria comprises having available processing resources sufficient for executing the requesting process.

16. The computer-readable storage medium of claim 15, wherein the operations further comprise repeating releasing steps according to the determined frequency.

17. The computer-readable storage medium of claim 15, wherein the re-computing comprises re-computing the determined frequency of the one or more processes according to a sum of a default query interval, an additional delay time assigned to each of one or more other processes having a respective priority level exceeding a respective priority level assigned to the process, or a system delay time determined from the available processing resources of the processor.

18. The computer-readable storage medium of claim 15, wherein the operations further comprise re-computing the determined frequency of the process according to a sum of an additional delay time assigned to each one of one or more processes respectively having a higher priority exceeding a respective priority level of the process and a system delay time determined from the available processing resources of the processor.

19. The computer-readable storage medium of claim 15, wherein at least one of the plurality of processes has a priority level exceeding the respective priority level of the requesting process.

20. The computer-readable storage medium of claim 15, wherein the one or more triggering events comprise at least one of an interval of time, the use of the available processing resources of the processor exceeding a utilization threshold, or a quantity of the plurality of processes pending execution exceeding a quantity threshold.