System for managing data collection processes

• US 8,275,787 B2
• Filed: 11/24/2009
• Issued: 09/25/2012
• Est. Priority Date: 02/21/2007
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Honigfort, Ed
• Primary Examiner(s): LU, KUEN S
• Application Number:
  US12/625,310
• Publication Number:
  US 20100076925A1
• Time in Patent Office: 1,036 Days
• Field of Search: 707/769
• US Class Current: 707/769
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A system and apparatus for managing data collection processes can include a data collection system having a controller element that assigns a priority level for processes, assigns to each of the processes a query interval for requesting use of processing resources, prompts each of the processes according to their respective query interval to request use of at least a portion of available processing resources, releases at least a portion of the available processing resources to a requesting one of the processes when the utilization of available processing resources exceeds a utilization threshold, and modifies the query interval of the processes after occurrence of a triggering event. Additional embodiments are disclosed.

Claims

1. A processor comprising a memory coupled to a controller, wherein the memory comprises computer instructions which when executed by the controller cause the controller to perform operations comprising:

assigning priority levels to a plurality of data collection processes for collecting data from one or more remote computing devices;

assigning a query interval to a data collection process of the plurality of data collection processes according to at least in part a priority level of the data collection process;

receiving one or more requests from the data collection process for use of at least a portion of available processing resources of the controller, wherein the one or more requests can only be sent by the data collection process once per the query interval; and

releasing the portion of the available processing resources of the controller to the requesting data collection process when the utilization of available processing resources exceeds a first utilization threshold.

2. The processor of claim 1, wherein the query intervals comprise a frequency for requesting the available processing resources, and wherein the controller repeats the release step according to the query interval.

3. The processor of claim 1, wherein the controller determines a computed query interval of the data collection process according to a sum of a default query interval and an additional delay time assigned to each one of the plurality of data collection processes assigned a priority level exceeding a priority level assigned to the data collection process.

4. The processor of claim 3, wherein the controller determines a re-computed query interval of the data collection process according to a sum of an additional delay time assigned to each one of one or more of the plurality of data collection processes assigned a priority level exceeding a priority level assigned to the data collection process and a system delay time determined from the available processing resources of the controller.

5. The processor of claim 1, wherein the controller determines a computed query interval of the data collection process according to a sum of a default query interval and a system delay time determined from the available amount of processing resources of the controller.

6. The processor of claim 1, wherein the controller reserves at least a portion of the available amount of processing resources for release to one or more of the plurality of data collection processes assigned a priority level exceeding a priority threshold.

7. The processor of claim 1, wherein the controller applies a release criteria to the release step, wherein the release criteria comprises having available processing resources sufficient for processing the requesting the data collection process and one or more of the plurality of processes assigned a priority level exceeding a priority level of the requesting one of the plurality of processes.

8. The processor of claim 1, wherein the controller is adapted to modify the query interval of the data collection process after occurrence of a triggering event, wherein the triggering event comprises at least one among an interval of time, a utilization of the processing resources of the data collection system exceeding a utilization threshold, and a quantity of the plurality of processes pending execution exceeding a quantity threshold.

9. A non-transitory computer-readable storage medium, comprising computer instruction, which when executed by at least one processor cause the at least one processor to perform operations comprising:

assigning a priority level to each of a plurality of processes;

determining a frequency for requesting available processing resources for each of the plurality of processes according to their respective assigned priority level to generate a query interval;

receiving one or more requests from a process of the plurality of processes for use of at least a portion of the available processing resources, wherein the one or more requests can only be sent by the process once per the query interval;

releasing at least a portion of the available processing resources to the requesting process according to release criteria; and

re-computing the determined frequency of one or more processes upon occurrence of one or more triggering events to generate an updated query interval.

10. The non-transitory storage medium of claim 9, comprising operations for repeating the releasing step according to the determined frequency.

11. The non-transitory storage medium of claim 9, comprising operations for re-computing the determined frequency of the process according to a sum of a default query interval, an additional delay time assigned to each of one or more other processes assigned a priority level exceeding a priority level assigned to the process, and a system delay time determined from the available processing resources of the processor.

12. The non-transitory storage medium of claim 9, comprising operations for reserving at least a portion of the available processing resources of the processor for release to one or more of the plurality of processes assigned a priority level exceeding a priority threshold.

13. The non-transitory storage medium of claim 9, comprising operations for re-computing the determined frequency of the process according to a sum of an additional delay time assigned to each one of one or more processes assigned a higher priority exceeding a priority level assigned to the process and a system delay time determined from the available processing resources of the processor.

14. The non-transitory storage medium of claim 9, wherein the release criteria comprises having available processing resources sufficient for executing the requesting process and at least one of the plurality of processes assigned a priority level exceeding the priority level of the requesting process.

15. The non-transitory storage medium of claim 9, comprising operations for determining the available amount of processing resources of the processor, wherein the triggering event comprises at least one among an interval of time, a utilization of the processing resources of the processor exceeding a utilization threshold, and a quantity of the plurality of processes pending execution exceeding a quantity threshold.