Oversubscription scheduling

• US 10,733,023 B1
• Filed: 08/03/2016
• Issued: 08/04/2020
• Est. Priority Date: 08/06/2015
• Status: Active Grant

• Current Assignee: Nutanix Incorporated
• Original Assignee: D2IQ, Inc.
• Inventors: Doyle, Connor Patric, Kozyrakis, Christoforos, Nielsen, Niklas Quarfot
• Primary Examiner(s): Bullock, Jr., Lewis A
• Assistant Examiner(s): Kepnang, Gilles R
• Application Number:
  US15/227,348
• Time in Patent Office: 1,462 Days
• CPC Class Codes: A61K 49/0054 Macromolecular compounds, i.e. oligomers, polymers, dendrimers
• CPC Class Codes: C08G 2261/1432 containing amide groups
• CPC Class Codes: C08G 2261/18 conjugated
• CPC Class Codes: C08G 2261/228 Polymers, i.e. more than 10 repeat units
• CPC Class Codes: C08G 2261/3324 derived from norbornene
• CPC Class Codes: C08G 2261/78 Complexation
• CPC Class Codes: C12N 15/113 Non-coding nucleic acids modulating the expression of genes, e.g. antisense oligonucleotides; Antisense DNA or RNA; Triplex- forming oligonucleotides; Catalytic nucleic acids, e.g. ribozymes; Nucleic acids used in co-suppression or gene silencing when used in plants C12N15/8218
• CPC Class Codes: C12N 15/1135 against oncogenes or tumor suppressor genes
• CPC Class Codes: C12N 2310/11 Antisense
• CPC Class Codes: C12N 2310/351 Conjugate
• CPC Class Codes: C12N 2310/3515 Lipophilic moiety, e.g. cholesterol
• CPC Class Codes: C12N 2310/51 in polymeric form, e.g. multimers, concatemers
• CPC Class Codes: C12N 2320/11 for the determination of target sites, i.e. of active nucleic acids
• CPC Class Codes: C12N 2320/32 Special delivery means, e.g. tissue-specific
• CPC Class Codes: C12Q 1/6886 for cancer immunoassay for cancer G01N33/574
• CPC Class Codes: G06F 2209/501 Performance criteria
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/4887 involving deadlines, e.g. rate based, periodic
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06F 9/5083 : Techniques for rebalancing the load in a distributed system
• CPC Class Codes: Y02E 30/10 : Nuclear fusion reactors

Abstract

A system for adjusting oversubscription loading includes an interface and a processor. The interface is configured to receive a set of performance data from a set of worker systems. The processor is configured to determine a feedback indication for a worker system of the set of worker systems based at least in part on the set of performance data. The feedback indication is used to adjust an oversubscription controller on the worker system. The processor is configured to provide the feedback indication to the worker system.

Claims

1. A master system for adjusting oversubscription loading, comprising:

an interface configured to;

receive a set of performance data from a set of worker systems; and

a processor configured to;

determine a feedback indication for a worker system of the set of worker systems based at least in part on the set of performance data, wherein the feedback indication is used to adjust eviction criteria of an oversubscription controller on the worker system, and wherein the determining of the feedback indication comprises operations to;

perform the following;

A) determine a response time for an application performing requests sent to the application to obtain a stability indicator; and

in response to a determination that the response time is greater than or equal to a maximum response time threshold, include the stability indicator in the feedback indication;

B) compare first tasks under ideal conditions over a first period of time with no potentially interfering workloads present on a worker with second tasks over a second period of time with one or more other interfering workloads present on the same worker to obtain a software experiment data; and

in response to a determination that a decrease in the second tasks over the second period of time, based on a comparison of the first tasks and the second tasks, is greater than or equal to a maximum decrease threshold, include the software experiment data in the feedback indication;

C) determine whether two or more tasks that are scheduled on the same worker use a shared resource to obtain a task interference; and

in response to a determination that the two or more tasks that are scheduled on the same worker use the shared resource, include the task interference in the feedback indication; and

D) include a classification of performance data in the feedback indication, the classification of performance data including a processor intensive classification being a dominant usage of system resources, a memory intensive classification being a dominant usage of system resources, a network access intensive classification being a dominant usage of system resources, a disk access intensive classification being a dominant usage of system resources, or any combination thereof; and

adjust the oversubscription controller of the worker system to evict a job, based on the provided feedback indication, useable by the worker system.

2. The system of claim 1, wherein the feedback indication is used to adjust a set point on the oversubscription controller.

3. The system of claim 2, wherein the set point comprises a desired processor load set point.

4. The system of claim 2, wherein the set point comprises a desired memory usage set point.

5. The system of claim 2, wherein the set point comprises a desired network usage set point.

6. The system of claim 1, wherein the eviction criteria comprises newest first.

7. The system of claim 1, wherein the eviction criteria comprises most processor use first.

8. The system of claim 1, wherein the eviction criteria comprises most memory use first.

9. The system of claim 1, wherein the eviction criteria comprises most network use first.

10. The system of claim 1, wherein the processor is further configured to assign the high-priority job to the worker system.

11. The system of claim 1, wherein the processor is further configured to determine whether an assignment of the high-priority job to the worker system exceeds a subscription threshold based at least in part on the set of performance data.

12. A method for adjusting oversubscription loading, comprising:

receiving a set of performance data from a set of worker systems;

determining, using a processor at a master system, a feedback indication for a worker system of the set of worker systems based at least in part on the set of performance data, wherein the feedback indication is used to adjust eviction criteria of an oversubscription controller on the worker system, and wherein the determining of the feedback indication comprises;

performing the following;

A) determining a response time for an application performing requests sent to the application to obtain a stability indicator; and

in response to a determination that the response time is greater than or equal to a maximum response time threshold, including the stability indicator in the feedback indication;

B) comparing first tasks under ideal conditions over a first period of time with no potentially interfering workloads present on a worker with second tasks over a second period of time with one or more other interfering workloads present on the same worker to obtain a software experiment data; and

in response to a determination that a decrease in the second tasks over the second period of time, based on a comparison of the first tasks and the second tasks, is greater than or equal to a maximum decrease threshold, including the software experiment data in the feedback indication;

C) determining whether two or more tasks that are scheduled on the same worker use a shared resource to obtain a task interference; and

in response to a determination that the two or more tasks that are scheduled on the same worker use the shared resource, including the task interference in the feedback indication; and

D) including a classification of performance data in the feedback indication, the classification of performance data including a processor intensive classification being a dominant usage of system resources, a memory intensive classification being a dominant usage of system resources, a network access intensive classification being a dominant usage of system resources, a disk access intensive classification being a dominant usage of system resources, or any combination thereof; and

adjusting the oversubscription controller of the worker system to evict a job, based on the provided feedback indication, useable by the worker system.

13. A computer program product for oversubscription loading, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving a set of performance data from a set of worker systems;

determining, using a processor at a master system, a feedback indication for a worker system of the set of worker systems based at least in part on the set of performance data, wherein the feedback indication is used to adjust eviction criteria of an oversubscription controller on the worker system, and wherein the determining of the feedback indication comprises;

performing the following;

A) determining a response time for an application performing requests sent to the application to obtain a stability indicator; and

in response to a determination that the response time is greater than or equal to a maximum response time threshold, including the stability indicator in the feedback indication;

B) comparing first tasks under ideal conditions over a first period of time with no potentially interfering workloads present on a worker with second tasks over a second period of time with one or more other interfering workloads present on the same worker to obtain a software experiment data; and

in response to a determination that a decrease in the second tasks over the second period of time, based on a comparison of the first tasks and the second tasks, is greater than or equal to a maximum decrease threshold, including the software experiment data in the feedback indication;

C) determining whether two or more tasks that are scheduled on the same worker use a shared resource to obtain a task interference; and

in response to a determination that the two or more tasks that are scheduled on the same worker use the shared resource, including the task interference in the feedback indication; and

D) including a classification of performance data in the feedback indication, the classification of performance data including a processor intensive classification being a dominant usage of system resources, a memory intensive classification being a dominant usage of system resources, a network access intensive classification being a dominant usage of system resources, a disk access intensive classification being a dominant usage of system resources, or any combination thereof; and

adjusting the oversubscription controller of the worker system to evict a job, based on the provided feedback indication, useable by the worker system.