Non-Uniform Memory Access (NUMA) resource assignment and re-evaluation

• US 10,019,167 B2
• Filed: 02/12/2014
• Issued: 07/10/2018
• Est. Priority Date: 02/20/2013
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Gray, William Samuel
• Primary Examiner(s): Bertram, Ryan
• Assistant Examiner(s): Ta, Trang K
• Application Number:
  US14/178,810
• Publication Number:
  US 20140237197A1
• Time in Patent Office: 1,609 Days
• CPC Class Codes: G06F 2209/503 Resource availability
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals

Abstract

A system and a method are disclosed for providing for non-uniform memory access (NUMA) resource assignment and re-evaluation. In one example, the method includes receiving, by a processing device, a request to launch a first process in a system having a plurality of Non-Uniform Memory Access (NUMA) nodes, determining, by the processing device, a resource requirement of the first process, determining, based on resources available on the plurality of NUMA nodes, a preferred NUMA node of the plurality of NUMA nodes to execute the first process, the preferred NUMA node being determined by the processing device without user input, and binding, by the processing device, the first process to the preferred NUMA node.

Claims

1. A method comprising:

receiving, by a processing device, a request to launch a first process in a system having a plurality of Non-Uniform Memory Access (NUMA) nodes;

determining, by the processing device, a resource requirement of the first process;

placing, in view of the resource requirement, the first process in an ordered list of a plurality of processes for consideration of resource allocation;

determining, in view of resources available on the plurality of NUMA nodes and a placement of the first process in the ordered list, a preferred NUMA node of the plurality of NUMA nodes to execute the first process, the preferred NUMA node being determined by the processing device without user input;

binding, by the processing device, the first process to the preferred NUMA node; and

determining an estimated amount of required resources for the first process to monitor the first process for NUMA node re-evaluation, wherein determining the estimated amount of required resources for the first process comprises dividing a number of CPU cores consumed by a percent target utilization.

2. The method of claim 1, wherein the resource requirement of the first process comprises a target utilization rate, further comprising determining the preferred NUMA node in view of the target utilization rate.

3. The method of claim 1, further comprising providing, by the processing device, a command line interface to bind the first process to the preferred NUMA node.

4. The method of claim 1, further comprising:

determining a respective magnitude resource vector for each respective NUMA node of the plurality of NUMA nodes by determining a product of an amount of memory available and a number of CPU cores available;

determining an ordered list of the plurality of NUMA nodes in view of the respective magnitude resource vectors; and

determining the preferred NUMA node for the first process in view of the ordered list of the plurality of NUMA nodes.

5. The method of claim 1, further comprising:

identifying a subset of the plurality of processes to potentially require an additional resource, the plurality of processes comprising the first process and being monitored for NUMA node placement re-evaluation;

determining a respective estimated amount of required resources for each of the identified processes;

determining an ordered list of the identified processes in view of the respective estimated amount of required resources; and

determining a preferred NUMA node for the each of the identified processes in view of the ordered list of the identified processes.

6. The method of claim 5, wherein the respective estimated amount of required resources for each of the identified processes is determined by dividing a number of CPU cores consumed by a percent target utilization, and by dividing an amount of memory consumed by the percent target utilization.

7. The method of claim 5 further comprising providing a user interface to receive user input identifying the plurality of processes to be monitored for the NUMA node placement re-evaluation.

8. An apparatus comprising:

a memory; and

a processing device communicably coupled to the memory, the processing device to;

receive a request to launch a first process in a system having a plurality of Non-Uniform Memory Access (NUMA) nodes;

determine a resource requirement of the first process;

place, in view of the resource requirement, the first process in an ordered list of a plurality of processes for consideration of resource allocation;

determine, in view of resources available on the plurality of NUMA nodes and a placement of the first process in the ordered list, a preferred NUMA node of the plurality of NUMA nodes to execute the first process, the preferred NUMA node being determined by the processing device without user input;

bind the first process to the preferred NUMA node; and

determine an estimated amount of required resources for the first process to monitor the first process for NUMA node re-evaluation, wherein to determine the estimated amount of required resources for the first process the processing device is to divide an amount of memory consumed by a percent target utilization.

9. The apparatus of claim 8, wherein the resource requirement of the first process comprises a target utilization rate, wherein the processing device is further to determine the preferred NUMA node in view of the target utilization rate.

10. The apparatus of claim 8, wherein the processing device is further to provide a command line interface to bind the first process to the preferred NUMA node.

11. The apparatus of claim 8, further comprising:

determine a respective magnitude resource vector for each respective NUMA node of the plurality of NUMA nodes by determining a product of an amount of memory available and a number of CPU cores available,

determine an ordered list of the plurality of NUMA nodes in view of the respective magnitude resource vectors, and

determine the preferred NUMA node for the first process in view of the ordered list of the plurality of NUMA nodes.

12. The apparatus of claim 8, wherein the processing device is further to:

identify a subset of plurality of processes to potentially require an additional resource, the plurality of processes comprising the first process and being monitored for NUMA node placement re-evaluation;

determine a respective estimated amount of required resources for each of the identified processes;

determine an ordered list of the identified processes in view of the respective estimated amount of required resources; and

determine a preferred NUMA node for the each of the identified processes in view of the ordered list of the identified processes.

13. The apparatus of claim 12, wherein to determine the respective estimated amount of required resources for each of the identified processes the processing device is further to divide a number of CPU cores consumed by a percent target utilization, and divide an amount of memory consumed by the percent target utilization.

14. The apparatus of claim 12, wherein the processing device is further to provide a user interface to receive user input identifying the plurality of processes to be monitored for the NUMA node placement re-evaluation.

15. A non-transitory computer readable storage medium including instructions that, when executed by a processing device, cause the processing device to:

receive, by the processing device, a request to launch a first process in a system having a plurality of Non-Uniform Memory Access (NUMA) nodes;

determine, by the processing device, a resource requirement of the first process;

place, in view of the resource requirement, the first process in an ordered list of a plurality of processes for consideration of resource allocation

determine, in view of resources available on the plurality of NUMA nodes and a placement of the first process in the ordered list, a preferred NUMA node of the plurality of NUMA nodes to execute the first process, the preferred NUMA node being determined by the processing device without user input;

bind, by the processing device, the first process to the preferred NUMA node; and

determine an estimated amount of required resources for the first process to monitor the first process for NUMA node re-evaluation by dividing an amount of memory consumed by a percent target utilization.

16. The non-transitory computer readable storage medium of claim 15, wherein the resource requirement of the first process comprises a target utilization rate, and wherein the instructions further cause the processing device to determine the preferred NUMA node in view of the target utilization rate.

17. The non-transitory computer readable storage medium of claim 15, wherein the instructions further cause the processing device to:

provide a command line interface to bind the first process to the preferred NUMA node.

18. The non-transitory computer readable storage medium of claim 15, wherein the instructions further cause the processing device to:

determine a respective magnitude resource vector for each respective NUMA node of the plurality of NUMA nodes by determining a product of an amount of memory available and a number of CPU cores available;

determine an ordered list of the plurality of NUMA nodes in view of the respective magnitude resource vectors; and

determine the preferred NUMA node for the first process in view of the ordered list of the plurality of NUMA nodes.

19. The non-transitory computer readable storage medium of claim 15, wherein the instructions further cause the processing device to:

identify a subset of the plurality of processes to potentially require an additional resource, the plurality of processes comprising the first process and being monitored for NUMA node placement re-evaluation;

determine a respective estimated amount of required resources for each of the identified processes;

determine an ordered list of the identified processes in view of the respective estimated amount of required resources; and

determine a preferred NUMA node for the each of the identified processes in view of the ordered list of the identified processes.

20. The non-transitory computer readable storage medium of claim 19, wherein to determine the respective estimated amount of required resources for each of the identified processes the instructions further cause the processing device to divide a number of CPU cores consumed by a percent target utilization and divide an amount of memory consumed by the percent target utilization.