Breadth-first resource allocation system and methods

• US 9,088,459 B1
• Filed: 02/22/2013
• Issued: 07/21/2015
• Est. Priority Date: 02/22/2013
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Inventors: Gao, Minlin, Syomichev, Alexey V., Bell, Aaron, Yang, Libin, Choy, Jason K. S.
• Primary Examiner(s): Dinh, Khanh
• Application Number:
  US13/774,108
• Time in Patent Office: 879 Days
• Field of Search: 709/203, 709/215, 709/223, 709/229, 714/26
• US Class Current: 1/1
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: H04L 41/0213 Standardised network management protocols, e.g. simple network management protocol [SNMP]
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/821 Prioritising resource allocation or reservation requests
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1017 based on a round robin mechanism
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A computing environment adapted with a resource allocation policy, the resource allocation policy being configured to evenly distribute application instances to as many servers as possible.

Claims

1. A computer-implemented method, said method comprising:

receiving a request to allocate CPU slots, said request associated with one or more instances of an application;

identifying a resource group comprising at least two servers having idle CPU slots;

determining a value representative of the number of running instances of the application on each server in the resource group;

determining a value representative of the number of idle CPU slots on each server in the resource group;

sorting servers in the resource group in descending order, excluding servers with no idle CPU slots, by the sum of their values representative of the number of running instances of the application and the number of idle CPU slots to create a list of eligible servers; and

allocating one CPU slot at a time from the list of eligible servers sorted in descending order in a round-robin fashion.

2. The computer-implemented method of claim 1, further comprising identifying one or more parameters of the application, wherein the one or more parameters are used in sorting the servers.

3. The computer-implemented method of claim 2, wherein a parameter defines a minimum number of servers the application needs to run on, the minimum number of servers being equal to or greater than a value of two.

4. The computer-implemented method of claim 2, wherein a parameter defines a preferred server type, the preferred server type being a server with larger memory capacities, a server with faster CPU speeds or a server with less running instances of another application.

5. The computer-implemented method of claim 2, further comprising determining whether rebalancing of CPU slots between servers in the resource group is required to satisfy a parameter of the application.

6. The computer-implemented method of claim 5, wherein rebalancing CPU slots between servers in the resource group increases the number of available servers with idle CPU slots.

7. A computer system, comprising:

a memory; and

a processing device communicatively coupled to said memory, said processing device configured to;

identify a resource group comprising at least two servers having idle CPU slots;

determine a value representative of the number of running instances of the application on each server in the resource group;

determine a value representative of the number of idle CPU slots on each server in the resource group;

sort servers in the resource group in descending order, excluding servers with no idle CPU slots, by the sum of their values representative of the number of running instances of the application and the number of idle CPU slots to create a list of eligible servers; and

allocate one CPU slot at a time from the list of eligible servers sorted in descending order in a round-robin fashion.

8. A non-transitory computer-readable storage medium programmed to include instructions that, when executed by a processing device, cause the processing device to perform a method, said method comprising:

identifying a resource group comprising at least two servers having idle CPU slots;

determining a value representative of the number of running instances of the application on each server in the resource group;

determining a value representative of the number of idle CPU slots on each server in the resource group;

sorting servers in the resource group in descending order, excluding servers with no idle CPU slots, by the sum of their values representative of the number of running instances of the application and the number of idle CPU slots to create a list of eligible servers; and

allocating one CPU slot at a time from the list of eligible servers sorted in descending order in a round-robin fashion.

9. A computer-implemented method, said method comprising:

receiving a request to release CPU slots, said request associated with one or more instances of an application;

identifying a resource group comprising servers having CPU slots allocated to one or more instances of the application;

determining a value representative of the number of running instances of the application on each server in the resource group;

sorting servers in the resource group in descending order, excluding servers with no instances of the application, by their values representative of the number of running instances of the application to create a list of eligible servers; and

releasing one CPU slot at a time from the list of eligible servers sorted in descending order.

10. The computer-implemented method of claim 9, further comprising identifying one or more parameters of the application, wherein the one or more parameters are used in sorting the servers.

11. The computer-implemented method of claim 10, wherein a parameter defines a minimum number of servers the application needs to run on, the minimum number of servers being equal to or greater than a value of two.

12. The computer-implemented method of claim 10, wherein a parameter defines a preferred server type, the preferred server type being a server with larger memory capacities, a server with faster CPU speeds or a server with less running instances of another application.

13. The computer-implemented method of claim 10, further comprising determining whether rebalancing of CPU slots between servers in the resource group is required to satisfy a parameter of the application.

14. The computer-implemented method of claim 13, wherein rebalancing CPU slots between servers in the resource group increases the number of available servers with idle CPU slots.

15. A computer system, comprising:

a memory; and

a processing device communicatively coupled to said memory, said processing device configured to;

receive a request to release CPU slots, said request associated with one or more instances of an application;

identify a resource group comprising servers having CPU slots allocated to one or more instances of the application;

determine a value representative of the number of running instances of the application on each server in the resource group;

sort servers in the resource group in descending order, excluding servers with no instances of the application, by their values representative of the number of running instances of the application to create a list of eligible servers; and

release one CPU slot at a time from the list of eligible servers sorted in descending order.

16. A non-transitory computer-readable storage medium programmed to include instructions that, when executed by a processing device, cause the processing device to perform a method, said method comprising:

receiving a request to release CPU slots, said request associated with one or more instances of an application;

identifying a resource group comprising servers having CPU slots allocated to one or more instances of the application;

determining a value representative of the number of running instances of the application on each server in the resource group;

sorting servers in the resource group in descending order, excluding servers with no instances of the application, by their values representative of the number of running instances of the application to create a list of eligible servers; and

releasing one CPU slot at a time from the list of eligible servers sorted in descending order.