Systems and methods for spillover in a multi-core system

• US 8,429,652 B2
• Filed: 06/22/2010
• Issued: 04/23/2013
• Est. Priority Date: 06/22/2009
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group), Foley & Lardner LLP
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: Narayana, Raghav Somanahalli, Muthiah, Manikam, Yengalasetti, Sreedhar
• Primary Examiner(s): Puente, Emerson
• Assistant Examiner(s): SWIFT, CHARLES M
• Application Number:
  US12/820,607
• Publication Number:
  US 20100325268A1
• Time in Patent Office: 1,036 Days
• Field of Search: 718/1, 718/100, 718/102, 718/104, 718/105, 709/223, 709/224, 709/226
• US Class Current: 718/1
• CPC Class Codes: G06F 2009/45579 I/O management, e.g. providing access to device drivers or storage
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 2209/5011 Pool
• CPC Class Codes: G06F 2209/504 Resource capping
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The present invention is directed towards systems and methods for spillover threshold management in a multi-core system. A pool manager divides the spillover threshold limit of connections for vServers into an exclusive quota pool and a shared quota pool. Each vServer operating on a core is allocated an exclusive number of connections from the exclusive quota pool. If a vServer wishes to create connections beyond its exclusive number, the vServer can borrow from the shared quota pool. When the vServers are using at least a first predetermined threshold of their exclusive number of connections and the number of available connections in the shared quota pool has reached a second predetermined threshold, the multi-core system establishes a backup vServer.

Claims

1. A method of managing spillover for virtual servers across a plurality of cores in a multi-core system, the method comprising:

receiving, by a multi-core system, a request from a client for a service managed by the multi-core system;

determining, by a pool manager of the multi-core system, that a first virtual server operating on a first core of the multi-core system is using at least a first predetermined threshold number of its exclusive number of uses of a resource, the exclusive number of uses allocated from an exclusive quota pool and based on a spillover threshold;

determining, by the pool manager, that a number of available uses of the resource in a shared quota pool has reached a second predetermined threshold, the shared quota pool based on the spillover threshold;

establishing, by the multi-core system, a backup virtual server; and

forwarding, by the multi-core system, the request for the service to the backup virtual server.

2. The method of claim 1, wherein the first predetermined threshold is equal to the exclusive number of uses of the first virtual server.

3. The method of claim 1, wherein the second predetermined threshold is zero.

4. The method of claim 1, wherein

determining that a first virtual server is using at least a first predetermined threshold number of its exclusive number of uses further comprises determining that the first virtual server is using at least a first predetermined threshold number of connections to services;

and

determining that a number of available uses in a shared quota pool has reached a second predetermined threshold further comprises determining that the number of available uses has reached a second predetermined threshold number of connections to services.

5. The method of claim 1, wherein

determining that a first virtual server is using at least a first predetermined threshold number of its exclusive number of uses further comprises determining that the first virtual server is using at least a first predetermined threshold amount of bandwidth;

determining that a number of available uses in a shared quota pool has reached a second predetermined threshold further comprises determining that an amount of available bandwidth in the shared quota pool has reached a second predetermined threshold amount of bandwidth.

6. The method of claim 1, wherein establishing a backup virtual server further comprises establishing a backup virtual server on a core of the multi-core system.

7. The method of claim 1, wherein establishing a backup virtual server further comprises establishing a backup virtual server on a core of a second multi-core system.

8. The method of claim 1, further comprising

monitoring, by the multi-core system, a status for each of a plurality of services managed by the multi-core system;

determining, by the multi-core system, a status of a service of the plurality of services indicates the service is not available; and

adjusting, by the multi-core system in response to the determination, the spillover threshold to comprise a sum of resource capacities for each of the plurality of services having a status of available.

9. The method of claim 8, further comprising

adjusting, by the multi-core system, the exclusive quota pool according to the adjusted spillover threshold;

adjusting, by the pool manager, the exclusive number of uses of resources allocated to the first virtual server according to the adjusted spillover threshold; and

adjusting, by the multi-core system, the shared quota pool according to the adjusted spillover threshold.

10. The method of claim 1, further comprising:

determining, by the multi-core system, a number of uses of resources for the multi-core system has fallen below the spillover threshold;

receiving, by the multi-core system, a second request for a service managed by the multi-core system from a second client; and

providing, by the multi-core system, the second request to the first virtual server on the multi-core system.

11. A multi-core system for managing spillover for virtual servers across a plurality of cores in a multi-core system, the system comprising:

a transceiver that receives a request from a client for a service managed by a multi-core system comprising a plurality of cores;

a pool manager, executing on a core of the plurality of cores, that

determines that a first virtual server operating on a first core of the multi-core system is using at least a first predetermined threshold number of its exclusive number of uses of a resource, the exclusive number of uses allocated from an exclusive quota pool and based on a spillover threshold, and

determines that a number of available uses of the resource in a shared quota pool has reached a second predetermined threshold, the shared quota pool based on the spillover threshold;

a management component that establishes a backup virtual server; and

a connection management mechanism that forwards the request for the service to the backup virtual server.

12. The system of claim 11, wherein the first predetermined threshold is equal to the exclusive number of uses of the first virtual server.

13. The system of claim 11, wherein the second predetermined threshold is zero.

14. The system of claim 11, wherein the pool manager

determines that the first virtual server is using at least a first predetermined threshold number of connections to services, and

determines that the number of available uses has reached a second predetermined threshold number of connections to services.

15. The system of claim 11, wherein the pool manager

determines that the first virtual server is using at least a first predetermined threshold amount of bandwidth, and

determines that an amount of available bandwidth in the shared quota pool has reached a second predetermined threshold amount of bandwidth.

16. The system of claim 11, wherein the management component establishes the backup virtual server on a core of the multi-core system.

17. The system of claim 11, wherein the management component establishes the backup virtual server on a core of a second multi-core system.

18. The system of claim 11, further comprising monitoring agents, wherein each agent

monitors a status for a service of a plurality of services managed by the multi-core system, and

determines a status of the service indicates the service is available or not available.

19. The system of claim 18, wherein the pool manager

adjusts, in response to the determinations of the monitoring agents, the spillover threshold to comprise a sum of resource capacities for each service having a status of available;

adjusts the exclusive quota pool according to the adjusted spillover threshold;

adjusts the exclusive number of uses of resources allocated to the first virtual server according to the adjusted spillover threshold; and

adjusts the shared quota pool according to the adjusted spillover threshold.

20. The system of claim 11, wherein the management component

determines a number of uses of resources for the multi-core system has fallen below the spillover threshold;

receives a second request for a service managed by the multi-core system from a second client; and

provides the second request to the first virtual server.