System and method for computer cloud management

• US 8,209,415 B2
• Filed: 02/27/2010
• Issued: 06/26/2012
• Est. Priority Date: 02/27/2009
• Status: Active Grant

• Current Assignee: Yottaa, Inc.
• Original Assignee: Yottaa, Inc.
• Inventors: Wei, Coach
• Primary Examiner(s): Meky, Moustafa M
• Application Number:
  US12/714,486
• Publication Number:
  US 20100223378A1
• Time in Patent Office: 850 Days
• Field of Search: 709200-203, 709217-227, 709/242
• US Class Current: 709/224
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/0897 by horizontal or vertical scaling of resources, or by migrating entities, e.g. virtual resources or entities
• CPC Class Codes: H04L 41/145 involving simulating, designing, planning or modelling of a network
• CPC Class Codes: H04L 47/781 Centralised allocation of resources
• CPC Class Codes: H04L 47/822 Collecting or measuring resource availability data

Abstract

A method for auto-scaling the infrastructure capacity of an application in response to client demands includes providing an application configured to run on an application infrastructure comprising a plurality of server nodes and to be accessed by clients via a first network. Next, providing traffic management means directing traffic from the clients to the server nodes of the application infrastructure. Providing monitoring means gathering performance metrics of the application and metrics of the application infrastructure. Providing controlling means configured to change the application infrastructure. Next, monitoring the performance metrics of the application and the metrics of the application infrastructure via the monitoring means thereby obtaining metrics information and then changing the application infrastructure based on the metrics information via the controlling means. Finally directing network traffic targeted to access the application to server nodes of the changed application infrastructure via the traffic management means.

Claims

1. A method for auto-scaling the infrastructure capacity of an application in response to client demands, comprising:

providing an application configured to run on an application infrastructure comprising a plurality of server nodes and to be accessed by clients via a first network;

providing a cloud management system wherein said cloud management system comprises a traffic management system (TMS), a node management system, a node monitoring system and a data depository, and wherein said TMS directs traffic from said clients to said server nodes of the application infrastructure, wherein said node monitoring system gathers performance metrics of said application and metrics of the application infrastructure, wherein said node management system controls and changes said application infrastructure based on said gathered application performance metrics and said application infrastructure metrics, and wherein said data depository comprises data used in the cloud management system;

intercepting network traffic from said clients to said application infrastructure within said first network by said cloud management system;

changing said application infrastructure by said node management system based on said gathered application performance metrics and said application infrastructure metrics; and

directing network traffic targeted to access said application to server nodes of the changed application infrastructure by said traffic management system.

2. The method of claim 1, wherein said application infrastructure comprises a cloud computing environment.

3. The method of claim 1, wherein said application infrastructure comprises virtual machines.

4. The method of claim 1, wherein said application infrastructure comprises virtual machines and physical server machines.

5. The method of claim 1, wherein said application infrastructure comprises server nodes running in different geographic locations.

6. The method of claim 3, wherein said node management system is configured to start, stop and manage virtual machine instances.

7. The method of claim 1, wherein said application infrastructure metrics comprises geographic proximity of said clients to said server nodes of said application infrastructure.

8. The method of claim 1, wherein said application performance metrics comprises application load demand and application performance data.

9. The method of claim 1, wherein said traffic management system comprises a Domain Name Server (DNS) and directs network traffic targeted to access said application to server nodes of the changed application infrastructure by resolving a domain name of said application via said Domain Name Server (DNS).

10. The method of claim 1, wherein said traffic management system uses a DNS to provide IP addresses of said server nodes in said application infrastructure to said clients.

11. The method of claim 1, wherein said traffic management system performs load balancing among said server nodes in said application infrastructure.

12. The method of claim 1, wherein said traffic management system selects one or more optimal server nodes among said server nodes in said application infrastructure for serving client requests.

13. The method of claim 1, wherein said traffic management system selects one or more servers nodes among said server nodes in said application infrastructure based on geographic proximity of said server nodes to said clients.

14. The method of claim 1, wherein said traffic management system selects one or more server nodes among said server nodes in said application infrastructure based on optimized network performance to certain clients.

15. The method of claim 1, wherein said traffic management system selects a persistent server node among said server nodes in said application infrastructure for serving requests from the same client.

16. The method of claim 1, wherein said node management system changes said application infrastructure capacity in response to said application infrastructure metrics.

17. The method of claim 1, wherein said node management system changes said application infrastructure capacity in response to a certain policy.

18. The method of claim 1, wherein said node management system changes said application infrastructure capacity in response to instructions received from a third party.

19. The method of claim 1, wherein said node management system changes said application infrastructure capacity by launching new server nodes in said application infrastructure.

20. The method of claim 1, wherein said node management system changes said application infrastructure capacity by shutting down sever nodes in said application infrastructure.

21. The method of claim 1, wherein said data used in the cloud management system comprise Virtual Machine Image artifacts, configuration data, routing policy data and node management policy data.

22. A system for auto-scaling the infrastructure capacity of an application in response to client demands, comprising:

an application configured to run on an application infrastructure comprising a plurality of server nodes and to be accessed by clients via a first network;

a cloud management system comprising a traffic management system (TMS), a node management system, a node monitoring system and a data depository,

wherein said traffic management system directs traffic from said clients to said server nodes of the application infrastructure;

wherein said node monitoring system gathers performance metrics of said application and metrics of the application infrastructure;

wherein said node management system controls and changes said application infrastructure based on said gathered application performance metrics and said application infrastructure metrics;

wherein said data depository comprises data used in the cloud management system;

wherein said cloud management system intercepts network traffic from said clients to said application infrastructure within said first network;

wherein said node management system changes said application infrastructure based on said gathered application performance metrics and said application infrastructure metrics; and

wherein said traffic management system directs network traffic targeted to access said application to server nodes of the changed application infrastructure.

23. The system of claim 22, wherein said application infrastructure comprises a cloud computing environment.

24. The system of claim 22, wherein said application infrastructure comprises virtual machines.

25. The system of claim 24, wherein said node management system is configured to start, stop and manage virtual machine instances.

26. The system of claim 22, wherein said application infrastructure comprises virtual machines and physical server machines.

27. The system of claim 22, wherein said application infrastructure comprises server nodes running in different geographic locations.

28. The system of claim 22, wherein said application infrastructure metrics comprises geographic proximity of said clients to said server nodes of said application infrastructure.

29. The system of claim 22, wherein said application performance metrics comprises application load demand and application performance data.

30. The system of claim 22, wherein said traffic management system comprises a Domain Name Server (DNS) and directs network traffic targeted to access said application to server nodes of the changes application infrastructure by resolving a domain name of said application via said Domain Name Server (DNS).

31. The system of claim 22, wherein said traffic management system uses a Domain Name Server (DNS) to provide IP addresses of said server nodes in said application infrastructure to said clients.

32. The system of claim 22, wherein said traffic management system performs load balancing among said server nodes in said application infrastructure.

33. The system of claim 22, wherein said traffic management system selects one or more optimal server nodes among said server nodes in said application infrastructure for serving client requests.

34. The system of claim 22, wherein said traffic management system selects one or more servers nodes among said server nodes in said application infrastructure based on geographic proximity of said server nodes to said clients.

35. The system of claim 22, wherein said traffic management system selects one or more server nodes among said server nodes in said application infrastructure based on optimized network performance to certain clients.

36. The system of claim 22, wherein said traffic management system selects a persistent server node among said server nodes in said application infrastructure for serving requests from the same client.

37. The system of claim 22, wherein said node management system changes said application infrastructure capacity in response to said application infrastructure metrics.

38. The system of claim 22, wherein said node management system changes said application infrastructure capacity in response to a certain policy.

39. The system of claim 22, wherein said node management system changes said application infrastructure capacity in response to instructions received from a third party.

40. The system of claim 22, wherein said node management system changes said application infrastructure capacity by launching new server nodes in said application infrastructure.

41. The system of claim 22, wherein said node management system changes said application infrastructure capacity by shutting down sever nodes in said application infrastructure.

42. The system of claim 22 further comprising a configuration management system and wherein said configuration management system comprises one of a user interface or an application programming interface (API).

43. The system of claim 22, wherein said data used in the cloud management system comprise Virtual Machine Image artifacts, configuration data, routing policy data and node management policy data.