Capacity planning for server resources

• US 7,313,620 B2
• Filed: 07/23/2004
• Issued: 12/25/2007
• Est. Priority Date: 04/14/2000
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Odhner, Matthew C., Zizys, Giedrius, Schliiter, Kent
• Primary Examiner(s): Pollack, Melvin H.
• Application Number:
  US10/897,645
• Publication Number:
  US 20050005012A1
• Time in Patent Office: 1,250 Days
• Field of Search: 709/203, 709223-226, 709/229, 718100-105
• US Class Current: 709/226
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling

Abstract

Methods and systems for capacity planning of server resources are described wherein fixed resources of a server cluster are used in comparison to similar server cluster benchmarks to determine the maximum load—requests per second—that can be handled by the server cluster. The maximum load is used to determine utilization of server resources and to provide estimates of server resource utilization for hypothetical loads. A recommendation as to changes to server resources to handle the hypothetical loads is displayed to the user.

Claims

1. A method for deriving server resource utilization estimates for a server cluster that handles multiple document types, the method comprising:

assigning a document type value to each document type, each document type value indicating a percentage that each document type makes up of a total amount of document types;

deriving a load table for each document type, each load table containing load table values empirically derived from a server cluster that has a known amount of memory and a processor having a known type and speed, each load table value representing a maximum load that can be handled by the server cluster when the load comprises only one of the multiple document types;

receiving one or more server cluster parameter values that indicate operating parameters for the server cluster;

receiving a specified load value that indicates a load desired to be handled by the server cluster;

utilizing the load tables to derive server resource utilization estimates to determine how handling the specified load will affect the utilization of server resources; and

recommending a plan to optimize handling of the specified load by increasing resources of the server cluster.

2. The method recited in claim 1, wherein the utilizing the load tables to derive server resource utilization estimates further comprises:

for each document type, finding the closest match in the corresponding load table between the memory and processor of the server cluster with the memory and processor entries in the load table; and

deriving server resource utilization estimates by using the load value of the closest match as the maximum load that can be handled by the server cluster for each document type.

3. The method recited in claim 2, wherein the server resource utilization estimate derived is processor utilization, and the method further comprises:

displaying the server resource utilization estimates;

deriving a first processor regression constant and a second processor regression constant for each document type by;

(1) finding a functional dependency approximation between processor utilization and load for each document type;

(2) transforming the functional dependency into linear form by using logarithmic transformation;

(3) deriving the first and second processor regression constants using linear regression methodology;

finding a partial processor utilization for each document type by dividing the first processor regression constant for a particular document type by e to the power of the product of the specified load, the document type value, and the second processor regression constant for the document type; and

summing the partial processor utilizations to derive the processor utilization of the server cluster for the specified load.

4. The method recited in claim 2, wherein the server resource utilization estimate derived is communication bandwidth utilization, and the method further comprises:

deriving a first bandwidth regression constant and a second bandwidth regression constant for each document type by;

(1) finding a functional dependency approximation between communication bandwidth utilization and load for each document type;

(2) transforming the functional dependency into linear form by using logarithmic transformation;

(3) deriving the first and second bandwidth regression constants using linear regression methodology;

determining a transmission overhead factor for each document type that, when applied to a certain size page of the document type, results in the actual bandwidth necessary to transmit the page;

finding a raw partial bandwidth utilization for each document type utilizing the document type value, the specified load, and the first and second bandwidth regression constants for the document type;

finding a weighted partial bandwidth utilization for each document type utilizing the raw partial bandwidth utilization for a document type and the transmission overhead factor for the document type;

finding a partial bandwidth utilization for each document type that is a function of the weighted partial bandwidth utilization for each document type and the total communication bandwidth available; and

summing the partial bandwidth utilizations to derive the communication bandwidth utilization.

5. The method recited in claim 2, wherein the server resource utilization estimate derived is communication bandwidth utilization, and the method further comprises:

deriving a first bandwidth regression constant and a second bandwidth regression constant for each document type by;

(1) finding a functional dependency approximation between communication bandwidth utilization and load for each document type;

(2) transforming the functional dependency into linear form by using logarithmic transformation;

(3) deriving the first and second bandwidth regression constants using linear regression methodology;

determining a transmission overhead factor for each document type that, when applied to a certain size page of the document type, results in the actual bandwidth necessary to transmit the page;

finding a raw partial bandwidth utilization for each document type by multiplying the document type value by a product of the specified load and the second bandwidth regression constant for the document type, and adding the first bandwidth regression constant for the document type;

finding a weighted partial bandwidth utilization for each document type by multiplying the raw partial bandwidth utilization for a document type by the transmission overhead factor for the document type;

finding a partial bandwidth utilization for each document type by dividing the weighted partial bandwidth utilization for each document type by the total communication bandwidth available; and

summing the partial bandwidth utilizations to derive the communication bandwidth utilization.

6. The method recited in claim 2, wherein the server resource utilization estimate derived is memory utilization, the method further comprising:

for each document type, deriving a connection memory factor as a function of the incoming connections at different speeds;

for each document type, deriving a weighted connection memory factor as a function of the connection memory factor, the specified load and the document type value;

for each document type, deriving a page load ratio utilizing the document type value, the specified load, the load value obtained from load table for the document type and the document type value;

for each document type, deriving a number of concurrent connections from the weighted connection memory factor and the page load ratio;

summing the number of concurrent connections for each document type to derive a total number of concurrent connections; and

deriving the memory utilization by multiplying from the total number of concurrent connections, the amount of memory necessary to support each connection for communications, the amount of memory necessary to support data structures associated with each connection, the amount of memory required by a server operating system, the amount of memory required by the server communication program, and the total memory available.

7. The method recited in claim 2, wherein the server resource utilization estimate derived is memory utilization, the method further comprising:

for each document type, deriving a connection memory factor that is the adjusted average of the incoming connections at different speeds;

for each document type, deriving a weighted connection memory factor by multiplying the connection memory factor by a product of the specified load and the document type value;

for each document type, deriving a page load ratio by dividing the product of the document type value and the specified load by the difference between the load value obtained from load table for the document type and the product of the document type value and the specified load;

for each document type, adding the weighted connection memory factor and the page load ratio to derive a number of concurrent connections for each document type;

summing the number of concurrent connections for each document type to derive a total number of concurrent connections; and

deriving the memory utilization by multiplying the total number of concurrent connections by the sum of the amount of memory necessary to support each connection for communications and the amount of memory necessary to support data structures associated with each connection, and adding the amount of memory required by a server operating system and the amount of memory required by the server communication program, and dividing the result thereof by total memory available.

8. The method recited in claim 2, wherein the server resource utilization estimate derived is general server utilization, and wherein the method further comprises:

deriving a partial load for each document type from the document type value for a document type and the specified load;

deriving a partial utilization value for each document type from the partial load for a document type and the load table value for the document type; and

deriving the general server utilization by summing the partial utilization values.

9. The method recited in claim 2, wherein the server resource utilization estimate derived is general server utilization, and wherein the method further comprises:

deriving a partial load for each document type by multiplying the document type value for a document type by the specified load;

deriving a partial utilization value for each document type by dividing the partial load for a document type by the load table value for the document type; and

deriving the general server utilization by summing the partial utilization values.

10. One or more computer-readable media having computer-readable instructions thereon which, when executed by one or more computers, cause the computers to implement the method of claim 2.

11. A computer-implemented method to derive server utilization estimates for a server cluster that handles a plurality of document types comprising:

collecting document type information that describes a percentage of a total number of documents handled by the server cluster for each of the plurality of document types;

based upon the collected document type information, determining one or more server resource utilization values for the server cluster; and

outputting the one or more server resource utilization values.

12. The computer-implemented method of claim 11, wherein the collecting includes:

outputting a user interface having one or more portions to receive input of document type information from a user; and

receiving the percentage of the total number of documents handled by the server cluster for each of the plurality of document types input by the user via the one or more portions of the user interface.

13. The computer-implemented method of claim 11, wherein the collecting document type information comprises:

collecting historical usage data during operation of the server cluster; and

based upon the historical usage data, determining the percentage of the total number of documents handled by the server cluster for each of the plurality of document types.

14. The computer-implemented method of claim 11, wherein each of the plurality of document types specifies a kind of document and a document size range.

15. The computer-implemented method of claim 11, wherein the plurality of document types includes at least hypertext markup language (HTML) documents and active server pages (ASP).

16. The computer-implemented method of claim 11, further comprising:

maintaining a load table, the load table including empirically derived load values corresponding to each of the plurality of document types for each of a plurality of server configurations;

receiving a plurality of server parameters indicative of a configuration of one or more servers in the server cluster; and

based upon the plurality of server parameters and the document type information, referencing the load table to determine the one or more server resource utilization values.

17. The computer-implemented method of claim 16, wherein one said load value corresponding to one said document type for a particular server configuration indicates a maximum load for the particular server configuration used with the one said document type.

18. The computer-implemented method of claim 16, wherein the plurality of server parameters are selected from a group consisting of:

a specified load to be handled by the server cluster, a number of servers in the server cluster, an available communications bandwidth, a processor type for the server cluster, a number of processors per server, a processor speed, and an amount of memory per server.

19. The computer-implemented method of claim 11, wherein the one or more server resource utilization values are selected from a group consisting of:

processor utilization, memory utilization, communication bandwidth utilization, and general server utilization.

20. The computer-implemented method of claim 11, wherein the determining one or more server resource utilization values for the server cluster comprises determining a value for each of processor utilization, memory utilization, communication bandwidth utilization, and general server utilization.

21. The computer-implemented method of claim 11 further comprising outputting a recommendation regarding whether to make a change to the server cluster to optimize performance based upon the one or more server resource utilization value.

22. The computer-implemented method of claim 11 further comprising:

collecting client connection information describing a percentage of a total number of client connections for each of a plurality of connection types; and

utilizing the client connection information with the document type information to determine the one or more server resource utilization values.

23. One or more computer-readable storage media comprising computer executable instructions to derive server utilization estimates for a server cluster that handles a plurality of document types which, when executed, cause a computer to perform acts comprising:

collecting document type information that describes a percentage of a total number of documents handled by the server cluster for each of the plurality of document types;

based upon the collected document type information, determining one or more server resource utilization values for the server cluster; and

outputting the one or more server resource utilization values.

24. One or more computer-readable storage media as recited in claim 23, wherein the collecting includes:

outputting a user interface having one or more portions to receive input of document type information from a user; and

receiving the percentage of the total number of documents handled by the server cluster for each of the plurality of document types input by the user via the one or more portions of the user interface.

25. One or more computer-readable storage media as recited in claim 23, wherein the collecting document type information comprises:

collecting historical usage data during operation of the server cluster; and

based upon the historical usage data, determining the percentage of the total number of documents handled by the server cluster for each of the plurality of document types.

26. One or more computer-readable storage media as recited in claim 23, wherein each of the plurality of document types specifies a kind of document and a document size range.

27. One or more computer-readable storage media as recited in claim 23, wherein the plurality of document types includes at least hypertext markup language (HTML) documents and active server pages (ASP).

28. One or more computer-readable storage media as recited in claim 23, further comprising:

maintaining a load table, the load table including empirically derived load values corresponding to each of the plurality of document types for each of a plurality of server configurations;

receiving a plurality of server parameters indicative of a configuration of one or more servers in the server cluster; and

based upon the plurality of server parameters and the document type information, referencing the load table to determine the one or more server resource utilization values.

29. One or more computer-readable storage media as recited in claim 28, wherein one said load value corresponding to one said document type for a particular server configuration indicates a maximum load for the particular server configuration used with the one said document type.

30. One or more computer-readable storage media as recited in claim 28, wherein the plurality of server parameters are selected from a group consisting of:

a specified load to be handled by the server cluster, a number of servers in the server cluster, an available communications bandwidth, a processor type for the server cluster, a number of processors per server, a processor speed, and an amount of memory per server.

31. One or more computer-readable storage media as recited in claim 23, wherein the one or more server resource utilization values are selected from a group consisting of:

processor utilization, memory utilization, communication bandwidth utilization, and general server utilization.

32. One or more computer-readable storage media as recited in claim 23, wherein the determining one or more server resource utilization values for the server comprises determining a value for each of processor utilization, memory utilization, communication bandwidth utilization, and general server utilization.

33. One or more computer-readable storage media as recited in claim 23 further comprising outputting a recommendation regarding whether to make a change to the server cluster to optimize performance based upon the one or more server resource utilization values.

34. One or more computer-readable storage media as recited in claim 23 further comprising:

collecting client connection information describing a percentage of a total number of client connections for each of a plurality of connection types; and

utilizing the client connection information along with the document type information to determine the one or more server resource utilization values.

35. A computer-implemented method of estimating server utilization for a server cluster comprising:

maintaining a load table, the load table including empirically derived load values corresponding to each of a plurality of document types handled by the server cluster for each of a plurality of server configurations specified for servers included in the server cluster;

outputting a user interface configured with one or more portions to receive data input by a user to estimate server utilization;

collecting via the user interface;

server parameters input by the user specifying a load to be handled by the server cluster and a configuration of the servers included in the server cluster; and

document type information input by the user describing a percentage usage for each type of document relative to a total amount of documents handled by the server cluster;

based upon the plurality of server parameters and the document type information, referencing the load table to determine a server resource utilization value; and

displaying via the user interface the determined server resource utilization value.

36. The computer-implemented method as recited in claim 35, wherein the user interface is configured to concurrently display the one or more portions to receive data and a results portion to display the determined server resource value.

37. The computer-implemented method as recited in claim 35, wherein the server resource utilization value is selected from a group consisting of:

processor utilization, memory utilization, communication bandwidth utilization, and general server utilization.

38. The computer-implemented method as recited in claim 35 further comprising displaying via the user interface a recommendation regarding whether to make a change to the server cluster to optimize performance based upon the determined server resource utilization value.

39. The computer-implemented method as recited in claim 35, wherein the server parameters input by the user are selected from a group consisting of:

a specified load to be handled by the server cluster, a number of servers in the server cluster, an available communications bandwidth, a processor type for the server cluster, a number of processors per server, a processor speed, and an amount of memory per server.

40. One or more computer-readable media having computer-readable instructions thereon which, when executed by one or more computers, cause the computers to implement the method of claim 35.