Separately storing core boot data and cluster configuration data in a server cluster

• US 6,453,426 B1
• Filed: 03/26/1999
• Issued: 09/17/2002
• Est. Priority Date: 03/26/1999
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Massa, Michael T., Helland, Patrick J., Gamache, Rod
• Primary Examiner(s): Ray, Gopal C.
• Application Number:
  US09/277,503
• Time in Patent Office: 1,271 Days
• Field of Search: 714/4, 714/5, 713/1, 713/2, 713/100, 709/201, 709/220, 709/221, 709/249, 709/203, 370/901, 370/908, 434/365
• US Class Current: 714/4.21
• CPC Class Codes: G06F 11/1417 Boot up procedures
• CPC Class Codes: G06F 11/1666 where the redundant component is memory or memory area
• CPC Class Codes: G06F 11/20 using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1034 Reaction to server failures by a load balancer
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method and system for distributing various types of cluster data among various storage devices of a server cluster. Cluster core boot data that is needed to get the cluster up and running is stored on a quorum storage mechanism, separate from cluster configuration data which is stored on lower cost and/or higher performance storage. The quorum storage may be implemented via a quorum of nodes, a single quorum disk or a quorum of replica members. The state of the cluster configuration data, as well as the state of other cluster data, may be stored on the quorum storage, thereby assuring the integrity of the data while providing increased reliability through the use of mirror sets of storage elements or the like for storing that data. Significant flexibility in how a cluster may be configured is achieved, along with improved cluster performance and scalability.

Claims

1. A system of distributing data in a server cluster, comprising, a first storage mechanism having cluster core boot data stored thereon, a second storage mechanism having cluster configuration data stored thereon, and at least one node including a cluster service for logging change information related to the core boot data to the first storage mechanism, and for logging changes to the cluster configuration data to the second storage mechanism.

2. The system of claim 1 wherein the first storage mechanism comprises a plurality of nodes, each node having storage therewith.

3. The system of claim 1 wherein the first storage mechanism comprises a single quorum device.

4. The system of claim 1 wherein the first storage mechanism comprises a plurality of replica devices.

5. The system of claim 4 wherein the node obtains control over a quorum of replica devices.

6. The system of claim 1 wherein the first storage mechanism further maintains state information of the second storage mechanism.

7. The system of claim 1 wherein the second storage mechanism comprises a plurality of storage elements.

8. The system of claim 7 wherein the first storage mechanism further maintains state information of the cluster configuration data, the state information comprising the status of each of the plurality of storage elements.

9. The system of claim 1 wherein the first storage mechanism further maintains state information of other cluster data.

10. The system of claim 9 wherein the other cluster data is maintained on a plurality of storage elements.

11. The system of claim 10 wherein the state information comprises the status of each of the plurality of storage elements.

12. The system of claim 1 wherein the second storage mechanism further maintains state information of other cluster data.

13. The system of claim 12 wherein the other cluster data is maintained on a plurality of storage elements.

14. The system of claim 13 wherein the state information comprises the status of each of the plurality of storage elements.

15. A method of accessing data for operating a server cluster, comprising the steps of, storing cluster core boot data on a first storage mechanism, storing cluster configuration data on a second storage mechanism, storing state information of the cluster configuration data on the first storage mechanism, accessing the first storage mechanism by a node forming a cluster to obtain the core boot data, accessing the first storage mechanism to determine the state of the second storage mechanism from the state information, evaluating the state information, and if the state information indicates the state of the second storage mechanism is valid, accessing the second storage mechanism to obtain the cluster configuration data.

16. The method of claim 15 wherein the step of storing the cluster core boot data comprises the steps of, replicating the core boot data to a quorum of nodes, and storing the core boot data with each of the nodes.

17. The method of claim 15 wherein the step of storing cluster core boot data comprises the step of storing the cluster core boot data on a single quorum device.

18. The method of claim 15 wherein the step of storing cluster core boot data comprises the step of storing the cluster core boot data on a quorum of replica devices.

19. The method of claim 15 wherein the second storage mechanism comprises a plurality of storage elements, and wherein the step of evaluating the state information includes the step of determining if at least one of the plurality of storage elements is valid.

20. The method of claim 15 further comprising the step of maintaining state information of at least one other storage device used to store other cluster data.

21. The method of claim 20 wherein the other cluster data is stored on a plurality of storage elements, and further comprising the step of evaluating the state information of the other cluster data by determining whether at least one of the plurality of storage elements is valid.

22. A computer-readable medium having computer executable instructions for performing the steps of claim 15.

23. A method of distributing data in a server cluster, comprising the steps of, storing cluster core boot data on a quorum storage, including replicating the core boot data to a plurality of nodes and storing the core boot data with each of the nodes, and storing cluster configuration data on another storage device of the cluster.

24. The method of claim 23 further comprising, maintaining, on the quorum storage, state information of the other storage device used to store the cluster configuration data.

25. The method of claim 24 wherein the other storage device used to store the cluster configuration data comprises a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is disabled.

26. The method of claim 24 wherein the other storage device used to store the cluster configuration data comprises a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is enabled.

27. The method of claim 23 further comprising, maintaining state information of at least one additional storage device used to store other cluster data.

28. The method of claim 27 wherein the state information of at least one additional storage device used to store other cluster data is maintained in the quorum storage.

29. The method of claim 27 wherein the state information of at least one additional storage device used to store other cluster data is maintained in the other storage device.

30. The method of claim 27 wherein the other cluster data is maintained on a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is disabled.

31. The method of claim 27 wherein the other cluster data is maintained on a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is enabled.

32. A computer-readable medium having computer executable instructions for performing the method of claim 23.

33. A method of distributing data in a server cluster, comprising, storing cluster core boot data on a quorum storage including storing the cluster core boot data on a single quorum device, and storing cluster configuration data on another storage device of the cluster.

34. The method of claim 33 further comprising, maintaining, on the quorum storage, state information of the other storage device used to store the cluster configuration data.

35. The method of claim 34 wherein the other storage device used to store the cluster configuration data comprises a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is disabled.

36. The method of claim 34 wherein the other storage device used to store the cluster configuration data comprises a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is enabled.

37. The method of claim 33 further comprising, maintaining state information of at least one additional storage device used to store other cluster data.

38. The method of claim 37 wherein the stat e information of at least one additional storage device used to store other cluster data is maintained in the quorum storage.

39. The method of claim 37 wherein the state information of at least one additional storage device used to store other cluster data is maintained in the other storage device.

40. The method of claim 37 wherein the other cluster data is maintained on a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is disabled.

41. The method of claim 37 wherein the other cluster data is maintained on a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is enabled.

42. A computer-readable medium having computer executable instructions for performing the method of claim 33.

43. A method of distributing data in a server cluster, comprising the steps of, storing cluster core boot data on a quorum storage including storing the cluster core boot data on a plurality of replica devices, and storing cluster configuration data on another storage device of the cluster.

44. The method of claim 43 further comprising, maintaining, on the quorum storage, state information of the other storage device used to store the cluster configuration data.

45. The method of claim 44 wherein the other storage device used to store the cluster configuration data comprises a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is disabled.

46. The method of claim 44 wherein the other storage device used to store the cluster configuration data comprises a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is enabled.

47. The method of claim 43 further comprising, maintaining state information of at least one additional storage device used to store other cluster data.

48. The method of claim 47 wherein the state information of at least one additional storage device used to store other cluster data is maintained in the quorum storage.

49. The method of claim 47 wherein the state information of at least one additional storage device used to store other cluster data is maintained in the other storage device.

50. The method of claim 47 wherein the other cluster data is maintained on a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is disabled.

51. The method of claim 47 wherein the other cluster data is maintained on a mirror set of storage elements, and wherein maintaining state information comprises recording information indicating that at least one of the storage elements is enabled.

52. A computer-readable medium having computer executable instructions for performing the method of claim 43.