Architecture and method for configuring a simplified cluster over a network with fencing and quorum

• US 20070022314A1
• Filed: 07/22/2005
• Published: 01/25/2007
• Est. Priority Date: 07/22/2005
• Status: Abandoned Application

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Haynes, Thomas, Daniel, Stephen, Erasani, Pranoop, Conklin, Clifford
• Application Number:
  US11/187,729
• Publication Number:
  US 20070022314A1
• Time in Patent Office: Days
• US Class Current: 714/4
• CPC Class Codes: G06F 11/1425 by reconfiguration of node membership
• CPC Class Codes: G06F 11/1482 by means of middleware or OS functionality
• CPC Class Codes: G06F 11/2033 switching over of hardware resources
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management

Abstract

A host-clustered networked storage environment includes a “quorum program.” The quorum program is invoked when a change in cluster membership occurs, or when the cluster members are not receiving reliable information about the continued viability of the cluster, or for a variety of other reasons. When the quorum program is so invoked, the cluster member is programmed to assert a claim on a quorum device configured in accordance with the present invention. More specifically, the quorum device is a vdisk embodied in as a logical unit (LUN) exported by the networked storage system. The LUN is created as a quorum device upon which a SCSI-3 reservation can be placed by an initiator. Thus, the LUN is created for this purpose as a SCSI target that exists solely as a quorum device. Fencing techniques are also provided in the networked environment such that failed cluster members can be fenced from given—exports of the networked—storage system.

Claims

1. A method of providing a quorum facility in a networked, host-clustered storage environment, comprising the steps of:

providing a plurality of nodes configured in a cluster for sharing data, each node being a cluster member;

providing a storage system that supports a plurality of data containers, said storage systems supporting a protocol to provide access to each respective data container associated with the storage system;

creating a logical unit (LUN) on the storage system as a quorum device;

mapping the logical unit to an iSCSI group of initiators which group is made up of the cluster members;

coupling the cluster to the storage system;

providing a quorum program in each cluster member such that when a change in cluster membership is detected, a surviving cluster member is instructed to send a message to an iSCSI target to place a SCSI reservation on the LUN; and

if a cluster member of the igroup is successful in placing the SCSI reservation on the LUN, then quorum is established for that cluster member.

2. The method as defined in claim 1 wherein said protocol used by said networked storage system is the Network File System protocol.

3. The method as defined in claim 1 wherein the cluster is coupled to the storage system over a network using Transmission Control Protocol/Internet Protocol.

4. The method as defined in claim 1 wherein said cluster member transmits said message that includes an iSCSI Protocol Data Unit.

5. The method as defined in claim 1 further comprising the step of said cluster members sending messages including instructions other than placing SCSI reservations on said quorum device.

6. The method as defined in claim 1 wherein said SCSI reservation is a Persistent Reservation.

7. The method as defined in claim 1 wherein said SCSI reservation is a Reserve/Release reservation.

8. The method as defined in claim 1 including the further step of employing an iSCSI driver in said cluster member to communicate with said LUN instead of or in addition to said quorum program.

9. A method for performing fencing and quorum techniques in a clustered storage environment, comprising the steps of:

providing a plurality of nodes configured in a cluster for sharing data, each node being a cluster member;

providing a storage system that supports a plurality of data containers, said storage system supporting a protocol that configures export lists that assign each cluster member certain access permission rights, including read write access permission or read only access permission as to each respective data container associated with this storage system;

creating a logical unit (LUN) configured as a quorum device;

coupling the cluster to the storage system;

providing a fencing program in each cluster member such that when a change in cluster membership is detected, a surviving member send an application program interface message to said storage system commanding said storage system to modify one or more of said export lists such that the access permission rights of one or more identified cluster members are modified; and

providing a quorum program in each cluster member such that when a change in cluster membership is detected, a surviving cluster member transmits a message to an iSCSI target to place the a SCSI reservation on the LUN.

10. A system of performing quorum capability in a storage system environment, comprising:

one or more storage systems coupled to one or more clusters of interconnected cluster members to provide storage services to one or more client;

a logical unit exported by said storage system and said logical unit being configured as a quorum device; and

a quorum program running on one or more cluster members including instructions such that when cluster membership changes, each cluster member asserts a claim on the quorum device by sending an iSCSI Protocol Data Unit message to place an iSCSI reservation on the logical unit serving as a quorum device.

11. The system as defined in claim 10 wherein said one or more storage systems are coupled to said one or more clusters by way of one or more networks that use the Transmission Control Protocol/Internet Protocol.

12. The system as defined in claim 10 wherein said storage system is configured to utilize the Network File System protocol.

13. The system as defined in claim 10 further comprising:

a fencing program running on one or more cluster members including instructions for issuing a host application program interface message when a change in cluster membership is detected, said application program interface message commanding said storage system to modify one or more of said export lists such that the access permission rights of one or more identified cluster members are modified.

14. The system as defined in claim 10 further comprising an iSCSI driver deployed in at least on of said cluster members configured to communicate with said LUN.

15. A computer readable medium for providing quorum capability in a clustered environment with networked storage system, including program instructions for performing the steps of:

creating a logical unit exported by the storage system which serves as a quorum device;

generating a message from a cluster member in a clustered environment to place a reservation on said logical unit which serves as a quorum device; and

generating a response to indicate whether said cluster member was successful in obtaining quorum.

16. The computer readable medium for providing quorum capability in a clustered environment with networked storage, as defined in claim 15 including program instructions for performing the further step of issuing a host application program interface message when a change in cluster membership is detected, said application program interface message commanding said storage system to modify one or more export lists such that access permission rights of one or more identified cluster members are modified.

17. A computer readable medium for providing quorum capability in a clustered environment with a networked storage system, comprising program instructions for performing the steps of:

detecting that cluster membership has changed;

generating a message including a SCSI reservation to be placed on a logical unit serving as a quorum device in said storage system; and

upon obtaining quorum, generating a message that one or more other cluster members are to be fenced off from a given export.

18. The computer readable medium as defmed in claim 17 further comprising instructions for generating an application program interface message including a command for modifying export lists of the storage system such that an identified cluster member no longer has read-write access to given exports of the storage system.

19. The computer readable medium as defined in claim 17 further comprising a cluster member obtaining quorum by successfully placing a SCSI reservation on a logical unit serving as a quorum device before such a reservation is placed thereupon by another cluster member.

20. The computer readable medium as defined in claim 17 further comprising instructions in a multiple node cluster having more than two cluster members to establish a quorum in a partitioned cluster by appointing a representative cluster member and having that cluster member place a SCSI reservation on a logical unit serving as a quorum device prior to a reservation being placed by another cluster member.