System and method for supporting service level quorum in a data grid cluster

• US 9,262,229 B2
• Filed: 01/17/2012
• Issued: 02/16/2016
• Est. Priority Date: 01/28/2011
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Lee, Robert H., Falco, Mark, Gleyzer, Gene, Purdy, Cameron
• Primary Examiner(s): Gillis, Brian J
• Assistant Examiner(s): TOKUTA, SHEAN S
• Application Number:
  US13/352,209
• Publication Number:
  US 20120198455A1
• Time in Patent Office: 1,491 Days
• Field of Search: 709/205, 709/229
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1425 by reconfiguration of node membership
• CPC Class Codes: G06F 2209/505 Clust
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

A system and method is described for use with a data grid cluster, for supporting service level quorum in the data grid cluster. The data grid cluster includes a plurality of cluster nodes that support performing at least one service action. A quorum policy, defined in a cache configuration file associated with the data grid cluster, can specify a minimum number of service members that are required in the data grid cluster for performing the service action. The data grid cluster uses the quorum policy to determine whether the service action is allowed to be performed, based on a present state of the plurality of cluster nodes in the data grid cluster.

Claims

1. A system for supporting service level quorum in a data grid cluster, comprising:

a plurality of computer servers, the data grid cluster executing thereon and the data grid cluster including a plurality of interoperating cluster nodes in the data grid cluster, wherein the data grid cluster supports performing a plurality of services including a root cluster service performed by all of the plurality of cluster nodes, a first service performed by a first subset of said plurality of cluster nodes, and a second service performed by a second subset of said plurality of cluster nodes, wherein the first service provides a different type of service than the root cluster service, and wherein the second service provides a different type of service than the root cluster service and the first service;

a root cluster service quorum policy defined in a cache configuration file associated with the data grid cluster, wherein the root cluster service quorum policy specifies a minimum number of qualified root cluster service members that are required for performing root cluster service actions of said root cluster service;

a first service quorum policy defined in the cache configuration file associated with the data grid cluster, wherein the first service quorum policy specifies a minimum number of qualified first service members required for performing first service actions of said first service;

a second service quorum policy defined in the cache configuration file associated with the data grid cluster, wherein the second service quorum policy specifies a minimum number of qualified second service members required for performing second service actions of said second service;

wherein the data grid cluster uses the root cluster quorum policy to determine whether root cluster service actions are allowed to be performed based on how many cluster nodes are operational in the data grid cluster;

wherein the data grid cluster uses the first service quorum policy to determine whether first service actions are allowed to be performed based on how many cluster nodes are operational in said first subset of said plurality of cluster nodes;

wherein the data grid cluster uses the second service quorum policy to determine whether second service actions are allowed to be performed based on how many cluster nodes are operational in said second subset of said plurality of cluster nodes; and

wherein the first service is a partitioned cache service and the second service is a proxy service.

2. The system according to claim 1, further comprising:

a pluggable interface that allows users to implement at least one custom action policy defining a custom action controlling behaviors of the data grid cluster, wherein the data grid cluster operates to use a factory class to create the at least one custom action policy.

3. The system according to claim 2, wherein:

the first service quorum policy contains a reference to the at least one custom action policy.

4. The system according to claim 1, wherein:

the root cluster service quorum policy defines a timeout survivor quorum that specifies a minimum number of cluster nodes that must remain in the data grid cluster when the root cluster service is terminating suspect members, wherein a cluster node becomes a suspected cluster member when it has not responded to network communications.

5. The system according to claim 1, wherein the first service quorum policy defines at least one of:

a distribution quorum that specifies a minimum number of storage-enabled members of the first service that must be present before the first service is allowed to perform partition distribution;

a restore quorum that specifies a minimum number of storage-enabled members of the first service that must be present before the first service is allowed to restore lost primary partitions from backup;

a read quorum that specifies a minimum number of storage-enabled members of the first service that must be present in order to process read requests, wherein a read request is any request that does not mutate the state or contents of a cache; and

a write quorum that specifies a minimum number of storage-enabled members of the first service that must be present in order to process write requests, wherein a write request is any request that may mutate the state or contents of a cache.

6. The system according to claim 1, wherein the second service quorum policy:

defines a connection quorum that specifies a minimum number of members of the second service that must be available before the second service can allow client connections.

7. The system according to claim 1, wherein:

the first service quorum policy is defined in a scheme element in the cache configuration file, when the scheme element supports scheme reference.

8. The system according to claim 1, further comprising:

at least one custom action policy defining a custom action controlling behaviors of the data grid cluster, wherein the at least one custom policy is defined based on at least one of

a particular time,

availability of a particular resource, and

an external event.

9. The system according to claim 8, wherein:

the first service quorum policy refers to the at least one custom action policy.

10. A method for supporting service level quorum in a data grid cluster, comprising:

providing at least a root cluster service, a first service, and a second service in the data grid cluster, the data grid cluster including a plurality of interoperating cluster nodes, wherein the first service provides a different type of service than the root cluster service, and wherein the second service provides a different type of service than the root cluster service and the first service;

defining a root cluster service quorum policy in a cache configuration file associated with data grid cluster, wherein the root cluster service quorum policy specifies a minimum number of qualified root cluster service members that are required for performing root cluster service actions of said root cluster service;

providing a first service quorum policy defined in the cache configuration file associated with the data grid cluster, wherein the first service quorum policy specifies a minimum number of qualified first service members required for performing first service actions of said first service;

providing a second service quorum policy defined in the cache configuration file associated with the data grid cluster, wherein the second service quorum policy specifies a minimum number of qualified second service members required for performing second service actions of said second service;

using the root cluster service quorum policy to determine whether root cluster service actions are allowed to be performed based on how many cluster nodes are operational in the data grid cluster;

using the first service quorum policy to determine whether first service actions are allowed to be performed based on how many cluster nodes are operational in said first subset of said plurality of cluster nodes;

using the second service quorum policy to determine whether second service actions are allowed to be performed based on how many cluster nodes are operational in said second subset of said plurality of cluster nodes; and

wherein the first service is a partitioned cache service and the second service is a proxy service.

11. A non-transitory machine readable medium having instructions stored thereon for supporting service level quorum in a data grid cluster, which instructions, when executed cause a system to perform steps comprising:

providing at least a root cluster service, a first service, and a second service in the data grid cluster, the data grid cluster including a plurality of interoperating cluster nodes, wherein the first service provides a different type of service than the root cluster service, and wherein the second service provides a different type of service than the root cluster service and the first service;

defining a root cluster service quorum policy in a cache configuration file associated with data grid cluster, wherein the root cluster service quorum policy specifies a minimum number of qualified root cluster service members that are required for performing root cluster service actions of said root cluster service;

providing a first service quorum policy defined in the cache configuration file associated with the data grid cluster, wherein the first service quorum policy specifies a minimum number of qualified first service members required for performing first service actions of said first service;

providing a second service quorum policy defined in the cache configuration file associated with the data grid cluster, wherein the second service quorum policy specifies a minimum number of qualified second service members required for performing second service actions of said second service;

using the root cluster service quorum policy to determine whether root cluster service actions are allowed to be performed based on how many cluster nodes are operational in the data grid cluster;

using the first service quorum policy to determine whether first service actions are allowed to be performed based on how many cluster nodes are operational in said first subset of said plurality of cluster nodes;

using the second service quorum policy to determine whether second service actions are allowed to be performed based on how many cluster nodes are operational in said second subset of said plurality of cluster nodes; and

wherein the first service is a partitioned cache service and the second service is a proxy service.

12. The non-transitory machine readable medium according to claim 11, having instructions stored thereon that when executed cause a system to perform the steps further comprising:

providing a pluggable interface that allows users to implement a custom action policy in order to control behaviors of the data grid cluster, wherein the data grid cluster operates to use a factory class to create the custom action policy.

13. The non-transitory machine readable medium according to claim 12, wherein the first service quorum policy contains a reference to the custom action policy.

14. The non-transitory machine readable medium according to claim 11, having instructions stored thereon that when executed cause a system to perform the steps further comprising:

defining, via the root cluster service quorum policy, a timeout survivor quorum that specifies a minimum number of cluster nodes that must remain in the data grid cluster when a root cluster service is terminating suspect members, wherein a cluster node becomes a suspected cluster member when it has not responded to network communications.

15. The non-transitory machine readable medium according to claim 11, further comprising defining, via the first service quorum policy, at least one of:

a distribution quorum that specifies a minimum number of storage-enabled members of the first service that must be present before the first service is allowed to perform partition distribution;

a restore quorum that specifies a minimum number of storage-enabled members of the first service that must be present before the first service is allowed to restore lost primary partitions from backup;

a read quorum that specifies a minimum number of storage-enabled members of the first service that must be present in order to process read requests, wherein a read request is any request that does not mutate the state or contents of a cache; and

a write quorum that specifies a minimum number of storage-enabled members of the first service that must be present in order to process write requests, wherein a write request is any request that may mutate the state or contents of a cache.

16. The non-transitory machine readable medium according to claim 11, having instructions stored thereon that when executed cause a system to perform the steps further comprising:

defining, via the second service quorum policy, a connection quorum that specifies a minimum number of members of the second service that must be available before the second service can allow client connections.

17. The non-transitory machine readable medium according to claim 11, having instructions stored thereon that when executed cause a system to perform the steps further comprising:

defining the first service quorum policy in a scheme element in the cache configuration file, when the scheme element supports scheme reference.

18. The non-transitory machine readable medium according to claim 11, having instructions stored thereon that when executed cause a system to perform the steps further comprising:

defining a custom action policy in order to control behaviors of the data grid cluster, wherein the custom action policy is based on at least one of, a particular time, availability of a particular resource, and an external event.