Dynamic membership management in a distributed system

• US 9,317,372 B1
• Filed: 03/17/2014
• Issued: 04/19/2016
• Est. Priority Date: 04/13/2005
• Status: Active Grant

• Current Assignee: Progress Software Corporation
• Original Assignee: Progress Software Corporation
• Inventors: Rousseau, Benjamin A., Hu, Carl, Tompkins, Frederick A. Jr.
• Primary Examiner(s): Vo, Truong
• Application Number:
  US14/216,304
• Time in Patent Office: 764 Days
• Field of Search: 707/638
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1425 by reconfiguration of node membership
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 9/466 Transaction processing

Abstract

Transactional database replication techniques are disclosed that do not require altering of the database management system implementation. A replicator module includes a dynamic membership manager, which is configured to manage the persistent membership of a coordination group. The persistent membership can be, for example, a durable set of sites that can replicate changes amongst themselves. Changes from sites not in the persistent membership are discarded. The set of recovered members is a subset of the persistent membership. The persistent membership changes incrementally by either removing or adding members. Failed members may still be part of the persistent membership. The dynamic membership manager module manages the modification of the persistent membership, initialization of replicas, and propagation of membership information.

Claims

1. A method comprising:

determining, using one or more processors, individual weights associated with individual persistent members of a coordination group in a previous quorum;

determining, using one or more processors, that a current quorum is attained based on an algorithm using the individual weights associated with the individual persistent members of the coordination group in the previous quorum;

determining, using one or more processors, whether a first site that is a persistent member of the coordination group has participated in at least one quorum prior to the current quorum; and

responsive to determining that the first site has participated in at least one quorum prior to the current quorum, a registrar of the first site modifying the persistent membership of the coordination group, the coordination group including a number of sites in a distributed environment and including the first site.

2. The method of claim 1 comprising:

receiving, by the registrar of the first site, a membership request from an entrant seeking to become a member of the persistent membership;

wherein modifying the persistent membership of the coordination group includes;

modifying, by the registrar of the first site, the persistent membership for the entrant;

responsive to the registrar receiving the membership request, disconnecting the registrar of the first site from the coordination group and inhibiting, by a distributed lock manager, updates to a first database while cotemporaneous to the inhibition of the updates the registrar of the first site initializes an entrant database for the entrant; and

reconnecting, by the registrar of the first site, to the coordination group after initialization of the entrant database.

3. The method of claim 1 comprising:

acquiring, by the registrar of the first site, a distributed lock on the coordination group and a name for the entrant;

examining, by the registrar of the first site upon receiving the distributed lock, the persistent membership to ensure that no other site utilizes the name for the entrant; and

refusing, by the registrar of the first site, to proceed with modifying the persistent membership of the coordination group to initialize the entrant database in response to the name for the entrant being already in use.

4. The method of claim 1, wherein the algorithm is a dynamic linear voting algorithm with weightings in order to determine quorum.

5. The method of claim 1, wherein quorum is attained when more than half the sum of the weightings in the previous quorum are present.

6. The method of claim 1, wherein the weight associated with the persistent member is fixed at the time that persistent member joins the persistent membership.

7. The method of claim 1, wherein a weight associated with a persistent member in the previous quorum is omitted when determining whether a quorum is attained.

8. The method of claim 1, wherein a weight associated with a persistent member in the previous quorum is omitted when determining whether a quorum is attained, when that persistent member is evicted.

9. The method of claim 1, wherein a weight associated with a persistent member in the previous quorum is omitted when determining whether a quorum is attained when that persistent member has left voluntarily.

10. A non-transitory computer-readable medium encoded with instructions that, when executed by one or more processors, causes the one or more processors to carry out a process comprising:

determining, using one or more processors, individual weights associated with individual persistent members of a coordination group in a previous quorum;

determining that a current quorum is attained based on an algorithm using the individual weights associated with the individual persistent members of the coordination group in the previous quorum;

determining whether a first site that is a persistent member of the coordination group has participated in at least one quorum prior to the current quorum; and

responsive to determining that the first site has participated in at least one quorum prior to the current quorum, a registrar of the first site modifying the persistent membership of the coordination group, the coordination group including a number of sites in a distributed environment and including the first site.

11. The computer-readable medium of claim 10, the process comprising:

receiving, by the registrar of the first site, a membership request from an entrant seeking to become a member of the persistent membership;

wherein modifying the persistent membership of the coordination group includes;

modifying, by the registrar of the first site, the persistent membership for the entrant;

responsive to the registrar receiving the membership request, disconnecting the registrar of the first site from the coordination group and inhibiting, by a distributed lock manager, updates to a first database while cotemporaneous to the inhibition of the updates the registrar of the first site initializes an entrant database for the entrant; and

reconnecting, by the registrar of the first site, to the coordination group after initialization of the entrant database.

12. The computer-readable medium of claim 10, the process comprising:

acquiring, by the registrar of the first site, a distributed lock on the coordination group and a name for the entrant;

examining, by the registrar of the first site upon receiving the distributed lock, the persistent membership to ensure that no other site utilizes the name for the entrant; and

refusing, by the registrar of the first site, to proceed with modifying the persistent membership of the coordination group to initialize the entrant database in response to the name for the entrant being already in use.

13. The computer-readable medium of claim 10, wherein the algorithm is a dynamic linear voting algorithm with weightings in order to determine quorum.

14. The computer-readable medium of claim 10, wherein quorum is attained when more than half the sum of the weightings in the previous quorum are present.

15. The computer-readable medium of claim 10, wherein the weight associated with the persistent member is fixed at the time that persistent member joins the persistent membership.

16. The computer-readable medium of claim 10, wherein a weight associated with a persistent member in the previous quorum is omitted when determining whether a quorum is attained.

17. The computer-readable medium of claim 10, wherein a weight associated with a persistent member in the previous quorum is omitted when determining whether a quorum is attained, when that persistent member is evicted.

18. The computer-readable medium of claim 10, wherein a weight associated with a persistent member in the previous quorum is omitted when determining whether a quorum is attained when that persistent member has left voluntarily.

19. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

determine individual weights associated with individual persistent members of a coordination group in a previous quorum;

determine that a current quorum is attained based on an algorithm using the individual weights associated with the individual persistent members of the coordination group in the previous quorum;

determine whether a first site that is a persistent member of the coordination group has participated in at least one quorum prior to the current quorum; and

responsive to determining that the first site has participated in at least one quorum prior to the current quorum, a registrar of the first site modifying the persistent membership of the coordination group, the coordination group including a number of sites in a distributed environment and including the first site.