METHOD AND APPARATUS FOR IMPLEMENTING HEARTBEAT SERVICE OF HIGH AVAILABILITY CLUSTER

• US 20150113340A1
• Filed: 12/29/2014
• Published: 04/23/2015
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: GAO, Junli
• Granted Patent: US 9,658,912 B2
• Time in Patent Office: Days
• US Class Current: 714/55
• CPC Class Codes: G06F 11/0709 in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
• CPC Class Codes: G06F 11/073 in a memory management context, e.g. virtual memory or cache management memory management G06F12/00; testing of static memory units G11C29/00
• CPC Class Codes: G06F 11/0757 by exceeding a time limit, i.e. time-out, e.g. watchdogs
• CPC Class Codes: G06F 11/202 where processing functionality is redundant redundant communication control functionality G06F11/2005, redundant storage control functionality G06F11/2089
• CPC Class Codes: H04L 41/0677 Localisation of faults
• CPC Class Codes: H04L 43/10 Active monitoring, e.g. heartbeat, ping or trace-route

Abstract

Embodiments of the present invention provide a method for implementing a heartbeat service of a high availability cluster, including: writing, by a server, heartbeat counting information to a disk array, where the heartbeat counting information includes a write heartbeat message sequence number, a read peer heartbeat message sequence number, active-standby state information, a heartbeat message, and a heartbeat message length of the server, so that one or more corresponding servers read the heartbeat counting information, in the disk array, of the server; and reading heartbeat counting information, which is written by the one or more corresponding servers to the disk array, of the one or more corresponding servers, and repeating the write operation and the read operation. Correspondingly, the embodiments of the present invention further provide a server, which solves a spit-brain problem, and improves data security.

Claims

1. A method for implementing a heartbeat service of a high availability cluster, comprising:

writing, by a server, heartbeat counting information to a disk array, wherein the heartbeat counting information comprises a write heartbeat message sequence number, a read peer heartbeat message sequence number, active-standby state information, a heartbeat message, and a heartbeat message length of the server, so that one or more corresponding servers read the heartbeat counting information, in the disk array, of the server; and

reading heartbeat counting information, which is written by the one or more corresponding servers to the disk array, of the one or more corresponding servers, and repeating the write operation and the read operation, wherein the heartbeat counting information of the one or more corresponding servers comprises a write heartbeat message sequence number, a read peer heartbeat message sequence number, active-standby state information, a heartbeat message, and a heartbeat message length of the one or more corresponding servers.

2. The method according to claim 1, comprising:

each time after the server performs one write operation, adding, by the server, a default positive integer to the write heartbeat message sequence number of the server, to obtain a new write heartbeat message sequence number of the server; and

each time after the server performs one read operation, adding, by the server, the default positive integer to the read peer heartbeat message sequence number of the server, to obtain a new read peer heartbeat message sequence number of the server; and

after it is determined that the write heartbeat message sequence number stored in the server is equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array, performing a next write operation.

3. The method according to claim 2, comprising:

each time after the one or more corresponding servers perform one write operation, adding, by the one or more corresponding servers, the default positive integer to the write heartbeat message sequence number of the one or more corresponding servers, to obtain a new write heartbeat message sequence number of the one or more corresponding servers; and

each time after the one or more corresponding servers perform one read operation, adding, by the one or more corresponding servers, the default positive integer to the read peer heartbeat message sequence number of the one or more corresponding servers, to obtain a new read peer heartbeat message sequence number of the one or more corresponding servers; and

after it is determined that the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array, performing a next write operation.

4. The method according to claim 1, comprising:

each time after the one or more corresponding servers perform one write operation, adding, by the one or more corresponding servers, a default positive integer to the write heartbeat message sequence number of the one or more corresponding servers, to obtain a new write heartbeat message sequence number of the one or more corresponding servers; and

each time after the one or more corresponding servers perform one read operation, adding, by the one or more corresponding servers, the default positive integer to the read peer heartbeat message sequence number of the one or more corresponding servers, to obtain a new read peer heartbeat message sequence number of the one or more corresponding servers; and

after it is determined that the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array, performing a next write operation.

5. The method according to claim 2, wherein:

after the server determines that the write heartbeat message sequence number stored in the server is not equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array, the method further comprises;

determining, by the server, that a state of the disk array is abnormal, and setting the write heartbeat message sequence number stored in the server to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array; and

writing the write heartbeat message sequence number, which is set by the server, to the disk array.

6. The method according to claim 3, wherein:

after the one or more corresponding servers determine that the write heartbeat message sequence number stored in the one or more corresponding servers is not equal to the read peer heartbeat message sequence number of the server which is read from the disk array, the method further comprises;

determining, by the one or more corresponding servers, that the state of the disk array is abnormal, and setting the write heartbeat message sequence number stored in the one or more corresponding servers to the read peer heartbeat message sequence number of the server which is read from the disk array; and

writing the write heartbeat message sequence number, which is obtained after the setting, to the disk array.

7. The method according to claim 1, comprising:

each time before the server performs one write operation, determining, by the server, the write heartbeat message sequence number stored in the server is equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array;

each time after the server performs one write operation, adding, by the server, a default positive integer to the write heartbeat message sequence number of the server, to obtain a new write heartbeat message sequence number of the server;

each time before the server performs one read operation, determining, by the server, the write heartbeat message sequence number stored in the server is equal to a sum of the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array and the default positive integer; and

each time after the server performs one read operation, adding the default positive integer to the read peer heartbeat message sequence number of the server, to obtain a new read peer heartbeat message sequence number of the server.

8. The method according to claim 7, comprising:

each time before the one or more corresponding servers perform one write operation, determining, by the one or more corresponding servers, the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array;

each time after the one or more corresponding servers perform one write operation, adding, by the one or more corresponding servers, the default positive integer to the write heartbeat message sequence number of the one or more corresponding servers, to obtain a new write heartbeat message sequence number of the one or more corresponding servers;

each time before the one or more corresponding servers perform one read operation, determining, by the one or more corresponding servers, the write heartbeat message sequence number stored in the one or more corresponding servers is equal to a sum of the read peer heartbeat message sequence number of the server which is read from the disk array and the default positive integer; and

each time after the one or more corresponding servers perform one read operation, adding, by the one or more corresponding servers, the default positive integer to the read peer heartbeat message sequence number of the one or more corresponding servers, to obtain a new read peer heartbeat message sequence number of the one or more corresponding servers.

9. The method according to claim 1, comprising:

each time before the one or more corresponding servers perform one write operation, determining, by the one or more corresponding servers, the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array;

each time after the one or more corresponding servers perform one write operation, adding, by the one or more corresponding servers, a default positive integer to the write heartbeat message sequence number of the one or more corresponding servers, to obtain a new write heartbeat message sequence number of the one or more corresponding servers;

each time before the one or more corresponding servers perform one read operation, determining, by the one or more corresponding servers, the write heartbeat message sequence number stored in the one or more corresponding servers is equal to a sum of the read peer heartbeat message sequence number of the server which is read from the disk array and the default positive integer; and

each time after the one or more corresponding servers perform one read operation, adding, by the one or more corresponding servers, the default positive integer to the read peer heartbeat message sequence number of the one or more corresponding servers, to obtain a new read peer heartbeat message sequence number of the one or more corresponding servers.

10. The method according to claim 7, wherein:

after the server determines that the write heartbeat message sequence number stored in the server is not equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array and the write heartbeat message sequence number stored in the server is not equal to a sum of the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array and the default positive integer, the method further comprises;

determining, by the server, that a state of the disk array is abnormal, and setting the write heartbeat message sequence number stored in the server to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array; and

writing the write heartbeat message sequence number, which is obtained after the setting, to the disk array.

11. The method according to claim 8, wherein:

after the one or more corresponding servers determine that the write heartbeat message sequence number stored in the one or more corresponding servers is not equal to the read peer heartbeat message sequence number of the server which is read from the disk array and the write heartbeat message sequence number stored in the one or more corresponding servers is not equal to a sum of the read peer heartbeat message sequence number of the server which is read from the disk array and the default positive integer, the method further comprises;

determining, by the one or more corresponding servers, that the state of the disk array is abnormal, and setting the write heartbeat message sequence number stored in the one or more corresponding servers to the read peer heartbeat message sequence number of the server which is read from the disk array; and

writing the write heartbeat message sequence number, which is obtained after the setting, to the disk array.

12. A server for implementing a heartbeat service of a high availability cluster, comprising:

a writing unit, configured to write heartbeat counting information to a disk array, wherein the heartbeat counting information comprises a write heartbeat message sequence number, a read peer heartbeat message sequence number, active-standby state information, a heartbeat message, and a heartbeat message length of the server, so that one or more corresponding servers read the heartbeat counting information, in the disk array, of the server; and

a reading unit, configured to read heartbeat counting information, which is written by the one or more corresponding servers to the disk array, of the one or more corresponding servers;

wherein the heartbeat counting information of the one or more corresponding servers comprises a write heartbeat message sequence number, a read peer heartbeat message sequence number, active-standby state information, a heartbeat message, and a heartbeat message length of the one or more corresponding servers;

wherein

the writing unit and the reading unit are further configured to repeat the write operation and the read operation respectively.

13. The server according to claim 12, wherein the server further comprises:

an accumulating unit, configured to;

each time after the server performs one write operation, add a default positive integer to the write heartbeat message sequence number of the server, to obtain a new write heartbeat message sequence number of the server;

the accumulating unit is further configured to;

each time after the server performs one read operation, add the default positive integer to the read peer heartbeat message sequence number of the server, to obtain a new read peer heartbeat message sequence number of the server; and

a determining unit, configured to determine the write heartbeat message sequence number stored in the server is equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array;

the writing unit is further configured to;

after the determining unit determines that the write heartbeat message sequence number stored in the server is equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array, perform a next write operation.

14. The server according to claim 13, wherein the one or more corresponding servers further comprise:

an accumulating unit, configured to;

each time after the one or more corresponding servers perform one write operation, add the default positive integer to the write heartbeat message sequence number of the one or more corresponding servers, to obtain a new write heartbeat message sequence number of the one or more corresponding servers;

the accumulating unit is further configured to;

each time after the one or more corresponding servers perform one read operation, add the default positive integer to the read peer heartbeat message sequence number of the one or more corresponding servers, to obtain a new read peer heartbeat message sequence number of the one or more corresponding servers; and

a determining unit, configured to determine the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array;

the writing unit is further configured to;

after the determining unit determines that the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array, perform a next write operation.

15. The server according to claim 13, wherein that the writing unit of the server performs one write operation after the server determines that the write heartbeat message sequence number stored in the server is not equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array further comprises that:

the determining unit determines that a state of the disk array is abnormal, and sets the write heartbeat message sequence number stored in the server to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array; and

writes the write heartbeat message sequence number, which is obtained after the setting, to the disk array.

16. The server according to claim 13, wherein that the writing unit of the one or more corresponding servers performs one write operation after the one or more corresponding servers determine that the write heartbeat message sequence number stored in the one or more corresponding servers is not equal to the read peer heartbeat message sequence number of the server which is read from the disk array further comprises that:

the one or more corresponding servers determine that the state of the disk array is abnormal, and set the write heartbeat message sequence number stored in the one or more corresponding servers to the read peer heartbeat message sequence number of the server which is read from the disk array; and

writes the write heartbeat message sequence number, which is obtained after the setting, to the disk array.

17. The server according to claim 12, wherein the server further comprises:

a determining unit, configured to;

each time before the writing unit performs one write operation, determine the write heartbeat message sequence number stored in the server is equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array; and

an accumulating unit, configured to;

each time after the writing unit performs one write operation, add a default positive integer to the write heartbeat message sequence number of the server, to obtain a new write heartbeat message sequence number of the server;

the determining unit is further configured to;

each time before the reading unit performs one read operation, determine the write heartbeat message sequence number stored in the server is equal to a sum of the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array and the default positive integer; and

the accumulating unit is further configured to;

each time after the reading unit performs one read operation, add the default positive integer to the read peer heartbeat message sequence number of the server, to obtain a new read peer heartbeat message sequence number of the server.

18. The server according to claim 17, wherein the one or more corresponding servers further comprise:

a determining unit, configured to;

each time before the writing unit performs one write operation, determine the write heartbeat message sequence number stored in the one or more corresponding servers is equal to the read peer heartbeat message sequence number of the server which is read from the disk array; and

an accumulating unit, configured to;

each time after the writing unit performs one write operation, add the default positive integer to the write heartbeat message sequence number of the one or more corresponding servers, to obtain a new write heartbeat message sequence number of the one or more corresponding servers;

the determining unit is further configured to;

each time before the reading unit performs one read operation, determine the write heartbeat message sequence number stored in the one or more corresponding servers is equal to a sum of the read peer heartbeat message sequence number of the server which is read from the disk array and the default positive integer; and

the accumulating unit is further configured to;

each time after the reading unit performs one read operation, add the default positive integer to the read peer heartbeat message sequence number of the one or more corresponding servers, to obtain a new read peer heartbeat message sequence number of the one or more corresponding servers.

19. The server according to claim 17, wherein:

after the determining unit of the server determines that the write heartbeat message sequence number stored in the server is not equal to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array and the write heartbeat message sequence number stored in the server is not equal to a sum of the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array and the default positive integer, the server further comprises that;

the determining unit determines that a state of the disk array is abnormal, and sets the write heartbeat message sequence number stored in the server to the read peer heartbeat message sequence number of the one or more corresponding servers which is read from the disk array; and

writes the write heartbeat message sequence number, which is obtained after the setting, to the disk array.

20. The server according to claim 18, wherein:

after the determining unit of the one or more corresponding servers determines that the write heartbeat message sequence number stored in the one or more corresponding servers is not equal to the read peer heartbeat message sequence number of the server which is read from the disk array and the write heartbeat message sequence number stored in the one or more corresponding servers is not equal to a sum of the read peer heartbeat message sequence number of the server which is read from the disk array and the default positive integer, the one or more corresponding servers further comprises that;

the determining unit of the one or more corresponding servers determines that the state of the disk array is abnormal, and the writing unit of the one or more corresponding servers sets the write heartbeat message sequence number stored in the one or more corresponding servers to the read peer heartbeat message sequence number of the server which is read from the disk array; and

writes the write heartbeat message sequence number, which is obtained after the setting, to the disk array.