CLUSTER DATA MANAGEMENT SYSTEM AND METHOD FOR DATA RESTORATION USING SHARED REDO LOG IN CLUSTER DATA MANAGEMENT SYSTEM

• US 20100161565A1
• Filed: 08/18/2009
• Published: 06/24/2010
• Est. Priority Date: 12/18/2008
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: LEE, Hun Soon, Kim, Byoung Seob, Lee, Mi Young
• Application Number:
  US12/543,208
• Publication Number:
  US 20100161565A1
• Time in Patent Office: Days
• US Class Current: 707/674
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2025 using centralised failover control functionality
• CPC Class Codes: G06F 11/2028 eliminating a faulty processor or activating a spare
• CPC Class Codes: G06F 11/203 using migration
• CPC Class Codes: G06F 11/2035 without idle spare hardware
• CPC Class Codes: G06F 11/2046 where the redundant components share persistent storage G06F11/2043 takes precedence

Abstract

Provided are a cluster data management system and a method for data restoration using a shared redo log in the cluster data management system. The data restoration method includes collecting service information of a partition served by a failed partition server, dividing redo log files written by the partition server by columns of a table including the partition, restoring data of the partition on the basis of the collected service information and log records of the divided redo log files, and selecting a new partition server that will serve the data-restored partition, and allocating the partition to the selected partition server.

Claims

1. A method for data restoration using a shared redo log in a cluster data management system, the method comprising:

collecting service information of a partition served by a failed partition server;

dividing redo log files written by the partition server by columns of a table including the partition;

restoring data of the partition on the basis of the collected service information and log records of the divided redo log files; and

selecting a new partition server that will serve the data-restored partition, and allocating the partition to the selected partition server.

2. The method of claim 1, wherein the service information includes information of the partition served by the failed partition server, information of the columns constituting each partition;

and row range information of a table including each partition.

3. The method of claim 1, wherein the dividing of redo log files comprises:

arranging log information of the redo log files on the basis of preset reference information;

sorting the arranged log information of the redo log files by the columns; and

dividing the redo log files with the sorted log information by the columns.

4. The method of claim 3, wherein the reference information includes a table including the partition served by the failed partition server, a row key, a cell key, and a time stamp.

5. The method of claim 1, wherein the restoring of data of the partition comprises:

selecting a partition server that will restore the data of the partition;

transmitting the collected service information and the divided redo log files to the selected partition server;

generating a new data file on the basis of the received service information and the log information of the redo log files; and

recording log records of the redo log files in the generated data file.

6. The method of claim 5, wherein the recording of log records of the redo log files comprises:

determining whether the record information of the redo log files belongs to the current partition whose data is being restored; and

recording the log records of the redo log files in the generated data file if the record information of the redo log files belongs to the current partition.

7. The method of claim 6, wherein the recording of the log records of the redo log files comprises:

generating a new data file if the record information of the redo log files does not belong to the current partition; and

recording the log records of the redo log files in the generated data file.

8. The method of claim 5, wherein the recording of the log information comprises:

generating information to be recorded in a data file, on the basis of other information than log sequence numbers of the log information of the redo log files; and

recording the generated information in the generated data file.

9. The method of claim 1, further comprising:

starting a service for the data-restored partition by the partition server allocated the partition.

10. A cluster data management system that restores data using a shared redo log, the cluster data management system comprising:

a partition server managing a service for at least one or more partitions and writing redo log files according to the service for the partition; and

a master server collecting service information of the partitions in the event of a partition server failure, dividing the redo log files by columns of a table including the partition, and selecting the partition server that will restore data of the partition on the basis of the collected service information of the partition and the log information of the redo log files.

11. The cluster data management system of claim 10, wherein the service information includes information of the partition served by the failed partition server, information of the columns constituting each partition;

and row range information of a table including each partition.

12. The cluster data management system of claim 10, wherein the master server arranges log information of the redo log files on the basis of preset reference information, sorts the arranged log information of the redo log files by the columns, and divides the redo log files by the columns.

13. The cluster data management system of claim 12, wherein the reference information includes a table including the partition served by the failed partition server, a row key, a cell key, and a time stamp.

14. The cluster data management system of claim 10, wherein the master server transmits the collected service information and the divided redo log files to the selected partition server.

15. The cluster data management system of claim 14, wherein the partition server restores data of the partition on the basis of the received service information and the log information of the divided redo log files.

16. The cluster data management system of claim 15, wherein the partition server generates a data file for data restoration of the partition on the basis of the received service information and the log information of the redo log files, and records the log information of the redo log files in the generated data file of the partition.

17. The cluster data management system of claim 16, wherein the partition server determines whether the log information of the redo log files belongs to the current partition whose data is being restored, and records the log information in the generated data file if the log information belongs to the current partition.

18. The cluster data management system of claim 17, wherein the partition server generates a new data file if the log information of the redo log files does not belong to the current partition, and records the log information in the generated data file.

19. The cluster data management system of claim 16, wherein the partition server generates information to be recorded in the data file, on the basis of other information than log sequence numbers of the log information of the redo log files, and records the generated information in the generated data file.

20. The cluster data management system of claim 15, wherein the master server selects a new partition server that will serve the data-restored partition, and allocates the partition to the selected partition server.