System and method for highspeed and bulk backup

• US 20050108484A1
• Filed: 03/13/2002
• Published: 05/19/2005
• Est. Priority Date: 01/04/2002
• Status: Abandoned Application

• Current Assignee: Ncerti Company Limited
• Original Assignee: Ncerti Company Limited
• Inventors: Park, Sung Won
• Application Number:
  US10/500,666
• Publication Number:
  US 20050108484A1
• Time in Patent Office: Days
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1461 Backup scheduling policy

Abstract

The present invention relates to a system and method for high-speed and bulk backup, and more particularly to a system and method for high-speed and bulk backup, wherein the data dispersed into a volume unit is set up, again divided into numerous units such as blocks to perform multi-processes that those units are compressed and transferred sequentially to different storage devices by a plurality of multiple threads, consequently, the time required for backup and recovery as well as the time required for data compression can be reduced as several flows are running simultaneously within a process, in a backup system for protecting the data stored on the storage unit to store the data within a system from disasters, defects, accidents, etc. According to the invention, since a bulk data can be transferred much faster, compared to conventional methods wherein a volume is compressed and transferred by a thread in charge, it has an effect that the time required for backup and recovery can be reduced substantially as well as the compression rate can be increased on a large scale.

Claims

1. A system of high-speed and bulk backup comprising:

a backup object disk whereon a backup object data to be stored;

a backup disk whereon the backup object data to be compressed and stored;

an input/output unit, wherein the command including backup operating commands is input and the results from the predetermined command is output;

a backup means, wherein a volume of data on said backup object disk is divided into a predetermined size of unit data, a plurality of threads rimming several flows within a process are generated and thereby said divided that data is sequentially compressed and stored onto said backup disk; and

a central processing unit, wherein the backup operating command supplied through said input/output unit is processed for implementing a backup using said backup means.

2. The system of high-speed and bulk backup of claim 1 comprising:

a backup master module, wherein the backup operating command supplied through said input/output unit and central processing unit is received and transmitted to a backup manager module;

a backup manager module, wherein a backup operating command required for implementing a backup is received from said backup master module and thereby the backup reservation information for each volume is managed, a backup status and backup history information for each volume is collected and managed, and the backup command for a disk volume according to a backup schedule is generated; and

a backup agent module, wherein a backup command is supplied from said backup manager module and thereby the volume of data on said backup object disk is divided into a predetermined size of unit data, a plurality of threads running several flows within a process are generated and thereby said divided unit data is sequentially compressed and stored onto said backup disk.

3. The system of high-speed and bulk backup of claim 1, wherein said unit data is divided with 20˜

25 Mbytes when the block size for division is multiplied by the number of blocks.

4. The system of high-speed and bulk backup of claim 1,

wherein said backup means implements a volume backup by dividing the whole volume of said backup object data through accessing to a raw device regardless of the type of file, and then by compressing into a plurality of threads, in case a backup object data stored in said backup object disk has more than one hundred thousand files.

5. The system of high-speed and bulk backup of claim 1,

wherein said backup means implements a file backup by dividing said backup object data into the unit of file, and then by compressing into a plurality of threads, in case a backup object data stored in said backup object disk has less than one hundred thousand files.

6. A system of high-speed and bulk backup comprising:

a backup master server including a backup master module receiving a backup operating command; and

a backup manager server including a backup object disk whereon the backup object data is stored, a backup disk whereon the backup object data is compressed and stored, a backup manager module wherein the backup operating command required for backup operation is received from said backup master server and thereby the backup command for a volume of disk is generated according to a backup schedule, and a backup agent module wherein according to the backup commands supplied from said backup manager module, the volume of data on said backup object disk is divided into a predetermined size of unit data, a plurality of threads running several flows within a process are generated, and thereby said divided unit data is sequentially compressed and stored onto said backup disk.

7. The system of high-speed and bulk backup of claim 6, wherein said predetermined size of unit data is divided with 20˜

25 Mbytes when the block size is multiplied by the number of blocks.

8. The system of high-speed and bulk backup of claim 6,

wherein said backup manager server implements a volume backup by dividing the whole volume of said backup object data through accessing to a raw device regardless of the type of file, and then by compressing into a plurality of threads, in case a backup object data stored in said backup object disk has more than one hundred thousand files.

9. The system of High-speed and bulk backup of claim 6,

wherein said backup manager server implements a file backup by dividing said backup object data into the unit of file, and then by compressing into a plurality of threads, in case a backup object data stored in said backup object disk has less than one hundred thousand files.

10. A system of high-speed and bulk backup comprising:

a backup master server including a backup master module receiving a backup operating command;

a plurality of backup manager servers including a backup object disk whereon the backup object data is stored, and a backup manager module wherein the backup operating command required for backup operation is received from said backup master server and thereby the backup command for a volume of disk is generated according to a backup schedule, and

a plurality of backup agent servers including a backup disk whereon the backup object data is compressed and stored, and a backup agent module wherein according to the backup command supplied from said backup manager module, the volume of data on said backup object disk is divided into a predetermined size of unit data, a plurality of threads rimming several flows within a process are generated, and thereby said divided unit data is sequentially compressed and stored onto said backup disk.

11. The system of high-speed and bulk backup of claim 10, wherein said predetermined size of unit data is divided with 20˜

25 Mbytes when the block size is multiplied by the number of blocks.

12. The system of high-speed and bulk backup of claim 10,

wherein said backup agent server implements a volume backup by dividing the whole volume of said backup object data through accessing to a raw device regardless of the type of file, and then by compressing into a plurality of threads, in case a backup object data stored in said backup object disk has more than one hundred thousand files.

13. The system of high-speed and bulk backup of claim 10,

wherein said backup agent server implements a file backup by dividing said backup object data into the unit of file, and then by compressing into a plurality of threads, in case a backup object data stored in said backup object disk has less than one hundred thousand files.

14. A method of high-speed and bulk backup comprising the steps of:

receiving the compression object disk information and the directory information to be stored;

driving a plurality of compression threads;

dividing and reading block index values supplied from said compression object disk on a plurality of driven compression threads;

reading each data block belong to the block index read for each compression thread;

compressing simultaneously for said each data block read on a plurality of said compression threads;

storing the data blocks compressed to a storage directory for a plurality of compression threads;

judging whether there exist more data blocks to be compressed, increasing the block index if there exist more data blocks to be compressed, then interrupting to read said data block;

finishing a plurality of threads if there exist no data blocks to be compressed; and

completing a backup by ensuring that compression of all data blocks is completed.