Combined stream auxiliary copy system and method

• US 9,170,890 B2
• Filed: 02/28/2014
• Issued: 10/27/2015
• Est. Priority Date: 09/16/2002
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Lu, Jun, Gokhale, Parag
• Primary Examiner(s): Tsai, Henry
• Assistant Examiner(s): Hassan, Aurangzeb
• Application Number:
  US14/193,379
• Publication Number:
  US 20140181043A1
• Time in Patent Office: 606 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0686 Libraries, e.g. tape libraries, jukebox
• CPC Class Codes: G11B 20/10 Digital recording or reproducing

Abstract

A system and method for transferring data in a library storage system. The library storage system comprises a management server including a storage policy. A media agent is connected to the management server. A plurality of storage media and a data source are connected to the media agent. The data source is divided into at least a first and a second portion of data. The portions of data are transferred from the data source to a first and second primary storage medium using a first and a second data stream respectively. The media agent then causes the first and second portion of data to be transferred from the first and second storage medium to a third auxiliary storage medium using a third combined data stream. Auxiliary copying is performed in chunks and multiple streams are copied in parallel.

Claims

1. A system for transferring data in a storage system, the system comprising:

at least one media agent comprising computer hardware, the at least one media agent accesses a data source comprising primary data stored in at least a first storage device, wherein the primary data in the first storage device comprises at least a first portion of data associated with a first application having a first file type, and at least a second portion associated with a second application having a second file type,

wherein the at least one media agent creates a first backup copy of the primary data wherein the at least one media agent copies the first portion of data in the first storage device to a second storage device by performing one or more first copy jobs, and copies the second portion of data in the first storage device to a third storage device by performing one or more second copy jobs, each of the first and second copy jobs identified with an application identifier and a copy job identifier, and

wherein the at least one media agent creates a second backup copy that orders the first and second portions of data for subsequent restoration by combining the first and second copy jobs that share a copy job identifier, and then orders the combined first and second copy jobs based at least in part on the order of the first and second application identifiers, and stores the ordered first and second portions of data within the second backup copy.

2. The system of claim 1 wherein the order the first and second portions of data in the second backup copy is further based on job order.

3. The system of claim 1 wherein the order the first and second portions of data in the second backup copy is further based on an archive order.

4. The system of claim 1 wherein the order of the first and second portions of data in the second backup copy is further based on respective stream numbers associated with first and second data streams.

5. The system of claim 1 wherein a user is provided notification if the first portion of data and the second portion of data cannot be combined.

6. The system of claim 1 further comprising a management server comprising computer hardware, the management server communicates with the media agent and stores a storage policy, wherein the media agent accesses the storage policy to determine if the first portion of data and the second portion of data are combinable.

7. The system of claim 1 further comprising an archive module comprising computer hardware, the archive module stores at least one storage policy, wherein the media agent accesses the storage policy to determine if the first portion of data and the second portion of data are combinable.

8. The system of claim 1, wherein the media agent determines that the first portion of data and the second portion of data are not combinable if one or more of the first portion of data and the second portion of data include SQL data or DB2 data.

9. The system of claim 1 wherein storing the ordered first and second portions in a combined format is based on user input.

10. The system of claim 1 wherein the primary data is restored with the second backup copy.

17. The system of claim 1 further comprising accessing an archive storage policy to determine if the first portion of data and the second portion of data are combinable.

20. The method of claim 1 wherein the primary data is restored with the second backup copy.

11. A method for transferring data in a storage system, the method comprising:

accessing with computer hardware, primary data stored in at least a first storage device, wherein the primary data in the first storage device comprises at least a first portion of data associated with a first application having a first file type, and at least a second portion associated with a second application having a second file type;

creating a first backup copy of the primary data with computer hardware by copying the first portion of data in the first storage device to a second storage device by performing one or more first copy jobs, and copying the second portion of data in the first storage device to a third storage device by performing one or more second copy jobs, each of the first and second copy jobs identified with an application identifier and a copy job identifier;

creating with computer hardware, a second backup copy by ordering the first and second portions of data existing in the first backup copy for subsequent restoration by combining the first and second copy jobs that share a copy job identifier, and then orders the combined first and second copy jobs based at least in part on the order of the first and second application identifiers; and

storing the ordered first and second portions within the second backup copy.

12. The method of claim 11 wherein the order the first and second portions of data in the second backup copy is further based on job order.

13. The method of claim 11 wherein the order the first and second portions of data in the second backup copy is further based on an archive order.

14. The method of claim 11 wherein the order of the first and second portions of data in the second backup copy is further based on respective stream numbers associated with first and second data streams.

15. The method of claim 11 further comprising notifying a user if the first portion of data and the second portion of data cannot be combined.

16. The method of claim 11 further comprising accessing a storage policy to determine if the first portion of data and the second portion of data are combinable.

18. The method of claim 11 wherein the first portion of data and the second portion of data are not combinable if one or more of the first portion of data and the second portion of data include SQL data or DB2 data.

19. The method of claim 11 wherein storing the ordered first and second portions in a combined format is based on user input.