Using a snapshot as a data source

• US 10,402,277 B2
• Filed: 02/10/2015
• Issued: 09/03/2019
• Est. Priority Date: 11/15/2004
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Ngo, David, Prahlad, Anand, Gokhale, Parag, Pawar, Rahul S.
• Primary Examiner(s): MacKall, Larry T
• Application Number:
  US14/618,241
• Publication Number:
  US 20150169413A1
• Time in Patent Office: 1,666 Days
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A system and method for using a snapshot as a data source is described. In some cases, the system stores a snapshot and an associated data structure or index to storage media to create a secondary copy of a volume of data. In some cases, the associated index includes application specific data about a file system or other application that created the data to identify the location of the data. The associated index may include three entries, and may be used to facilitate the recovery of data via the snapshot.

Claims

1. A method for use with a physical data storage system to create a backup copy of a data set, the method comprising:

performing a snapshot copy of a data set,

wherein the snapshot copy is a point in time representation of the data set;

storing the snapshot copy of the data set to secondary storage media;

wherein the snapshot copy is created using pointers, without creating another physical copy of all the data, and

wherein the pointers map to specific disk blocks of the data set;

generating a data structure associated with the snapshot copy of the data set,

wherein the data structure includes an index of application specific context information for data objects within the snapshot copy, including;

information identifying the data objects within the snapshot copy of the data set,

information identifying secondary copies associated with the data objects, and

identity of an application that created the data objects; and

storing the data structure to the secondary storage media along with the snapshot copy of the data set to create a backup copy of the data set within the secondary storage media,

wherein the data structure permits granular recovery of data objects by permitting access to portions of individual data objects within secondary copies.

2. The method of claim 1, wherein the generating includes identifying system resources including information indicating a location of system resources of the data storage system when the snapshot copy of the data set was generated.

3. The method of claim 1, wherein generating the snapshot copy of the data set includes:

performing continuous data replication on the data set;

identifying one or more recovery points during the performed continuous data replication; and

associating the one or more recovery points as the snapshot copy of the data set.

4. The method of claim 1, wherein storing the snapshot copy of the data set includes:

identifying a proper subset of data blocks associated with the snapshot copy of the data set that satisfy a criteria; and

storing a portion of the snapshot copy of the data set associated with the proper subset of blocks to the secondary storage media.

5. The method of claim 1, wherein the data structure further includes:

identity of system resources used to create data objects;

identity of a hardware-based snapshot mechanism that performed the snapshot copy; and

information identifying a removable storage media that includes a secondary copy of the data stored on a primary volume.

6. The method of claim 1, wherein storing the snapshot copy of the data set to secondary storage media includes storing the snapshot copy of the data set to the secondary storage media without storing a physical copy of the data set to the secondary storage media.

7. A method performed by a data storage system for restoring a data object, the method comprising:

receiving a request to restore at least a portion of a data object;

identifying the data object via a snapshot containing an image of the data object at a point in time,

wherein the snapshot is created using pointers, without creating another physical copy of all the data,

wherein the pointers are associated with disk blocks, and

wherein the snapshot is stored in secondary storage media;

parsing an index, stored along with the snapshot in the secondary storage media and logically associated with the snapshot, to retrieve a location of a copy of the data object,

wherein the index contains application specific context information for the data objects within the snapshot, including;

information identifying data objects within the snapshot that contains the image of the data object,

information identifying secondary copies associated with the data objects, and

identity an application that created the data objects; and

retrieving the data object using the retrieved location from the index logically associated with the snapshot,

wherein the index permits granular recovery of data objects by permitting access to portions of individual data objects within data copies.

8. The method of claim 7, wherein:

parsing the index logically associated with the snapshot includes retrieving application specific context information for the data object.

9. The method of claim 7, wherein parsing the index includes:

identifying a proper subset of data blocks associated with the snapshot that satisfy a criteria; and

providing information regarding a portion of the snapshot of the data set associated with the proper subset of blocks to the data storage system.

10. The method of claim 7, wherein the index further includes:

information identifying system resources used to create data objects;

information identifying an application that created the data objects;

information identifying a hardware-based snapshot mechanism that performed the snapshot; and

information identifying a removable storage media that includes a secondary copy of the data stored on a primary volume.

11. A method for creating a backup copy of a primary volume of data, the method comprising:

creating a full backup of a primary volume of data using a snapshot mechanism,

wherein the snapshot mechanism creates a snapshot of the primary volume of data,

wherein an associated index contains application specific context information related to a location of resources used to create the snapshot of the primary volume of data,

wherein the snapshot is created using logical pointers, without creating another physical copy of the primary volume of data, and

wherein the index permits granular recovery of data objects by permitting access to portions of individual data objects based on the snapshot;

creating one or more incremental backups using a data storage operation different from a snapshot; and

storing, as the backup copy of the primary volume of data, the full backup created using the snapshot mechanism, the one or more incremental backups, and the index associated with the snapshot to physical storage media,

wherein the index associated with the snapshot includes identity of a hardware-based snapshot mechanism that performed the snapshot and identity of a mount point at which the snapshot was performed.

12. The method of claim 11, further comprising:

parsing the index associated with the snapshot to retrieve information providing application specific context for a specific data object.

13. The method of claim 11, wherein the index further includes:

information identifying system resources used to create data objects;

information identifying an application that created the data objects;

and

information identifying a removable storage media that includes a secondary copy of the data stored on the primary volume.

14. A system for restoring a data object, the system comprising:

at least one hardware-implemented processor;

at least one non-transitory memory, coupled to the at least one hardware-implemented processor and storing instructions, which when executed by the at least one hardware processor, perform a process, the process comprising;

receiving a request to restore a data object;

identifying the data object via a snapshot containing an image of the data object at a point in time,

wherein the snapshot is created using pointers, without creating another physical copy of all the data,

wherein the pointers are associated with disk blocks, and

wherein the snapshot is stored in secondary storage media;

parsing an index, stored along with the snapshot in the secondary storage media and logically associated with the snapshot, to retrieve a location of a copy of the data object,

wherein the index contains application specific context information, including;

information identifying data objects within the snapshot that contains the image of the data object,

information identifying secondary copies associated with the data objects, and

identity of an application that created the data objects; and

retrieving the data object using the retrieved location from the index logically associated with the snapshot,

wherein the index permits granular recovery of data objects by permitting access to portions of individual data objects within data copies.

15. The system of claim 14, wherein parsing the index further comprises:

retrieving application specific context information for the data object.

16. The system of claim 14, wherein parsing the index further comprises:

identifying a proper subset of data blocks associated with the snapshot that satisfy a criteria; and

providing information regarding a portion of the snapshot of the data set associated with the proper subset of blocks to the data storage system.

17. The system of claim 14, wherein the index further includes:

information identifying system resources used to create data objects;

information identifying an application that created the data objects;

information identifying a hardware-based snapshot mechanism that performed the snapshot; and

information identifying a removable storage media that includes a secondary copy of the data stored on a primary volume.