Integration of deduplicating backup server with cloud storage

• US 9,128,948 B1
• Filed: 09/15/2010
• Issued: 09/08/2015
• Est. Priority Date: 09/15/2010
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Corporation (NortonLifeLock Inc.)
• Inventors: Raorane, Guruprasad Balkrishna
• Primary Examiner(s): Jalil, Neveen Abel
• Assistant Examiner(s): TORGRIMSON, TYLER J
• Application Number:
  US12/882,532
• Time in Patent Office: 1,819 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097

Abstract

Various systems and methods can integrate a deduplicating backup server with cloud storage. For example, one method involves detecting a trigger condition associated with a storage device that stores backup images for a backup server. The method then selects to move a unit of data from the storage device to a cloud storage system, in response to detecting the trigger condition. The method selects the unit of data based on a most recent time at which the unit of data was accessed during a restore operation. The selection of the unit of data can also be based on a number of references to the unit of data, in systems in which the storage device is a deduplicated storage device.

Claims

1. A method comprising:

detecting a trigger condition associated with a storage device, wherein

the storage device stores backup images for a backup server,

the storage device is a deduplicated storage device, and

the trigger condition comprises at least one of

an amount of space used to store backup images on the storage device exceeding a threshold amount of space,

an overall amount of space used on the storage device exceeding a threshold amount of space, or

expiration of a timer;

selecting to move a unit of data from the storage device to a cloud storage system, in response to the detecting;

confirming that the unit of data qualifies for migration, wherein

the confirming comprises

comparing metadata identifying a most recent time at which the unit of data was accessed during a restore operation with metadata associated with other units of data, and

determining a number of references to the unit of data within the deduplicated storage device; and

the comparing and the determining determines whether the unit of data must be stored locally on the storage device or is already stored on the cloud storage system; and

upon confirmation that the unit of data qualifies for migration, sending a copy of the unit of data to the cloud storage system and deleting the unit of data and metadata identifying the most recent time at which the unit of data was accessed from the storage device.

2. The method of claim 1, wherein the confirming also comprises determining a number of references to the unit of data, wherein the storage device is a deduplicated storage device.

3. The method of claim 1, further comprising selecting to not move a second unit of data to the cloud storage system, in response to metadata associated with the second unit of data indicating that the second unit of data must be stored locally.

4. The method of claim 1, further comprising selecting to delete a second unit of data from the storage device, based upon a most recent time at which the second unit of data was accessed during a restore operation, wherein a copy of the second unit of data is already stored on the cloud storage system when the second unit of data is selected for deletion.

5. The method of claim 1, wherein the unit of data is a first backup image of the backup images stored on the storage device.

6. The method of claim 1, wherein

the unit of data comprises at least one of

a portion of an application file,

file system cluster, or

a chunk.

19. The method of claim 1, wherein

the cloud storage system is operated by a third-party provider, and

the cloud storage system is configured to provide storage space on an on-demand basis.

7. A system comprising:

one or more processors; and

memory coupled to the one or more processors, wherein the memory stores program instructions executable by the one or more processors to;

detect a trigger condition associated with a storage device, wherein

the storage device stores backup images for a backup server,

the storage device is a deduplicated storage device, and

the trigger condition comprises at least one of

an amount of space used to store backup images on the storage device exceeding a threshold amount of space,

an overall amount of space used on the storage device exceeding a threshold amount of space, or

expiration of a timer;

select to move a unit of data from the storage device to a cloud storage system, in response to detection of the trigger condition;

confirm that the unit of data qualifies for migration, wherein

confirming that the unit of data qualifies for migration comprises

comparing metadata identifying a most recent time at which the unit of data was accessed during a restore operation with metadata associated with other units of data, and

determining a number of references to the unit of data within the deduplicated storage device; and

the comparing and the determining determines whether the unit of data must be stored locally on the storage device or is already stored on the cloud storage system; and

upon confirmation that the unit of data qualifies for migration, sending a copy of the unit of data to the cloud storage system and deleting the unit of data and metadata identifying the most recent time at which the unit of data was accessed from the storage device.

8. The system of claim 7, wherein

confirming that the unit of data qualifies for migration also comprises determining a number of references to the unit of data, wherein the storage device is a deduplicated storage device.

9. The system of claim 7, wherein the program instructions are further executable to select to not move a second unit of data to the cloud storage system, in response to metadata associated with the second unit of data indicating that the second unit of data must be stored locally.

10. The system of claim 7, wherein the program instructions are further executable to select to delete a second unit of data from the storage device, based upon a most recent time at which the second unit of data was accessed during a restore operation, wherein a copy of the second unit of data is already stored on the cloud storage system when the second unit of data is selected for deletion.

11. The system of claim 7, wherein the unit of data is a first backup image of the backup images stored on the storage device.

12. The system of claim 7, wherein

the unit of data comprises at least one of

a portion of an application file,

file system cluster, or

a chunk.

13. A non-transitory computer readable storage medium storing program instructions executable by one or more processors to:

detect a trigger condition associated with a storage device, wherein

the storage device stores backup images for a backup server,

the storage device is a deduplicated storage device, and

the trigger condition comprises at least one of

an amount of space used to store backup images on the storage device exceeding a threshold amount of space,

an overall amount of space used on the storage device exceeding a threshold amount of space, or

expiration of a timer;

select to move a unit of data from the storage device to a cloud storage system, in response to detection of the trigger condition; and

confirm that the unit of data qualifies for migration, wherein

confirming that the unit of data qualifies for migration comprises

comparing metadata identifying a most recent time at which the unit of data was accessed during a restore operation with metadata associated with other units of data, and

determining a number of references to the unit of data within the deduplicated storage device, and

the comparing and the determining determines whether the unit of data must be stored locally on the storage device or is already stored on the cloud storage system; and

upon confirmation that the unit of data qualifies for migration, sending a copy of the unit of data to the cloud storage system and deleting the unit of data and metadata identifying the most recent time at which the unit of data was accessed from the storage device.

14. The non-transitory computer readable storage medium of claim 13, wherein

confirming that the unit of data qualifies for migration also comprises determining a number of references to the unit of data, wherein the storage device is a deduplicated storage device.

15. The non-transitory computer readable storage medium of claim 13, wherein the program instructions are further executable to select to not move a second unit of data to the cloud storage system, in response to metadata associated with the second unit of data indicating that the second unit of data must be stored locally.

16. The non-transitory computer readable storage medium of claim 13, wherein the program instructions are further executable to select to delete a second unit of data from the storage device, based upon a most recent time at which the second unit of data was accessed during a restore operation, wherein a copy of the second unit of data is already stored on the cloud storage system when the second unit of data is selected for deletion.

17. The non-transitory computer readable storage medium of claim 13, wherein the unit of data is a first backup image of the backup images stored on the storage device.

18. The non-transitory computer readable storage medium of claim 13, wherein

the unit of data comprises at least one of

a portion of an application file,

file system cluster, or

a chunk.