Incremental backups for removable media

• US 10,162,709 B1
• Filed: 11/23/2016
• Issued: 12/25/2018
• Est. Priority Date: 11/23/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lazier, Colin Laird, Kubo, Masataka, Donlan, Bryan James
• Primary Examiner(s): Dudek, Jr., Edward J
• Application Number:
  US15/360,864
• Time in Patent Office: 762 Days
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive

Abstract

Techniques for storing incremental backups in long-term storage are described herein. A backup data set is generated from a set of data to backup and a deletion time for that backup data set is determined. A scheduled time period to perform the backup is selected based at least in part on a requested time period to perform the backup. The requested time period is altered if the performing the backup at the requested time period would produce a period of high resource contention at the destination for the backup. The backup is then stored at the destination at the scheduled time.

Claims

1. A computer-implemented method for managing incremental backups on removable media, comprising:

receiving a backup request, the backup request including a location of a set of data to backup and a backup durability;

generating a set of backup data from the set of data to backup;

determining a deletion time for the set of data to backup based at least in part on the backup durability;

determining, based at least in part on the deletion time, a destination from a plurality of destinations to store the set of backup data;

detecting one or more periods of high resource contention at the destination, the one or more periods of high resource contention indicating a time period of high resource demand at the destination;

scheduling the backup request at a scheduled time period different from the time period of high resource demand at the destination as a result of the one or more periods of high resource contention at the destination; and

performing a backup of the set of backup data to the destination at the scheduled time period different from the time period of high resource demand at the destination.

2. The computer-implemented method of claim 1, wherein the backup request is one of a plurality of backup requests, each backup request of the plurality of backup requests having the same deletion time.

3. The computer-implemented method of claim 1, wherein the time period different from the time period of high resource demand is a time period at which the data to back up is requested from the location of the set of data to backup by a backup service, the time period at which the data to back up is requested from the location of the set of data to backup corresponding to a time period of low resource demand at the destination.

4. The computer-implemented method of claim 1, wherein the time period different from the time period of high resource demand is a time period provided to a customer of a backup service, the time period provided from a set of available time periods corresponding to time periods of low demand for resources at the destination.

5. A system, comprising:

one or more processors; and

memory that stores instructions that, as a result of being executed by the one or more processors, cause the system to;

generate, from a set of data to backup, a backup data set that contains sufficient information to reproduce the set of data to backup;

determine a deletion time for the backup data set, the deletion time based at least in part on a backup durability of the backup data set and used to determine a destination from a plurality of destinations;

request a first scheduled time period to perform the backup;

execute a resource contention mitigation operation in response to a determination that the first scheduled time period causes a period of high resource contention at the destination for the backup to produce a second scheduled time period to perform the backup; and

perform the backup during the second scheduled time period.

6. The system of claim 5, wherein the destination is determined based at least in part on the deletion time.

7. The system of claim 5, wherein the destination is provided by a storage service that stores data on removable media.

8. The system of claim 5, wherein the resource contention mitigation operation retrieves the set of data to backup during the second scheduled time period.

9. The system of claim 5, wherein the resource contention mitigation operation:

provides the second scheduled time period to a customer associated with the backup data set; and

receives an acceptance of the second scheduled time period from the customer.

10. The system of claim 5, wherein the second scheduled time period is the same as the first scheduled time period.

11. The system of claim 5, wherein the resource contention mitigation operation is a refusal to perform the backup, the refusal to perform the backup provided to a customer associated with the backup data set.

12. The system of claim 5, wherein, upon determining a second deletion time for a second data set is the same as the deletion time, the system stores the second data set at the destination.

13. A non-transitory computer-readable storage medium having stored thereon executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:

generate a backup data set from a set of data to backup;

determine a deletion time for the backup data set;

select a destination for the backup based on the deletion time for the backup data set matching a deletion time of other data sets previously stored in the destination;

determine a scheduled time period to perform a backup of the backup data set, the scheduled time period to perform the backup determined based at least in part on a requested time period to perform the backup;

adjust the requested time period to produce the scheduled time period based at least in part on a determination that there is a period of high resource contention at the destination of the backup, the period of high resource contention occurring during the requested time period; and

cause the backup data set to be sent to the destination at the scheduled time period.

14. The non-transitory computer-readable storage medium of claim 13, wherein the deletion time is based at least in part on a backup durability of the backup data set.

15. The non-transitory computer-readable storage medium of claim 13, wherein the instructions that cause the computer system to determine the scheduled time period to perform the backup further include instructions that, as a result of being executed by the one or more processors, cause the computer system to adjust the requested time period to produce the scheduled time period by performing a resource contention mitigation operation in response to a determination that the scheduled time period causes the period of high resource contention, at the destination, for the backup.

16. The non-transitory computer-readable storage medium of claim 15, wherein the resource contention mitigation operation includes at least one of:

reschedule using a pull model, reschedule using an allotted time slot, or refuse.

17. The non-transitory computer-readable storage medium of claim 13, wherein the instructions that cause the backup data set to be sent to the destination at the scheduled time period further include instructions that, as a result of being executed by the one or more processors, cause the backup data set to be stored using a storage service.

18. The non-transitory computer-readable storage medium of claim 13, wherein the backup data set is an incremental backup, the incremental backup generated from a previous full backup, the previous full backup generated from a previous version of the set of data to backup, the incremental backup and the previous full backup collectively containing sufficient information to reproduce the set of data to backup.

19. The non-transitory computer-readable storage medium of claim 13, wherein the backup data set is an incremental backup, the incremental backup generated from a previous incremental backup and a previous full backup, the previous incremental backup generated from a first previous version of the set of data to backup, the previous full backup generated from a second previous version of the set of data to backup, the incremental backup, the previous incremental backup, and the previous full backup collectively containing sufficient information to reproduce the set of data to backup.

20. The non-transitory computer-readable storage medium of claim 13, wherein the backup data set is a full backup, the full backup containing sufficient information to reproduce the set of data to backup.