Efficient data storage management system

• US 10,936,237 B2
• Filed: 10/25/2018
• Issued: 03/02/2021
• Est. Priority Date: 10/25/2018
• Status: Active Grant

• Current Assignee: Aparavi Software AG
• Original Assignee: Aparavi Software AG
• Inventors: Christensen, Rod
• Primary Examiner(s): Tsui, Daniel D
• Application Number:
  US16/171,211
• Publication Number:
  US 20200133498A1
• Time in Patent Office: 859 Days
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

An efficient data storage system is described. An agent software application on computing devices in a first tier processes snapshot backups and pushes them to an appliance software application on a server in a second tier. The appliance software application processes archive backups and pushes them to cloud storage in a third tier. A cloud application on a management server receives storage policy specifications from customers and promulgates the policies to the agent software application and the appliance software application. The policy specifications include a snapshot specification including a snapshot time period for backups in the second tier and an archive specification including an archive time period for backups in the third tier. The backups are created efficiently such that if a file has not changed, a reference to a file is included in a storage set rather than the data file itself. This reduces the size of storage sets.

Claims

1. A data storage system comprising:

a software agent configured to operate on a plurality of agent computing devices at the customer location, each agent computing device having first tier local storage;

a software appliance operating on a customer server computer at a customer location, the customer server computer having at least one second tier local storage system;

wherein each software agent on each agent computing device identified in a snapshot backup specification is configured to create a snapshot of data on the first tier local storage of the agent computing device regularly according to a snapshot time period and send the snapshot of data to the software appliance on the customer server

wherein the snapshot of data is created by the software agent performing actions including

comparing a current snapshot to a most recent prior snapshot on a file by file basis, wherein for each file,

if a file from the current snapshot is the same as the corresponding file from the most recent prior snapshot, including a reference to the most recent version of the file in the current snapshot and transmitting file reference to the software appliance as part of the current snapshot

if the file from the current snapshot is different from the corresponding file from the most recent prior snapshot, including the current version of the file in the current snapshot and transmitting the file to the software appliance as part of the current snapshot;

wherein when there is no connection between the agent computing device and software appliance, the agent computing device temporarily stores the snapshot of data on the agent computing device until the connection with the software appliance is established such that the agent computing device stores at least one snapshot of data on the first tier local storage until the connection to the software appliance is established.

2. The data storage system of claim 1 further comprising:

the software appliance on the customer server computer creating archive data regularly according to an archive time period and sending the archive data to a cloud storage system having third tier storage.

3. The data storage system of claim 2 wherein the third tier storage is at least one of private cloud storage and cloud storage provided by third party cloud services.

4. The data storage system of claim 1 wherein the second tier local storage system is at least one selected from the group including:

included in the customer server computer, coupled directly to the customer server computer, and accessible by the customer server computer via the local network.

5. The data storage system of claim 1 wherein the second tier local storage system includes at least one selected from the group including:

hard disk drives (HDDs), silicon storage devices and solid-states drives (SSDs), a network attached storage device (NAS), a storage area network (SAN), or a just a bunch of disks (JBOD) storage device.

6. The data storage system of claim 1 wherein the agent software application on each agent computing device is further configured to create a checkpoint on the first tier local storage according to a checkpoint time period specified in the storage policy.

13. The data storage system of claim 1 wherein the first tier local storage is at least one selected from the group including hard disk drives (HDDs), solid-states drives (SSDs), a Redundant Array of Independent Disks (RAID) device, a network attached storage device (NAS), a storage area network (SAN), or a just a bunch of disks (JBOD) storage device.

7. A data storage system comprising:

at least one agent computing device having an agent software application installed thereon, each agent computing device at a customer location, each agent computing device having first tier local storage, each agent computing device coupled to a local area network, the agent software application on each agent computing device configured to create a snapshot backup according to a snapshot time period specified in a storage policy

a customer server computer having an appliance software application installed thereon, the customer server at the customer location, the customer server computer having at least one second tier local storage system, the appliance software application configured to regularly create an archive backup according to an archive time period specified in the storage policy, the archive backup including data from the snapshot backups residing on the second tier storage and to send over a wide area network the archive data to a cloud storage system having third tier storage, the local area network coupled with the wide area network

a management server coupled to the wide area network and configured to communicate with and distribute the storage policy to the appliance software application on the customer server computer and the agent software application on the agent computing devices

wherein the agent application is configured to create the snapshot backup by performing actions including

comparing a current snapshot to a most recent prior snapshot on a file by file basis, wherein for each file,

if a file from the current snapshot is the same as the corresponding file from the most recent prior snapshot, including a reference to the most recent version of the file in the current snapshot and transmitting file reference to the software appliance as part of the current snapshot

if the file from the current snapshot is different from the corresponding file from the most recent prior snapshot, including the current version of the file in the current snapshot and transmitting the file to the software appliance as part of the current snapshot;

wherein when there is no connection between the agent computing device and software appliance, the agent computing device temporarily stores the snapshot of data on the agent computing device until the connection with the software appliance is established such that the agent computing device stores at least one snapshot of data on the first tier local storage until the connection to the software appliance is established.

8. The data storage system of claim 7 wherein the second tier local storage system is at least one selected from the group including:

included in the customer server computer, coupled directly to the customer server computer, and accessible by the customer server computer via the local network.

9. The data storage system of claim 7 wherein the storage policy specifies the snapshot backup and the archive backup should be stored for a retention period.

10. The data storage system of claim 7 wherein the wide area network is one of the Internet or a private wide area network.

11. The data storage system of claim 7 wherein the cloud storage is one of a private cloud storage or a third party cloud storage.

12. The data storage system of claim 7 wherein the archive time period is greater than the snapshot time period.

14. The data storage system of claim 7 wherein the first tier local storage is at least one selected from the group including:

hard disk drives (HDDs) and solid-states drives (SSDs), a Redundant Array of Independent Disks (RAID) device, a network attached storage device (NAS), a storage area network (SAN), or a just a bunch of disks (JBOD) storage device.

15. The data storage system of claim 7 wherein the second tier local storage system includes at least one selected from the group including:

hard disk drives (HDDs), silicon storage devices and solid-states drives (SSDs), a Redundant Array of Independent Disks (RAID) device, a network attached storage device (NAS), a storage area network (SAN), or a just a bunch of disks (JBOD) storage device.

16. The data storage system of claim 7 wherein the agent software application on each agent computing device is further configured to create a checkpoint on the first tier local storage according to a checkpoint time period specified in the storage policy.

17. The data storage system of claim 7 wherein the third tier storage is at least one of private cloud storage and cloud storage provided by third party cloud services.