System and method for resource sharing across multi-cloud arrays

• US 9,836,244 B2
• Filed: 05/05/2014
• Issued: 12/05/2017
• Est. Priority Date: 01/28/2010
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Bates, John W.
• Primary Examiner(s): King, John B
• Application Number:
  US14/269,758
• Publication Number:
  US 20140245026A1
• Time in Patent Office: 1,310 Days
• Field of Search: 726 1- 7, 713150, 713153, 713189-190
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04L 63/0457 wherein the sending and receiving network entities apply dynamic encryption, e.g. stream encryption cryptographic mechanisms or cryptographic arrangements for stream encryption H04L9/065

Abstract

A system for resource sharing across multi-cloud storage arrays includes a plurality of storage arrays and a cloud array storage (CAS) application. The plurality of storage resources are distributed in one or more cloud storage arrays, and each storage resource comprises a unique object identifier that identifies location and structure of the corresponding storage resource at a given point-in-time. The cloud array storage (CAS) application manages the resource sharing process by first taking an instantaneous copy of initial data stored in a first location of a first storage resource at a given point-in-time and then distributing copies of the instantaneous copy to other storage resources in the one or more cloud storage arrays. The instantaneous copy comprises a first unique object identifier pointing to the first storage location of the initial data in the first storage resource and when the instantaneous copy is distributed to a second storage resource, the first unique object identifier is copied into a second storage location within the second storage resource and the second storage location of the second storage resource is assigned a second unique object identifier.

Claims

1. A method for a network including a plurality of storage systems, including a local storage system and one or more cloud storage systems connected to the local storage system by an Internet connection, the method comprising:

creating a snapshot of a storage volume stored in a first location on a first storage system of the plurality of storage systems at a given point-in-time, wherein the snapshot comprises a first unique object identifier specifying at least the first location, wherein the storage volume is stored in at least one of the one or more cloud storage systems as a hierarchical tree structure of cloud objects, wherein the first unique identifier is an object identifier of a first cloud object within the hierarchical tree structure, wherein the hierarchical tree structure includes a plurality of cloud objects, including the first cloud object at the top of the hierarchy, and a plurality of other cloud objects representing portions of the storage volume, wherein the hierarchical tree structure is persisted on at least one of the one or more cloud storage systems that is not the local storage system, and wherein the method further comprises persisting on the local storage system only the first cloud object from among the plurality of cloud objects of the hierarchical tree structure, wherein the cloud objects are nodes in the tree structure; and

sharing the snapshot with at least a second storage system of the plurality of storage systems by sending at least a first copy of the snapshot to the second storage system.

2. The method of claim 1, wherein the acts of creating and sharing are controlled by a cloud storage software application operative to provide secure replication of data between the plurality of storage systems.

3. The method of claim 1, wherein at least initially the snapshot only includes metadata of the storage volume, and does not include data of the storage volume.

4. The method of claim 1, wherein the first storage system is the local storage system, and the storage volume resides on the local storage system, the method further comprising:

reserving a first region of the first storage system for one or more future write I/O requests for the storage volume.

5. The method of claim 4, further comprising:

in response to a first write I/O request of the one or more future write I/O requests, wherein the first write I/O request is for first data stored at a second location within the first location in which the first storage volume is stored, copying second data stored in the second location to a third location within the first region, and writing the first data to the second location.

6. A system for a network including a plurality of storage systems, including a local storage system and one or more cloud storage systems connected to the local storage system by an Internet connection, the system comprising:

an application module operative to control creating a snapshot of a storage volume stored in a first location on a first storage system of the plurality of storage systems at a given point-in-time, wherein the snapshot comprises a first unique object identifier specifying at least the first location, wherein the storage volume is stored in at least one of the one or more cloud storage systems as a hierarchical tree structure of cloud objects, wherein the first unique identifier is an object identifier of a first cloud object within the hierarchical tree structure, wherein the hierarchical tree structure includes a plurality of cloud objects, including the first cloud object at the top of the hierarchy, and a plurality of other cloud objects representing portions of the storage volume, wherein the hierarchical tree structure is persisted on at least one of the one or more cloud storage systems that is not the local storage system, and wherein the method further comprises persisting on the local storage system only the first cloud object from among the plurality of cloud objects of the hierarchical tree structure, wherein the cloud objects are nodes in the tree structure; and

sharing the snapshot with at least a second storage system of the plurality of storage systems by sending at least a first copy of the snapshot to the second storage system.

7. The system of claim 6, wherein the application module is a cloud storage software application operative to provide secure replication of data between the plurality of storage systems.

8. The system of claim 6, wherein at least initially the snapshot only includes metadata of the storage volume, and does not include data of the storage volume.

9. The system of claim 6, wherein the first storage system is the local storage system, and the storage volume resides on the local storage system, and

wherein the application module is further operative to control reserving a first region of the first storage system for one or more future write I/O requests for the storage volume.

10. The system of claim 9, further comprising:

wherein the application module is further operative to control, in response to a first write I/O request of the one or more future write I/O requests, wherein the first write I/O request is for first data stored at a second location within the first location in which the first storage volume is stored, copying second data stored in the second location to a third location within the first region, and writing the first data to the second location.