Efficient cloud network attached storage

• US 8,341,363 B2
• Filed: 05/03/2010
• Issued: 12/25/2012
• Est. Priority Date: 05/03/2010
• Status: Active Grant

• Current Assignee: Panzura, Inc.
• Original Assignee: Panzura, Inc.
• Inventors: Chou, Randy Yen-pang, Mulam, Ravi, Jung, Steve
• Primary Examiner(s): DUDEK JR, EDWARD J
• Application Number:
  US12/772,927
• Publication Number:
  US 20110271067A1
• Time in Patent Office: 967 Days
• Field of Search: 711/162, 711/E12.103, 707/640, 707/694
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

Snapshots of data and metadata associated with the data are created. The snapshot of the data is separate from the snapshot of the associated metadata. The snapshot of metadata is maintained locally in a cloud network attached storage (NAS) and globally. The snapshot of data is maintained according to an accessibility metric.

Snapshot of metadata is transmitted from a backup remote site to a cloud network attached storage (NAS). A request for data corresponding to the metadata is received from the cloud NAS. The requested data is not available at the cloud NAS. The requested data is transmitted from the backup site to the cloud NAS.

Claims

1. A method comprising:

receiving a request from a client to update data on a cloud network attached (NAS) device, wherein the cloud NAS device is part of a federation of two or more cloud NAS devices, wherein the federation of cloud NAS devices further comprises one or more cloud provider storage devices that store data for the cloud NAS devices;

creating on the cloud NAS device snapshots of data and metadata associated with the updated data, the snapshot of the data being separate from the snapshot of the associated metadata;

propagating the snapshot of metadata to all other devices in the federation wherein periodic exchanges of snapshots of metadata ensure that each device in the federation stores metadata for all of the data stored in the federation;

determining based on an accessibility metric whether to maintain the updated data in the cloud NAS device; and

determining based on the accessibility metric whether to transfer the snapshot of data to at least one of the additional cloud NAS devices and the one or more cloud provider storage devices.

2. The method of claim 1 wherein creating comprises:

creating an incremental data and an incremental metadata, the incremental data and incremental metadata corresponding to differences between new data and metadata and existing data and metadata, respectively.

3. The method of claim 1 wherein propagating the snapshot of metadata comprises:

keeping the snapshot of metadata locally in the cloud NAS device; and

transmitting the snapshot of metadata to a cloud provider storage device without regard to the accessibility metric.

4. The method of claim 1 wherein determining whether to maintain the updated data in the cloud NAS device further comprises:

keeping the updated data locally in the cloud NAS device if the updated data satisfies the accessibility metric; and

transmitting the snapshot of data to the cloud provider storage and removing the updated data from the cloud NAS device if the updated data does not satisfy the accessibility metric.

5. The method of claim 1:

wherein the accessibility metric is related to at least one of frequency of access and recency of access; and

wherein the method further comprises updating the accessibility metric based on at least one of the frequency of access and the recency of access for the updated data.

6. The method of claim 1,

wherein an additional cloud NAS device is added to the federation;

wherein during a recovery period the additional cloud NAS device is configured to receive the metadata for all of the data in the federation from at least one of the additional cloud NAS devices and/or the one or more cloud provider storage devices prior to receiving data from the federation;

wherein during the recovery period a second client accessing the additional cloud NAS device uses the received metadata to formulate a second request; and

wherein upon receiving the second request during the recovery period, the additional cloud NAS is configured to contact at least one of the additional cloud NAS devices and/or the one or more cloud provider storage devices to retrieve data associated with the second request.

7. The method of claim 3 wherein transmitting the snapshot of metadata comprises:

transmitting the snapshot of metadata using a file copy utility over a secure connection.

8. The method of claim 4 wherein transmitting the snapshot of data comprises:

transmitting the snapshot of data using a file copy utility over a secure connection.

9. A method comprising:

transmitting a snapshot of metadata from a backup remote site to a cloud network attached storage (NAS) device during a recovery period, wherein the cloud NAS device is joining a federation of one or more cloud NAS devices, wherein the federation of cloud NAS devices further comprises one or more cloud provider storage devices that store data for the cloud NAS devices, wherein the backup remote site is at least one of the one or more cloud NAS devices and/or the one or more cloud provider storage devices in the federation, wherein each cloud NAS device in the federation periodically propagates snapshots of updated metadata to all of the federation to ensure that each device in the federation stores metadata for all of the data stored in the federation, wherein during the recovery period the cloud NAS device is configured to receive the metadata for all of the data in the federation from at least one of the one or more cloud NAS devices and/or the one or more cloud provider storage devices prior to receiving data from the federation, wherein the cloud NAS device receives a request from a client for data corresponding to the transmitted metadata, wherein the request is received during the recovery period, wherein the requested data is not available at the cloud NAS device, wherein the cloud NAS device is configured to contact at least one of the one or more cloud NAS devices and/or the one or more cloud provider storage devices to retrieve data associated with the request; and

transmitting the requested data from the federation to the cloud NAS device.

10. The method of claim 9 further comprising:

transmitting a snapshot of data separately from the snapshot of metadata to the cloud NAS device.

11. The method of claim 10 wherein transmitting the snapshot of data comprises:

transmitting incremental data corresponding to difference between new data and existing data.

12. The method of claim 11 wherein transmitting incremental data comprises:

transmitting incremental data using a file copy utility over a secure connection.

13. A system comprising:

a cloud network attached storage (NAS) device coupled to a network cloud, wherein the cloud NAS device is part of a federation of two or more cloud NAS devices, wherein the federation of cloud NAS devices further comprises one or more cloud provider storage devices that store data for the cloud NAS devices; and

an information manager coupled to the cloud NAS device comprising;

a data processor, and

a metadata processor;

wherein, upon receiving a request from a client to update data in the cloud NAS device;

the metadata processor is configured to propagate a snapshot of metadata to all other devices in the federation, wherein periodic exchanges of snapshots of metadata ensure that each device in the federation stores metadata for all of the data stored in the federation;

the data processor is configured to determine based on an accessibility metric whether to maintain the updated data in the cloud NAS device;

the data processor is further configured to determine based on the accessibility metric whether to transfer the snapshot of data to at least one of the additional cloud NAS devices and the one or more cloud provider storage devices.

14. The system of claim 13 wherein the snapshot of data includes incremental data corresponding to difference between new data and existing data.

15. The system of claim 13 wherein the snapshot of metadata includes incremental metadata corresponding to difference between new metadata and existing metadata.

16. The system of claim 13 wherein the data processor updates the accessibility metric according to at least one of frequency of access and recency of access.

17. A system comprising:

a client;

a cloud provider storage device; and

a cloud network attached storage (NAS) device coupled to the client and the cloud provider storage via a network cloud, wherein the cloud NAS device is part of a federation of two or more cloud NAS devices, wherein the federation of cloud NAS devices further comprises the cloud provider storage device, wherein the cloud provider storage device stores data for the cloud NAS devices;

the cloud NAS device comprising;

a cloud NAS, and

an information manager coupled to the cloud NAS comprising;

a data processor, and

a metadata processor;

wherein, upon receiving a request from the client to update data in the cloud NAS;

the metadata processor is configured to propagate a snapshot of metadata to all other devices in the federation via the network cloud, wherein periodic exchanges of snapshots of metadata ensure that each cloud NAS device and each cloud provider storage device in the federation stores metadata for all of the data stored in the federation;

the data processor is configured to determine based on an accessibility metric whether to maintain the updated data in the cloud NAS device;

the data processor is further configured to determine based on the accessibility metric whether to transfer the snapshot of data to at least one of the additional cloud NAS devices and the one or more cloud provider storage devices via the network cloud.

18. The system of claim 17 wherein the client communicates with the cloud NAS device using a file system protocol.

19. The system of claim 17 wherein the data processor updates the accessibility metric according to at least one of frequency of access and recency of access.

20. The system of claim 17 wherein the cloud NAS device communicates with the cloud provider storage using a file copy utility over a secure connection.

21. An article of manufacture comprising:

a non-transitory machine-accessible medium including data that, when accessed by a machine, causes the machine to perform operations comprising;

receiving a request from a client to update data on a cloud network attached (NAS) device, wherein the cloud NAS device is part of a federation of two or more cloud NAS devices, wherein the federation of cloud NAS devices further comprises one or more cloud provider storage devices that store data for the cloud NAS devices;

creating on the cloud NAS device snapshots of data and metadata associated with the updated data, the snapshot of the data being separate from the snapshot of the associated metadata;

propagating the snapshot of metadata to all other devices in the federation, wherein periodic exchanges of snapshots of metadata ensure that each device in the federation stores metadata for all of the data stored in the federation;

determining based on an accessibility metric whether to maintain the updated data in the cloud NAS device; and

determining based on the accessibility metric whether to transfer the snapshot of data to at least one of the additional cloud NAS devices and the one or more cloud provider storage devices.

22. The article of manufacture of claim 21 wherein the data causing the machine to perform creating snapshots comprises data that, when executed by the machine, causes the machine to perform operations comprising:

creating an incremental data and an incremental metadata, the incremental data and incremental metadata corresponding to differences between new data and metadata and existing data and metadata, respectively.

23. The article of manufacture of claim 21 wherein the data causing the machine to perform propagating the snapshot of metadata comprises data that, when executed by the machine, causes the machine to perform operations comprising:

keeping the snapshot of metadata locally in the cloud NAS device; and

transmitting the snapshot of metadata to a cloud provider storage device without regard to the accessibility metric.

24. The article of manufacture of claim 21 wherein the data causing the machine to determine whether to maintain the updated data in the cloud NAS device further comprises data that, when executed by the machine, causes the machine to perform operations comprising:

keeping the updated data locally in the cloud NAS device if the updated data satisfies the accessibility metric; and

transmitting the snapshot of data to the cloud provider storage and removing the updated data from the cloud NAS device if the updated data does not satisfy the accessibility metric.

25. The article of manufacture of claim 21 wherein the data further comprises data that, when accessed by a machine, causes the machine to perform operations comprising:

updating the accessibility metric.

26. An article of manufacture comprising:

a non-transitory machine-accessible medium including data that, when accessed by a machine, causes the machine to perform operations comprising;

transmitting a snapshot of metadata from a backup remote site to a cloud network attached storage (NAS) device during a recovery period, wherein the cloud NAS device is joining a federation of one or more cloud NAS devices, wherein the federation of cloud NAS devices further comprises one or more cloud provider storage devices that store data for the cloud NAS devices, wherein the backup remote site is at least one of the one or more cloud NAS devices and/or the one or more cloud provider storage devices in the federation, wherein each cloud NAS device in the federation periodically propagates snapshots of updated metadata to all of the federation to ensure that each cloud NAS device and each cloud provider storage device in the federation stores metadata for all of the data stored in the federation, wherein during the recovery period the cloud NAS device is configured to retrieve the metadata for all of the data in the federation from at least one of the one or more cloud NAS devices and/or the one or more cloud provider storage devices of the federation prior to receiving data from the federation, wherein the cloud NAS device receives a request from a client for data corresponding to the transmitted metadata , wherein the request is received during the recovery period, wherein the requested data is not available at the cloud NAS device, wherein the cloud NAS device is configured to contact at least one of the one or more cloud NAS devices and/or the one or more cloud provider storage devices in the federation to retrieve data associated with the request; and

transmitting the requested data from the federation to the cloud NAS device.