DISTRIBUTED STORAGE ARRAY

• US 20080162812A1
• Filed: 03/14/2008
• Published: 07/03/2008
• Est. Priority Date: 04/21/2006
• Status: Active Grant

• Current Assignee: Valtrus Innovations Limited (f/k/a Dolya Holdco 9 Limited) (Key Patent Innovations Limited)
• Original Assignee: Christopher Stroberger, Susan Spence
• Inventors: Stroberger, Christopher, Spence, Susan
• Granted Patent: US 7,487,311 B2
• Time in Patent Office: Days
• US Class Current: 711/114
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2074 Asynchronous techniques
• CPC Class Codes: G06F 2201/855 Details of asynchronous mirroring using a journal to transfer not-yet-mirrored changes

Abstract

Systems and methods for asynchronous backup of virtual disks in a distributed storage array are disclosed. An exemplary method may comprise receiving an IO stream at the virtual disks in the distributed storage array, writing data to one or more storage cells of the virtual disks in the distributed storage array, and logging completed writes in a first batch for each of the one or more storage cells. The method also comprises establishing a consistency point in the IO stream, terminating logging to the first batch for each of the one or more storage cells at the consistency point and logging completed writes after the consistency point to a new batch for each of the one or more storage cells. The method also comprises transferring writes logged in the first batch to at least one remote storage so that the at least one remote storage is crash consistent.

Claims

1. A method for asynchronous backup of virtual disks in a distributed storage array;

comprising;

receiving an IO stream at the virtual disks in the distributed storage array;

writing data to one or more storage cells of the virtual disks in the distributed storage array, and logging completed writes in a first batch for each of the one or more storage cells;

establishing a consistency point in the IO stream;

terminating logging to the first batch for each of the one or more storage cells at the consistency point and logging completed writes after the consistency point to a new batch for each of the one or more storage cells; and

transferring writes logged in the first batch to at least one remote storage so that the at least one remote storage is crash consistent.

2. The method of claim 1, wherein receiving the IO stream includes receiving at least some substantially simultaneous writes from multiple clients.

3. The method of claim 1, wherein logging completed writes is irrespective of any ordering of the writes for different regions of the virtual disks.

4. The method of claim 1, further comprising temporarily suspending all IO to the virtual disks at the consistency point.

5. The method of claim 4, wherein temporarily suspending all IO includes delaying cache commits and write acknowledgements for a predetermined time.

6. The method of claim 4, further comprising temporarily suspending the IO stream for one network roundtrip.

7. The method of claim 6, further comprising determining the time for suspending the IO stream based on the slowest storage cell response time.

8. The method of claim 6, wherein temporarily suspending the IO stream is for about half the time it takes to perform a single write.

9. The method of claim 4, further comprising temporarily suspending the IO stream based on maximum clock skew time.

10. The method of claim 9, further comprising suspending write acknowledgements by the storage cells for a time equal to the maximum skew between any two storage cell clocks in the distributed storage array.

11. The method of claim 9, further comprising determining which writes are included in the first batch based on timestamps from storage cell clocks.

12. A system comprising:

a distributed storage array having a plurality of storage cells;

a logging service operatively associated with the plurality of storage cells, the logging service;

logging completed writes in a first batch for each of the storage cells,

establishing a consistency point for terminating logging to the first batch, and

logging completed writes for each of the one or more storage cells after the consistency point to a new batch; and

a remote storage for recording writes logged in the first batch such that the remote storage is a mirror image of the plurality of storage cells as of the consistency point.

13. The system of claim 12, further comprising a batch collection area at the remote storage, the batch collection area for confirming receipt of the first batch before the first batch is removed from the distributed storage array.

14. The system of claim 12, further comprising a hatch manager to temporarily suspend an IO stream at the consistency point.

15. The system of claim 12, wherein the hatches are maintained on the same storage cells as data being logged in the batches.

16. The system of claim 15, wherein acknowledgements are made to one or more clients only after both a write is completed and logged so that the batches are valid as of the time of writing to the storage cells.

17. The system of claim 12, wherein the batches are maintained in disjointed storage cells so that the batches are transferable to remote storage even if one or more of the storage cells for recording writes fail.

18. The system of claim 12, wherein the batches are maintained as one or more virtual disk to provide redundancy for the batches.

19. A distributed storage array with asynchronous backup, comprising:

first hatch means for logging completed writes for each of a plurality of storage cells;

means for terminating logging by the first batch means at a consistency point;

second batch means for logging completed writes after the consistency point; and

means for transferring the completed writes by the first batch means to a remote storage for maintaining a mirror image of the plurality of storage cells consistent to the consistency point.

20. The distributed storage array of claim 19, further comprising means for temporarily suspending all IO at the consistency point.

21. A system comprising:

a logging service for operatively associating with a plurality of storage cells in a distributed storage array, the logging service comprising program code for;

logging completed writes in a first batch for each of the storage cells,

establishing a consistency point for terminating logging to the first batch,

logging completed writes for each of the one or more storage cells after the consistency point to a new batch, and

causing writes leased in the first batch to be sent to a remote storage for recording on the remote storage such that the remote storage is a mirror image of the plurality of storage cells as of the consistency point.