SYSTEM AND METHOD FOR ASYNCHRONOUS REPLICATION OF A STORAGE IN A COMPUTING ENVIRONMENT

• US 20150249708A1
• Filed: 03/03/2015
• Published: 09/03/2015
• Est. Priority Date: 03/03/2014
• Status: Abandoned Application

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: CloudEndure Ltd. (Amazon.com, Inc.)
• Inventors: FEINBERG, Leonid, EHRLICH, Ofir, GADISH, Ofer, SHAI, Gil, SETTER, Ophir
• Application Number:
  US14/636,233
• Publication Number:
  US 20150249708A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A system and method for method for asynchronous replication of a storage in a computing environment (CE) are provided. The method includes connecting to a primary storage; receiving a content and an address respective of the content; storing, in a designated storage, the content and the address respective of the content; and sending, from the designated storage, the content and the address respective of the content to a secondary storage, wherein the secondary storage is in a secondary CE.

Claims

1. A method for asynchronous replication of a storage in a computing environment (CE), comprising:

connecting to a primary storage;

receiving a content and an address respective of the content;

storing, in a designated storage, the content and the address respective of the content; and

sending, from the designated storage, the content and the address respective of the content to a secondary storage, wherein the secondary storage is in a secondary CE.

2. The method of claim 1, further comprising:

determining whether a primary buffer is at full capacity;

upon determining that the primary buffer is not at full capacity, identifying the primary buffer as the designated storage; and

upon determining that the primary buffer is at full capacity, identifying a secondary buffer as a secondary designated storage.

3. The method of claim 2, further comprising:

retrieving content from the primary storage respective of the address and of a content length of the content stored in the secondary buffer; and

sending the content to the secondary storage.

4. The method of claim 3, wherein sending the content to the secondary storage further comprises:

sending the content to a writing component, the writing component communicatively connected to the secondary storage; and

writing, by the writing component, the content to the secondary storage.

5. The method of claim 2, wherein the primary buffer and the secondary buffer are implemented on a single memory.

6. The method of claim 2, further comprising:

storing, in the secondary designated storage, the address respective of the content.

7. The method of claim 6, further comprising:

storing, in the secondary designated storage, a content length respective of the content.

8. The method of claim 2, further comprising:

storing, in the secondary designated storage, a block of the primary storage respective of the content address was changed.

9. The method of claim 8, wherein the secondary designated storage includes at least a bitmap of the primary storage.

10. The method of claim 5, wherein the primary buffer is determined to be at full capacity if a free space of the primary buffer drops below a threshold.

11. The method of claim 10, wherein the threshold is any one of:

a static threshold, a dynamic threshold, and an adaptive threshold.

12. The method of claim 1, wherein the content and the address respective of the content are received upon determining that the secondary storage is inconsistent with the primary storage.

13. The method of claim 1, further comprising:

detecting content that needs to be replicated.

14. The method of claim 13, wherein detecting content that needs to be replicated further comprises:

determining a signature for at least one section of the primary storage;

receiving a signature for at least one section of the secondary storage, wherein each received signature corresponds to a determined signature;

determining whether each determined signature matches each corresponding received signature;

upon determining that a determined signature does not match a corresponding received signature, identifying a section associated with the determined signature as part of the detected content.

15. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to claim 1.

16. An asynchronous replication system for synchronizing a storage in a computing environment (CE), comprising:

a processing system;

a memory containing instructions that, when executed by the processing system, configure the system to;

connect to a primary storage;

receive a content and an address respective of the content;

store, in a designated storage, the content and the address respective of the content; and

send, from the designated storage, the content and the address respective of the content to a secondary storage, wherein the secondary storage is in a secondary CE.

17. The system of claim 16, wherein the system is further configured to:

determine whether a primary buffer is at full capacity;

upon determining that the primary buffer is not at full capacity, identify the primary buffer as the designated storage; and

upon determining that the primary buffer is at full capacity, identify a secondary buffer as a secondary designated storage.

18. The system of claim 17, wherein the system is further configured to:

retrieve content from the primary storage respective of the address and of a content length of the content stored in the secondary buffer; and

send the content to the secondary storage.

19. The system of claim 17, wherein the primary buffer and the secondary buffer are implemented on a single memory.

20. The system of claim 17, wherein the system is further configured to:

store, in the secondary designated storage, the address respective of the content.

21. The system of claim 20, wherein the system is further configured to:

read content from the primary storage, respective of the address stored in the secondary designated storage; and

send, to the secondary storage, the content from the primary storage corresponding to the address.

22. The system of claim 20, wherein the system is further configured to:

determine if an address is stored with more than one timestamp in the secondary designated storage; and

send to the secondary storage the content corresponding to the latest timestamp, upon determination that the address is stored with more than one timestamp in the secondary designated storage.

23. The system of claim 20, wherein the system is further configured to:

store, in the secondary designated storage, a content length respective of the content.

24. The system of claim 19, wherein the primary buffer is determined to be at full capacity if a free space of the primary buffer drops below a threshold.

25. The system of claim 24, wherein the threshold is any one of:

a static threshold, a dynamic threshold, and an adaptive threshold.

26. The system of claim 16, wherein the content and the address respective of the content are received upon determining that the secondary storage is inconsistent with the primary storage.

27. The system of claim 16, wherein the system is further configured to:

detect content for replication.

28. The system of claim 27, wherein the system is further configured to:

determine a signature for at least one section of the primary storage;

receive a signature for at least one section of the secondary storage, wherein each received signature corresponds to a determined signature;

determine whether each determined signature matches each corresponding received signature;

upon determining that a determined signature does not match a corresponding received signature, identify a section associated with the determined signature as part of the detected content.

29. The system of claim 28, wherein the system is further configured to:

generate a notification respective of at least an address of a section of the detected content to indicate that the secondary storage is inconsistent for the at least an address.

30. The system of claim 28, wherein the system is further configured to:

generate a notification to indicate that the secondary storage is consistent respective of the primary storage, upon determination that the detected content was stored on the secondary storage.

31. The system of claim 28, wherein the system is further configured to:

generate a notification to indicate that the secondary storage is consistent respective of the primary storage at a known timestamp, upon determination that the secondary storage is a replication of the primary storage at the known timestamp.