Address range transfer from first node to second node

• US 9,703,701 B2
• Filed: 03/28/2013
• Issued: 07/11/2017
• Est. Priority Date: 03/28/2013
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Voigt, Douglas L
• Primary Examiner(s): Dudek, Jr., Edward
• Assistant Examiner(s): Russell, Andrew
• Application Number:
  US14/765,057
• Publication Number:
  US 20150370702A1
• Time in Patent Office: 1,566 Days
• CPC Class Codes: G06F 11/1441 Resetting or repowering
• CPC Class Codes: G06F 11/1443 Transmit or communication errors
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 12/0238 Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
• CPC Class Codes: G06F 12/0292 using tables or multilevel address translation means G06F12/023 takes precedence; address translation in virtual memory systems G06F12/10
• CPC Class Codes: G06F 12/0804 with main memory updating G06F12/0806 takes precedence
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 13/404 with address mapping
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 2212/1008 Correctness of operation, e.g. memory ordering
• CPC Class Codes: G06F 2212/1032 Reliability improvement, data loss prevention, degraded operation etc
• CPC Class Codes: G06F 2212/1048 Scalability
• CPC Class Codes: G06F 2212/214 Solid state disk
• CPC Class Codes: G06F 2212/7201 Logical to physical mapping or translation of blocks or pages
• CPC Class Codes: G11C 16/22 Safety or protection circuits preventing unauthorised or accidental access to memory cells

Abstract

A group address range is mapped to a memory address range of a nonvolatile memory. A first memory address of the memory address range is to be copied to a volatile memory if the first memory address is mapped to the group address range and a write access is requested for the first memory address. The group address range is transferred from a first node to a second node in response to a synch command. The copied address is to be written the NVM after the group address range is transferred.

Claims

1. A first node, comprising:

a group table including a first group that includes a first group address range that is mapped to a memory address range of a nonvolatile memory (NVM), the first group address range including a copy-on-write (COW) range, with a first memory address of the memory address range to be copied to a volatile memory if the first memory address is mapped to the COW range and a write access is requested for the first memory address; and

a controller to transfer address ranges included in the first group, including the first group address range, from the first node to a second node according to an order determined based on the group table, in response to a synchronize command, wherein

the controller is to transmit a marker after the transfer is complete, and

the controller is to write the copied address to the NVM after the second node acknowledges the marker.

2. The first node of claim 1, wherein,

the group address range is associated with a ready flag,

the controller is to set the ready flag of the group address range, if the group address range is to be transferred to the second node, and

the controller is to reset the ready flag of the group address range after the group address range is transferred to the second node.

3. The first node of claim 2, wherein,

the group table includes a plurality of the group address ranges, each of the group address ranges to be associated with one of a plurality of the ready flags, and

the controller is to reset the ready flag of the group address range that is transferred last after the second node acknowledges receipt of the marker and the copied address is written to the NVM.

4. The first node of claim 3, further comprising:

a log to record the group address ranges after the group address ranges are transferred to the second node, wherein the log is to record the marker after the marker is transferred to the second node.

5. The first node of claim 4, wherein,

the controller is to stop and leave the transfer incomplete, if the copied address is lost before being transferred to the second node, and

the second node is to discard the transferred group address range from the first node, if the second node does not receive the marker.

6. The first node of claim 5, wherein,

the controller is to receive the copied address from the second node, if the transfer is interrupted by a power loss, the marker is recorded in the log, the COW range is recorded before the marker in the log and the copied address is not written to the NVM.

7. The first node of claim 4, wherein,

the controller is to clear the log after the ready flag of the last group address range is reset, and

the copied address is lost if the first node loses power before the copied address is written to the NVM.

8. The first node of claim 3, wherein,

the controller is to resend the marker to the second node, if the second node does not acknowledge receipt of the marker, and

the second node is to the acknowledge the marker to the first node after the second node receives the marker from the first node and all of the group address ranges transferred to the second node are stored at a NVM accessible by the second node.

9. The first node of claim 3, wherein,

the controller is to send the last group address range, if the first node is reset and only the ready flag of the last group address range remains set after the first node is reset, and

the second node is to send all of the transferred the group address ranges back to the first node, if the second node receives the last group address range after the receiving the marker.

10. The first node of claim 1, wherein,

the first node is to discard the copied address if the marker is not acknowledged by the second node after at least one of a first threshold period and a first threshold number of retransmissions of the marker to the second node, and

the second node is to discard the group address range transferred from the first node, if the second node does not receive the marker after at least one of a second threshold period and a second threshold number of retransmissions of an acknowledgment of the group address range last received by the second node.

11. The first node of claim 1, wherein, the copied address is modified in response to a write access for the first memory address, and

the controller is to write the copied address back to the first memory address of the NVM after second node acknowledges the marker.

12. A method, comprising:

receiving, at a first node, a synchronize command including a synchronize address range;

identifying, in a group table that includes a number of group address ranges organized into groups, one of the group address ranges that includes the synchronize address range, wherein each of the group address ranges maps to a corresponding memory address range in a nonvolatile memory (NVM), and the identified group address range maps to a memory address range in the NVM that includes a first memory address that is identified for copy-on-write (COW) treatment;

transferring data corresponding to the group that includes the indentified group address range from the first node to a second node in an order that is determined based on the group table;

transmitting a marker from the first node to the second node after the transferring is completed;

waiting for the second node to acknowledge the marker before writing a copied address corresponding to the first memory address to the NVM; and

discarding the copied address in response to at least one of the transferring is not completed and the second node does not acknowledge the marker after a first threshold period.

13. The method of claim 12,

at the second node, discarding the transferred data corresponding to the group that includes the identified group address range in response to not receiving the marker within a second threshold period after receiving the transferred data.

14. A non-transitory computer-readable storage medium storing instructions that, if executed by a processor of a device, cause the processor to:

specify, in a group table at a first node, one or more groups that each include one or more group address ranges that are respectively mapped to memory address ranges of a nonvolatile memory (NVM);

copy, at the first node, a first memory address of the memory address range to a volatile memory, in response to a write operation for the first memory address; and

in response to a synchronize command that includes a synchronize address range;

identify a group that corresponds to the synchronize address range,

transfer address ranges associated with the identified group from the first node to the second node,

transmit a marker from the first node to the second node after the transfer is completed, and

if the transferred address ranges include the copied address;

discard the copied address at the first node if the second node does not acknowledge the marker within a first threshold period, and

write the copied address to the first memory address of the NVM if the second node acknowledges receipt of the marker.

15. The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the processor to:

discard, at the second node, the transferred address ranges if the second node does not receive the marker within a second threshold period.

16. The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the processor to:

associate each of the group address ranges with a ready flag,

set the ready flag of a given group address range if the given group address range is to be transferred to the second node, and

reset the ready flag of the given group address range after the given group address range is transferred to the second node.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions further cause the processor to:

if the second node acknowledges receipt of the marker, reset the ready flag of the group address range that is transferred last after the copied address is written to the NVM.

18. The non-transitory computer-readable storage medium of claim 17, wherein the instructions further cause the processor to:

generate a log to record the group address ranges that have been transferred to the second node, wherein the log is to record the marker after the marker is transferred to the second node.

19. The non-transitory computer-readable storage medium of claim 18, wherein the instructions further cause the processor to:

stop and leave the transfer incomplete, if the copied address is lost before being transferred to the second node.

20. The non-transitory computer-readable storage medium of claim 19, wherein the instructions further cause the processor to:

if the transfer is interrupted by a power loss, if the marker is recorded in the log, and if the COW range is recorded before the marker in the log and the copied address is not written to the NVM, receive the copied address from the second node.