One shot RDMA having a 2-bit state

• US 7,398,300 B2
• Filed: 08/14/2003
• Issued: 07/08/2008
• Est. Priority Date: 08/14/2002
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Elzur, Uri
• Primary Examiner(s): Chen; Alan S
• Application Number:
  US10/642,023
• Publication Number:
  US 20040034725A1
• Time in Patent Office: 1,790 Days
• Field of Search: 709/212, 709/217, 719/312, 719/313, 710/22, 710/26, 710/36, 710/37, 710/11, 710/19, 711/163
• US Class Current: 709/212
• CPC Class Codes: G06F 13/28 using burst mode transfer, e.g. direct memory access DMA, cycle steal G06F13/32 takes precedence
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A system and method for managing memory resources in a system that allows remote direct access of memory. An aspect of the invention provides for automatically un-binding bound direct-access memory resources based on information received in messages from a remote source. The information may, for example, include a last-segment indicator to indicate that the message segment is the last expected message segment for a message. Another aspect of the invention provides for memory management of directly-accessible sections of memory by assigning a flag to indicate when the section of memory has special access restrictions, such as a set number of allowable accesses. Yet another aspect of the invention provides for a flag to represent when the access restrictions associated with a particular section of memory have been met.

Claims

1. A method for managing memory resources in a system that allows remote direct access of memory, the method comprising:

at a local system that allows a remote system to directly access memory of the local system through a communication network, receiving a message segment from the remote system over the communication network, the received message segment directly accessing a section of memory of the local system that is designated to operate in a first mode, where the first mode is characterized by a maximum number of N remote direct accesses to the section of memory by the remote system; and

at the local system, setting an N-shot fired (NSF) flag associated with the section of memory in response to at least the received message segment.

2. The method of claim 1, further comprising determining if the received message segment includes a last-segment indicator.

3. The method of claim 2, wherein the last-segment indicator is an L-bit in RDMA communications.

4. The method of claim 2, wherein the NSF flag-setting step comprises setting the NSF flag if the received message segment includes information indicating that the received message segment is a last message segment of a message.

5. The method of claim 1, wherein:

N=1;

the first mode is a one-shot mode (OSM); and

the N-shot-fired (NSF) flag comprises a one-shot-fired (OSF) flag associated with the section of memory.

6. The method of claim 5, further comprising setting an OSM flag associated with the section of memory to indicate that the section of memory is in a one-shot-mode, and wherein setting an NSF flag in response to at least the received message segment comprises setting the OSF flag associated with the section of memory to indicate that a one-shot access of the section of memory is complete.

7. The method of claim 6, wherein at least one of the OSM flag and the OSF flag is a single bit.

8. The method of claim 6, wherein the flag-setting steps are performed by a network interface card.

9. The method of claim 5, wherein receiving a message segment from the remote system over the communication network, the received message segment directly accessing a section of memory of the local system that is designated to operate in a first mode, comprises receiving the message segment from the remote system over the communication network, the received message segment attempting to access a section of memory that is designated to operate in a one-shot mode, the method further comprising determining if the OSF flag associated with the section of memory is set.

10. The method of claim 9, further comprising:

accessing the section of memory according to the received message segment if the OSF flag is not set; and

denying access to the section of memory if the OSF flag is set.

11. The method of claim 10, further comprising generating an error message if the OSF flag is set.

12. The method of claim 9, further comprising configuring the system to only receive message segments that are in order.

13. The method of claim 9, further comprising storing out-of-order received message segments in a buffer at least until preceding TCP holes are plugged.

14. The method of claim 1, further comprising setting an N-shot-mode (NSM) flag associated with the section of memory, and wherein receiving a message segment from the remote system over the communication network, the received message segment directly accessing a section of memory of the local system that is designated to operate in a first mode comprises:

receiving a message segment from the remote system over the communication network, the received message segment attempting to directly access the section of memory of the local system;

analyzing the NSM flag to determine if the section of memory has been designated to operate in an N-shot mode; and

processing the received message segment according to the results of the analyzing step.

15. The method of claim 14, wherein the message segment processing step comprises analyzing the received message segment to determine if the received message segment includes information indicating that the received message segment is a last message segment of a message.

16. The method of claim 15, wherein setting an NSF flag associated with the section of memory in response to at least the received message segment comprises setting the NSF flag if it is determined that the received message segment includes a last-segment indicator corresponding to a last segment of a message, and N-1 previous message segments have been received accessing the section of memory.

17. The method of claim 15, wherein the message segment processing step further comprises incrementing a shots-fired counter associated with the section of memory in response to the received message segment.

18. The method of claim 14, wherein the message segment processing step comprises analyzing the NSF flag to determine if the section of memory is closed to further access.

19. The method of claim 18, wherein the message segment processing step comprises generating an error message if the NSF flag indicates that the section of memory is closed to further access.

20. The method of claim 1, wherein N=1, and the first mode is a one-shot mode.

21. A network interface for managing remote direct access of memory, the network interface comprising at least one circuit operable to, at least:

at a local system that allows a remote system to directly access memory of the local system through a communication network, receive a message segment from the remote system over the communication network, the received message segment directly accessing a section of memory of the local system that is designated to operate in a first mode, where the first mode is characterized by a maximum number of N remote direct accesses to the section of memory by the remote system; and

at the local system, set an N-shot (NSF) flag associated with the section of memory in response to at least the received message segment.

22. The network interface of claim 21, wherein:

N=1;

the first mode is a one-shot mode (OSM); and

the N-shot-fired (NSF) flag is a one-shot-fired (OSF) flag associated with the section of memory.

23. The network interface of claim 21, wherein the at least one circuit is further operable to:

set an N-shot-mode (NSM) flag associated with the section of memory to indicate that the section of memory has been designated to operate in an N-shot mode;

receive a message segment from a remote system over a communication network, the message segment attempting to directly access the section of memory;

analyze the NSM flag to determine if the section of memory has been designated to operate in an N-shot mode; and

process the received message segment according to the results of analyzing the NSM flag.

24. The network interface of claim 21, wherein the at least one circuit is disposed on a network interface card.