Method, system, and program for managing memory for data transmission through a network

• US 20050080928A1
• Filed: 10/09/2003
• Published: 04/14/2005
• Est. Priority Date: 10/09/2003
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Beverly, Harlan T., Foulds, Christopher T.
• Granted Patent: US 7,496,690 B2
• Time in Patent Office: Days
• US Class Current: 709/245
• CPC Class Codes: G06F 12/1081 for peripheral access to main memory, e.g. direct memory access [DMA]
• CPC Class Codes: H04L 61/106 across networks, e.g. mapping telephone numbers to data network addresses
• CPC Class Codes: H04L 61/35 involving non-standard use of addresses for implementing network functionalities, e.g. coding subscription information within the address or functional addressing, i.e. assigning an address to a function
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/165 Combined use of TCP and UDP protocols; selection criteria therefor

Abstract

Provided are a method, system, and program for managing memory for data transmission through a network. Virtual memory addresses of the data to be sent are provided to a sending agent. The sending agent provides to a host the virtual addresses of requested data. In response, the requested data addressed by the virtual addresses or the physical memory locations of the requested data are provided to the sending agent for sending to a destination.

Claims

1. A method for sending data from a source to a destination, comprising:

a host providing to a sending agent of the source, virtual memory addresses of data to be sent to a destination wherein the data is stored in a plurality of physical locations of the source, each location having a physical address and a virtual memory address which is mapped to the physical address;

the sending agent providing to the host at least some of the virtual memory addresses of the data to be sent to the destination;

the host identifying to the sending agent the data addressed by the virtual memory addresses provided by the sending agent; and

the sending agent sending the identified data to the destination.

2. The method of claim 1 wherein the host identifying data comprises the host providing to the sending agent the data addressed by the virtual addresses provided by the sending agent, said method further comprising the sending agent storing the data received from the host in a buffer of the sending agent.

3. The method of claim 1 wherein the host identifying data comprises the host providing to the sending agent the physical addresses of the locations containing the data addressed by the virtual memory addresses provided by the sending agent.

4. The method of claim 3 wherein the physical locations include locations of a first memory and locations of a second memory and the data identified by the host is stored in the first memory and the physical memory addresses provided by the host are physical memory locations of the first memory containing the data addressed by the virtual addresses provided by the sending agent, the method further comprising pinning the physical memory locations of the first memory provided by the host to the sending agent to prevent the data addressed by the virtual addresses provided by the sending agent from being swapped to the second memory.

5. The method of claim 4 further comprising:

the sending agent retrieving from the pinned physical memory locations of the first memory, the data addressed by the virtual addresses provided by the sending agent; and

unpinning the pinned physical memory locations of the first memory after the sending agent sends to the destination the data addressed by the virtual addresses provided by the sending agent.

6. The method of claim 1 further comprising receiving from the destination an acknowledgment for data successfully sent by the sending agent and received by the destination;

wherein the virtual memory addresses provided by the sending agent to the host are the virtual addresses of data sent by the sending agent to the destination but not acknowledged as successfully received by the destination.

7. The method of claim 1 further comprising:

receiving from the destination an acknowledgment for data successfully sent by the sending agent and received by the destination;

the sending agent providing to the host the virtual addresses of data sent by the sending agent to the destination but not acknowledged as successfully received by the destination;

the host identifying to the sending agent the unacknowledged data addressed by the virtual memory addresses provided by the sending agent; and

the sending agent resending the identified unacknowledged data to the destination.

8. The method of claim 1 wherein the host providing virtual addresses to the sending agent includes the host providing to the sending agent at least one data structure which includes in an address field containing the virtual address of one of a plurality of memory locations storing a block of data to be sent to the destination, a size field containing a value representing the size of the block of data;

and a sequence number field containing a value representing a packet sequence number associated with data within the block of data.

9. The method of claim 1 wherein the host providing virtual addresses to the sending agent includes the host providing to the sending agent a plurality of data structures, wherein each data structure includes in an address field, the virtual address of one of a plurality of memory locations storing a block of data to be sent to the destination, a size field containing a value representing the size of the block of data, a sequence number field containing a value representing the packet sequence number associated with data within the block of data;

and a link field containing the virtual address of another data structure of the plurality of data structures.

10. The method of claim 1 wherein the physical locations include locations of a first memory and a second memory and the data to be sent to the destination is stored in the first memory, the method further comprising,

pinning the locations of the first memory storing the data to be sent to prevent the data to be sent from being swapped to the second memory;

the host providing to the sending agent in addition to the virtual memory addresses of the data to be sent, the physical addresses of the locations of the first memory storing the data to be sent;

the sending agent retrieving from the pinned locations of the first memory, the data to be sent; and

unpinning the pinned locations of the first memory storing the data to be sent after the sending agent retrieves the data from the pinned locations of the first memory storing the data to be sent.

11. A system adapted to communicate with a destination, comprising:

memory;

a processor coupled to the system memory;

an operating system executable by the processor in memory;

a network adaptor;

data storage;

a data storage controller adapted to manage Input/Output (I/O) access to the data storage; and

a device driver executable by the processor in the memory,

wherein the memory and the data storage each comprise physical locations adapted to store data, each location having a physical address and a virtual address which is mapped to the physical address; and

wherein at least one of the operating system and device driver is adapted to provide a host and at least one of the device driver and the network adaptor is adapted to provide a sending agent wherein;

(I) the host provides to the sending agent, virtual memory addresses of data to be sent to a destination,

(ii) the sending agent provides to the host at least some of the virtual memory addresses of the data to be sent to the destination;

(iii) the host identifies to the sending agent the data addressed by the virtual memory addresses provided by the sending agent; and

(iv) the sending agent sending the identified data to the destination establish an active connection adapted to send packets of data between the system and a destination.

12. The system of claim 11 wherein the system further comprises a buffer and wherein the host identifying data comprises the host providing to the sending agent the data addressed by the virtual addresses provided by the sending agent, and wherein the sending agent is further adapted to store the data received from the host in the buffer.

13. The system of claim 11 wherein the host identifying data comprises the host providing to the sending agent the physical addresses of the locations containing the data addressed by the virtual memory addresses provided by the sending agent.

14. The system of claim 13 wherein the data identified by the host is stored in the memory and the physical addresses provided by the host are physical locations of the memory containing the data addressed by the virtual addresses provided by the sending agent, the system further comprising pinning the physical memory locations of the memory provided by the host to the sending agent to prevent the data addressed by the virtual addresses provided by the sending agent from being swapped to the data storage.

15. The system of claim 14 wherein the sending agent is further adapted to retrieve from the pinned physical memory locations of the memory, the data addressed by the virtual addresses provided by the sending agent;

and

at least one of the sending agent and the host is further adapted to unpin the pinned physical memory locations of the memory after the sending agent sends to the destination the data addressed by the virtual addresses provided by the sending agent.

16. The system of claim 11 wherein the sending agent is further adapted to receive from the destination an acknowledgment for data successfully sent by the sending agent and received by the destination;

and wherein the virtual memory addresses provided by the sending agent to the host are the virtual addresses of data sent by the sending agent to the destination but not acknowledged as successfully received by the destination.

17. The system of claim 11 wherein the sending agent is further adapted to:

receive from the destination an acknowledgment for data successfully sent by the sending agent and received by the destination; and

provide to the host the virtual addresses of data sent by the sending agent to the destination but not acknowledged as successfully received by the destination;

wherein the host is further adapted to identify to the sending agent the unacknowledged data addressed by the virtual memory addresses provided by the sending agent; and

wherein the sending agent is further adapted to resend the identified unacknowledged data to the destination.

18. The system of claim 11 wherein the host providing virtual addresses to the sending agent includes the host providing to the sending agent at least one data structure which includes an address field containing the virtual address of one of a plurality of locations storing a block of data to be sent to the destination, a size field containing a value representing the size of the block of data;

and a sequence number field containing a value representing a packet sequence number associated with data within the block of data.

19. The system of claim 11 wherein the host providing virtual addresses to the sending agent includes the host providing to the sending agent a plurality of data structures, wherein each data structure includes an address field containing the virtual address of one of a plurality of memory locations storing a block of data to be sent to the destination, a size field containing a value representing the size of the block of data, a sequence number field containing a value representing the packet sequence number associated with data within the block of data;

and a link field containing the virtual address of another data structure of the plurality of data structures.

20. The system of claim 11 wherein the data to be sent to the destination is stored in the memory, and wherein at least one of the host and the sending agent is adapted to:

pin the locations of the memory storing the data to be sent to prevent the data to be sent from being swapped to the data storage;

wherein the host is further adapted to provide to the sending agent in addition to the virtual memory addresses of the data to be sent, the physical addresses of the locations of the memory storing the data to be sent;

wherein the sending agent is further adapted to retrieve from the pinned locations of the memory, the data to be sent; and

to unpin the pinned locations of the memory storing the data to be sent after the sending agent retrieves the data from the pinned locations of the memory storing the data to be sent.

21. An article of manufacture for sending data from a source to a destination, the operations comprising:

a host providing to a sending agent of the source, virtual memory addresses of data to be sent to a destination wherein the data is stored in a plurality of physical locations of the source, each location having a physical address and a virtual memory address which is mapped to the physical address;

the sending agent providing to the host at least some of the virtual memory addresses of the data to be sent to the destination;

the host identifying to the sending agent the data addressed by the virtual memory addresses provided by the sending agent; and

the sending agent sending the identified data to the destination.

22. The article of manufacture of claim 21 wherein the host identifying data comprises the host providing to the sending agent the data addressed by the virtual addresses provided by the sending agent, said operations further comprising the sending agent storing the data received from the host in a buffer of the sending agent.

23. The article of manufacture of claim 21 wherein the host identifying data comprises the host providing to the sending agent the physical addresses of the locations containing the data addressed by the virtual memory addresses provided by the sending agent.

24. The article of manufacture of claim 23 wherein the physical locations include locations of a first memory and locations of a second memory and the data identified by the host is stored in the first memory and the physical memory addresses provided by the host are physical memory locations of the first memory containing the data addressed by the virtual addresses provided by the sending agent, the operations further comprising pinning the physical memory locations of the first memory provided by the host to the sending agent to prevent the data addressed by the virtual addresses provided by the sending agent from being swapped to the second memory.

25. The article of manufacture of claim 24 wherein the operations further comprise:

the sending agent retrieving from the pinned physical memory locations of the first memory, the data addressed by the virtual addresses provided by the sending agent; and

unpinning the pinned physical memory locations of the first memory after the sending agent sends to the destination the data addressed by the virtual addresses provided by the sending agent.

26. The article of manufacture of claim 21 wherein the operations further comprise receiving from the destination an acknowledgment for data successfully sent by the sending agent and received by the destination;

wherein the virtual memory addresses provided by the sending agent to the host are the virtual addresses of data sent by the sending agent to the destination but not acknowledged as successfully received by the destination.

27. The article of manufacture of claim 21 wherein the operations further comprise:

receiving from the destination an acknowledgment for data successfully sent by the sending agent and received by the destination;

the sending agent providing to the host the virtual addresses of data sent by the sending agent to the destination but not acknowledged as successfully received by the destination;

the host identifying to the sending agent the unacknowledged data addressed by the virtual memory addresses provided by the sending agent; and

the sending agent resending the identified unacknowledged data to the destination.

28. The article of manufacture of claim 21 wherein the host providing virtual addresses to the sending agent includes the host providing to the sending agent at least one data structure which includes in an address field containing the virtual address of one of a plurality of memory locations storing a block of data to be sent to the destination, a size field containing a value representing the size of the block of data;

and a sequence number field containing a value representing a packet sequence number associated with data within the block of data.

29. The article of manufacture of claim 21 wherein the host providing virtual addresses to the sending agent includes the host providing to the sending agent a plurality of data structures, wherein each data structure includes in an address field, the virtual address of one of a plurality of memory locations storing a block of data to be sent to the destination, a size field containing a value representing the size of the block of data, a sequence number field containing a value representing the packet sequence number associated with data within the block of data;

and a link field containing the virtual address of another data structure of the plurality of data structures.

30. The article of manufacture of claim 21 wherein the physical locations include locations of a first memory and a second memory and the data to be sent to the destination is stored in the first memory, the operations further comprising,

pinning the locations of the first memory storing the data to be sent to prevent the data to be sent from being swapped to the second memory;

the host providing to the sending agent in addition to the virtual memory addresses of the data to be sent, the physical addresses of the locations of the first memory storing the data to be sent;

the sending agent retrieving from the pinned locations of the first memory, the data to be sent; and

unpinning the pinned locations of the first memory storing the data to be sent after the sending agent retrieves the data from the pinned locations of the first memory storing the data to be sent.