Proxy based data transfer utilizing direct memory access

• US 9,992,238 B2
• Filed: 11/11/2015
• Issued: 06/05/2018
• Est. Priority Date: 11/11/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cai, Junjie, Liu, Xin Peng, Lu, Chuan Sheng
• Primary Examiner(s): Mejia, Anthony
• Application Number:
  US14/938,244
• Publication Number:
  US 20170134441A1
• Time in Patent Office: 937 Days
• Field of Search: 709213
• CPC Class Codes: G06F 12/0223 User address space allocation, e.g. contiguous or non contiguous base addressing
• CPC Class Codes: G06F 15/17331 Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: H04L 1/008 where the control data relates to payload of a different packet
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

A method for transferring data utilizing direct memory access. The method includes a computer processor establishing a networking connection, using a proxy, between at least a first computing entity and a second computing entity. The method further includes determining a shared memory space for the established networking connection between at least the first computing entity and the second computing entity. The method further includes allocating the shared memory space from heap memory. The method further includes transmitting data over the established networking connection between at least the first computing entity and the second computing entity utilizing a direct memory access protocol and the allocated shared memory space.

Claims

1. A method for communicating data utilizing direct memory access, the method comprising:

establishing, by one or more processors, a networking connection, using a proxy, between at least a first computing entity and a second computing entity;

determining, by one or more processors, a shared memory space for the established networking connection between at least the first computing entity and the second computing entity;

allocating, by one or more processors, the shared memory space from heap memory; and

transmitting, by one or more processors, data over the established networking connection between at least the first computing entity and the second computing entity utilizing a direct memory access protocol and the allocated shared memory space.

2. The method of claim 1, wherein establishing the networking connection further comprises:

establishing, by one or more processors, utilizing the proxy, the network connection between the first computing entity and the second computing entity utilizing a transport layer of a network architecture,

wherein establishing the network connection includes establishing a socket secure (SOCKS) session, and

wherein the SOCKS session utilizes transmission control protocol (TCP).

3. The method of claim 1, wherein establishing the networking connection further comprises:

redirecting, by one or more processors, an invocation of a first set of one or more application programming interfaces (APIs) corresponding to the first computing entity and the second computing entity that transfer the data utilizing networking, to a second set of one or more APIs, wherein the second set of one or more APIs enables the direct memory access protocol.

4. The method of claim 1, wherein determining the shared memory space further comprises:

determining, by one or more processors, a relationship of the first computing entity and the second computing entity based at least in part on a corresponding first socket connection and a second socket connection within a global sockets registry table; and

allocating, by one or more processors, the shared memory space from the heap memory based, at least in part on the determined relationship of the first computing entity and the second computing entity.

5. The method of claim 4, further comprising:

determining, by one or more processors, a write pointer and a read pointer pair corresponding to one or more memory addresses of the allocated shared memory space, wherein the one or more memory addresses are related to transmitted data;

modifying, by one or more processors, the write pointer based, at least in part, on transmitting a first block of data, of the transmitted data, from the first computing entity to the allocated shared memory space, wherein the write pointer is modified utilizing the proxy; and

modifying, by one or more processors, the read pointer based, at least in part, on transmitting a second block of data, of the transmitted data, from the allocated shared memory space to the second computing entity, wherein the read pointer is modified utilizing the proxy.

6. The method of claim 5, further comprising:

determining, by one or more processors, that the proxy manages a plurality of associated pairs of read pointers and write pointers that are utilized to transmit data between a first computing entity and a second computing entity utilizing the allocated shared memory space;

wherein associated pairs of read pointers and write pointers pairs are associated with blocks of data; and

wherein data transmission associated with the allocated shared memory space occurs by one of;

unidirectional communication, bidirectional communication, or a combination thereof.

7. The method of claim 5, further comprising:

determining, by one or more processors, that the proxy utilized for network communication between the first computing entity and the second computing entity utilizes a message sharing pool;

allocating, by one or more processors, a plurality of messaging buffers comprised of shared memory of the message sharing pool;

transmitting, by one or more processors, data over the established networking connection between at least the first computing entity and the second computing entity utilizing a messaging buffer of the plurality of messaging buffers; and

releasing, by one or more processors, the messaging buffer.

8. A computer program product for communicating data utilizing direct memory access, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instruction readable/executable by a computer processor comprising;

program instructions to establish a networking connection, using a proxy, between at least a first computing entity and a second computing entity;

program instructions to determine a shared memory space for the established networking connection between at least the first computing entity and the second computing entity;

program instructions to allocate the shared memory space from heap memory; and

program instructions to transmit data over the established networking connection between at least the first computing entity and the second computing entity utilizing a direct memory access protocol and the allocated shared memory space.

9. The computer program product of claim 8, wherein establishing the networking connection further comprises:

program instructions to establish, utilizing the proxy, the network connection between the first computing entity and the second computing entity utilizing a transport layer of a network architecture,

wherein establishing the network connection includes establishing a socket secure (SOCKS) session, and

wherein the SOCKS session utilizes transmission control protocol (TCP).

10. The computer program product of claim 8, wherein establishing the networking connection further comprises:

program instructions to redirect an invocation of a first set of one or more application programming interfaces (APIs) corresponding to the first computing entity and the second computing entity that transfer the data utilizing networking, to a second set of one or more APIs, wherein the second set of one or more APIs enables the direct memory access protocol.

11. The computer program product of claim 8, wherein determining the shared memory space further comprises:

program instructions to determining a relationship of the first computing entity and the second computing entity based at least in part on a corresponding first socket connection and a second socket connection within a global sockets registry table; and

program instructions to allocate the shared memory space from the heap memory based, at least in part on the determined relationship of the first computing entity and the second computing entity.

12. The computer program product of claim 11, further comprising:

program instructions to determine a write pointer and a read pointer pair corresponding to one or more memory addresses of the allocated shared memory space, wherein the one or more memory addresses are related to transmitted data;

program instructions to modify the write pointer based, at least in part, on transmitting a first block of data, of the transmitted data, from the first computing entity to the allocated shared memory space, wherein the write pointer is modified utilizing the proxy; and

program instructions to modify the read pointer based, at least in part, on transmitting a second block of data, of the transmitted data, from the allocated shared memory space to the second computing entity, wherein the read pointer is modified utilizing the proxy.

13. The computer program product of claim 12, further comprising:

program instructions to determine that the proxy manages a plurality of associated pairs of read pointers and write pointers that are utilized to transmit data between a first computing entity and a second computing entity utilizing the allocated shared memory space;

wherein associated pairs of read pointers and write pointers pairs are associated with blocks of data; and

wherein data transmission associated with the allocated shared memory space occurs by one of;

unidirectional communication, bidirectional communication, or a combination thereof.

14. The computer program product of claim 12, further comprising:

program instructions to determine that the proxy utilized for network communication between the first computing entity and the second computing entity utilizes a message sharing pool;

program instructions to allocate a plurality of messaging buffers comprised of shared memory of the message sharing pool;

program instructions to transmit, data over the established networking connection between at least the first computing entity and the second computing entity utilizing a messaging buffer of the plurality of messaging buffers; and

program instructions to release the messaging buffer.

15. A computer system for communicating data utilizing direct memory access, the computer system comprising:

one or more processors;

one or more computer readable storage media;

program instructions stored on the one or more computer readable storage media for execution by at least one or more processors, the program instructions comprising;

program instruction to instructions to establish a networking connection, using a proxy, between at least a first computing entity and a second computing entity;

program instructions to determine a shared memory space for the established networking connection between at least the first computing entity and the second computing entity;

program instructions to allocate the shared memory space from heap memory; and

program instructions to transmit data over the established networking connection between at least the first computing entity and the second computing entity utilizing a direct memory access protocol and the allocated shared memory space.

16. The computer system of claim 15, wherein establishing the networking connection further comprises:

program instructions to redirect an invocation of a first set of one or more application programming interfaces (APIs) corresponding to the first computing entity and the second computing entity that transfer the data utilizing networking, to a second set of one or more APIs, wherein the second set of one or more APIs enables the direct memory access protocol.

17. The computer system of claim 15, wherein determining the shared memory space further comprises:

program instructions to determining a relationship of the first computing entity and the second computing entity based at least in part on a corresponding first socket connection and a second socket connection within a global sockets registry table; and

program instructions to allocate the shared memory space from the heap memory based, at least in part on the determined relationship of the first computing entity and the second computing entity.

18. The computer system of claim 17, further comprising:

program instructions to determine a write pointer and a read pointer pair corresponding to one or more memory addresses of the allocated shared memory space, wherein the one or more memory addresses are related to transmitted data;

program instructions to modify the write pointer based, at least in part, on transmitting a first block of data, of the transmitted data, from the first computing entity to the allocated shared memory space, wherein the write pointer is modified utilizing the proxy; and

program instructions to modify the read pointer based, at least in part, on transmitting a second block of data, of the transmitted data, from the allocated shared memory space to the second computing entity, wherein the read pointer is modified utilizing the proxy.

19. The computer system of claim 18, further comprising:

program instructions to determine that the proxy manages a plurality of associated pairs of read pointers and write pointers that are utilized to transmit data between a first computing entity and a second computing entity utilizing the allocated shared memory space;

wherein associated pairs of read pointers and write pointers pairs are associated with blocks of data; and

wherein data transmission associated with the allocated shared memory space occurs by one of;

unidirectional communication, bidirectional communication, or a combination thereof.

20. The computer system of claim 18, further comprising:

program instructions to determine that the proxy utilized for network communication between the first computing entity and the second computing entity utilizes a message sharing pool;

program instructions to allocate a plurality of messaging buffers comprised of shared memory of the message sharing pool;

program instructions to transmit, data over the established networking connection between at least the first computing entity and the second computing entity utilizing a messaging buffer of the plurality of messaging buffers; and

program instructions to release the messaging buffer.