Method and system for responder side cut through of received data

• US 9,021,123 B2
• Filed: 08/23/2011
• Issued: 04/28/2015
• Est. Priority Date: 08/23/2011
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Bugge, Haakon Ording, Ry, Hans Westgaard
• Primary Examiner(s): KHAN, AFTAB N
• Application Number:
  US13/215,260
• Publication Number:
  US 20130051494A1
• Time in Patent Office: 1,344 Days
• Field of Search: 370373-374, 370/474, 370/476, 370/470, 370/465, 709/217, 709/219, 709/236, 709/246, 709/235, 710/30, 710/29, 710/22
• US Class Current: 709/236
• CPC Class Codes: H04L 1/0007 by modifying the frame length
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 69/32 Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
• CPC Class Codes: H04Q 11/0478 Provisions for broadband connections

Abstract

A method for receiving a single message includes a receiving communication adapter receiving a first sub-unit in a single message. A transmitting communication adapter partitions the single message into sub-units. The method further includes storing the first payload in the memory of a receiving device, appending a first completion code into the first sub-unit, and sending a first notification to a receiving entity of the first completion code. The receiving entity processes the first payload based on the first determination. The receiving communication adapter receives a second sub-unit of the multiple sub-units after the first payload is processed by the receiving entity. The method further includes storing the second payload in the memory of the receiving device. The receiving entity determines that the first sub-unit is completely stored based on the first completion code, and that the second sub-unit is completely stored based on a second completion code.

Claims

1. A method for receiving a single message, the method comprising:

receiving, by a receiving communication adapter from a transmitting communication adapter via a consolidated processor and input/output (I/O) network, a first sub-unit of a plurality of sub-units in the single message, wherein the first sub-unit comprises a first payload, and wherein the single message is partitioned into the plurality of sub-units by the transmitting communication adapter;

identifying a first maximum transmission unit (MTU) encoding on the first sub-unit;

determining that the first sub-unit is received when a size of the first sub-unit matches the first MTU encoding;

performing, by the receiving communication adapter, direct memory access to store the first payload in the memory of a receiving device, wherein the receiving device is directly connected, via a peripheral component interconnect (PCI) express connection, to the receiving communication adapter and comprises a receiving entity;

appending, by the receiving communication adapter, a first completion code into the first sub-unit;

sending, by the receiving communication adapter, a first notification to the receiving entity of the first completion code;

making, by the receiving entity, in response to the first notification, a first determination that the first sub-unit is completely stored based on the first completion code;

processing, by the receiving entity, the first payload based on the first determination;

receiving, by the receiving communication adapter via the consolidated processor and I/O network, a second sub-unit of the plurality of sub-units after the first payload is processed by the receiving entity, wherein the second sub-unit comprises a second payload;

identifying a second MTU encoding on the second sub-unit, wherein the second MTU encoding specifies a different size value than the first MTU encoding, wherein the second MTU encoding is defined based on selecting from a group consisting of ramping up and ramping down of a MTU size of the single message, and wherein ramping up is performed as a function of a first constant and ramping down is performed as a function of a second constant;

determining that the second sub-unit is received when a size of the second sub-unit matches the second MTU encoding;

performing, internally at a receiving side comprising the receiving communication adapter and the receiving device, and by the receiving communication adapter, direct memory access via the PCI express connection to store the second payload in the memory of the receiving device; and

making, by the receiving entity, a second determination that the second sub-unit is completely stored based on a second completion code appended by the receiving communication adapter,

wherein the first completion code is different than the second completion code.

2. The method of claim 1, wherein the first completion code is a unique sequence number (“

USN”

).

3. The method of claim 1, wherein the receiving communication adapter is a host channel adapter.

4. The method of claim 1, wherein the second completion code is a first cyclic redundancy code (“

CRC”

), the method further comprising;

generating the first CRC based on a unique sequence number (“

USN”

) and the first sub-unit.

5. The method of claim 4, wherein a receiving entity uses an expected USN as an initial seed to determine a next USN, wherein the next USN is used to generate a second CRC, the method further comprising:

transmitting the second sub-unit to the receiving entity, wherein the receiving entity confirms that the second sub-unit is completely received by matching the second CRC to the first CRC.

6. The method of claim 4, wherein the first sub-unit and the second sub-unit are not in memory order.

7. The method of claim 4, wherein after confirming the second sub-unit is completely received, the receiving communication adapter transfers the second sub-unit to the memory of the receiving device while receiving a third sub-unit of the plurality of sub-units from the transmitting communication adapter.

8. A system for receiving a single message, the system comprising:

a receiving device comprising;

a memory; and

a receiving entity configured to;

make a first determination that a first payload is completely stored using a first completion code;

process the first payload in response to the first determination;

make a second determination that a second payload is completely stored using a second completion code; and

process the second payload in response to the second determination; and

a receiving communication adapter directly connected, via a peripheral component interconnect (PCI) express connection, to the receiving device and configured to;

receive, from a transmitting communication adapter via a consolidated processor and input/output (I/O) network, a first sub-unit of a plurality of sub-units in the single message, wherein the first sub-unit comprises the first payload, and wherein the single message is partitioned into the plurality of sub-units by the transmitting communication adapter;

identify a first maximum transmission unit (MTU) encoding on the first sub-unit;

determine that the first sub-unit is received when a size of the first sub-unit matches the first MTU encoding;

perform, internally at a receiving side comprising the receiving communication adapter and the receiving device, direct memory access via the PCI express connection to store the first payload in the memory of the receiving device;

append the first completion code into the first sub-unit;

send a first notification to the receiving entity of the first completion code, wherein the receiving entity makes the first determination using the first completion code in response to the first notification;

receive, via the consolidated processor I/O network, a second sub-unit of the plurality of sub-units after the first payload is processed by the receiving entity, wherein the second sub-unit comprises a second payload;

identify a second MTU encoding on the second sub-unit, wherein the second MTU encoding specifies a different size value than the first MTU encoding, wherein the second MTU encoding is defined based on selecting from a group consisting of ramping up and ramping down of a MTU size of the single message, and wherein ramping up is performed as a function of a first constant and ramping down is performed as a function of a second constant;

determine that the second sub-unit is received when a size of the second sub-unit matches the second MTU encoding; and

perform direct memory access to store the second payload in the memory of the receiving device,

wherein the first completion code is different than the second completion code.

9. The system of claim 8, wherein the first completion code is a unique sequence number (“

USN”

).

10. The system of claim 8, wherein the second completion code is a first cyclic redundancy code (“

CRC”

), the receiving communication adapter is further configured to;

generate the first CRC based on a unique sequence number (“

USN”

) and the first sub-unit; and

transmit the second sub-unit to the receiving entity.

11. The system of claim 10, wherein the receiving entity further configured to:

determine a next USN using an expected USN as an initial seed, wherein the next USN is used to generate a second CRC; and

confirm that the second sub-unit is completely received by matching the second CRC to the first CRC.

12. The system of claim 10, wherein the first sub-unit and the second sub-unit are not in memory order.

13. The system of claim 10, wherein after confirming the second sub-unit is completely received, the receiving communication adapter transfers the second sub-unit to the memory of the receiving device while receiving a third sub-unit of the plurality of sub-units from the transmitting communication adapter.

14. The system of claim 10, wherein the receiving communication adapter is a host channel adapter.

15. A host channel adapter comprising:

a hardware processor;

a network port; and

receiving processing logic comprising;

a packet receiver module configured to;

receive, from a transmitting communication adapter via a consolidated processor and input/output (I/O) network, a first sub-unit of a plurality of sub-units in the single message, wherein the first sub-unit comprises a first payload, and wherein the single message is partitioned into the plurality of sub-units by the transmitting communication adapter;

identify a first maximum transmission unit (MTU) encoding on the first sub-unit;

determine that the first sub-unit is received when a size of the first sub-unit matches the first MTU encoding;

receive, from the transmitting communication adapter via the consolidated processor and I/O network, a second sub-unit of the plurality of sub-units, wherein the second sub-unit comprises a second payload;

identify a second MTU encoding on the second sub-unit, wherein the second MTU encoding specifies a different size value than the first MTU encoding, wherein the second MTU encoding is defined based on selecting from a group consisting of ramping up and ramping down of a MTU size of the single message, and wherein ramping up is performed as a function of a first constant and ramping down is performed as a function of a second constant; and

determine that the second sub-unit is received when a size of the second sub-unit matches the second MTU encoding;

a direct memory access validation module configured to;

perform, internally at a receiving side comprising the host channel adapter and a receiving device, direct memory access via a peripheral component interconnect (PCI) express connection to store the first payload in the memory of the receiving device, wherein the receiving device is directly connected, via the PCI express connection, to the host channel adapter and comprises a receiving entity; and

perform direct memory access to store the second payload in the memory of the receiving device; and

a completion code module configured to;

append a first completion code into the first sub-unit; and

send a first notification to the receiving entity of the first completion code, wherein the receiving entity makes a determination that the first sub-unit is completely received using the first completion code in response to the first notification,

wherein the first completion code is different than the second completion code.

16. The host channel adapter of claim 15, wherein the first completion code is a unique sequence number (“

USN”

).

17. The host channel adapter of claim 15, wherein a second completion code is a first cyclic redundancy code (“

CRC”

), the completion code module is further configured to;

generate the first CRC based on a unique sequence number (“

USN”

) and the first sub-unit; and

transmit the second sub-unit to the receiving entity.

18. The host channel adapter of claim 17, wherein the receiving entity is configured to:

determine a next USN using an expected USN as an initial seed, wherein the next USN is used to generate a second CRC; and

confirm that the second sub-unit is completely received by matching the second CRC to the first CRC.

19. The host channel adapter of claim 17, wherein the first sub-unit and the second sub-unit are not in memory order.