Method and system for receiving commands using a scoreboard on an infiniband host channel adaptor

• US 8,589,610 B2
• Filed: 05/31/2011
• Issued: 11/19/2013
• Est. Priority Date: 05/31/2011
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Manula, Brian Edward, Sandven, Magne Vigulf, Bugge, Haakon Ording
• Primary Examiner(s): PHAN, RAYMOND NGAN
• Application Number:
  US13/149,436
• Publication Number:
  US 20120311208A1
• Time in Patent Office: 903 Days
• Field of Search: 710104-110, 710 52- 57, 711170-173
• US Class Current: 710/107
• CPC Class Codes: G06F 13/124 where hardware is a sequential transfer control unit, e.g. microprocessor, peripheral processor or state-machine
• CPC Class Codes: G06F 13/364 using independent requests or grants, e.g. using separated request and grant lines

Abstract

A method for processing commands on a host channel adapter includes a host channel adapter receiving data from a host connected to the host channel adapter. The command includes an instruction, identification of packet data, and a length field. The host channel adapter extracts a length of the command from the length field, generates a scoreboard mask based on the length, where the scoreboard mask includes unused bits in the scoreboard preset, and sets, with each portion of the data received, a corresponding bit in a scoreboard. The host channel adapter further determines that the size of the data received for the command matches the length using the scoreboard, issues a kick on the host channel adapter when a size of the data received for the command matches the length, executes, in response to the kick, the instruction on a pipeline, and sends the packet data on a network.

Claims

1. A method for processing commands on a host channel adapter, the method comprising:

receiving, by the host channel adapter, data in a command from a host connected to the host channel adapter, wherein the command comprises an instruction, an identification of packet data, and a length field;

extracting, by the host channel adapter, a length of the command from the length field in the data;

generating a scoreboard mask based on the length, wherein the scoreboard mask comprises unused bits in the scoreboard preset; and

setting, with each portion of the data received, a bit in a scoreboard to identify the portion of data received;

determining that a size of the data received for the command matches the length using the scoreboard by;

performing a bitwise “

or”

operation on the scoreboard and the scoreboard mask to obtain a result, and

determining that all bits of the result are set;

issuing, by the host channel adapter, a kick on the host channel adapter when the size of the data received for the command matches the length;

executing, by the host channel adapter and in response to the kick, the instruction on a pipeline to initiate sending the packet data; and

sending, by the host channel adapter, the packet data on a network.

2. The method of claim 1, wherein receiving the data comprises:

receiving, from a virtual machine, a write of the data to a virtual collect buffer, wherein the virtual collect buffer is one of a limited number of virtual collect buffers allocated to the virtual machine, and

wherein the method further comprises;

determining, by the host channel adapter, that a physical collect buffer is available upon receiving a first portion of the data;

locking the physical collect buffer to the virtual collect buffer based on the physical collect buffer being available;

storing the first portion of the data and the subsequent portions of the data in the physical collect buffer based on the virtual collect buffer being locked to the physical collect buffer; and

unlocking the physical collect buffer when the command is executed on the pipeline.

3. The method of claim 1, wherein the identification of packet data comprises the packet data.

4. The method of claim 1, wherein the identification of packet data identifies at least one location in memory comprising the packet data.

5. The method of claim 2, wherein each virtual collect buffer of the limited number of virtual collect buffers is located on a separate page.

6. The method of claim 2, wherein issuing the kick comprises:

storing an address of the physical collect buffer in a virtual kick list, and

wherein commands are executed in the pipeline in an order defined by the virtual kick list.

7. A host channel adapter comprising:

a physical collect buffer comprising;

a payload buffer configured to store a payload of a command;

a header buffer configured to store a header of the command;

a scoreboard field configured to store a scoreboard for tracking which portion of the command is received; and

a scoreboard mask field configured to store a scoreboard mask for masking bits of the scoreboard based on a length of the command;

a collect buffer controller operatively connected to the physical collect buffer and configured to;

receive data in a command from a host connected to the host channel adapter, wherein the command comprises an instruction, an identification of packet data, and a length field;

extract a length of the command from the length field in the data;

generate the scoreboard mask based on the length;

store the data in the physical collect buffer;

set, with each portion of the data received, a bit of the scoreboard to identify the portion of data received; and

issue a kick on the host channel adapter when the scoreboard and the scoreboard mask indicate that all command data of the command is received; and

a hardware pipeline configured to;

execute, in response to the kick, the instruction to initiate sending the packet data.

8. The host channel adapter of claim 7, further comprising:

a port configured to;

send the packet data on a network.

9. The host channel adapter of claim 7, further comprising:

a port data collector operatively connected to the collect buffer controller and configured to;

receive, from a virtual machine, a write of the data to a virtual collect buffer, wherein the virtual collect buffer is one of a limited number of virtual collect buffers allocated to the virtual machine, and

wherein the collect buffer controller is operatively connected to the port data collector and further configured to bind the physical collect buffer to the virtual collect buffer.

10. The host channel adapter of claim 7, further comprising:

a virtual kick list configured to store, when the kick is received, an address of the physical collect buffer in a virtual kick list.

11. The host channel adapter of claim 7, further comprising:

a doorbell checksum state configured to store a checksum.

12. The host channel adapter of claim 7, further comprising:

a collect group table configured to store a mapping between physical collect buffers and underlying functions.

13. The host channel adapter of claim 7, further comprising:

a free physical collect buffer controller configured to store a list of available physical collect buffers.

14. The host channel adapter of claim 7, further comprising:

an underlying function table configured to store a mapping of underlying functions to offsets of a virtual address space.

15. The host channel adapter of claim 9, wherein each virtual collect buffer of the limited number of virtual collect buffers is located on a separate page.

16. An integrated circuit comprising:

a physical collect buffer comprising;

a payload buffer; and

a header buffer; and

a collect buffer controller configured to;

receive data in a command from a host connected to the host channel adapter, wherein the command comprises an instruction, an identification of packet data, and a length field;

extract a length of the command from the length field in the data;

generate a scoreboard mask based on the length, wherein the scoreboard mask comprises unused bits in the scoreboard preset;

store the data in the physical collect buffer;

set, with each portion of the data received, a bit in a scoreboard to identify the portion of data received;

determine that a size of the data received for the command matches the length using the scoreboard by;

performing a bitwise “

or”

operation on the scoreboard and the scoreboard mask to obtain a result, and

determining that all bits of the result are set; and

issue a kick on the host channel adapter when the size of the data received for the command matches the length,

wherein, in response to the kick, the instruction is executed and sent on the network.

17. The integrated circuit of claim 16, further comprising:

a free physical collect buffer controller configured to store a list of available physical collect buffers.

18. The integrated circuit of claim 16, further comprising:

an underlying function table configured to store a mapping of underlying functions to offsets of a virtual address space.

19. The integrated circuit of claim 16, further comprising:

a collect group table configured to store a mapping between physical collect buffers and underlying functions.