Stateless packet segmentation and processing

• US 9,313,302 B2
• Filed: 01/26/2015
• Issued: 04/12/2016
• Est. Priority Date: 09/09/2009
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Vincent, Pradeep, Marr, Michael David
• Primary Examiner(s): Phillips, Hassan
• Assistant Examiner(s): DUONG, DUC T
• Application Number:
  US14/605,893
• Publication Number:
  US 20150139241A1
• Time in Patent Office: 442 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04L 61/4505 using standardised directories; using standardised directory access protocols
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

High-speed processing of packets to, and from, a virtualization environment can be provided while utilizing segmentation offload and other such functionality of commodity hardware. Virtualization information can be added to extension portions of protocol headers, for example, such that the payload portion is unchanged and, when physical address information is added to a frame, a frame can be processed using commodity hardware. In some embodiments, the virtualization information can be hashed and added to the payload or stream at, or relative to, various segmentation boundaries, such that the virtualization or additional header information will only be added to a subset of the packets once segmented, thereby reducing the necessary overhead. Further, the hashing of the information can allow for reconstruction of the virtualization information upon desegmentation even in the event of packet loss.

Claims

1. A computer-implemented method, comprising:

under control of one or more computer systems configured with executable instructions,

receiving an initial set of Ethernet frames, at least some frames of the initial set of Ethernet frames including segments having virtualization information;

extracting the virtualization information from the segments;

determining that a predetermined number of Ethernet frames including segments having virtualization information have been received;

reassembling header data using the virtualization information; and

desegmenting the received segments for processing.

2. The computer-implemented method of claim 1, further comprising determining whether there are one or more additional Ethernet frames not included in the initial set of Ethernet frames.

3. The computer-implemented method of claim 2, further comprising initiating a request for the one or more additional Ethernet frames not included in the initial set of Ethernet frames.

4. The computer-implemented method of claim 1, further comprising reassembling the segments into at least one larger segment.

5. The computer-implemented method of claim 1, wherein desegmenting the received segments for processing is performed using commodity hardware.

6. The computer-implemented method of claim 5, wherein the commodity hardware includes at least one network interface card (NIC) configured to perform segmentation offload for the segments.

7. The computer-implemented method of claim 1, wherein reassembling the header data includes replacing real address information with information for a virtual network.

8. A system, comprising:

a processor; and

a memory device including instructions that, when executed by the processor, cause the processor to;

receive an initial set of Ethernet frames, at least some frames of the initial set of Ethernet frames including segments having virtualization information;

extract the virtualization information from the segments;

determine if a predetermined number of Ethernet frames including segments having virtualization information have been received;

reassemble header data using the virtualization information; and

desegment the received segments for processing.

9. The system of claim 8, wherein the instructions when executed further cause the processor to:

determine whether there are one or more additional Ethernet frames not included in the initial set of Ethernet frames.

10. The system of claim 9, wherein the instructions when executed further cause the processor to:

initiate a request for the one or more additional Ethernet frames not included in the initial set of Ethernet frames.

11. The system of claim 8, wherein the instructions when executed further cause the processor to:

reassemble the segments into at least one larger segment.

12. The system of claim 8, wherein desegmenting the received segments for processing is performed using commodity hardware.

13. The system of claim 12, wherein the commodity hardware includes at least one network interface card (NIC) configured to perform segmentation offload for the segments.

14. The system of claim 8, wherein reassembling the header data includes replacing real address information with information for a virtual network.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor of a computing system, cause the computing system to:

receive an initial set of Ethernet frames, at least some frames of the initial set of Ethernet frames including segments having virtualization information;

extract the virtualization information from the segments;

determine if a predetermined number of Ethernet frames including segments having virtualization information have been received;

reassemble header data using the virtualization information; and

desegment the received segments for processing.

16. The non-transitory computer-readable storage medium of claim 15, further comprising:

determining whether there are one or more additional Ethernet frames not included in the initial set of Ethernet frames.

17. The non-transitory computer-readable storage medium of claim 16, further comprising initiating a request for the one or more additional Ethernet frames not included in the initial set of Ethernet frames.

18. The non-transitory computer-readable storage medium of claim 15, further comprising reassembling the segments into at least one larger segment.

19. The non-transitory computer-readable storage medium of claim 15, wherein desegmenting the received segments for processing is performed using commodity hardware.

20. The non-transitory computer-readable storage medium of claim 15, wherein reassembling the header data includes replacing real address information with information for a virtual network.