Leveraging physical network interface functionality for packet processing

• US 8,483,221 B1
• Filed: 02/22/2012
• Issued: 07/09/2013
• Est. Priority Date: 09/09/2009
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Vincent, Pradeep, Marr, Michael David
• Primary Examiner(s): Phillips, Hassan
• Assistant Examiner(s): DUONG, DUC T
• Application Number:
  US13/402,062
• Time in Patent Office: 503 Days
• Field of Search: None
• US Class Current: 370/392
• CPC Class Codes: H04L 61/4505 using standardised directories; using standardised directory access protocols
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

High-speed processing of packets to, and from, a virtualization environment can be provided while utilizing segmentation offload and other such functionality of commodity hardware. Virtualization information can be added to extension portions of protocol headers, for example, such that the payload portion is unchanged and, when physical address information is added to a frame, a frame can be processed using commodity hardware. In some embodiments, the virtualization information can be hashed and added to the payload or stream at, or relative to, various segmentation boundaries, such that the virtualization or additional header information will only be added to a subset of the packets once segmented, thereby reducing the necessary overhead. Further, the hashing of the information can allow for reconstruction of the virtualization information upon desegmentation even in the event of packet loss.

Claims

1. A computer-implemented method, comprising:

under control of one or more computer systems configured with executable instructions,

obtaining a data packet including a payload portion and specifying a virtual address;

generating a transmission frame having an address header and a protocol header field, the protocol header field including the virtual address and the address header including a physical address associated with the virtual address; and

segmenting the transmission frame, including the payload portion, into a plurality of transmission segments to be transmitted to the physical address,

wherein the address header and the protocol header field are capable of being replicated to each of the plurality of transmission segments.

2. The computer-implemented method of claim 1, wherein the transmission frame is capable of being segmented into the plurality of transmission segments using commodity hardware.

3. The computer-implemented method of claim 2, wherein the commodity hardware includes at least one network interface card (NIC) configured to perform segmentation offload for the transmission frame.

4. The computer-implemented method of claim 1, further comprising:

contacting a mapping service to determine the physical address corresponding to the virtual address.

5. The computer-implemented method of claim 1, wherein the protocol header field is in one of a transmission control protocol (TCP) or a user datagram protocol (UDP) header.

6. The computer-implemented method of claim 1, wherein the data packet is a user data packet sent to the virtual address.

7. The computer-implemented method of claim 1, further comprising:

performing a discovery process to determine a transmission size limit for each of the plurality of transmission segments.

8. The computer-implemented method of claim 1, further comprising:

including port information in a protocol header of the transmission frame.

9. The computer-implemented method of claim 1, wherein the payload portion is a level four payload in a network stack.

10. The computer-implemented method of claim 1, wherein the protocol header field is part of a TCP header, and wherein the virtual address is added to a TCP options area of the TCP header of the transmission frame.

11. The computer-implemented method of claim 1, wherein the data packet is transmitted from a virtual machine to a network interface card (NIC) and wherein the NIC segments the data packet into the plurality of transmission segments, each transmission segment being smaller than the data packet.

12. A system for processing data packets in an electronic environment, comprising:

a processor; and

a memory device including instructions that, when executed by the processor, cause the processor to;

receive a data packet including a payload portion and specifying a virtual address;

generate a transmission frame having an address header and a protocol header field, the protocol header field including the virtual address and the address header including a physical address associated with the virtual address;

segment the transmission frame, including the payload portion, into a plurality of transmission segments, the address header and the protocol header field capable of being replicated to each of the plurality of transmission segments; and

transmit the plurality of transmission segments to the second address.

13. The system of claim 12, wherein the transmission frame is capable of being segmented into the plurality of transmission segments using commodity hardware.

14. The system of claim 13, wherein the commodity hardware includes at least one network interface card (NIC) configured to perform segmentation offload for the transmission frame.

15. The system of claim 14, wherein the commodity hardware includes at least one network interface configured to perform offload segmentation for the transmission frame.

16. The system of claim 14, wherein the instructions when executed further cause the processor to:

perform a discovery process to determine a transmission size limit for each of the plurality of transmission segments.

17. The system of claim 12, wherein the data packet is transmitted from a virtual machine to a network interface card (NIC) and wherein the NIC segments the data packet into the plurality of transmission segments, each transmission segment being smaller than the data packet.

18. A non-transitory computer readable storage medium storing instructions for processing data packets in an electronic environment, the instructions when executed by a processor causing the processor to:

obtain a user data packet including a payload portion and specifying a virtual address;

generate a transmission frame having an address header and a protocol header field, the protocol header field including the virtual address and the address header including a physical address associated with the virtual address, the address header and the protocol header field capable of being replicated to each of the plurality of transmission segments; and

segment the transmission frame, including the payload portion, into a plurality of transmission segments to be transmitted to the physical address.

19. The non-transitory computer readable storage medium of claim 18, wherein the protocol header field is part of one of a transmission control protocol (TCP) header or a user datagram protocol (UDP) header.

20. The non-transitory computer readable storage medium of claim 18, wherein the transmission frame is capable of being segmented into the plurality of transmission segments using commodity hardware, the commodity hardware including at least one network interface card (NIC) configured to perforin offload segmentation for the transmission frame.