Interface bundles in virtual network devices

• US 8,990,430 B2
• Filed: 02/19/2004
• Issued: 03/24/2015
• Est. Priority Date: 02/19/2004
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Smith, Michael R., Wang, Jeffrey Y M, Golshan, Ali
• Primary Examiner(s): JAKOVAC, RYAN J
• Application Number:
  US10/782,314
• Publication Number:
  US 20050198371A1
• Time in Patent Office: 4,051 Days
• Field of Search: 370/401, 709/249
• US Class Current: 709/249
• CPC Class Codes: H04L 45/02 Topology update or discovery
• CPC Class Codes: H04L 45/583 Stackable routers
• CPC Class Codes: H04L 45/586 of virtual routers
• CPC Class Codes: H04L 49/1553 Interconnection of ATM switching modules, e.g. ATM switching fabrics
• CPC Class Codes: H04L 49/30 Peripheral units, e.g. input or output ports
• CPC Class Codes: H04L 49/354 for supporting virtual local area networks [VLAN]
• CPC Class Codes: H04L 49/552 by ensuring the integrity of packets received through redundant connections
• CPC Class Codes: H04L 49/70 Virtual switches

Abstract

A virtual network device includes several different virtual network device sub-units, which collectively operate as a single logical network device. An interface bundle includes interfaces in more than one of the different virtual network device sub-units included in the virtual network device. The interface bundle is coupled to a virtual link bundle, which connects the virtual network device to another device. The interface bundle is managed as a single logical interface.

Claims

1. A system comprising:

a virtual link bundle comprising a first plurality of communication links, wherein

the first plurality of communication links is configured to couple a virtual network device to a first network device external to the virtual network device,

the first virtual network device operates in a distribution layer,

a first end of each of the first plurality of communication links is configured to be coupled to the first network device,

a second end of a first one of the first plurality of communication links is configured to be coupled to a first virtual network device sub-unit within the virtual network device,

a second end of a second one of the first plurality of communication links is configured to be coupled to a second virtual network device sub-unit within the virtual network device,

the first virtual network device sub-unit is coupled to the second virtual network device sub-unit via a virtual network device link,

the first network device comprises a first plurality of ports,

each of the first plurality of ports is configured to communicate packets with a respective client,

the first network device is configured to append a header to a packet before sending the packet to the virtual network device via one of the first plurality of communication links, and

the header identifies a one of the first plurality of ports having received the packet,

the first plurality of communication links provides redundant connections between the first network device and the virtual network device; and

a second virtual link bundle comprising a second plurality of communication links, wherein

the second plurality of communication links is configured to couple the virtual network device to a second network device external to the virtual network device,

a first end of each of the second plurality of communication links is configured to be coupled to the second network device,

a second end of a first one of the second plurality of communication links is configured to be coupled to the first virtual network device sub-unit within the virtual network device,

a second end of a second one of the second plurality of communication links is configured to be coupled to the second virtual network device sub-unit within the virtual network device,

the second network device comprises a second plurality of ports,

the second plurality of communication links provides redundant connections between the second network device and the virtual network device,

the first network device and the second network device operate in an access layer,

the first network device and the second network device are satellite network devices which do not perform layer two forwarding or layer three routing,

the first plurality of communication links and the second plurality of communication links are uplinks,

the second virtual network device sub-unit is configured to

disable transmission of the second packet via the virtual link bundle in response to determining that the second packet was received via the virtual network device link,

detect a failure of all links of the virtual link bundle coupled to the second virtual network device sub-unit, and

enable transmission of the second packet via the virtual link bundle in response to the failure.

2. The system of claim 1, further comprising the first network device, wherein

the first network device is configured to select a communication link of the first plurality of communication links on which to send a particular packet.

3. The system of claim 2, wherein

each packet sent between the virtual network device and the first network device is sent via only a one of the first plurality of communication links.

4. The system of claim 1, further comprising the first virtual network device sub-unit, wherein

the first virtual network device sub-unit is configured to identify whether a one of the first plurality of communication links is coupled to another virtual network device sub-unit within the virtual network device.

5. The system of claim 1, further comprising the first virtual network device sub-unit and the second virtual network device sub-unit, wherein

the first virtual network device sub-unit and the second virtual network device sub-unit are configured to communicate packets with each other via the virtual network device link.

6. The system of claim 1, wherein

the first plurality of communication links are configured to be managed as a single link.

7. The system of claim 1, wherein

the first virtual network device sub-unit comprises:

a first interface; and

a controller coupled to the first interface and configured to forward packets received via the first interface, wherein

the first interface is identified by a first logical identifier,

a second interface is identified by the first logical identifier,

an interface bundle comprises the first interface and the second interface,

the second interface is comprised in the second virtual network device sub-unit,

the controller is configured to detect whether a third packet was received via the virtual network device link,

a first end of the virtual network device link is configured to be coupled to the first virtual network device sub-unit,

a second end of the virtual network device link is configured to be coupled to the second virtual network device sub-unit, and

the first interface is configured to filter out the third packet from a packet flow being sent via the first interface if the third packet was received via the virtual network device link.

8. The system of claim 7, wherein

the first virtual network device sub-unit is configured to maintain consistent forwarding information with the second virtual network device sub-unit.

9. The system of claim 8, wherein

the controller is configured to perform control protocol processing for the first interface according to a routing protocol running on the interface bundle,

the controller is configured to provide information generated when performing the control protocol processing to a secondary controller comprised in the second virtual network device sub-unit, and

the secondary controller is configured to use the information to manage the second interface.

10. The system of claim 7, wherein

the controller is configured to lookup a destination address of the first packet in a lookup table, and

if the lookup table returns the first logical identifier, the first virtual network device sub-unit is configured to prioritize sending the first packet via the first interface over sending the first packet via the second interface.

11. The system of claim 10, wherein

if the lookup table returns the first logical identifier, the first virtual network device sub-unit is configured to send the first packet via the first interface instead of sending the packet via the second interface, unless one or more of the first interface and a link coupled to the first interface are failed.

12. The system of claim 11, wherein

the first virtual network device sub-unit comprises a plurality of interfaces,

more than one of the interfaces are each comprised in the interface bundle, and

the more than one of the interfaces comprises the first interface.

13. The system of claim 12, wherein

if each respective communication link coupled to the more than one of the interfaces fails, the first virtual network device sub-unit is configured to forward the first packet via the second interface comprised in the second virtual network device sub-unit.

14. The system of claim 7, wherein

the first virtual network device sub-unit is configured to learn that a source address of a second packet is behind the first interface, in response to receiving the second packet via the virtual network device link.

15. The system of claim 1, wherein

the first network device is configured to use a hash-based load-sharing algorithm to select one of the first plurality of communication links comprised in the virtual link bundle, and

the first network device is configured to send a packet via the selected one of the first plurality of communication links.

16. The system of claim 1, wherein

a primary controller comprised in the first virtual network device sub-unit is configured to perform control protocol processing for the first interface according to a routing protocol running on the virtual link bundle,

the primary controller is configured to send information generated by performing the control protocol processing to a secondary controller comprised in the second virtual network device sub-unit, and

the secondary controller is configured to use the information to manage the second interface.

44. The system of claim 1, wherein

the second virtual network device sub-unit is configured to prevent unnecessary traffic over the virtual network device link, and

preventing unnecessary traffic comprises selecting a local interface of a plurality of interfaces associated with the virtual link bundle, wherein

the plurality of interfaces comprises the local interface and a remote interface,

the second virtual network device sub-unit comprises the local interface and the first virtual network device sub-unit comprises the remote interface, and

the selecting comprises generating a hash value for each interface of the plurality of interfaces.

45. The system of claim 1, wherein

the determining that the second packet was received via the virtual network device link comprises examining information in a header of the second packet, and

the information is added to the header by the first virtual network device sub-unit in response to forwarding the second packet via the virtual network device link.

17. A method comprising:

sending a first packet via a first link of a virtual link bundle if a destination identifier associated with the first packet is associated with the virtual link bundle, wherein

the virtual link bundle comprises a first plurality of communication links,

the first plurality of communication links is configured to couple a virtual network device to a first network device external to the virtual network device,

the first virtual network device operates in a distribution layer,

a first end of each of the first plurality of communication links is configured to be coupled to the first network device,

a second end of a first one of the first plurality of communication links is configured to be coupled to a first virtual network device sub-unit within the virtual network device,

a second end of a second one of the first plurality of communication links is configured to be coupled to a second virtual network device sub-unit within the virtual network device,

the first virtual network device sub-unit is coupled to the second virtual network device sub-unit via a virtual network device link,

the first network device comprises a first plurality of ports,

each of the first plurality of ports is configured to communicate packets with a respective client,

the first network device is configured to append a header to the first packet before sending the first packet to the virtual network device via one of the first plurality of communication links, and

the header identifies a one of the first plurality of ports having received the packet,

the first plurality of communication links provides redundant connections between the first network device and the virtual network device; and

sending a second packet via a second link of a second virtual link bundle if a second destination identifier associated with the second packet is associated with the second virtual link bundle, wherein

the second virtual link bundle comprises a second plurality of communication links,

the second plurality of communication links is configured to couple the virtual network device to a second network device external to the virtual network device,

a first end of each of the second plurality of communication links is configured to be coupled to the second network device,

a second end of a first one of the second plurality of communication links is configured to be coupled to the first virtual network device sub-unit within the virtual network device,

a second end of a second one of the second plurality of communication links is configured to be coupled to the second virtual network device sub-unit within the virtual network device,

the second network device comprises a second plurality of ports,

the second plurality of communication links provides redundant connections between the second network device and the virtual network device,

the first network device and the second network device operate in an access layer,

the first network device and the second network device are satellite network devices which do not perform layer two forwarding or layer three routing,

the first plurality of communication links and the second plurality of communication links are uplinks,

the second virtual network device sub-unit is configured to

disable transmission of the second packet via the virtual link bundle in response to determining that the second packet was received via the virtual network device link,

detect a failure of all links of the virtual link bundle coupled to the second virtual network device sub-unit, and

enable transmission of the second packet via the virtual link bundle in response to the failure.

18. The method of claim 17, further comprising:

selecting the first one of the first plurality of communication links comprised in the virtual link bundle, wherein

the selecting comprises performing a hash-based algorithm.

19. The method of claim 17, further comprising:

receiving a third packet, wherein

a destination identifier for the third packet identifies an interface bundle, and

the interface bundle comprises a first interface; and

detecting whether the third packet was received via the virtual network device link, wherein

a first end of the virtual network device link is coupled to the first virtual network device sub-unit,

a second end of the virtual network device link is coupled to the second virtual network device sub-unit;

filtering out the third packet from a packet flow being sent via the first interface if the third packet was received via the virtual network device link.

20. The method of claim 19, further comprising:

sending the third packet via the first interface if the third packet was not received via the virtual network device link.

21. The method of claim 20, further comprising:

maintaining consistency between a lookup table comprised in the first virtual network device sub-unit and a second lookup table comprised in the second virtual network device sub-unit.

22. The method of claim 20, further comprising

performing control protocol processing for the interface bundle at a primary controller comprised in the first virtual network device sub-unit, wherein

the first interface is comprised in the first virtual network device sub-unit.

23. The method of claim 22, further comprising:

managing a second interface of the second virtual network device sub-unit in response to information generated by the performing the control protocol processing, wherein

the second interface is comprised in the interface bundle.

24. The method of claim 23, further comprising:

looking up a destination address of the third packet in a lookup table, and

if the lookup table returns the destination identifier, sending the third packet via the first interface of the first virtual network device sub-unit instead of sending the third packet via the second interface of the second virtual network device sub-unit.

25. The method of claim 19, further comprising:

learning that a source address of the third packet is behind a local interface, in response to receiving the third packet via the virtual network device link.

26. A system comprising:

means for sending a first packet via a first link of a virtual link bundle if a destination identifier associated with the first packet is associated with the virtual link bundle, wherein

the virtual link bundle comprises a first plurality of communication links,

the first plurality of communication links is configured to couple a virtual network device to a first network device external to the virtual network device,

the first virtual network device operates in a distribution layer,

a first end of each of the first plurality of communication links is configured to be coupled to the first network device,

a second end of a first one of the first plurality of communication links is configured to be coupled to a first virtual network device sub-unit within the virtual network device,

a second end of a second one of the first plurality of communication links is configured to be coupled to a second virtual network device sub-unit within the virtual network device,

the first virtual network device sub-unit is coupled to the second virtual network device sub-unit via a virtual network device link,

the first network device comprises a first plurality of ports,

each of the first plurality of ports is configured to communicate packets with a respective client,

the first network device is configured to append a header to the first packet before sending the first packet to the virtual network device via one of the first plurality of communication links, and

the header identifies a one of the first plurality of ports having received the packet,

the first plurality of communication links provides redundant connections between the first network device and the virtual network device; and

means for sending a second packet via a second link of a second virtual link bundle if a second destination identifier associated with the second packet is associated with the second virtual link bundle, wherein

the second virtual link bundle comprises a second plurality of communication links,

the second plurality of communication links is configured to couple the virtual network device to a second network device external to the virtual network device,

a first end of each of the second plurality of communication links is configured to be coupled to the second network device,

a second end of a first one of the second plurality of communication links is configured to be coupled to the first virtual network device sub-unit within the virtual network device,

a second end of a second one of the second plurality of communication links is configured to be coupled to the second virtual network device sub-unit within the virtual network device,

the second network device comprises a second plurality of ports,

the second plurality of communication links provides redundant connections between the second network device and the virtual network device,

the first network device and the second network device operate in an access layer,

the first network device and the second network device are satellite network devices which do not perform layer two forwarding or layer three routing,

the first plurality of communication links and the second plurality of communication links are uplinks,

the second virtual network device sub-unit is configured to

disable transmission of the second packet via the virtual link bundle in response to determining that the second packet was received via the virtual network device link,

detect a failure of all links of the virtual link bundle coupled to the second virtual network device sub-unit, and

enable transmission of the second packet via the virtual link bundle in response to the failure.

27. The system of claim 26, further comprising:

means for selecting the first one of the first plurality of communication links comprised in the virtual link bundle, wherein

the selecting comprises performing a hash-based algorithm.

28. The system of claim 26, further comprising:

means for receiving a third packet, wherein

a destination identifier for the third packet identifies an interface bundle, and

the interface bundle comprises a first interface; and

means for detecting whether the third packet was received via the virtual network device link, wherein

a first end of the virtual network device link is coupled to a first virtual network device sub-unit,

a second end of the virtual network device link is coupled to a second virtual network device sub-unit;

means for filtering out the third packet from a packet flow being sent via the first interface if the third packet was received via the virtual network device link.

29. The system of claim 28, further comprising:

means for sending the third packet via the first interface if the third packet was not received via the virtual network device link.

30. The system of claim 29, further comprising:

means for maintaining consistency between a lookup table comprised in the first virtual network device sub-unit and a second lookup table comprised in the second virtual network device sub-unit.

31. The system of claim 29, further comprising

means for performing control protocol processing for the interface bundle at a primary controller comprised in the first virtual network device sub-unit, wherein

the first interface is comprised in the first virtual network device sub-unit.

32. The system of claim 31, further comprising:

means for managing a second interface of the second virtual network device sub-unit in response to information generated by the performing the control protocol processing, wherein

the second interface is comprised in the interface bundle.

33. The system of claim 32, further comprising:

means for looking up a destination address of the third packet in a lookup table, and

means for sending the third packet via the first interface of the first virtual network device sub-unit instead of sending the third packet via the second interface of the second virtual network device sub-unit if the lookup table returns the destination identifier.

34. The system of claim 28, further comprising:

means for learning that a source address of the third packet is behind a local interface, in response to receiving the third packet via the virtual network device link.

35. A computer readable medium comprising program instructions executable to:

send a first packet via a first link of a virtual link bundle if a destination identifier associated with the first packet is associated with the virtual link bundle, wherein

the virtual link bundle comprises a first plurality of communication links,

the first plurality of communication links is configured to couple a virtual network device to a first network device external to the virtual network device,

the first virtual network device operates in an access layer,

a first end of each of the first plurality of communication links is configured to be coupled to the first network device,

a second end of a first one of the first plurality of communication links is configured to be coupled to a first virtual network device sub-unit within the virtual network device,

a second end of a second one of the first plurality of communication links is configured to be coupled to a second virtual network device sub-unit within the virtual network device,

the first virtual network device sub-unit is coupled to the second virtual network device sub-unit via a virtual network device link,

the first network device comprises a first plurality of ports,

each of the first plurality of ports is configured to communicate packets with a respective client,

the first network device is configured to append a header to the first packet before sending the first packet to the virtual network device via one of the first plurality of communication links, and

the header identifies a one of the first plurality of ports having received the packet,

the first plurality of communication links provides redundant connections between the first network device and the virtual network device; and

send a second packet via a second link of a second virtual link bundle if a second destination identifier associated with the second packet is associated with the second virtual link bundle, wherein

the second virtual link bundle comprises a second plurality of communication links,

the second plurality of communication links is configured to couple the virtual network device to a second network device external to the virtual network device,

a first end of each of the second plurality of communication links is configured to be coupled to the second network device,

a second end of a first one of the second plurality of communication links is configured to be coupled to the first virtual network device sub-unit within the virtual network device,

a second end of a second one of the second plurality of communication links is configured to be coupled to the second virtual network device sub-unit within the virtual network device,

the second network device comprises a second plurality of ports,

the second plurality of communication links provides redundant connections between the second network device and the virtual network device,

the first network device and the second network device operate in an access layer,

the first network device and the second network device are satellite network devices which do not perform layer two forwarding or layer three routing,

the first plurality of communication links and the second plurality of communication links are uplinks,

the second virtual network device sub-unit is configured to

disable transmission of the packet via the virtual link bundle in response to determining that the packet was received via the virtual network device link,

detect a failure of all links of the virtual link bundle coupled to the second virtual network device sub-unit, and

enable transmission of the packet in response to the failure.

36. The computer readable medium of claim 35, wherein the program instructions are further executable to:

select the first one of the first plurality of communication links comprised in the virtual link bundle, wherein

selecting the first one of the first plurality of communication links comprises performing a hash-based algorithm.

37. The computer readable medium of claim 35, wherein the program instructions are further executable to:

detect reception of a third packet, wherein

a destination identifier for the third packet identifies an interface bundle, and

the interface bundle comprises a first interface; and

detect whether the third packet was received via the virtual network device link, wherein

a first end of the virtual network device link is coupled to the first virtual network device sub-unit,

a second end of the virtual network device link is coupled to the second virtual network device sub-unit;

filter out the third packet from a packet flow being sent via the first interface if the third packet was received via the virtual network device link.

38. The computer readable medium of claim 37, wherein the program instructions are further executable to:

send the third packet via the first interface if the third packet was not received via the virtual network device link.

39. The computer readable medium of claim 38, wherein the program instructions are further executable to:

maintain consistency between a lookup table comprised in the first virtual network device sub-unit and a second lookup table comprised in the second virtual network device sub-unit.

40. The computer readable medium of claim 38, wherein the program instructions are further executable to:

perform control protocol processing for the interface bundle at a primary controller comprised in the first virtual network device sub-unit, wherein

the first interface is comprised in the first virtual network device sub-unit.

41. The computer readable medium of claim 40, wherein the program instructions are further executable to:

manage a second interface of the second virtual network device sub-unit in response to information generated by performing the control protocol processing, wherein

the second interface is comprised in the interface bundle.

42. The computer readable medium of claim 41, wherein the program instructions are further executable to:

look up a destination address of the third packet in a lookup table, and

if the lookup table returns the destination identifier, send the third packet via the first interface of the first virtual network device sub-unit instead of sending the packet via the second interface of the second virtual network device sub-unit.

43. The computer readable medium of claim 37, wherein the program instructions are further executable to:

learn that a source address of the third packet is behind a local interface, in response to detecting reception of the third packet via the virtual network device link.