Ordered application message delivery using multiple processors in a network element

• US 7,606,867 B1
• Filed: 06/19/2006
• Issued: 10/20/2009
• Est. Priority Date: 06/21/2005
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Raghavan, Vijay, Agarwal, Anoop, Kothambawala, Juzer, Tran, Luu, Singhal, Pravin
• Primary Examiner(s): NEURAUTER, GEORGE C
• Application Number:
  US11/471,465
• Time in Patent Office: 1,219 Days
• Field of Search: 709/209, 709/238, 712/31
• US Class Current: 709/209
• CPC Class Codes: G06F 2221/2141 Access rights, e.g. capability lists, access control lists, access tables, access matrices
• CPC Class Codes: G06F 8/656 while running
• CPC Class Codes: H04L 41/026 using e-messaging for transporting management information, e.g. email, instant messaging or chat
• CPC Class Codes: H04L 41/06 Management of faults, events, alarms or notifications
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 41/5003 Managing SLA; Interaction between SLA and QoS
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 41/5012 determining service availability, e.g. which services are available at a certain point in time
• CPC Class Codes: H04L 41/5096 wherein the managed service relates to distributed or central networked applications
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 45/00 Routing or path finding of packets in data switching networks routing or path finding in wireless networks H04W40/00
• CPC Class Codes: H04L 45/56 Routing software
• CPC Class Codes: H04L 45/563 Software download or update
• CPC Class Codes: H04L 63/0245 Filtering by information in the payload
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/102 Entity profiles
• CPC Class Codes: H04L 63/12 : Applying verification of the received information cryptographic mechanisms or cryptographic arrangements for data integrity or data verification H04L9/32
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/34 : involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 69/22 : Parsing or analysis of headers
• CPC Class Codes: H04L 9/40 : Network security protocols

Abstract

A data processing apparatus comprises a plurality of processors and message processing logic operable for establishing one of the processors as a master processor and all other processors as slave processors; receiving an application message from a particular message source among a plurality of message sources coupled to one or more network interfaces and the processors, wherein the application message comprises one or more data frames, packets and segments; granting exclusive control of the particular message source to a selected one of the slave processors; assigning an ordered sequence number to the application message; granting exclusive control, for a particular message destination among a plurality of message destinations coupled to the network interfaces and the processors, to the selected one of the slave processors; and providing the application message to the particular message destination.

Claims

1. A data processing apparatus, comprising:

a plurality of processors;

message processing logic which when executed by one or more of the processors is operable to perform;

establishing one of the processors as a master processor and all other processors as slave processors, wherein the establishing one of the processors as a master processor and all other processors as slave processors is performed using Web Cache Control Protocol (WCCP);

receiving an application message from a particular message source among a plurality of message sources coupled to one or more network interfaces and the processors, wherein the application message comprises one or more data frames, packets and segments;

granting exclusive control of the particular message source to a selected one of the slave processors;

assigning an ordered sequence number to the application message;

granting exclusive control, for a particular message destination among a plurality of message destinations coupled to the network interfaces and the processors, to the selected one of the slave processors; and

providing the application message to the particular message destination.

2. An apparatus as recited in claim 1, wherein the selected one of the slave processors yields exclusive control of the particular message source to the master processor after processing a specified plurality of messages.

3. An apparatus as recited in claim 1, wherein the selected one of the slave processors yields exclusive control of the particular message source to the master processor after processing a specified time period.

4. An apparatus as recited in claim 1, wherein the message processing logic further comprises logic which when executed by the processors is operable to perform:

persistently storing information identifying the assigned ordered sequence number of the application message;

determining that the selected one of the slave processors has failed;

selecting a different one of the slave processors;

granting exclusive control of the particular message source to the selected different one of the slave processors;

retrieving, at the selected different one of the slave processors, the stored information identifying the assigned ordered sequence number of the application message;

receiving a new application message;

assigning a new sequence number to the new application message by increasing the assigned ordered sequence number that was retrieved.

5. An apparatus as recited in claim 1, wherein the message processing logic further comprises logic which when executed by the processors is operable to perform:

persistently storing information identifying which selected one of the slave processors has been granted exclusive control of the particular message source;

determining that the master processor has failed;

establishing a different one of the processors as a new master processor;

retrieving, at the new master processor, the stored information identifying which selected one of the slave processors has been granted exclusive control of the particular message source.

6. An apparatus as recited in claim 1, wherein the message processing logic further comprises logic which when executed by the processors is operable to perform:

receiving the application message and its sequence number from the selected one of the slave processors;

determining whether the sequence number is next in order after a previous sequence number of a previously sent message;

providing the application message to the particular message destination only when the sequence number is ordered sequentially after a previous sequence number of a previously sent message.

7. An apparatus as recited in claim 1, wherein the message processing logic further comprises logic which when executed by the processors is operable to perform, at the master processor:

receiving a first application message and a first sequence number from a first one of the slave processors that has processed messages for a particular message source;

receiving a second application message and a second sequence number from a second one of the slave processors that has processed messages for the same particular message source;

determining whether the first sequence number is next in order after a previous sequence number of a previously sent message;

providing the first application message to the particular message destination if the first sequence number is next in order after the previous sequence number of the previously sent message, and otherwise;

determining whether the second sequence number is next in order after the previous sequence number of the previously sent message;

providing the second application message to the particular message destination when the second sequence number is next in order after the previous sequence number of the previously sent message.

8. An apparatus as recited in claim 1, wherein the message processing logic further comprises logic which when executed by the processors is operable to perform, at the master processor:

receiving a first request for exclusive access to the particular message destination, a first application message and a first sequence number from a first one of the slave processors that has processed messages for a particular message source;

receiving a second request for exclusive access to the particular message destination, a second application message and a second sequence number from a second one of the slave processors that has processed messages for the same particular message source;

determining whether the first sequence number is next in order after a previous sequence number of a previously sent message;

granting exclusive control of the particular message destination to the first one of the slave processors only when the first sequence number is next in order after a previous sequence number of a previously sent message.

9. An apparatus as recited in claim 1, wherein the message processing logic further comprises logic which when executed by the processors is operable to perform:

in response to providing the application message to the particular message destination, persistently storing information identifying the assigned ordered sequence number of the application message in association with information identifying the particular message destination;

receiving a request for exclusive access to the particular message destination, a new application message and its sequence number from the selected one of the slave processors;

retrieving the persistently stored information identifying the assigned ordered sequence number of the application message for the particular message destination;

determining whether the sequence number is next in order after the retrieved sequence number;

providing the application message to the particular message destination only when the sequence number is next in order after the retrieved sequence number.

10. An apparatus as recited in claim 1, comprising any of a router for a packet data network and a switch for a packet data network.

11. An apparatus as recited in claim 1, comprising a switching system coupled to the processors and comprising packet forwarding logic, wherein the switching system and packet forwarding logic are configured to receive packets on a first network interface, determine a second network interface on which to send the packets, and to send the packets on the second network interface.

12. An apparatus as recited in claim 1, wherein the application message is of OSI Layer 4, 5, or 6 and comprises one or more data frames, packets and segments of OSI Layer 1, 2 and 3.

13. A data processing apparatus, comprising:

a plurality of processors;

means for establishing one of the processors as a master processor and all other processors as slave processors, wherein the means for establishing one of the processors as a master processor and all other processors as slave processors comprises Web Cache Control Protocol (WCCP);

means for receiving an application message from a particular message source among a plurality of message sources coupled to one or more network interfaces and the processors, wherein the application message comprises one or more data frames, packets and segments;

means for granting exclusive control of the particular message source to a selected one of the slave processors;

means for assigning an ordered sequence number to the application message;

means for granting exclusive control, for a particular message destination among a plurality of message destinations coupled to the network interfaces and the processors, to the selected one of the slave processors; and

means for providing the application message to the particular message destination.

14. An apparatus as recited in claim 13, comprising means for the selected one of the slave processors to yield exclusive control of the particular message source to the master processor after processing a specified plurality of messages.

15. An apparatus as recited in claim 13, wherein comprising means for the selected one of the slave processors to yield exclusive control of the particular message source to the master processor after processing a specified time period.

16. An apparatus as recited in claim 13, further comprising:

means for persistently storing information identifying the assigned ordered sequence number of the application message;

means for determining that the selected one of the slave processors has failed;

means for selecting a different one of the slave processors;

means for granting exclusive control of the particular message source to the selected different one of the slave processors;

means for retrieving, at the selected different one of the slave processors, the stored information identifying the assigned ordered sequence number of the application message;

means for receiving a new application message;

means for assigning a new sequence number to the new application message by increasing the assigned ordered sequence number that was retrieved.

17. An apparatus as recited in claim 13, further comprising:

means for persistently storing information identifying which selected one of the slave processors has been granted exclusive control of the particular message source;

means for determining that the master processor has failed;

means for establishing a different one of the processors as a new master processor;

means for retrieving, at the new master processor, the stored information identifying which selected one of the slave processors has been granted exclusive control of the particular message source.

18. An apparatus as recited in claim 13, further comprising:

means for receiving the application message and its sequence number from the selected one of the slave processors;

means for determining whether the sequence number is next in order after a previous sequence number of a previously sent message;

means for providing the application message to the particular message destination only when the sequence number is ordered sequentially after a previous sequence number of a previously sent message.

19. An apparatus as recited in claim 13, further comprising:

means for receiving a first application message and a first sequence number from a first one of the slave processors that has processed messages for a particular message source;

means for receiving a second application message and a second sequence number from a second one of the slave processors that has processed messages for the same particular message source;

means for determining whether the first sequence number is next in order after a previous sequence number of a previously sent message;

means for providing the first application message to the particular message destination if the first sequence number is next in order after the previous sequence number of the previously sent message;

means for determining whether the second sequence number is next in order after the previous sequence number of the previously sent message and for providing the second application message to the particular message destination when the second sequence number is next in order after the previous sequence number of the previously sent message.

20. An apparatus as recited in claim 13, further comprising:

means for receiving a first request for exclusive access to the particular message destination, a first application message and a first sequence number from a first one of the slave processors that has processed messages for a particular message source;

means for receiving a second request for exclusive access to the particular message destination, a second application message and a second sequence number from a second one of the slave processors that has processed messages for the same particular message source;

means for determining whether the first sequence number is next in order after a previous sequence number of a previously sent message;

means for granting exclusive control of the particular message destination to the first one of the slave processors only when the first sequence number is next in order after a previous sequence number of a previously sent message.

21. An apparatus as recited in claim 13, further comprising:

means for persistently storing information identifying the assigned ordered sequence number of the application message in association with information identifying the particular message destination in response to providing the application message to the particular message destination;

means for receiving a request for exclusive access to the particular message destination, a new application message and its sequence number from the selected one of the slave processors;

means for retrieving the persistently stored information identifying the assigned ordered sequence number of the application message for the particular message destination;

means for determining whether the sequence number is next in order after the retrieved sequence number;

means for providing the application message to the particular message destination only when the sequence number is next in order after the retrieved sequence number.

22. An apparatus as recited in claim 13, comprising any of a router for a packet data network and a switch for a packet data network.

23. An apparatus as recited in claim 13, comprising a switching system coupled to the processors and comprising packet forwarding logic, wherein the switching system and packet forwarding logic are configured to receive packets on a first network interface, determine a second network interface on which to send the packets, and to send the packets on the second network interface.

24. An apparatus as recited in claim 13, wherein the application message is of OSI Layer 4, 5, or 6 and comprises one or more data frames, packets and segments of OSI Layer 1, 2 and 3.

25. A computer-implemented method, comprising:

establishing one of a plurality of processors as a master processor and all other processors as slave processors, wherein the establishing of one of the processors as a master processor and all other processors as slave processors is performed using Web Cache Control Protocol (WCCP);

receiving an application message from a particular message source among a plurality of message sources coupled to one or more network interfaces and the processors, wherein the application message comprises one or more data frames, packets and segments;

granting exclusive control of the particular message source to a selected one of the slave processors;

assigning an ordered sequence number to the application message;

granting exclusive control, for a particular message destination among a plurality of message destinations coupled to the network interfaces and the processors, to the selected one of the slave processors; and

providing the application message to the particular message destination.

26. A method as recited in claim 25, wherein the selected one of the slave processors yields exclusive control of the particular message source to the master processor after processing a specified plurality of messages.

27. A method as recited in claim 25, wherein the selected one of the slave processors yields exclusive control of the particular message source to the master processor after processing a specified time period.

28. A method as recited in claim 25, further comprising:

persistently storing information identifying the assigned ordered sequence number of the application message;

determining that the selected one of the slave processors has failed;

selecting a different one of the slave processors;

granting exclusive control of the particular message source to the selected different one of the slave processors;

retrieving, at the selected different one of the slave processors, the stored information identifying the assigned ordered sequence number of the application message;

receiving a new application message;

assigning a new sequence number to the new application message by increasing the assigned ordered sequence number that was retrieved.

29. A method as recited in claim 25, further comprising:

persistently storing information identifying which selected one of the slave processors has been granted exclusive control of the particular message source;

determining that the master processor has failed;

establishing a different one of the processors as a new master processor;

retrieving, at the new master processor, the stored information identifying which selected one of the slave processors has been granted exclusive control of the particular message source.

30. A method as recited in claim 25, further comprising:

receiving the application message and its sequence number from the selected one of the slave processors;

determining whether the sequence number is next in order after a previous sequence number of a previously sent message;

providing the application message to the particular message destination only when the sequence number is ordered sequentially after a previous sequence number of a previously sent message.

31. A method as recited in claim 25, further comprising:

receiving a first application message and a first sequence number from a first one of the slave processors that has processed messages for a particular message source;

receiving a second application message and a second sequence number from a second one of the slave processors that has processed messages for the same particular message source;

determining whether the first sequence number is next in order after a previous sequence number of a previously sent message;

providing the first application message to the particular message destination if the first sequence number is next in order after the previous sequence number of the previously sent message, and otherwise;

determining whether the second sequence number is next in order after the previous sequence number of the previously sent message;

providing the second application message to the particular message destination when the second sequence number is next in order after the previous sequence number of the previously sent message.

32. A method as recited in claim 25, further comprising:

receiving a first request for exclusive access to the particular message destination, a first application message and a first sequence number from a first one of the slave processors that has processed messages for a particular message source;

receiving a second request for exclusive access to the particular message destination, a second application message and a second sequence number from a second one of the slave processors that has processed messages for the same particular message source;

determining whether the first sequence number is next in order after a previous sequence number of a previously sent message;

granting exclusive control of the particular message destination to the first one of the slave processors only when the first sequence number is next in order after a previous sequence number of a previously sent message.

33. A method as recited in claim 25, further comprising:

in response to providing the application message to the particular message destination, persistently storing information identifying the assigned ordered sequence number of the application message in association with information identifying the particular message destination;

receiving a request for exclusive access to the particular message destination, a new application message and its sequence number from the selected one of the slave processors;

retrieving the persistently stored information identifying the assigned ordered sequence number of the application message for the particular message destination;

determining whether the sequence number is next in order after the retrieved sequence number;

providing the application message to the particular message destination only when the sequence number is next in order after the retrieved sequence number.

34. A method as recited in claim 25, wherein the computer implementing the method comprises any of a router for a packet data network and a switch for a packet data network.

35. A method as recited in claim 25, wherein the computer implementing the method comprises a switching system coupled to the processors and comprising packet forwarding logic, wherein the switching system and packet forwarding logic are configured to receive packets on a first network interface, determine a second network interface on which to send the packets, and to send the packets on the second network interface.

36. A method as recited in claim 25, wherein the application message is of OSI Layer 4, 5, or 6 and comprises one or more data frames, packets and segments of OSI Layer 1, 2 and 3.