Reliable communications in on-chip networks

• US 8,473,818 B2
• Filed: 10/12/2009
• Issued: 06/25/2013
• Est. Priority Date: 10/12/2009
• Status: Active Grant

• Current Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC), Intellectual Ventures Asia Pte Ltd (Intellectual Ventures LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Mangione-Smith, William H., Mutlu, Onur
• Primary Examiner(s): Lottich, Joshua P
• Assistant Examiner(s): Arcos, Jeison C
• Application Number:
  US12/577,378
• Publication Number:
  US 20110087943A1
• Time in Patent Office: 1,352 Days
• Field of Search: 714/12, 714/27, 714/776, 712/27
• US Class Current: 714/776
• CPC Class Codes: G06F 13/4022 using switching circuits, e.g. switching matrix, connection or expansion network G06F13/4009 takes precedence
• CPC Class Codes: G06F 15/17325 Synchronisation; Hardware support therefor intertask synchronisation G06F9/52
• CPC Class Codes: H04L 1/18 Automatic repetition systems, e.g. Van Duuren systems

Abstract

Techniques for reliable communication in an on-chip network of a multi-core processor are provided. Packets are tagged with tags that define reliability requirements for the packets. The packets are routed in accordance with the reliability requirements. The reliability requirements and routing using them can ensure reliable communication in the on-chip network.

Claims

1. In a multi-core processor having a switch fabric providing communication among a plurality of cores, a method for delivering a packet in the switch fabric, the method comprising:

originating the packet at an originating core included in the plurality of cores, the core including a processor and a network switch, wherein the plurality of cores are the nodes in the switch fabric;

tagging the packet with a tag included as part of the packet, wherein the tag defines a reliability requirement for the packet, wherein the reliability requirement controls delivery of the packet in the switch fabric; and

delivering the packet to a destination core in compliance with the reliability requirement, wherein the reliability requirement enables the switch fabric to dynamically adjust performance of the switch fabric in the delivery of the packet.

2. The method of claim 1,

wherein the reliability requirement includes a bit indicating whether reliable transport is required for the packet in the switch fabric.

3. The method of claim 2, wherein the bit is set by at least one of an application, an operating system, the switch, a processor, or a virtual machine monitor.

4. The method of claim 1, wherein the reliability requirement is applied to at least one of the packets, all packets from a stream of packets in an application, all packets associated with the application, or all packets from the originating core.

5. The method of claim 1, further comprising resending the packet when the packet fails to be delivered to the destination core.

6. The method of claim 5, further comprising resending the packet by at least one of a network switch, a core, or a plurality of network switches and cores in cooperation.

7. The method of claim 1, further comprising responding to a packet failure with an application through an interface with the core.

8. The method of claim 7, further comprising cancelling delivery of the packet according to an age of the packet.

9. The method of claim 8, further comprising replacing the packet with an updated packet.

10. The method of claim 6, wherein a packet failure is asynchronous such that threads can work on other tasks in the multi-core processor and also respond to the packet failure.

11. The method of claim 1, further comprising storing a record of packet delivery failures, wherein the record is used to determine reliability requirements for subsequent packets.

12. A method for routing a packet in a switch fabric, the method comprising:

receiving a packet at a core of a multi-core processor from an originating core, the core including at least a processor and a network switch for routing packets and the packet including a tag as part of the packet;

examining a reliability requirement defined by the tag, wherein the reliability requirement identifies delivery options for the packet in the switch fabric; and

transmitting the packet in the switch fabric to a destination core while complying with the reliability requirement defined by the tag, wherein the core, the originating core and the destination core are part of the nodes in the switch fabric.

13. The method of claim 12, wherein examining a reliability requirement associated with the packet further comprises complying with the reliability requirement.

14. The method of claim 13, wherein the reliability requirement requires storing the packet in a buffer of the core until receipt of the packet is confirmed.

15. The method of claim 13, wherein the reliability requirement requires requesting that the packet be resent in the event of packet failure.

16. The method of claim 12, wherein the reliability requirement requires confirmation of receipt of the packet before transmitting subsequent packets.

17. The method of claim 12, further comprising cancelling the packet according to an age of the packet in the event of packet failure.

18. The method of claim 12, further comprising replacing the packet with an updated packet in the event of packet failure.

19. The method of claim 12, further comprising:

storing data associated with packet failures in the switch fabric; and

adjusting the reliability requirement of subsequent packets based on the data.

20. The method of claim 19, wherein adjusting the reliability requirement comprises mapping delivery tasks to specific cores in the multi-core processor via the switch fabric.

21. A multi-core processor having a switch fabric for routing a packet, the processor comprising:

a plurality of connections;

a plurality of cores connected by the plurality of connections to form the switch fabric, the plurality of cores including an originating core and a destination core, each core including a processor and a network switch, wherein the originating core generates the packet and tags the packet with a tag included as part of the packet, wherein the tag defines a reliability requirement, wherein the packet is delivered to the destination core via the switch fabric according to the reliability requirement, wherein the plurality of cores are the nodes in the switch fabric.

22. The processing device of claim 21, wherein at least one of the originating core, the destination core, or a core in a delivery path of the packet changes settings of the network switch, wherein the settings are defined in the reliability requirement.

23. The processing device of claim 22, wherein the settings include at least one of a clock speed for the network switch or a voltage level for the network switch.

24. The processing device of claim 21, wherein each core in a delivery path of the packet in the switch fabric from the originating core to the destination core evaluates the reliability requirement for compliance.

25. The processing device of claim 24, further comprising storing the packet in a cache of at least one core in the delivery path.