Switching apparatus and method for providing shared I/O within a load-store fabric

• US 8,102,843 B2
• Filed: 04/19/2004
• Issued: 01/24/2012
• Est. Priority Date: 01/21/2003
• Status: Expired due to Fees

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Emulex Design & Manufacturing Corp. (Broadcom, Inc.)
• Inventors: Pettey, Christopher J., Khan, Asif, Pagan, Annette, Pekkala, Richard E., Utley, Robert Haskell
• Primary Examiner(s): Banks Harold, Marsha D
• Assistant Examiner(s): Wyllie, Christopher
• Application Number:
  US10/827,620
• Publication Number:
  US 20040268015A1
• Time in Patent Office: 2,836 Days
• Field of Search: 370/400, 370/401, 370/463, 370/402, 710/104, 710/307, 710/305, 709/250, 707/100
• US Class Current: 370/362
• CPC Class Codes: H04L 49/602 Multilayer or multiprotocol switching, e.g. IP switching

Abstract

An apparatus and method are provided that enable I/O devices to be shared among multiple operating system domains. The apparatus has a first plurality of I/O ports, a second I/O port, and core logic. The first plurality of I/O ports is coupled to a plurality of operating system domains through a PCI Express fabric. Each of the first plurality of I/O ports is configured to route PCI Express transactions between said plurality of operating system domains and the switching apparatus. The second I/O port is coupled to a first shared input/output endpoint, where the first shared input/output endpoint is configured to request/complete said PCI Express transactions for each of the plurality of operating system domains. The core logic is coupled to the first plurality of I/O ports and the second I/O port. The core logic routes the PCI Express transactions between the first plurality of I/O ports and the second I/O port.

Claims

1. A switching apparatus for sharing input/output endpoints, the switching apparatus comprising:

a first plurality of I/O ports, coupled to a plurality of operating system domains through a PCI Express fabric, each configured to route PCI Express transactions between said plurality of operating system domains and the switching apparatus;

a second I/O port, coupled to a first shared input/output endpoint, wherein said first shared input/output endpoint is configured to request/complete said PCI Express transactions for each of said plurality of operating system domains; and

core logic, coupled to said first plurality of I/O ports and said second I/O port, configured to route said PCI Express transactions between said first plurality of I/O ports and said second I/O port, wherein said core logic is configured to associate each of said PCI Express transactions with a corresponding one of said plurality of operating system domains (OSDs), and wherein said core logic designates said corresponding one of said plurality of OSDs in transmissions to/from said second I/O port according to a variant of PCI Express protocol, and wherein said variant comprises encapsulating an OS domain header within a transaction layer packet that otherwise comports with said PCI Express protocol, and wherein said first shared input/output endpoint designates one of said PCI Express transactions for a particular one of said plurality of operating system domains by encapsulating said OS domain header within said transaction layer packet, and wherein said transaction layer packet is routed to said core logic via said second I/O port, and wherein said core logic is configured to detect and decapsulate said OS domain header from said transaction layer packet, and is configured to route said one of said PCI Express transactions to said particular one of said plurality of operating system domains.

2. The switching apparatus as recited in claim 1, wherein said core logic maps said each of said plurality of operating system domains to a corresponding root complex.

3. The switching apparatus as recited in claim 1, wherein said first shared input/output endpoint is integrated into the switching apparatus.

4. The switching apparatus as recited in claim 1, wherein said first shared input/output endpoint is integrated into a root complex.

5. The switching apparatus as recited in claim 1, wherein said first shared input/output endpoint is integrated into a processing complex.

6. The switching apparatus as recited in claim 1, wherein said transaction layer packet is routed between said second I/O port and said first shared input/output endpoint.

7. The switching apparatus as recited in claim 6, wherein said first shared I/O endpoint is configured to detect said OS domain header and to perform a specified operation according to said PCI Express protocol exclusively for said one of said plurality of OSDs.

8. The switching apparatus as recited in claim 1, wherein said core logic is integrated within a shared I/O switch.

9. The switching apparatus as recited in claim 1, wherein said core logic is integrated within a root complex.

10. The switching apparatus as recited in claim 1, wherein said core logic is integrated within a processing complex.

11. A shared input/output (I/O) switching mechanism, comprising:

core logic, configured to enable operating system domains to share one or more I/O endpoints over a PCI Express fabric, said core logic comprising;

global routing logic, configured to route PCI Express transactions to/from said operating system domains, and for routing PCI Express+transactions to/from said one or more I/O endpoints, wherein each of said PCI Express+transactions designates an associated one of said operating system domains for which an operation specified by each of said PCI Express transactions be performed;

wherein said core logic isolates said PCI Express transactions over a plurality of PCI Express bus hierarchies according to each of said operating system domains, and wherein said PCI Express transactions are routed in accordance with addressing mechanisms for a particular one of said plurality of PCI Express bus hierarchies, said particular one of said plurality of PCI Express bus hierarchies corresponding to said associated one of said operating system domains, and wherein said PCI Express+transactions comport with a variant of the PCI Express protocol, and wherein said variant comprises encapsulating an OS domain header within a transaction layer packet of said each of said PCI Express transactions, and wherein said each of said PCI Express transactions otherwise comports with the PCI Express protocol, and wherein one of said one or more I/O endpoints designates one of said PCI Express+transactions for a particular one of said operating system domains by encapsulating an OS domain header within a transaction layer packet, and wherein said transaction layer packet is routed to the shared I/O switching mechanism, and wherein VMAC logic within the shared I/O switching mechanism is configured to detect and decapsulate said OS domain header from said transaction layer packet, and wherein said core logic routes a corresponding one of said PCI Express transactions to said particular one of said plurality of operating system domains according to the PCI Express protocol, said PCI Express protocol providing exclusively for a single operating system domain within said PCI Express fabric.

12. The shared I/O switching mechanism as recited in claim 11, wherein said core logic associates each of said operating system domains with a corresponding root complex.

13. The shared I/O switching mechanism as recited in claim 11, wherein said transaction layer packet is routed between said the shared I/O switching mechanism and one of said one or more I/O endpoints.

14. The shared I/O switching mechanism as recited in claim 13, wherein said one of said one or more I/O endpoints is configured to detect said OS domain header and to perform said operation according to the PCI Express protocol exclusively for said one of said operating system domains.

15. A method for interconnecting independent operating system domains to a shared I/O endpoint within a PCI Express fabric, comprising:

via first ports, first communicating with each of the independent operating system domains according to the PCI Express protocol;

via a second port, second communicating with the shared I/O endpoint according to a variant of the PCI Express protocol to enable the shared I/O endpoint to associate a prescribed operation with a corresponding one of the independent operating system domains, said second communicating comprising;

employing the variant of the PCI Express protocol to associate a unique root complex that with the corresponding one of the operating system domains, wherein said employing comprises;

encapsulating an OS domain header within a transaction layer packet that otherwise comports with the PCI Express protocol, wherein the value of the OS domain header designates the corresponding one of the operating system domains;

within the shared I/O endpoint, designating a transaction for a particular one of the operating system domains by embedding an OS domain header within a transaction layer packet; and

first transmitting the transaction layer packet to the second port; and

within the switching apparatus, detecting and removing the OS domain header from the transaction layer packet; and

via core logic within a switching apparatus, mapping the independent operating system domains to the shared I/O endpoint, wherein said mapping comprises;

associating each of the independent operating system domains with a corresponding root complex; and

isolating transactions over a plurality of PCI Express bus hierarchies according to each of the operating system domains.

16. The method as recited in claim 15, further comprising:

over the PCI Express fabric, first interconnecting the independent operating system domains to the switching apparatus via the first ports; and

over the PCI Express fabric, second interconnecting the shared I/O endpoint to the switching apparatus via the second port.

17. The method as recited in claim 15, wherein said first communicating comprises:

associating each of the independent operating system domains with a corresponding root complex.

18. The method as recited in claim 15, wherein said second communicating further comprises:

routing the transaction layer packet between the second port and the shared I/O endpoint.

19. The method as recited in claim 18, wherein said second communicating further comprises:

within the I/O endpoint, detecting the OS domain header; and

performing the prescribed operation according to the PCI Express protocol, wherein said performing is accomplished exclusively for the corresponding one of the operating system domains.

20. The method as recited in claim 15, wherein said first communicating comprises:

second transmitting the transaction layer packet to the particular one of the operating system domains according to the PCI Express protocol.