Bridging mechanism for peer-to-peer communication

• US 8,463,881 B1
• Filed: 09/27/2008
• Issued: 06/11/2013
• Est. Priority Date: 10/01/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Baker, Paul A., Murphy, Michael W., Whitby-Strevens, Colin, Ferguson, David, Diefendorff, Keith, Cornelius, William, Anderson, Eric Werner, Hochsprung, Ron
• Primary Examiner(s): Patel, Dhairya A
• Application Number:
  US12/239,743
• Time in Patent Office: 1,718 Days
• Field of Search: 709/204, 709/205, 709/206, 709/207, 709/208, 709/209, 709/211, 709/220, 709/221, 709/222, 709/227, 709/228, 709/229, 709/249
• US Class Current: 709/220
• CPC Class Codes: G06F 13/4027 using bus bridges G06F13/4022 takes precedence
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A high-speed optical interface for connecting computers to external I/O devices allows a number of native I/O formats to be encapsulated into PCIe Vendor Defined Messages (“VDMs”) for transfer over a single physical medium, preferably optical, and is thus referred to as the converged I/O (“CIO”) interface. Standard PCIe bridges are modified to support peer-to-peer communications, allowing greater exploitation of the capabilities of PCIe.

Claims

1. A method comprising:

determining, by a computer system in a first domain, that a peer-to-peer connection is to be made between the first domain and a second domain alien to the first domain, wherein the first domain is not yet connected to the second domain;

sending, by the computer system, a request to the second domain for a first set of domain numbers, the first set having a size equal to one more than a number N1 of alien domains currently connected to the first domain, the number N1 of alien domains not including the second domain;

receiving, by the computer system, the first set of domain numbers from the second domain;

associating, by the computer system, a domain number in the first set of domain numbers with a domain number stored in a local list of domain numbers, the local list of domain numbers being specific to the first domain;

receiving, by the computer system, a request from the second domain for a second set of domain numbers, the second set having a size equal to one more than a number N2 of alien domains currently connected to the second domain, the number N2 of alien domains not including the first domain;

generating, by the computer system, the second set of domain number from a pool of available domain numbers; and

sending, by the computer system, the second set of domain numbers to the second domain;

wherein each domain number in the first and second sets of domain numbers identifies a Peripheral Component Interconnect Express (PCIe) hierarchy with a single PCIe root element.

2. The method of claim 1 wherein each domain number in the first and second sets of domain numbers is used to form the most significant bits of an address value.

3. The method of claim 2 wherein the address value is a PCIe address value.

4. The method of claim 1 further comprising:

sending a message from the first domain to the second domain, the message being encoded as a PCIe vendor defined message (VDM).

5. The method of claim 1 wherein each of the first and second domains is a PCIe hierarchy with a single PCIe Root Element.

6. The method of claim 1 wherein each of the first and second domains is a self-contained system that includes a host and a CIO network.

8. The method of claim 1 wherein the peer-to-peer connection is to be made through a port of a router in the first domain, and wherein the determining comprises probing for a new endpoint at a second function of the port.

7. A method comprising:

storing, by a computer system in a first domain, a set of virtual domain numbers local to the first domain and corresponding to a first set of alien domains directly connected to the first domain and a second set of alien domains connected to the first set of alien domains;

receiving, by the computer system on a port of a router in the first domain, a message from an alien domain in the first or second sets of alien domains, the message specifying an originating domain number and a target domain number;

translating, by the computer system, the originating domain number and the target domain number using the set of virtual domain numbers, wherein the translated originating domain number is relative to a domain receiving the message and the translated target domain number is relative to domain sending the translated message; and

forwarding, by the computer system, the translated message to a destination other than the alien domain in the first or second sets of alien domains from which the message was received,

wherein each domain number is the set of virtual domain numbers identifies a Peripheral Component Interconnect Express (PCIe) hierarchy with a single PCIe root element.

9. The method of claim 7 wherein the method further comprises translating a request identifier included in the message based on bus, device and function fields associated with the port.

10. The method of claim 7 wherein each of the first and second domains is a PCIe hierarchy with a single PCIe Root Element.

11. The method of claim 7 wherein each of the first and second domains is a self-contained system that includes a host and a CIO network.

12. A computer system configured to operate in a first domain, the computer system comprising:

a hardware processor configured to;

determine that a peer-to-peer connection is to be made between the first domain and a second domain alien to the first domain, wherein the first domain is not yet connected to the second domain;

send a request to the second domain for a first set of domain numbers, the first set having a size equal to one more than a number N1 of alien domains currently connected to the first domain, the number N1 of alien domains not including the second domain;

receive the first set of domain numbers from the second domain;

associate a domain number in the first set of domain numbers with a domain number stored in a local list of domain numbers, the local list of domain numbers being specific to the first domain;

receive a request from the second domain for a second set of domain numbers, the second set having a size equal to one more than a number N2 of alien domains currently connected to the second domain, the number N2 of alien domains not including the first domain;

generate the second set of domain numbers from a pool of available domain numbers; and

send the second set of domain numbers to the second domain, wherein each domain number in the first and second sets of domain numbers identifies a Peripheral Component Interconnect Express (PCIe) hierarchy with a single PCIe root element.

13. The computer system of claim 12 wherein the first domain and the second domain are PCIe hierarchies.

14. The system of claim 12 wherein the first domain is a PCIe hierarchy with a single PCIe Root Element.

15. The system of claim 14 wherein the first domain includes one or more CIO routers and endpoints connected to the PCIe root element.

16. The system of claim 14 wherein the first domain is a self-contained system that includes a host and a CIO network.

17. A computer system configured to operate in a first domain, the computer system comprising:

a storage device configured to store a set of virtual domain numbers local to the first domain and corresponding to a first set of alien domains directly connected to the first domain and a second set of alien domains connected to the first set of alien domains; and

a hardware processor configured to;

receive on a port of a router in the first domain, a message from an alien domain in the first or second sets of alien domains, the message specifying an originating domain number and a target domain number;

translate the originating domain number and the target domain number using the set of virtual domain numbers, wherein the translated originating domain number is relative to a domain receiving the message and the translated target domain number is relative to domain sending the translated message; and

forward the translated message to a destination other than the alien domain in the first or second sets of alien domains from which the message was received,

wherein each domain number is the set of virtual domain numbers identifies a Peripheral Component Interconnect Express (PCIe) hierarchy with a single PCIe root element.

18. The system of claim 17 wherein the first domain is a PCIe hierarchy with a single PCIe Root Element.

19. The system of claim 18 wherein the first domain includes one or more CIO routers and endpoints connected to the PCIe root element.

20. The system of claim 19 wherein the first domain is a self-contained system that includes a host and a CIO network.