Performing synchronized collective operations over multiple process groups
First Claim
Patent Images
1. A method comprising:
- performing synchronized collective communication operations across a plurality of processing groups simultaneously, wherein the plurality of processing groups are connected together in a network architecture selected from the group consisting of;
2D mesh, 3D torus, and infiniband and wherein each processing group contains a plurality of high performance computing nodes, each of the plurality of nodes occurring in a single processing group, via;
identifying a plurality of characteristics of the network architecture by receiving a call from each of the plurality of nodes, wherein the plurality of characteristics comprises identification of the processing groups via identification of a plurality of sub-communicators and nodes from the plurality of nodes which are connected to each of the plurality of sub-communicators;
constructing, based upon the characteristics of the network architecture, a plurality of communication-efficient bidirectional edge disjoint spanning paths for the plurality of processing groups;
assigning one of the plurality of edge disjoint spanning paths to each processing group, wherein each node is assigned to only one of the plurality of edge disjoint spanning paths and wherein each edge disjoint spanning path comprises only and all nodes assigned to a particular processing group; and
performing synchronized collective communication operations across the plurality of processing groups and reducing communication bottlenecks and preventing contention and interference between communications occurring simultaneously across the plurality of processing groups by routing processing communications for each processing group using only the edge disjoint path assigned to the corresponding processing group.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods and arrangements for performing synchronized collective operations. Communication calls are accepted from at least two distinct processor groups. Edge disjoint spanning paths are created over a collective comprising the processor groups, and the spanning paths are assigned to the processor groups to facilitate communication within each processor group.
-
Citations
11 Claims
-
1. A method comprising:
-
performing synchronized collective communication operations across a plurality of processing groups simultaneously, wherein the plurality of processing groups are connected together in a network architecture selected from the group consisting of;
2D mesh, 3D torus, and infiniband and wherein each processing group contains a plurality of high performance computing nodes, each of the plurality of nodes occurring in a single processing group, via;identifying a plurality of characteristics of the network architecture by receiving a call from each of the plurality of nodes, wherein the plurality of characteristics comprises identification of the processing groups via identification of a plurality of sub-communicators and nodes from the plurality of nodes which are connected to each of the plurality of sub-communicators; constructing, based upon the characteristics of the network architecture, a plurality of communication-efficient bidirectional edge disjoint spanning paths for the plurality of processing groups; assigning one of the plurality of edge disjoint spanning paths to each processing group, wherein each node is assigned to only one of the plurality of edge disjoint spanning paths and wherein each edge disjoint spanning path comprises only and all nodes assigned to a particular processing group; and performing synchronized collective communication operations across the plurality of processing groups and reducing communication bottlenecks and preventing contention and interference between communications occurring simultaneously across the plurality of processing groups by routing processing communications for each processing group using only the edge disjoint path assigned to the corresponding processing group. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
Specification