Message aggregation, combining and compression for efficient data communications in GPU-based clusters
First Claim
Patent Images
1. A processing node comprising:
- a processor configured to generate a plurality of network messages; and
a network operation combiner, wherein in response to an indication that one or more network messages of the plurality of network messages are combinable, the network operation combiner is configured to;
perform a combining operation on a plurality of data elements in the one or more network messages to produce a given result; and
generate a first packed network message comprising the given result in place of the plurality of data elements, wherein the first packed network message includes fewer than all of the data elements in the one or more network messages;
a data compressor configured to replace two or more network messages with a second packed network message responsive to the two or more network messages comprising an indication of a same destination node and one or more data elements in common, the second packed network message comprising an indication of the destination node and a single copy of the one or more data elements in common.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for efficient management of network traffic management of highly data parallel computing. A processing node includes one or more processors capable of generating network messages. A network interface is used to receive and send network messages across a network. The processing node reduces at least one of a number or a storage size of the original network messages into one or more new network messages. The new network messages are sent to the network interface to send across the network.
6 Citations
17 Claims
-
1. A processing node comprising:
-
a processor configured to generate a plurality of network messages; and a network operation combiner, wherein in response to an indication that one or more network messages of the plurality of network messages are combinable, the network operation combiner is configured to; perform a combining operation on a plurality of data elements in the one or more network messages to produce a given result; and generate a first packed network message comprising the given result in place of the plurality of data elements, wherein the first packed network message includes fewer than all of the data elements in the one or more network messages; a data compressor configured to replace two or more network messages with a second packed network message responsive to the two or more network messages comprising an indication of a same destination node and one or more data elements in common, the second packed network message comprising an indication of the destination node and a single copy of the one or more data elements in common. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method comprising:
-
generating a plurality of network messages; wherein in response to an indication that one or more network messages of the plurality of network messages is combinable; performing a combining operation on a plurality of data elements in the one or more network messages to produce a given result; and generating a first packed network message comprising the given result in place of the plurality of data elements, wherein the first packed network message includes fewer than all of the data elements in the one or more network messages; replacing two or more network messages with a second packed network message responsive to the two or more network messages comprising an indication of a same destination node and one or more data elements in common, the second packed network message comprising an indication of the destination node and a single copy of the one or more data elements in common. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computing system comprising:
-
a source node; a network; and a target node coupled to the source node via the network; and wherein the source node is configured to; generate a plurality of network messages; in response to an indication that one or more network messages of the plurality of network messages is combinable; perform a combining operation on a plurality of data elements in the one or more network messages to produce a given result; and generate a first packed network message comprising the given result in place of the plurality of data elements, wherein the first packed network message includes fewer than all of the data elements in the one or more network messages; replace two or more network messages with a second packed network message responsive to the two or more network messages comprising an indication of a same destination node and one or more data elements in common, the second packed network message comprising an indication of the destination node and a single copy of the one or more data elements in common. - View Dependent Claims (16, 17)
-
Specification