Architecture and system for coordinated network-wide redundancy elimination
First Claim
1. An apparatus for reducing redundant network transmissions in a network, the apparatus comprising at least one compressing node and at least a first and second decompressing node along a transmission path from the at least one compressing node, packets from the at least one compressing node passing first through the first decompressing node and then to the second decompressing node, all nodes intercommunicating and spatially separated on the network;
- wherein the at least one compressing node compresses redundant packets and marks them for decompression at different ones of the first and second decompressing nodes to spread the computational task of decompressing redundant packets among the first and second decompressing nodes;
wherein the first decompressing node receives packets marked for decompression by both the first and second decompressing nodes and selectively decompresses the received packets only when a given received packet is marked for decompression by the first decompressing node and performs that decompression before forwarding the given received packet to the second decompressing node.
3 Assignments
0 Petitions
Accused Products
Abstract
A network employing redundancy-aware hardware may actively allocate decompression tasks among different devices along a single path to improve data throughput. The allocation can be performed by a hash or similar process operating on a header of the packets to distribute caching according to predefined ranges of hash values without significant additional communication overhead. Decompression of packets may be similarly distributed by marking shim values to match the earlier caching of antecedent packets. Nodes may use coordinated cache sizes and organizations to eliminate the need for separate cache protocol communications.
-
Citations
15 Claims
-
1. An apparatus for reducing redundant network transmissions in a network, the apparatus comprising at least one compressing node and at least a first and second decompressing node along a transmission path from the at least one compressing node, packets from the at least one compressing node passing first through the first decompressing node and then to the second decompressing node, all nodes intercommunicating and spatially separated on the network;
-
wherein the at least one compressing node compresses redundant packets and marks them for decompression at different ones of the first and second decompressing nodes to spread the computational task of decompressing redundant packets among the first and second decompressing nodes; wherein the first decompressing node receives packets marked for decompression by both the first and second decompressing nodes and selectively decompresses the received packets only when a given received packet is marked for decompression by the first decompressing node and performs that decompression before forwarding the given received packet to the second decompressing node. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 14)
-
-
11. An apparatus for reducing redundant network transmissions in a network, the apparatus comprising at least one compressing node and at least a first and second decompressing node along a transmission path from the at least one compressing node, all nodes intercommunicating and spatially separated on the network;
-
wherein the at least one compressing node compresses redundant packets and marks them for decompression at different ones of the first and second decompressing nodes to spread the computational task of decompressing redundant packets among the first and second decompressing nodes; wherein the first and second decompressing nodes selectively decompress packets according to whether the packets are marked for a particular first or second decompressing node; wherein the first and second decompressing nodes selectively store portions of antecedent packets identified by using a predefined rule based on data in the antecedent packets that allocates storage of the antecedent packets among the first and second decompressing nodes; and wherein the at least one compressing node compresses redundant packets by identifying and excising portions of each given redundant packet that are redundant with a given stored portion of an antecedent packet previously passing through the at least one compressing node and wherein the at least one compressing node marks each given redundant packet for decompression at a given decompressing node previously storing the given stored portion of the antecedent packet according to the predefined rule; and wherein the first decompressing node further communicates with a second compressing node and wherein each of the at least one and second compressing nodes include a storage area for storing portions of antecedent packets marked for storage at the first decompressing node; and wherein the first decompressing node has first and second storage areas equal in size to the storage area of the at least one and second compressing nodes respectively; whereby ejection of stored data caused by overflow of the storage area of the at least one and second compressing nodes causes synchronous ejection of stored data in the respective storage area of the first decompressing node.
-
-
15. An apparatus for reducing redundant data transmissions in a network, the apparatus comprising at least one compressing node and at least a first and second decompressing node connected in series along at least one transmission path from the at least one compressing node, packets from the at least one compressing node passing first through the first decompressing node and then to the second decompressing node, all nodes intercommunicating and spatially separated on the network and operating according to stored programs executed by electronic hardware;
-
wherein the at least one compressing node; (a) receives and stores at least a portion of an antecedent network packet and marks the antecedent network packet for storage of the portion, at one of the first and second decompressing nodes according to a system distributing storage of different network packets from the at least one compressing node among ones of the first and second decompressing nodes; (b) excises at least a portion of a subsequent network packet that is redundant with the stored portion of the antecedent network packet and marking the subsequent network packet for decompression by a same one of the first and second decompressing node as was marked to store the portion of the antecedent network packet; wherein the first decompressing node; (a) receives a given antecedent network packet and stores a portion of the given antecedent network packet as marked by the at least one compressing node for storage by the first decompressing nodes; (b) receives a given subsequent network packet, which is subsequent to the given antecedent network packet; and (c) restores a previously excised portion of the given subsequent network packet from the stored portion of the given antecedent network packet using the stored portion of the given antecedent network packet and then forwards the restored given subsequent network packet to the second decompressing node; and wherein the second decompressing node; (a) receives a second given antecedent network packet from the first decompressing node and stores a portion of the second given antecedent network packet as marked by the at least one compressing node for storage by the second decompressing node; (b) receives a second given subsequent network packet, which is subsequent to the second given antecedent network packet; and (c) restores a previously excised portion of the second given subsequent network packet from the stored portion of the second given antecedent network packet using the stored portion of the second given antecedent network packet.
-
Specification