System and method for utilizing a data reducing module for dictionary compression of encoded data
First Claim
1. A method for facilitating deduplication in mesh networks using dictionary compression of encoded data to improve bandwidth utilization and scalability, the method implemented by a network traffic management system comprising one or more transmitter devices (TDs), one or more receiver devices (RDs), one or more client devices, or one or more server devices and comprising:
- selecting a first data segment in a received data stream having a universal first identifier and data length information and a corresponding first plurality of content data bytes;
querying a global probabilistic data structure to determine when an RD has a stored copy of the first plurality of content data bytes and the corresponding universal first identifier and data length information for the first data segment, and when the determining indicates that the RD has the stored copy of the universal first identifier and data length information and first plurality of content data bytes for the first data segment;
performing dictionary compression by preparing a first encoded data packet, wherein the first encoded data packet includes the universal first identifier and data length information without the first plurality of content data bytes for the data segment; and
sending the first encoded data packet over a network to the RD to facilitate retrieval of the first plurality of content data bytes associated with the first data segment from the RD'"'"'s data store and decoding of the first data segment to include the first plurality of content data bytes without requiring that the first plurality of content data bytes for the data segment be transmitted over the network.
1 Assignment
0 Petitions
Accused Products
Abstract
A system, medium and method of performing dictionary compression is disclosed. A first data segment received at a receiver device (RD) from a transmiter device (TD) is selected A global bloom filter of the TD is queried to determine if the RD has a stored copy of a first plurality of content data bytes and corresponding first identifier and data length information for the first data segment. A first encoded data packet is prepared and sent which includes the first identifier and data length information without the first plurality of content data bytes. The RD utilizes the received first identifier and data length information to retrieve the first plurality of content data bytes associated with the first data segment from the RD'"'"'s data store and decodes the first data segment to include the first plurality of content data bytes.
374 Citations
20 Claims
-
1. A method for facilitating deduplication in mesh networks using dictionary compression of encoded data to improve bandwidth utilization and scalability, the method implemented by a network traffic management system comprising one or more transmitter devices (TDs), one or more receiver devices (RDs), one or more client devices, or one or more server devices and comprising:
-
selecting a first data segment in a received data stream having a universal first identifier and data length information and a corresponding first plurality of content data bytes; querying a global probabilistic data structure to determine when an RD has a stored copy of the first plurality of content data bytes and the corresponding universal first identifier and data length information for the first data segment, and when the determining indicates that the RD has the stored copy of the universal first identifier and data length information and first plurality of content data bytes for the first data segment; performing dictionary compression by preparing a first encoded data packet, wherein the first encoded data packet includes the universal first identifier and data length information without the first plurality of content data bytes for the data segment; and sending the first encoded data packet over a network to the RD to facilitate retrieval of the first plurality of content data bytes associated with the first data segment from the RD'"'"'s data store and decoding of the first data segment to include the first plurality of content data bytes without requiring that the first plurality of content data bytes for the data segment be transmitted over the network. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A non-transitory computer readable medium having stored thereon instructions for facilitating deduplication in mesh networks using dictionary compression of encoded data to improve bandwidth utilization and scalability comprising executable code, which when executed by at least one processor, causes the at least one processor to:
-
select a first data segment in a received data stream having a universal first identifier and data length information and a corresponding first plurality of content data bytes; query a global probabilistic data structure to determine when a receiver device (RD) has a stored copy of the first plurality of content data bytes and the corresponding universal first identifier and data length information for the first data segment, and when the determining indicates that the RD has the stored copy of the universal first identifier and data length information and first plurality of content data bytes for the first data segment; perform dictionary compression by preparing a first encoded data packet, wherein the first encoded data packet includes the universal first identifier and data length information without the first plurality of content data bytes for the data segment; and send the first encoded data packet over a network to the RD to facilitate retrieval of the first plurality of content data bytes associated with the first data segment from the RD'"'"'s data store and decoding of the first data segment to include the first plurality of content data bytes without requiring that the first plurality of content data bytes for the data segment be transmitted over the network. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A transmitter device (TD) comprising memory comprising programmed instructions stored thereon and one or more processors configured to be capable of executing the stored programmed instructions to:
-
select a first data segment in a received data stream having a universal first identifier and data length information and a corresponding first plurality of content data bytes; query a global probabilistic data structure to determine when a receiver device (RD) has a stored copy of the first plurality of content data bytes and the corresponding universal first identifier and data length information for the first data segment, and when the determining indicates that the RD has the stored copy of the universal first identifier and data length information and first plurality of content data bytes for the first data segment; perform dictionary compression by preparing a first encoded data packet, wherein the first encoded data packet includes the universal first identifier and data length information without the first plurality of content data bytes for the data segment; and send the first encoded data packet over a network to the RD to facilitate retrieval of the first plurality of content data bytes associated with the first data segment from the RD'"'"'s data store and decoding of the first data segment to include the first plurality of content data bytes without requiring that the first plurality of content data bytes for the data segment be transmitted over the network. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. A network traffic management system comprising one or more transmitter devices (TDs), one or more receiver devices (RDs), one or more client devices, or one or more server devices, the system comprising memory comprising programmed instructions stored thereon and one or more processors configured to be capable of executing the stored programmed instructions to:
-
select a first data segment in a received data stream having a universal first identifier and data length information and a corresponding first plurality of content data bytes; query a global probabilistic data structure to determine when an RD has a stored copy of the first plurality of content data bytes and the corresponding universal first identifier and data length information for the first data segment, and when the determining indicates that the RD has the stored copy of the universal first identifier and data length information and first plurality of content data bytes for the first data segment; perform dictionary compression by preparing a first encoded data packet, wherein the first encoded data packet includes the universal first identifier and data length information without the first plurality of content data bytes for the data segment; and send the first encoded data packet over a network to the RD to facilitate retrieval of the first plurality of content data bytes associated with the first data segment from the RD'"'"'s data store and decoding of the first data segment to include the first plurality of content data bytes without requiring that the first plurality of content data bytes for the data segment be transmitted over the network. - View Dependent Claims (20)
-
Specification