Transmission apparatus for VPN optimization by defragmentation and deduplication and method

• US 8,559,450 B2
• Filed: 06/23/2011
• Issued: 10/15/2013
• Est. Priority Date: 04/10/2009
• Status: Active Grant

• Current Assignee: Barracuda Networks Incorporated
• Original Assignee: Barracuda Networks Incorporated
• Inventors: Ongole, Subrahmanyam, Srinivasan, Sridhar
• Primary Examiner(s): Kizou, Hassan
• Assistant Examiner(s): MAGLO, EMMANUEL K
• Application Number:
  US13/166,808
• Publication Number:
  US 20110249683A1
• Time in Patent Office: 845 Days
• Field of Search: 370/351, 370/252, 370/253, 370/395.53, 370/401, 370/474, 711/103, 711113-134
• US Class Current: 370/401
• CPC Class Codes: H04L 12/4641 Virtual LANs, VLANs, e.g. virtual private networks [VPN] LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272
• CPC Class Codes: H04L 45/745 Address table lookup; Address filtering
• CPC Class Codes: H04L 63/0876 based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint

Abstract

A transmission apparatus for optimizing a virtual private network operates by defragmenting and deduplicating transfer of variable sized blocks. A large data object is converted to a plurality of data paragraphs by a fingerprinting method. Each data paragraph is cached and hashed. The hashes are transmitted to at least one satellite apparatus. Only data paragraphs which are not previously cached at each satellite are transferred.

Claims

1. A transmission apparatus which comprises:

a circuit for generation of a data paragraph, a hash, and a remainder, a satellite cache store, a satellite transfer diary store;

a circuit which packs a plurality of hashes and a remainder into a packet, the circuits communicatively coupled to each other circuit;

a circuit for transmission of a pending transfer;

a circuit which determines when data paragraphs corresponding to hashes are located at primary cache store, and

at least one network interface, the circuits and network interface communicatively coupled to each other.

2. The transmission apparatus of claim 1 wherein the circuit for generation of a data paragraph, a hash, and a remainder is coupled to the satellite cache store whereby a data paragraph is stored corresponding to each hash, and

the circuit for generation of a data paragraph, a hash, and a remainder is coupled to the satellite transfer diary store whereby the reception apparatus, the hash, and the status of the transfer of the data paragraph to the reception apparatus is recorded wherein status comprises a past date or pending, and the circuit for generation of a data paragraph, a hash, and a remainder is coupled to a circuit which packs hashes and a remainder into a data object integration packet addressed to a reception apparatus, whereby duplicative transfer of a data paragraph is avoided if it is already stored at the reception apparatus.

3. The transmission apparatus of claim 1 wherein the circuit for generation of a data paragraph, a hash, and a remainder comprises a circuit to select a string between a minimum length and a maximum length by computing a fingerprint and matching selected bits of the fingerprint to a certain mask by reading from the beginning of a data object or from the end of the previous data paragraph.

4. The transmission apparatus of claim 1 wherein the circuit for generation of a data paragraph, a hash, and a remainder comprises a circuit to compute an SHA1 value on a variable length string.

5. The transmission apparatus of claim 1 wherein the circuit for generation of a data paragraph, a hash, and a remainder comprises a circuit to compute an MD5 value on a variable length string.

6. The transmission apparatus of claim 1 further comprising a circuit

configured to transmit a hash to a satellite apparatus and to receive from the satellite apparatus if the transmission of a data paragraph corresponding to the hash is pending or past and

configured to transmit the data paragraph on the condition that the transmission is pending.

7. The transmission apparatus of claim 1 wherein the circuit which determines a data paragraph computes a low cost fingerprint cumulatively from the start of a string until certain bits of the fingerprint trigger an end of paragraph event and determination of the next paragraph begins.

8. The transmission apparatus of claim 1 wherein the circuit which determines a data paragraph triggers when a maximum size string is reached or a remainder triggers when the end of a data object is reached.

9. The apparatus of claim 3 further comprising:

a data paragraph cache store and

a transfer diary store whereby data paragraphs transmitted from the apparatus can be reused in receiving incoming data objects.