Chunk compression in a deduplication aware client environment
First Claim
Patent Images
1. A method comprising:
- at a client device comprising a processor and memory, parsing a data stream to identify one or more uncompressed data chunks for transmission to a networked storage system;
identifying an amount of available computing resources at the client device;
when the identified amount of available computing resources meets or exceeds a designated computing resource availability compression threshold, compressing each uncompressed data chunk to produce a respective compressed data chunk, and transmitting each compressed data chunk to the networked storage system via a network for storage at the networked storage system; and
when the identified amount of available computing resources is below the designated computing resource availability compression threshold, encrypting each uncompressed data chunk prior to transmission, and transmitting each encrypted, uncompressed data chunk to the networked storage system via the network;
wherein one or more uncompressed data chunks are identified via a rolling hash parsing technique operable to generate at least some identical chunks when parsing different but overlapping data streams.
23 Assignments
0 Petitions
Accused Products
Abstract
Techniques and mechanisms described herein facilitate the transmission of a data stream to a networked storage system. According to various embodiments, a data stream may be parsed to identify one or more uncompressed data chunks for transmission to a networked storage system. Each uncompressed data chunk may be compressed to produce a respective compressed data chunk. Each compressed data chunk may be transmitted to the networked storage system via a network for storage at the networked storage system.
-
Citations
12 Claims
-
1. A method comprising:
-
at a client device comprising a processor and memory, parsing a data stream to identify one or more uncompressed data chunks for transmission to a networked storage system; identifying an amount of available computing resources at the client device; when the identified amount of available computing resources meets or exceeds a designated computing resource availability compression threshold, compressing each uncompressed data chunk to produce a respective compressed data chunk, and transmitting each compressed data chunk to the networked storage system via a network for storage at the networked storage system; and when the identified amount of available computing resources is below the designated computing resource availability compression threshold, encrypting each uncompressed data chunk prior to transmission, and transmitting each encrypted, uncompressed data chunk to the networked storage system via the network; wherein one or more uncompressed data chunks are identified via a rolling hash parsing technique operable to generate at least some identical chunks when parsing different but overlapping data streams. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A device comprising:
-
memory operable to store one or more uncompressed data chunks for transmission to a networked storage system, the one or more uncompressed data chunks identified by parsing a data stream; a processor operable to identify an amount of available computing resources at the device and; compress each uncompressed data chunk to produce a respective compressed data chunk when the identified amount of available computing resources meets or exceeds a designated computing resource availability compression threshold; and encrypt each uncompressed data chunk prior to transmission when the identified amount of available computing resources is below the designated computing resource availability compression threshold; and a communications interface operable to; transmit, via a network for storage at the networked storage system, each compressed data chunk to the networked storage system when the identified amount of available computing resources meets or exceeds the designated computing resource availability compression threshold; and transmit each encrypted, uncompressed data chunk to the networked storage system via the network when the identified amount of available computing resources is below the designated computing resource availability compression threshold; wherein one or more uncompressed data chunks are identified via a rolling hash parsing technique operable to generate at least some identical chunks when parsing different but overlapping data streams. - View Dependent Claims (10, 11)
-
-
12. One or more non-transitory computer readable media having instructions stored thereon for performing a method, the method comprising:
-
at a client device comprising a processor and memory, parsing a data stream to identify one or more uncompressed data chunks for transmission to a networked storage system; identifying an amount of available computing resources at the client device; when the identified amount of available computing resources meets or exceeds a designated computing resource availability compression threshold, compressing each uncompressed data chunk to produce a respective compressed data chunk; and transmitting each compressed data chunk to the networked storage system via a network for storage at the networked storage system; and when the identified amount of available computing resources is below the designated computing resource availability compression threshold, encrypting each uncompressed data chunk prior to transmission, and transmitting each encrypted, uncompressed data chunk to the networked storage system via the network; wherein one or more uncompressed data chunks are identified via a rolling hash parsing technique operable to generate at least some identical chunks when parsing different but overlapping data streams.
-
Specification