High speed data transfer mechanism
First Claim
1. A method for copying data from a source to a destination using a data pipe, the method comprising:
- identifying at least a first characteristic of a first portion of the data;
identifying at least a second characteristic of a second portion of the data;
copying the first portion of the data through the data pipe in a first chunk in a first format based on the first characteristic;
generating a first header describing the contents of the first chunk, the first header including information relating to at least a first storage operation to be performed on the first chunk;
copying the second portion of the data through the data pipe in a second chunk in a second format based on the second characteristic, the second format being distinct from the first format; and
generating a second header describing the contents of the second chunk, the second header including information relating to at least a second storage operation to be performed on the second chunk.
5 Assignments
0 Petitions
Accused Products
Abstract
A storage and data management system establishes a data transfer pipeline between an application and a storage media using a source data mover and a destination data mover. The data movers are modular software entities which compartmentalize the differences between operating systems and media types. In addition, they independently interact to perform encryption, compression, etc., based on the content of a file as it is being communicated through the pipeline. Headers and chunking of data occurs when beneficial without the application ever having to be aware. Faster access times and storage mapping offer enhanced user interaction.
379 Citations
20 Claims
-
1. A method for copying data from a source to a destination using a data pipe, the method comprising:
-
identifying at least a first characteristic of a first portion of the data; identifying at least a second characteristic of a second portion of the data; copying the first portion of the data through the data pipe in a first chunk in a first format based on the first characteristic; generating a first header describing the contents of the first chunk, the first header including information relating to at least a first storage operation to be performed on the first chunk; copying the second portion of the data through the data pipe in a second chunk in a second format based on the second characteristic, the second format being distinct from the first format; and generating a second header describing the contents of the second chunk, the second header including information relating to at least a second storage operation to be performed on the second chunk. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for copying data from a first storage device to a second storage device, the method comprising:
-
obtaining data from a first storage device; parsing the data into at least a first chunk and a second chunk, said parsing being based on a first characteristic of the data in the first chunk and a second characteristic of the data in the second chunk; generating a first header for the first chunk, the first header being indicative of a first storage operation to be performed on the first chunk; generating a second header for the second chunk, the second header being indicative of a second storage operation to be performed on the second chunk; sending the first header and the first chunk in a first format over a network to a first storage destination; and sending the second header and the second chunk in a second format over the network to a second storage destination. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A system for transferring data between a source storage device and multiple destination storage devices, the system comprising:
-
a source storage device configured to store a piece of data; a plurality of destination storage devices; a first data mover module comprising; a parsing module configured to divide the piece of data into a plurality of chunks based on different characteristics of the data, a header module configured to generate and associate a header with each of the plurality of chunks, each header comprising information regarding a storage operation to be performed on the associated chunk, and a interface module configured to transmit the plurality of chunks over a network; and a second data mover module coupled to the network and configured to receive the plurality of chunks from the network, the second data mover module being further configured to send the plurality of chunks to the plurality of destination storage devices based on the storage operation information stored in each header. - View Dependent Claims (18, 19, 20)
-
Specification