Hierarchical skipping method for optimizing data transfer through retrieval and identification of non-redundant components
First Claim
Patent Images
1. A method for selectively transmitting files in whole or in part from a pieces store through a network to a backup apparatus comprising:
- receiving a request into a request buffer,selectively transferring pieces from piece store into a reply buffer, andtransmitting the reply,wherein receiving a request into a request buffer comprises determining whether skip or next are indicated for each piece in the request buffer, if a piece type 1 has a skip indicator, all the type 2 and type 3 pieces for that file associated with the piece type 1 are removed from the piece store, if a piece type 2 has a skip indicator the type 3 piece corresponding to that type 2 piece is removed from the piece store.
3 Assignments
0 Petitions
Accused Products
Abstract
A method for optimizing data transfer through retrieval and identification of non-redundant components. Efficiently packing each network transmission block using sequence search criteria. A hierarchical skipping method. Avoidance of sending undesired pieces. Segmentation of each file and object into a hierarchy of pieces in a plurality of types.
-
Citations
10 Claims
-
1. A method for selectively transmitting files in whole or in part from a pieces store through a network to a backup apparatus comprising:
-
receiving a request into a request buffer, selectively transferring pieces from piece store into a reply buffer, and transmitting the reply, wherein receiving a request into a request buffer comprises determining whether skip or next are indicated for each piece in the request buffer, if a piece type 1 has a skip indicator, all the type 2 and type 3 pieces for that file associated with the piece type 1 are removed from the piece store, if a piece type 2 has a skip indicator the type 3 piece corresponding to that type 2 piece is removed from the piece store. - View Dependent Claims (4, 6, 7, 9, 10)
an object attribute piece and a file metadata piece, wherein the method further comprises the steps following; receiving at least one piece from each thread circuit and loading piece store with type 4 object attributes, type 1 begin file, type 6 file metadata, type 2 file data hash, type 3 file data, whereby a transmission of a file data piece may be skipped if the apparatus determines it is unnecessary by examining one of the higher priority pieces.
-
-
9. The method of claim 1 for operating one of a plurality of heterogeneous user stations further comprising the steps following:
-
within the request reception circuit, receiving from a local area network attached apparatus a skip flag, receiving from a local area network attached apparatus a next piece request, receiving from a local area network attached apparatus an object request; within the piece store extraction circuit, removing from piece store and loading into the reply buffer the highest priority piece of each file or each object, until the reply buffer is full; within the pieces management circuit receiving at least one piece from each thread circuit and loading piece store, in the following priority; firstly, begin file, secondly, file data hash, thirdly, file data; loading into the reply buffer no more than one piece type of each file or each object; within the reply transmission circuit; transmitting a reply buffer to a local area network attached apparatus when the reply buffer is full, transmitting a reply buffer to a local area network attached apparatus when no more pieces may be extracted from the piece store.
-
-
10. The method of claim 9
wherein the pieces further comprise: -
an object attribute piece and file metadata piece, wherein the method further comprises the steps following; receiving at least one piece from each thread circuit and loading piece store, in the following priority; firstly, object attributes secondly, begin file thirdly, file metadata fourthly, file data hash fifthly, file data whereby a transmission of a file data piece may be skipped if the apparatus determines it is unnecessary by examining one of the higher priority pieces.
-
-
2. The method of claim one further comprising
transferring all type 1 pieces from the piece store to the reply buffer, if a piece type 1 has a next indicator in the request buffer, transferring as many type 2 pieces corresponding to that piece type 1 as possible from piece store to the reply buffer, if a piece type 2 has a next indicator in the request buffer, transferring the corresponding piece type 3 from piece store to the reply buffer, if the reply buffer is not full, writing new pieces into the piece store and transferring new pieces into the reply buffer if appropriate, when either the reply buffer or piece store is full, transferring pieces is stopped and the reply is transmitted to the network attached backup apparatus.
-
3. An apparatus comprising
a network adapter, a request buffer, a piece manager, a reply buffer, and a piece store.
-
5. A system for bare metal backup of user disk storage comprising
at least one local area network attached apparatus, coupled to a plurality of heterogeneous user stations, wherein each heterogeneous user station comprises at least one piece store, a piece store extraction circuit, a request reception circuit, a pieces management circuit a reply buffer, and a reply transmission circuit; -
wherein the local area network attached apparatus comprises; means for requesting an object from a local area network attached user station, and means for restoring platform independent data files and data files adapted to a specific user'"'"'s operating system configuration and file system. - View Dependent Claims (8)
-
Specification