DATA PROCESSING APPARATUS AND METHOD OF PROCESSING DATA
First Claim
1. A data processing apparatus comprising:
- a chunk store containing specimen data chunks,a manifest store containing at least one manifest that represents at least a part of a data set and that comprises at least one reference to at least one of said specimen data chunks,a sparse chunk index containing information on only those specimen data chunks having a predetermined characteristic,at least one processor to;
process input data into input data chunks, anduse the sparse chunk index to identify at least one of said at least one manifest that includes at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks having the predetermined characteristic.
2 Assignments
0 Petitions
Accused Products
Abstract
Data processing apparatus comprising: a chunk store containing specimen data chunks, a manifest store containing at least one manifest that represents at least a part of a data set and that comprises at least one reference to at least one of said specimen data chunks, a sparse chunk index containing information on only those specimen data chunks having a predetermined characteristic, the processing apparatus being operable to process input data into input data chunks and to use the sparse chunk index to identify at least one of said at least one manifest that includes at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks having the predetermined characteristic.
88 Citations
20 Claims
-
1. A data processing apparatus comprising:
-
a chunk store containing specimen data chunks, a manifest store containing at least one manifest that represents at least a part of a data set and that comprises at least one reference to at least one of said specimen data chunks, a sparse chunk index containing information on only those specimen data chunks having a predetermined characteristic, at least one processor to; process input data into input data chunks, and use the sparse chunk index to identify at least one of said at least one manifest that includes at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks having the predetermined characteristic. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A data processing apparatus comprising:
-
a chunk store containing specimen data chunks, a manifest store containing at least one manifest that represents at least a part of a data set and that comprises at least one reference to at least one of said specimen data chunks, a sparse chunk index containing information on only some specimen data chunks, at least one processor to; process input data into input data chunks; identify at least one candidate data chunk from the input data chunks having a predetermined characteristic; select at least one candidate data chunk according to at least one selection criterion to populate the sparse chunk index with information relating to at least one specimen data chunks corresponding to the selected at least one candidate data chunk; and use the sparse chunk index to identify at least one manifest that includes at least one reference to one of said specimen data chunks corresponding to an input data chunk having the predetermined characteristic.
-
-
13. A data processing apparatus comprising:
-
a chunk store configured for containing specimen data chunks, a sparse chunk index, configured for containing information on only some specimen data chunks, at least one processor to; process input data into input data chunks; identify at least one candidate data chunk from the input data chunks having a predetermined characteristic; and select at least one candidate data chunk according to at least one selection criterion to populate the chunk index with information relating to at least one of the specimen data chunks corresponding to the selected at least one candidate data chunk. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A method of processing data comprising:
-
providing a chunk store containing specimen data chunks; providing a manifest store containing at least one manifest that represents at least a part of a data set and that comprises at least one reference to at least one of said specimen data chunks; providing a sparse chunk index containing information on only those specimen data chunks having a chunk identifier having a predetermined characteristic; processing input data into input data chunks; and using the sparse chunk index to identify at least one manifest in the manifest store that includes at least one reference to a said specimen data chunk corresponding to at least one of said input data chunks having a chunk identifier having the predetermined characteristic. - View Dependent Claims (19)
-
-
20. A method of processing data comprising:
-
providing a chunk store configured for containing specimen data chunks; providing a sparse chunk index, configured for containing information on only some specimen data chunks; processing input data into input data chunks; generating a chunk identifier for each input data chunk; identifying at least one candidate data chunk from the input data chunks having a chunk identifier having a predetermined characteristic; and selecting at least one candidate data chunk according to at least one selection criterion to populate the chunk index with information relating to a specimen data chunk corresponding to one of the selected at least one candidate data chunk.
-
Specification