DATA PROCESSING APPARATUS AND METHOD OF PROCESSING DATA
First Claim
1. A data processing apparatus comprising:
- a chunk store containing specimen data chunks,a manifest store containing a plurality of manifests, each of which represents at least a part of a data set and each of which comprises at least one reference to at least one of said specimen data chunks,a sparse chunk index containing information on only some specimen data chunks,at least one processor to;
process input data into input data chunks;
identify manifests having at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks and on which there is information contained in the sparse chunk index; and
prioritize the identified manifests for subsequent operation.
2 Assignments
0 Petitions
Accused Products
Abstract
Data processing apparatus comprising: a chunk store containing specimen data chunks, a manifest store containing a plurality of manifests, each of which represents at least a part of a data set and each of which comprises at least one reference to at least one of said specimen data chunks, a sparse chunk index containing information on only some specimen data chunks, the processor being operable to: process input data into input data chunks; identify manifests having at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks and on which there is information contained in the sparse chunk index; and prioritize the identified manifests for subsequent operation.
-
Citations
20 Claims
-
1. A data processing apparatus comprising:
-
a chunk store containing specimen data chunks, a manifest store containing a plurality of manifests, each of which represents at least a part of a data set and each of which comprises at least one reference to at least one of said specimen data chunks, a sparse chunk index containing information on only some specimen data chunks, at least one processor to; process input data into input data chunks;
identify manifests having at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks and on which there is information contained in the sparse chunk index; andprioritize the identified manifests for subsequent operation. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A data processing apparatus comprising:
at least one processor to; prioritize manifests that include at least one reference to a specimen data chunk in a chunk store corresponding to at least one input data chunk that has information about it contained in a sparse chunk index and that belongs to an input data set; prioritize the identified manifests for subsequent operation according to the number of said corresponding specimen data chunks referenced by each of them. - View Dependent Claims (16)
-
17. A data processing apparatus, comprising:
-
a chunk store containing specimen data chunks; a manifest store containing manifests, each of which represents at least a part of a data set and comprise at least one reference to at least one of said specimen data chunks; a sparse chunk index containing information on only some specimen data chunks; and at least one processor to; process input data into input data chunks;
identify at least one manifest having at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks and on which there is information contained in the sparse chunk index;prioritize the identified manifests for subsequent operation; and subsequently manage the information contained in the sparse chunk index.
-
-
18. A method of processing data, comprising:
-
providing a chunk store containing specimen data chunks; providing a manifest store containing manifests representing at least a part of a data set, each manifest comprising at least one reference to at least one of said specimen data chunks; and providing a sparse chunk index containing information on only some specimen data chunks; processing input data into input data chunks; and identifying and prioritising manifests having at least one reference to one of said specimen data chunks that corresponds to one of said input data chunks and on which there is information contained in the sparse chunk index. - View Dependent Claims (19)
-
-
20. A method of data processing, comprising:
-
identifying manifests which include at least one reference to a specimen data chunk in a chunk store corresponding to at least one input data chunk that has information about it contained in a sparse chunk index and that belongs to an input data set; and prioritizing the identified manifests for subsequent operation according to the number of corresponding specimen data chunks referenced therein.
-
Specification