De-duplication Storage System with Multiple Indices for Efficient File Storage
First Claim
Patent Images
1. A computer-accessible storage medium storing program instructions executable to:
- store a first group of one or more indices on a first type of storage device, wherein each index of the first group specifies storage locations of file segments stored in a de-duplication storage system;
store a second group of one or more indices on a second type of storage device, wherein each index of the second group specifies storage locations of file segments stored in the de-duplication storage system;
in response to receiving a first file to be stored in the de-duplication storage system;
split the first file into a plurality of file segments;
use the first group of indices, but not the second group of indices, to attempt to lookup storage locations of the plurality of file segments of the first file;
in response to receiving a request to restore a second file from the de-duplication storage system;
determine that a particular index of the second group of indices specifies storage locations of file segments of the second file; and
use the particular index of the second group of indices to lookup the storage locations of the file segments of the second file in order to restore the second file.
6 Assignments
0 Petitions
Accused Products
Abstract
A de-duplication storage system which uses multiple indices is described. A first group of one or more indices may be stored in random access memory (RAM) or another type of fast storage. A second group of one or more indices may be stored on one or more disk drives or another type of storage where large amounts of data can be stored inexpensively. The first group of indices may be used when adding new files to the de-duplication storage system in order to determine whether the file segments of the new files are already stored. The second group of indices may be used when restoring files in order to lookup the segments of the files.
-
Citations
19 Claims
-
1. A computer-accessible storage medium storing program instructions executable to:
-
store a first group of one or more indices on a first type of storage device, wherein each index of the first group specifies storage locations of file segments stored in a de-duplication storage system; store a second group of one or more indices on a second type of storage device, wherein each index of the second group specifies storage locations of file segments stored in the de-duplication storage system; in response to receiving a first file to be stored in the de-duplication storage system; split the first file into a plurality of file segments; use the first group of indices, but not the second group of indices, to attempt to lookup storage locations of the plurality of file segments of the first file; in response to receiving a request to restore a second file from the de-duplication storage system; determine that a particular index of the second group of indices specifies storage locations of file segments of the second file; and use the particular index of the second group of indices to lookup the storage locations of the file segments of the second file in order to restore the second file. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method comprising:
-
storing a first group of one or more indices on a first type of storage device, wherein each index of the first group specifies storage locations of file segments stored in a de-duplication storage system; storing a second group of one or more indices on a second type of storage device, wherein each index of the second group specifies storage locations of file segments stored in the de-duplication storage system; in response to receiving a first file to be stored in the de-duplication storage system; splitting the first file into a plurality of file segments; using the first group of indices, but not the second group of indices, to attempt to lookup storage locations of the plurality of file segments of the first file; in response to receiving a request to restore a second file from the de-duplication storage system; determining that a particular index of the second group of indices specifies storage locations of file segments of the second file; and using the particular index of the second group of indices to lookup the storage locations of the file segments of the second file in order to restore the second file. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A system comprising:
-
one or more processors; and random access memory storing program instructions; wherein the program instructions are executable by the one or more processors to; store a first group of one or more indices on a first type of storage device, wherein each index of the first group specifies storage locations of file segments stored in a de-duplication storage system; store a second group of one or more indices on a second type of storage device, wherein each index of the second group specifies storage locations of file segments stored in the de-duplication storage system; in response to receiving a first file to be stored in the de-duplication storage system; split the first file into a plurality of file segments; use the first group of indices, but not the second group of indices, to attempt to lookup storage locations of the plurality of file segments of the first file; in response to receiving a request to restore a second file from the de-duplication storage system; determine that a particular index of the second group of indices specifies storage locations of file segments of the second file; and use the particular index of the second group of indices to lookup the storage locations of the file segments of the second file in order to restore the second file. - View Dependent Claims (16, 17, 18, 19)
-
Specification