Storing a variable number of instances of data objects

• US 9,773,025 B2
• Filed: 03/19/2013
• Issued: 09/26/2017
• Est. Priority Date: 03/30/2009
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Muller, Marcus S., Attarde, Deepak Raghunath, Vijayan, Manoj Kumar
• Primary Examiner(s): Beausoliel, Jr., Robert
• Assistant Examiner(s): Bromell, Alexandria
• Application Number:
  US13/847,359
• Publication Number:
  US 20130218842A1
• Time in Patent Office: 1,652 Days
• Field of Search: 707640
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

Described are systems and methods for storing a variable number of instances of data objects (e.g., 1, 2, 3, or up to N−1 instances, where N is the number of instances of the data object included in primary data) in secondary storage across a data storage network. In some examples, a system for storing a variable number of instances of data objects includes, one or more computing devices storing a set of data objects and multiple storage devices distinct from the one or more computing devices. Each of the multiple storage devices is configured to store at least a single instance of a data object. The system also includes a database configured to store information associated with the data objects. This information includes substantially unique identifiers for the data objects and, for each of the data objects, a number of instances of the data object stored on the multiple storage devices.

Claims

1. A system for storing multiple instances of a data object in a data storage network, wherein the data storage network includes data storage devices coupled via a computer network, and wherein the computer network also couples to a computer storing a primary copy of data that includes a first set of N number of the same data objects, the system comprising:

multiple data storage devices, wherein each of the multiple storage devices is distinct from, and coupled via the computer network to, the computer;

a variable instance database configured to store information associated with secondary copies of the data that includes a second set of reduced instanced data objects, wherein the information includes, for each data object of the reduced instanced data objects of the second set;

a unique identifier generated for the reduced instanced data object, and

a number of instances of the reduced instanced data object, to store for the reduced instanced data object that is based on a classification assigned to the reduced instanced data object,

wherein the number of instances of the reduced instanced data object is less than the N number of instances of the data object stored in the primary copy of data,

wherein at least one of the reduced instanced data objects of the second set has multiple instances stored among the multiple storage devices, and

wherein a pointer is stored in the variable instance database, to a storage location for each instance of the reduced instanced data object;

a secondary storage computing device that includes a processor and is configured to;

receive an indication to perform a storage operation on the primary copy of the data, including the first set of N number of the same data objects, where N is a number greater than 3,

wherein the indication specifies that fewer than N instances but greater than one instance of the N number of data objects of the first set are to be stored, and

wherein each of the data objects of the first set are to be stored on a distinct one of the multiple storage devices;

generate a unique identifier for each of the N number of data objects of the first set;

access the variable instance database and for the N number of data objects of the first set, use the generated unique identifier and the number of instances to store based on the classification assigned to the reduced instanced data object to determine the fewer than N instances but greater than one instance to store for the first set of N number of data objects; and

store the fewer than N instances of the data object but greater than one instance of the data object on the multiple storage devices.

2. The system of claim 1,

wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies a number of copies to store as selected by an administrator,

wherein the data storage network includes at least two different hierarchical tiers and at least two of the storage devices respectively reside in the two hierarchical tiers,

wherein storing the fewer than N instances but greater than one instance of the data object on the multiple storage devices includes storing two instances of the data object on the two storage devices respectively residing in the two hierarchical tiers, and

wherein the secondary storage computing device is further configured to identify the N data objects of the first set before generating the substantially unique identifier for each of the N number of data objects of the first set.

3. The system of claim 1 wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies at least one of the multiple storage devices on which to store an instance of the one data object.

4. The system of claim 1 wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies that the multiple storage devices on which to store instances of the data object are to be dynamically determined.

5. The system of claim 1, further comprising a storage manager component configured to:

receive an indication to perform a storage operation on the N number of data objects of the first set;

process the indication; and

send the processed indication to perform the storage operation to the secondary storage computing device.

6. The system of claim 1, further comprising:

a first storage manager component configured to;

receive an indication to perform a storage operation on the N number of data objects of the first set;

process the indication; and

send the processed indication to perform the storage operation to the secondary storage computing device; and

a second storage manager component configured to;

receive the indication to perform the storage operation on the N number of data objects of the first set;

process the indication; and

send the processed indication to perform the storage operation to the first storage manager component,

wherein the first storage manager component is hierarchically subordinate to the second storage manager component.

7. The system of claim 1, further comprising an indexing component configured to:

generate index data based at least partially upon the N number of data objects of the first set; and

store the generated index data in an index.

8. At least one non-transitory computer-readable medium storing data and instructions, the data and instructions comprising:

data including a variable instance database configured to store information associated with secondary copies of data that includes a second set of reduced instanced data objects, wherein the information includes, for each data object of the reduced instanced data objects of the second set;

a unique identifier generated for the reduced instanced data object, and

a number of instances of the reduced instanced data object, to store for the reduced instanced data object that is based on a classification assigned to the reduced instanced data object,

wherein the number of instances of the reduced instanced data object is less than N number of instances of the data object stored in a primary copy of data,

wherein at least one of the reduced instanced data objects of the second set has multiple instances stored among multiple storage devices, and

wherein a pointer is stored in the variable instance database to a storage location for each instance of the reduced instanced data object;

instructions to perform a method to be executed by at least one data processing device, the method comprising;

receiving an indication to perform a storage operation on the primary copy of the data, including a first set of N number of the same data objects, where N is a number greater than 3,

wherein the indication specifies that fewer than N instances but greater than one instance of the N number of data objects of the first set are to be stored, and

wherein each of the data objects of the first set are to be stored on a distinct one of the multiple storage devices;

generating a unique identifier for each of the N number of data objects of the first set;

accessing the variable instance database and for the N number of data objects of the first set, using the generated unique identifier and the number of instances to store based on the classification assigned to the reduced instanced data object to determine the fewer than N instances but greater than one instance to store for the first set of N number of data objects; and

storing the fewer than N instances of the data object but greater than one instance of the data object on the multiple storage devices.

9. The computer-readable medium of claim 8,

wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies a number of copies to store as selected by an administrator,

wherein a data storage network includes at least two different hierarchical tiers and at least two of the storage devices respectively reside in the two hierarchical tiers,

wherein storing the fewer than N instances but greater than one instance of the data object on the multiple storage devices includes storing two instances of the data object on the two storage devices respectively residing in the two hierarchical tiers, and

wherein a secondary storage computing device is further configured to identify the N data objects of the first set before generating the substantially unique identifier for each of the N number of data objects of the first set.

10. The computer-readable medium of claim 8 wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies at least one of the multiple storage devices on which to store an instance of the one data object.

11. The computer-readable medium of claim 8, wherein the method further comprises:

receiving an indication to perform a storage operation on the N number of data objects of the first set;

processing the indication; and

sending the processed indication to perform the storage operation to a secondary storage computing device.

12. The computer-readable medium of claim 8, wherein the method further comprises:

generating index data based at least partially upon the N number of data objects of the first set; and

storing the generated index data in an index.

13. A computer-implementable method to reduce an amount of stored data, that the method:

receiving an indication to perform a storage operation on a primary copy of data, including a first set of N number of data objects, where N is a number greater than 3,

wherein the indication specifies that fewer than N instances but greater than one instance of the N number of data objects of the first set are to be stored,

wherein each of the data objects of the first set are to be stored on a distinct one of multiple storage devices, and

wherein the method employs a variable instance database configured to store information associated with secondary copies of data that includes a second set of reduced instanced data objects, wherein the information includes, for each data object of the reduced instanced data objects of the second set;

a unique identifier generated for the reduced instanced data object, and

a number of instances of the reduced instanced data object, to store for the reduced instanced data object that is based on a classification assigned to the reduced instanced data object,

wherein the number of instances of the reduced instanced data object is less than N number of instances of the data object stored in the primary copy of data,

wherein at least one of the reduced instanced data objects of the second set has multiple instances stored among multiple storage devices, and

wherein a pointer is stored in the variable instance database to a storage location for each instance of the reduced instanced data object;

generating a unique identifier for each of the N number of data objects of the first set;

accessing the variable instance database and for the N number of data objects of the first set, using the generated unique identifier and the number of instances to store based on the classification assigned to the reduced instanced data object to determine the fewer than N instances but greater than one instance to store for the first set of N number of data objects; and

storing the fewer than N instances of the data object but greater than one instance of the data object on the multiple storage devices.

14. The method of claim 13,

wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies a number of copies to store as selected by an administrator,

wherein a data storage network includes at least two different hierarchical tiers and at least two of the storage devices respectively reside in the two hierarchical tiers,

wherein storing the fewer than N instances but greater than one instance of the data object on the multiple storage devices includes storing two instances of the data object on the two storage devices respectively residing in the two hierarchical tiers, and

wherein a secondary storage computing device is further configured to identify the N data objects of the first set before generating the substantially unique identifier for each of the N number of data objects of the first set.

15. The method of claim 13 wherein the indication to perform the storage operation on the N number of data objects of the first set further specifies at least one of the multiple storage devices on which to store an instance of the one data object.

16. The method of claim 13, wherein the method further comprises:

receiving an indication to perform a storage operation on the N number of data objects of the first set;

processing the indication; and

sending the processed indication to perform the storage operation to a secondary storage computing device.

17. The method of claim 13, wherein the method further comprises:

generating index data based at least partially upon the N number of data objects of the first set; and

storing the generated index data in an index.