Organically managing primary and secondary storage of a data object based on expiry timeframe supplied by a user of the data object

• US 10,311,042 B1
• Filed: 08/31/2015
• Issued: 06/04/2019
• Est. Priority Date: 08/31/2015
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kumar, Kuldeep
• Primary Examiner(s): Thomas, Ashish
• Assistant Examiner(s): Mahmood, Rezwanul
• Application Number:
  US14/840,571
• Time in Patent Office: 1,373 Days
• CPC Class Codes: G06F 16/125 characterised by the use of retention policies retention policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

The illustrative systems and methods advantageously reduce the amount of storage space occupied by data that no longer has a useful life—as established by the data objects'"'"' user(s) and overcoming predetermined rules required by information management policies. An illustrative data agent may receive instructions from an illustrative storage manager to perform secondary copy operations for a given set of data objects. The instructions may generally instruct that expiry-marked data objects are to be treated based on parsing each data object'"'"'s user-supplied expiry timeframe. The illustrative system (i) will delete expired data objects including expired secondary copies; (ii) will refrain from making secondary copies of expired data objects; and (iii) if an expiry-marked data object is not expired, the illustrative system will make secondary copies according to the instructions from the storage manager, but will track those expiry-marked secondary copies for future deletion after they expire, (iv) and will delete expired secondary copies even if the original expiry-marked data object has been deleted from the system prior to its expiration.

Claims

1. A method for managing data objects in a data storage management system, the method comprising:

storing an expiry-marked data object to a primary storage device in the data storage management system, wherein the expiry-marked data object comprises a user-supplied expiry timeframe for the data object, and wherein the user-supplied expiry timeframe is supplied when the data object is created;

triggering, by a storage manager that manages the data storage management system, a first secondary copy operation for the expiry-marked data object based on a first policy that governs storage management for data that includes the data object;

before subjecting the expiry-marked data object to the first secondary copy operation,

parsing, by a data agent tasked by the storage manager with performing at least part of the first secondary copy operation, the user-supplied expiry timeframe of the expiry-marked data object to determine whether the expiry-marked data object has expired;

if the data agent determines that the expiry-marked data object has expired,

canceling the first secondary copy operation for the expiry-marked data object, wherein the canceling is performed by one of the storage manager and the data agent,

thereby causing the data storage management system to refrain from generating any secondary copies of the expiry-marked data object; and

if the data agent determines that the expiry-marked data object has not expired;

(i) performing the first secondary copy operation for the expiry-marked data object, resulting in one or more secondary copies of the expiry-marked data object, wherein each of the one or more secondary copies comprises the user-supplied expiry timeframe, and wherein each of the one or more secondary copies is stored in a format that is distinct from a native format of the data object in the primary storage device,

(ii) indexing the one or more secondary copies of the expiry-marked data object into a temporary-copy index, and

(iii) storing the temporary-copy index for use in deleting the one or more secondary copies of the expiry-marked data object after the user-supplied expiry timeframe passes.

2. The method of claim 1 further comprising:

triggering, by the storage manager, a second secondary copy operation for a set of data objects comprising at least one of (A) the expiry-marked data object and (B) the one or more secondary copies of the expiry-marked data object;

if at the time of the triggering of the second secondary copy operation the user-supplied expiry timeframe for the data object has passed;

(a) identifying the one or more secondary copies of the expiry-marked data object based on the temporary-copy index, and

(b) deleting the one or more secondary copies of the expiry-marked data object from the data storage management system.

3. The method of claim 1 further comprising:

receiving, by an application, from a user in the course of generating the data object, the user-supplied expiry timeframe for the data object; and

associating, by the application, the data object with the user-supplied expiry timeframe for the data object, resulting in the expiry-marked data object that is stored to the primary storage device.

4. The method of claim 3 wherein the application comprises a plugin component that prompts the user to supply the user-supplied expiry timeframe for the data object.

5. The method of claim 3 wherein the data object comprises an email message, and

further wherein the application is an email client that comprises a plugin component which prompts the user to supply the user-supplied expiry timeframe for the email message in the course of creating the email message.

6. The method of claim 1 wherein if the expiry-marked data object is determined to have expired, additionally (iv) deleting the expiry-marked data object from the primary storage device.

7. The method of claim 1 wherein the triggering of the first secondary copy operation is based on a policy that governs storage management for a set of data objects comprising the expiry-marked data object.

8. The method of claim 1 wherein the triggering of the first secondary copy operation is based on a policy that governs storage management for a set of data objects comprising the expiry-marked data object;

and

wherein the policy indicates that expired data objects as well as secondary copies of expired data objects are to be deleted from the data storage management system.

9. The method of claim 1 wherein the triggering of the first secondary copy operation is based on a scheduling policy that governs storage management timing for a set of data objects comprising the expiry-marked data object;

and

wherein the scheduling policy indicates that expired data objects as well as secondary copies of expired data objects are to be deleted from the data storage management system.

10. The method of claim 1 wherein the data object comprises an email message.

11. The method of claim 1 wherein the data object comprises an email message and wherein the user-supplied expiry timeframe is part of the subject line of the email message.

12. The method of claim 1 wherein the data object comprises a file.

13. The method of claim 1 wherein the data object comprises a file and wherein the user-supplied expiry timeframe is a tag associated with the file.

14. The method of claim 1 wherein the data object comprises a folder.

15. The method of claim 1 wherein the data object comprises a folder and wherein the user-supplied expiry timeframe is a tag associated with the file.

16. A system for storage management of primary and secondary data based on user-supplied expiry timeframes for data objects, the system comprising:

a client computing device for executing (a) an application that receives a user-supplied expiry timeframe for a data object in the course of the data object being created by the application, and (b) a data agent associated with the application that created the data object;

a primary storage device associated with the client computing device for storing the data object and the user-supplied expiry timeframe for the data object, wherein in the primary storage device the data object is stored in a format that is native to the application;

a secondary storage device for storing one or more secondary copies of the data object, wherein a given secondary copy in the secondary storage device is stored in a format suitable to the given secondary copy that is distinct from the native format of the data object in the primary storage device;

a secondary storage computing device for executing a media agent for storing secondary copies to the secondary storage device;

a storage manager for managing the system, wherein the storage manager is programmed to;

instruct the data agent to perform a first storage management operation based on a first policy that governs storage management for data that includes the data object; and

wherein the data agent is programmed to perform at least part of the first storage management operation comprising;

parsing the user-supplied expiry timeframe for the data object in the primary storage device to determine whether the data object has expired, and

if the data object has expired;

(i) preventing the first storage management operation from generating any secondary copies of the data object, and

(ii) indicating to the storage manager that at least one of;

(i) the data object has expired, and (ii) the first storage management operation did not generate a secondary copy of the data object, and

if the data object has not expired;

(a) generating one or more secondary copies of the data object according to the first policy, wherein each of the one or more secondary copies comprises the user-supplied expiry timeframe.

17. The system of claim 16 wherein the data agent is further programmed to perform at least part of the first storage management operation further comprising:

if the data object has not expired;

(b) indexing the one or more secondary copies of the data object into an index for use in deleting the one or more secondary copies of the data object after the user-supplied expiry timeframe passes.

18. The system of claim 17 wherein the data agent is further programmed to transmit the index to the storage manager for use in deleting the one or more secondary copies of the data object after the user-supplied expiry timeframe passes.

19. A method for managing storage space quotas in a data storage management system based on expiry timeframes supplied by users, the method comprising:

parsing a first data object governed by a data management policy to determine whether the first data object comprises an expiry timeframe,

wherein the expiry timeframe is supplied by a user in the course of generating the first data object, and

wherein the user is associated with a storage space quota for storing data objects and secondary copies of data objects in the data storage management system;

if the first data object comprises an expiry timeframe that has passed;

(a) canceling a secondary copy operation for the first data object, wherein the secondary copy operation is triggered by a storage manager based on the data management policy, and wherein the canceling comprises refraining from generating any secondary copies of the first data object, and

(b) deleting the first data object by a data agent that determines that the first data object comprises the expiry timeframe that has passed, and

by a media agent as instructed by the storage manager, (c) determining whether secondary copies of the first data object are stored in the data storage management system, and if so, (d) deleting any secondary copies of the first data object from one or more components of the data storage management system;

if the first data object comprises an expiry timeframe that has not passed, performing the secondary copy operation for the first data object according to the data management policy, wherein the data agent and the media agent perform the secondary copy operation as instructed by the storage manager,

wherein the secondary copy operation generates one or more secondary copies of the first data object;

wherein the first data object and the one or more secondary copies of the first data object occupy an amount of storage space that is governed by the storage space quota associated with the user; and

wherein if the first data object comprises an expiry timeframe, the deleting of the first data object and any secondary copies of the first data object if the expiry timeframe of the first data object has passed enables the quota to be satisfied.

20. The method of claim 19 wherein the first data object is an email message generated by the user and wherein the method further comprises:

receiving the email message as a second data object which comprises the expiry timeframe of the first data object, wherein the second data object is associated with a second user who is associated with a second storage space quota;

parsing the second data object governed by a second data management policy to determine whether the second data object comprises an expiry timeframe; and

if the expiry timeframe of the second data object has passed;

(A) canceling a secondary copy operation for the second data object based on the second data management policy, wherein the canceling comprises refraining from generating any secondary copies of the second data object, and

(B) deleting the second data object, and

(C) determining whether secondary copies of the second data object are stored in the data storage management system, and if so, (D) deleting any secondary copies of the second data object from one or more components of the data storage management system; and

wherein the second data object and the one or more secondary copies of the second data object occupy an amount of storage space that is governed by the second storage space quota associated with the second user; and

wherein the deleting of the second data object and any secondary copies of the second data object if the expiry timeframe of the second data object has passed enables the second quota of the second user to be satisfied based on the expiry timeframe originally supplied by the user generating the first data object.