Method and system for selectively deleting stored data

• US 7,765,369 B1
• Filed: 11/07/2005
• Issued: 07/27/2010
• Est. Priority Date: 11/05/2004
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Gokhale, Parag, Oshinsky, David Alan, Prahlad, Anand
• Primary Examiner(s): Peugh; Brian R
• Assistant Examiner(s): Namazi; Mehdi
• Application Number:
  US11/269,521
• Time in Patent Office: 1,723 Days
• Field of Search: 711/118, 711/159, 711/162, 711/165, 707/100, 707/101, 707/206, 707/E17.002, 707/E17.008, 707/692, 707/693, 707/796, 707/803
• US Class Current: 711/159
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 12/00 Accessing, addressing or allocating within memory systems or architectures digital input from, or digital output to record carriers, e.g. to disk storage units, G06F3/06
• CPC Class Codes: G06F 12/02 Addressing or allocation; Relocation program address sequencing G06F9/00; arrangements for selecting an address in a digital store G11C8/00
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0686 Libraries, e.g. tape libraries, jukebox
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method and system are provided for selectively deleting data stored to storage media, such as a tape, in a network storage system. An instruction to delete selected data is received and the location of the data selected for deletion is identified. The location of the data is obtained by consulting an index of storage data. The selected data is retrieved, together with any other data on the tape that precedes the selected data. The retrieved data, excluding the selected data, is copied to a tape. The index is updated to reflect the changes in the stored data on the tape.

Claims

1. A method in a computing system for selectively deleting data stored on a storage medium, the method comprising:

receiving an instruction to delete at least one selected data file contained on a first storage medium, wherein the first storage medium is a removable, magnetic tape;

identifying in an index associated with the first storage medium a location of the at least one selected data file on the first storage medium, wherein the first storage medium contains at least one data file that precedes at least one selected data file;

transferring from the first storage medium to a second storage medium at least one selected data file and at least one preceding data file; and

transferring back from the second storage medium to the first storage medium the at least one preceding data file but not the at least one selected data file.

2. The method of claim 1, further comprising:

automatically generating the received instruction from a storage policy.

3. The method of claim 1, further comprising:

automatically generating the received instruction from user preferences.

4. The method of claim 1, wherein receiving the instruction includes receiving and processing the instruction via a storage manager.

5. The method of claim 1, wherein identifying in an index associated with the first storage medium a location of the at least one selected data file on the first storage medium includes reviewing the index via a storage manager.

6. The method of claim 1, wherein transferring from the first storage medium to the second storage medium the at least one selected data file and the at least one preceding data file includes transferring the data files in a sequence the data files are stored on the first storage medium.

7. The method of claim 1, wherein transferring from the first storage medium to the second storage medium the at least one selected data file and the at least one preceding data file includes transferring all data files that precede the at least one selected data file.

8. A method for selectively deleting data stored on a storage medium, the method comprising:

receiving and processing an instruction to delete at least one selected data file from a first storage medium;

identifying in an index associated with the data file, a location of the at least one selected data file on the first storage medium, wherein the first storage medium contains multiple data files, and wherein the first storage medium comprises magnetic tape storage;

transferring from the first storage medium to a second storage medium at least one other data file preceding at least one selected data file; and

deleting from the first storage medium the at least one selected data file without deleting the at least one other preceding data file, further comprising;

using header and footer data associated with the at least one selected data file in order to determine a starting point or a finishing point on the magnetic tape storage at which the at least one selected data file starts or finishes, respectively;

shifting the location of the at least one other preceding data file on the magnetic tape storage to either the starting point or the finishing point.

9. The method of claim 8, further comprising:

automatically generating the received instruction from a storage policy.

10. The method of claim 8, wherein transferring from the first storage medium to the second storage medium the at least one other preceding data file includes transferring all data files that precede the at least one selected data file.

11. A computing system for selectively deleting data stored on a first storage medium comprising magnetic tape, the system comprising:

means for receiving and processing an instruction to delete at least one selected data file stored on the first storage medium, wherein the first storage medium comprises magnetic tape;

means for identifying a location of the at least one selected data file on the first storage medium, wherein the first storage medium contains multiple data files;

means for transferring from the first storage medium to a second storage medium at least one data file preceding at least one selected data file;

means for transferring back from the second storage medium to the first storage medium the transferred preceding data file of the multiple data files; and

means for deleting from the first storage medium the at least one selected data file.

12. An apparatus for selectively deleting data stored on a storage device having a magnetic tape storage medium, the apparatus comprising:

a storage device having a magnetic tape storage medium;

a storage manager for receiving and processing an instruction to delete at least one selected data file from the magnetic tape storage medium, wherein the magnetic tape storage medium contains multiple data files, including at least one selected data file and at least one file that precedes the at least one selected data file;

a media management component, coupled to the storage manager, for identifying a location of the at least one selected data file on the magnetic tape storage medium, wherein the media management component is also coupled to another storage device; and

a jobs agent, in communication with the storage manager, for transferring from the magnetic tape storage medium to the other storage device the at least one data file that precedes the selected data file;

wherein

the storage device is coupled to the media management component for transferring back from the other storage device to the magnetic tape storage medium the at least one preceding data file.

13. The apparatus according to claim 12, wherein the instruction is automatically generated from a storage policy.

14. The apparatus according to claim 12, wherein the instruction is automatically generated from user preferences.

15. The apparatus according to claim 12, wherein the jobs agent consults a first index to determine which media management component controls the at least one selected data file.

16. The apparatus according to claim 12, wherein the storage manager communicates with the media management component to obtain data related to said at least one selected data file.

17. The apparatus according to claim 12, wherein the media management component consults a second index to identify a location of the at least one selected data file.

18. The apparatus according to claim 12, wherein the storage manager instructs the media management component to delete the at least one selected data file.

19. The apparatus according to claim 18, wherein the deleting comprises shifting the at least one preceding data file on the magnetic tape storage medium.

20. The apparatus according to claim 18, wherein the deleting comprises writing zeros over the at least one selected data file.

21. The apparatus according to claim 18, wherein the deleting comprises removing pointers in the second index that reference the at least one selected data file.

22. The apparatus according to claim 21, wherein the second index is updated with a new data location and offset information.

23. A computer readable storage medium storing program code which when executed on a computer, causes the computer to perform a method for selectively deleting data stored on a storage medium, the method comprising:

receiving and processing an instruction to delete at least one selected data file from a first-storage medium comprising magnetic tape;

identifying a location of the at least one selected data file on the first storage medium, wherein the first storage medium contains multiple data files, wherein identifying the location includes reviewing an index associated with the first data storage medium;

transferring from the first storage medium to a second storage medium at least one other data file that precedes at least one selected data file; and

transferring back from the second storage medium to the first storage medium the at least one other preceding data file.

24. The computer readable medium of claim 23, comprising automatically generating the instruction from a storage policy.

25. The computer readable medium of claim 23, wherein transferring from the first storage medium to a second storage medium comprises transferring data files using a first index associated with the first storage medium.

26. The computer readable medium of claim 23, wherein transferring from the first storage medium to the second storage medium at least one other data file comprises transferring all data files that precede the at least one selected data file in the sequence in which the data files are stored on the first storage medium.

27. The computer readable medium of claim 23, wherein deleting comprises removing pointers in a second index, the pointers referencing the at least one selected data file.

28. The computer readable medium of claim 27, wherein the second index is updated with new data location and offset information.