Accessing a file system using tiered deduplication

• US 9,934,238 B2
• Filed: 01/05/2017
• Issued: 04/03/2018
• Est. Priority Date: 10/29/2014
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Mitkar, Amit, Kumarasamy, Paramasivam, Kottomtharayil, Rajiv
• Primary Examiner(s): Bragdon, Reginald
• Assistant Examiner(s): Namazi, Mehdi
• Application Number:
  US15/399,597
• Publication Number:
  US 20170124108A1
• Time in Patent Office: 453 Days
• CPC Class Codes: G06F 13/102 where the programme performs an interfacing function, e.g. device driver G06F13/105 takes precedence; scheduling within device drivers G06F9/52; contention policies within device drivers G06F9/4881
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/196 Specific adaptations of the file system to access devices and non-file objects via standard file system access operations, e.g. pseudo file systems dedicated interfaces to storage systems G06F3/0601
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0667 at data level, e.g. file, record or object virtualisation
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices

Abstract

An illustrative pseudo-file-system driver uses deduplication functionality and resources in a storage management system to provide an application and/or a virtual machine with access to a locally-stored file system. From the perspective of the application/virtual machine, the file system appears to be of virtually unlimited capacity. The pseudo-file-system driver instantiates the file system in primary storage, e.g., configured on a local disk. The application/virtual machine requires no configured settings or limits for the file system'"'"'s storage capacity, and may thus treat the file system as “infinite.” The pseudo-file-system driver intercepts write requests and may use the deduplication infrastructure in the storage management system to offload excess data from local primary storage to deduplicated secondary storage, based on a deduplication database. The pseudo-file-system driver also intercepts read requests and in response may restore data from deduplicated secondary storage to primary storage, also based on the deduplication database.

Claims

1. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device having one or more processors and corresponding computer-readable memory, cause the computing device to perform a method comprising:

executing a pseudo-file-system driver on the computing device, which hosts an application and an associated data agent component of a storage management system that comprises the computing device;

instantiating a file system, by the pseudo-file-system driver, based on exposing a first mount point for the file system,

wherein the file system resides in a primary storage device in communication with the computing device;

configuring, by the pseudo-file-system driver, an association between the file system and a corresponding deduplication database component of the storage management system; and

executing the application,

wherein the pseudo-file system driver invokes at least one deduplication job, which (i) moves some data from the file system in the primary storage device to a secondary storage device component of the storage management system, and (ii) stores the moved data in deduplicated form thereto based at least in part on the deduplication database, and

wherein based at least in part on invoking the at least one deduplication job the pseudo-file-system driver provides the application with access to the file system configured without a storage-capacity limit.

2. The computer-readable medium of claim 1 wherein executing the pseudo-file-system driver renders unnecessary configuring the file system with a storage-capacity limit relative to the application.

3. The computer-readable medium of claim 1 wherein executing the pseudo-file-system driver renders unnecessary configuring the application with a storage-capacity limit relative to the file system.

4. The computer-readable medium of claim 1 wherein the pseudo-file-system driver identifies excess data in the file system before invoking the at least one deduplication job relative to the excess data.

5. The computer-readable medium of claim 1 wherein the at least one deduplication job is performed at least in part by a media agent component of the storage management system, and wherein the media agent component maintains the deduplication database.

6. The computer-readable medium of claim 1 wherein the at least one deduplication job is performed at least in part by a media agent component of the storage management system in conjunction with the data agent on the computing device, and wherein the media agent component maintains the deduplication database.

7. The computer-readable medium of claim 1 wherein when the pseudo-file-system driver identifies data requested by the application that is not available from the file system in the primary storage device, the pseudo-file-system driver invokes a restore job that uses the deduplication database to retrieve the unavailable data from at least one of the deduplication database and a secondary storage device associated with a media agent component of the storage management system.

8. The computer-readable medium of claim 7 wherein the restore job is performed at least in part by the media agent component of the storage management system, and wherein the media agent maintains the deduplication database.

9. The computer-readable medium of claim 7 wherein the restore job is performed at least in part by the media agent component of the storage management system in conjunction with the data agent on the computing device, and wherein the media agent maintains the deduplication database.

10. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device having one or more processors and corresponding computer-readable memory, cause the computing device to perform a method for using deduplication in a storage management system to provide a virtual machine on the computing device with access to a file system, the method comprising:

executing a pseudo-file-system driver on the computing device, which hosts the virtual machine and an associated data agent component of the storage management system;

based on exposing a first mount point for the file system to the virtual machine, instantiating the file system,

wherein the file system is stored in a primary storage device in communication with the computing device; and

invoking, by the pseudo-file-system driver, at least one deduplication job that;

(a) moves some data from the file system in the primary storage device to a secondary storage device component of the storage management system,

(b) stores the moved data in deduplicated form thereto based at least in part on a deduplication database component of the storage management system, and

thereby providing the virtual machine with access to the file system without a predefined limit on storage capacity for the file system.

11. The computer-readable medium of claim 10 wherein the method further comprises:

configuring, by the pseudo-file-system driver, an association between the file system and the deduplication database component of the storage management system.

12. The computer-readable medium of claim 10 wherein, based at least in part on the invoking of the at least one deduplication job, the file system appears to the virtual machine to be of virtually unlimited storage capacity.

13. The method of claim 10 wherein the at least one deduplication job is performed at least in part by a media agent component of the storage management system, and wherein the media agent component maintains the deduplication database.

14. The method of claim 10 further comprising:

when the pseudo-file-system driver identifies data requested by the virtual machine that is not available from the file system in the primary storage device, invoking, by the pseudo-file-system driver, at least one restore job that moves the identified data from a secondary storage component of the storage management system to the file system in the primary storage device,

wherein the restore job is based at least in part on the deduplication database, and

wherein the secondary storage component of the storage management system is at least one of a media agent component and a secondary storage device component associated with the media agent component.

15. A storage management system for using deduplication to provide a virtual machine with access to a file system of seemingly unlimited storage capacity, the system comprising:

a first computing device comprising the virtual machine, a data agent, a pseudo-file-system driver, and a mount point exposed by the pseudo-file-system driver to the virtual machine,

wherein the first computing device comprises one or more processors and corresponding computer-readable memory;

a primary storage device in communication with the first computing device, wherein the primary storage device comprises data of the file system;

a second computing device comprising a media agent and a deduplication database that is associated with the file system,

wherein the second computing device comprises one or more processors and corresponding computer-readable memory;

a secondary storage device in communication with the second computing device, wherein the secondary storage device comprises data stored in deduplicated form based on the deduplication database;

wherein the pseudo-file-system driver is configured to provide the virtual machine with access to the file system appearing to lack a storage-capacity limit,

based at least in part on at least one deduplication job invoked by the pseudo-file-system driver to;

(a) move some data from the file system in the primary storage device to at least one of the media agent and the secondary storage device, and

(b) store the moved data in deduplicated form thereto based at least in part on the deduplication database.

16. The storage management system of claim 15 wherein the pseudo-file-system driver is further configured to invoke the at least one deduplication job for excess data identified by the pseudo-file-system driver in the file system.

17. The storage management system of claim 15 wherein the pseudo-file-system driver is further configured to invoke a restore job that uses the deduplication database to retrieve, from at least one of the deduplication database and a secondary storage device, data requested by the virtual machine which is not available from the file system in the primary storage device.

18. The storage management system of claim 15 wherein the virtual machine is configured without a storage-capacity limit for the file system.

19. The storage management system of claim 15 wherein the file system is configured without a storage-capacity limit for the virtual machine.

20. The storage management system of claim 15 wherein the at least one deduplication job is performed at least in part by the media agent on the second computing device in conjunction with the data agent on the first computing device, and wherein the media agent maintains the deduplication database.