Cluster file system with a fuse file system interface

• US 9,858,290 B1
• Filed: 06/27/2013
• Issued: 01/02/2018
• Est. Priority Date: 06/27/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Bent, John M., Faibish, Sorin, Gupta, Uday, Pedone, James
• Primary Examiner(s): WILLOUGHBY, ALICIA M
• Application Number:
  US13/928,966
• Time in Patent Office: 1,650 Days
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/1847 specifically adapted to static storage, e.g. adapted to flash memory or SSD
• CPC Class Codes: G06F 16/1858 Parallel file systems, i.e. file systems supporting multiple processors
• CPC Class Codes: G06F 16/188 Virtual file systems

Abstract

Cluster file systems are provided having a FUSE interface. A cluster file system comprises a FUSE object storage device that communicates with at least one object storage server of the cluster file system; and provides an interface between the cluster file system and at least one additional file system having a FUSE implementation. The additional file system optionally includes a burst buffer appliance. The burst buffer appliance can be configured, for example, to control the movement of data between first and second storage tiers. The burst buffer appliance can optionally communicate with a plurality of clients over the network and process requests from the clients. The FUSE object storage device provides an interface to, for example, a parallel log-structured file system and/or a Lustre clustered file system.

Claims

1. A FUSE object storage device of a cluster file system, comprising:

a memory; and

at least one processing device coupled to a memory, configured to;

communicate with at least one object storage server of the cluster file system; and

provide an interface between said cluster file system and a parallel log structured file system having a FUSE implementation and comprising a burst buffer appliance, wherein said burst buffer appliance comprises a high-speed memory that provides a buffer between a plurality of clients on one or more compute nodes and said cluster file system for storing bursty data associated with input-output (JO) operations, wherein said interface maps, using said FUSE object storage device associated with said at least one object storage server, one or more file-based operations of said FUSE implementation to one or more object-based operations of said cluster file system by creating a plurality of files, in a FUSE file system, for a plurality of objects of said FUSE object storage device.

2. The object storage device of claim 1 wherein said burst buffer appliance is configured to communicate with a plurality of object storage servers of the cluster file system over a network.

3. The object storage device of claim 2 wherein said burst buffer appliance is configured to implement storage tiering control functionality for at least first and second storage tiers comprising respective disjoint subsets of the plurality of object storage servers.

4. The object storage device of claim 3 wherein the burst buffer appliance further comprises a controller to implement said storage tiering control functionality.

5. The object storage device of claim 1 wherein said burst buffer appliance is configured to control movement of data between first and second storage tiers.

6. The object storage device of claim 1 wherein the burst buffer appliance is further configured to communicate with said plurality of clients over the network and to process requests from said clients.

7. The object storage device of claim 1 wherein the cluster file system comprises a Lustre file system.

8. The object storage device of claim 1 wherein said burst buffer appliance comprises a flash storage device.

9. The object storage device of claim 1 wherein said interface is further configured to adapt one or more non-transactional aspects of said FUSE implementation to a transactional approach of said cluster file system.

10. A method comprising:

configuring a FUSE object storage device in a cluster file system to communicate with at least one object storage server of the cluster file system; and

providing an interface in the FUSE object storage device between said cluster file system and a parallel log structured file system having a FUSE implementation and comprising a burst buffer appliance, wherein said burst buffer appliance comprises a high-speed memory that provides a buffer between a plurality of clients on one or more compute nodes and said cluster file system for storing bursty data associated with input-output (IO) operations, wherein said interface maps, using said FUSE object storage device associated with said at least one object storage server, one or more file-based operations of said FUSE implementation to one or more object-based operations of said cluster file system by creating a plurality of files, in a FUSE file system, for a plurality of objects of said FUSE object storage device.

11. The method of claim 10 wherein said burst buffer appliance is configured to communicate with a plurality of object storage servers of the cluster file system over a network.

12. The method of claim 11 wherein said burst buffer appliance is configured to implement storage tiering control functionality for at least first and second storage tiers comprising respective disjoint subsets of the plurality of object storage servers.

13. The method of claim 10 wherein said burst buffer appliance is configured to control movement of data between first and second storage tiers.

14. The method of claim 10 wherein the cluster file system comprises a Lustre file system.

15. The method of claim 10 wherein said burst buffer appliance comprises a flash storage device.

16. The method of claim 10 wherein said interface is further configured to adapt one or more non-transactional aspects of said FUSE implementation to a transactional approach of said cluster file system.

17. A computer program product comprising a non-transitory machine-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed cause the burst buffer appliance to perform the steps of the method of claim 10.

18. A cluster file system comprising:

at least one object storage server coupled to a FUSE object storage device, wherein said FUSE object storage device is configured to;

communicate with said at least one object storage server of the cluster file system; and

provide an interface between said cluster file system and a parallel log structured file system having a FUSE implementation and comprising a burst buffer appliance, wherein said burst buffer appliance comprises a high-speed memory that provides a buffer between a plurality of clients on one or more compute nodes and said cluster file system for storing bursty data associated with input-output (TO) operations, wherein said interface maps, using said FUSE object storage device associated with said at least one object storage server, one or more file-based operations of said FUSE implementation to one or more object-based operations of said cluster file system by creating a plurality of files, in a FUSE file system, for a plurality of objects of said FUSE object storage device.

19. The cluster file system of claim 18 wherein said burst buffer appliance is configured to control movement of data between first and second storage tiers.

20. The cluster file system of claim 18 wherein the cluster file system comprises a Lustre file system.

21. The cluster file system of claim 18 wherein said burst buffer appliance comprises a flash storage device.