Cluster file system with a burst buffer appliance for controlling movement of data among storage tiers
First Claim
1. An object storage device of a cluster file system, comprising:
- a burst buffer appliance of said object storage device configured to communicate with a plurality of object storage servers of the cluster file system over a network;
the burst buffer appliance comprising at least first and second storage tiers and a controller to implement storage tiering control functionality for the at least first and second storage tiers of said burst buffer appliance, wherein the at least first and second storage tiers comprise respective disjoint subsets of persistent storage, wherein the first storage tier comprises persistent storage of a first persistent storage type and wherein the second storage tier comprises persistent storage of a second persistent storage type different than the first persistent storage type, wherein, upon a read request for a given requested data object stored in a predefined one of the at least first and second storage tiers of said burst buffer appliance, the controller moves the data from the predefined one of the at least first and second storage tiers to the other of the at least first and second storage tiers, wherein the burst buffer appliance further comprises a daemon for a parallel log-structured file system and wherein, upon a read request for a portion of a logical file striped across a plurality of object storage devices, notifies at least one daemon of at least one additional burst buffer appliance of at least one additional object storage device to pre-fetch at least one additional portion of said logical file that is stored by said at least one additional object storage device;
the burst buffer appliance thereby being configured to control movement of data between the first and second storage tiers of said burst buffer appliance; and
the burst buffer appliance being implemented utilizing at least one processing device coupled to a memory.
13 Assignments
0 Petitions
Accused Products
Abstract
A cluster file system comprises a burst buffer appliance coupled to a plurality of object storage servers via a network. The burst buffer appliance comprises a controller configured to implement storage tiering control functionality for at least first and second storage tiers comprising respective disjoint subsets of the plurality of object storage servers. The burst buffer appliance is thereby configured to control movement of data between the first and second storage tiers. The object storage servers in the first storage tier may be configured to interface with object storage targets of a first type and the object storage servers in the second storage tier may be configured to interface with object storage targets of a second type different than the first type. For example, the object storage targets of the first type may comprise non-volatile electronic storage devices such as flash storage devices, and the object storage targets of the second type may comprise disk storage devices.
-
Citations
20 Claims
-
1. An object storage device of a cluster file system, comprising:
-
a burst buffer appliance of said object storage device configured to communicate with a plurality of object storage servers of the cluster file system over a network; the burst buffer appliance comprising at least first and second storage tiers and a controller to implement storage tiering control functionality for the at least first and second storage tiers of said burst buffer appliance, wherein the at least first and second storage tiers comprise respective disjoint subsets of persistent storage, wherein the first storage tier comprises persistent storage of a first persistent storage type and wherein the second storage tier comprises persistent storage of a second persistent storage type different than the first persistent storage type, wherein, upon a read request for a given requested data object stored in a predefined one of the at least first and second storage tiers of said burst buffer appliance, the controller moves the data from the predefined one of the at least first and second storage tiers to the other of the at least first and second storage tiers, wherein the burst buffer appliance further comprises a daemon for a parallel log-structured file system and wherein, upon a read request for a portion of a logical file striped across a plurality of object storage devices, notifies at least one daemon of at least one additional burst buffer appliance of at least one additional object storage device to pre-fetch at least one additional portion of said logical file that is stored by said at least one additional object storage device; the burst buffer appliance thereby being configured to control movement of data between the first and second storage tiers of said burst buffer appliance; and the burst buffer appliance being implemented utilizing at least one processing device coupled to a memory. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method comprising:
-
configuring a burst buffer appliance of an object storage device in a cluster file system to communicate with a plurality of object storage servers of the cluster file system over a network, wherein the burst buffer appliance comprises at least first and second storage tiers and a controller, wherein the burst buffer appliance further comprises a daemon for a parallel log-structured file system and wherein, upon a read request for a portion of a logical file striped across a plurality of object storage devices, notifies at least one daemon of at least one additional burst buffer appliance of at least one additional object storage device to pre-fetch at least one additional portion of said logical file that is stored by said at least one additional object storage device; and implementing storage tiering control functionality in the burst buffer appliance for the at least first and second storage tiers of the burst buffer appliance, wherein the at least first and second storage tiers comprise respective disjoint subsets of persistent storage, wherein the first storage tier comprises persistent storage of a first persistent storage type and wherein the second storage tier comprises persistent storage of a second persistent storage type different than the first persistent storage type, wherein, upon a read request for a given requested data object stored in a predefined one of the at least first and second storage tiers of said burst buffer appliance, the controller moves the data from the predefined one of the at least first and second storage tiers to the other of the at least first and second storage tiers; the burst buffer appliance thereby being configured to control movement of data between the first and second storage tiers of the burst buffer appliance. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. A cluster file system comprising:
-
a burst buffer appliance of an object storage device, wherein the burst buffer appliance comprises at least first and second storage tiers and a controller; and a plurality of object storage servers coupled to the burst buffer appliance via a network; the burst buffer appliance configured to implement storage tiering control functionality for the at least first and second storage tiers of the burst buffer appliance, wherein the at least first and second storage tiers comprise respective disjoint subsets of persistent storage, wherein the first storage tier comprises persistent storage of a first persistent storage type and wherein the second storage tier comprises persistent storage of a second persistent storage type different than the first persistent storage type, wherein, upon a read request for a given requested data object stored in a predefined one of the at least first and second storage tiers of said burst buffer appliance, the controller moves the data from the predefined one of the at least first and second storage tiers to the other of the at least first and second storage tiers, wherein the burst buffer appliance further comprises a daemon for a parallel log-structured file system and wherein, upon a read request for a portion of a logical file striped across a plurality of object storage devices, notifies at least one daemon of at least one additional burst buffer appliance of at least one additional object storage device to pre-fetch at least one additional portion of said logical file that is stored by said at least one additional object storage device; the burst buffer appliance thereby being configured to control movement of data between the first and second storage tiers of the burst buffer appliance. - View Dependent Claims (19, 20)
-
Specification