SYSTEM AND METHOD TO MAXIMIZE SERVER RESOURCE UTILIZATION AND PERFORMANCE OF METADATA OPERATIONS
First Claim
1. An MDS (metadata server) in a distributed storage system which includes a plurality of data servers (DSs) storing file contents and one or more MDSs performing a plurality of metadata operations in response to metadata requests of different types, the MDS including a controller having a processor and a memory, the MDS storing file system metadata, the controller being configured to:
- classify the metadata operations into different categories, which include a normal category and one or more special categories which are different from the normal category, the normal category having a primary stage which does not involve communication between the MDS and a component external to the MDS;
for each of the one or more special categories, partition each of the metadata operations into a plurality of stages at least one of which involves communication between the MDS and a component external to the MDS; and
dynamically assign resources to each of the partitioned stage based on monitored workloads of the different types of metadata requests.
1 Assignment
0 Petitions
Accused Products
Abstract
An MDS (metadata server) in a distributed storage system includes data servers (DSs) storing file contents and one or more MDSs performing metadata operations in response to metadata requests of different types, the MDS including a controller having a processor and a memory, the MDS storing file system metadata. The controller is configured to: classify the metadata operations into different categories, which include a normal category and one or more special categories different from the normal category, the normal category having a primary stage which does not involve communication between the MDS and a component external to the MDS; for each special category, partition each metadata operation into a plurality of stages at least one of which involves communication between the MDS and a component external to the MDS; and dynamically assign resources to each of the partitioned stage based on monitored workloads of the different types of metadata requests.
-
Citations
15 Claims
-
1. An MDS (metadata server) in a distributed storage system which includes a plurality of data servers (DSs) storing file contents and one or more MDSs performing a plurality of metadata operations in response to metadata requests of different types, the MDS including a controller having a processor and a memory, the MDS storing file system metadata, the controller being configured to:
-
classify the metadata operations into different categories, which include a normal category and one or more special categories which are different from the normal category, the normal category having a primary stage which does not involve communication between the MDS and a component external to the MDS; for each of the one or more special categories, partition each of the metadata operations into a plurality of stages at least one of which involves communication between the MDS and a component external to the MDS; and dynamically assign resources to each of the partitioned stage based on monitored workloads of the different types of metadata requests. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method of managing resources of an MDS (metadata server) in a distributed storage system which includes a plurality of data servers (DSs) storing file contents and one or more MDSs performing a plurality of metadata operations in response to metadata requests of different types, the MDS including a controller having a processor and a memory, the MDS storing file system metadata, the method comprising:
-
classifying the metadata operations into different categories, which include a normal category and one or more special categories which are different from the normal category, the normal category having a primary stage which does not involve communication between the MDS and a component external to the MDS; for each of the one or more special categories, partitioning each of the metadata operations into a plurality of stages at least one of which involves communication between the MDS and a component external to the MDS; and dynamically assigning resources to each of the partitioned stage based on monitored workloads of the different types of metadata requests. - View Dependent Claims (14, 15)
-
Specification