Statistics management for scale-out storage
First Claim
Patent Images
1. A method for use with a distributed storage system comprising a plurality of storage devices, the method comprising:
- initializing a statistics group on a plurality of storage nodes, the statistics group associated with a managed object;
assigning ownership of the managed object to a first one of the storage nodes having a data chunk management service and storage devices;
collecting statistics values for the managed object on the first one of the storage nodes;
changing ownership of the managed object to a second one of the storage nodes, while continuing to store statistics values collected by the first one of the storage nodes on the first one of the storage nodes after the change of ownership, the second one of the storage nodes having a data chunk management service and storage devices;
collecting statistics values for the managed object on the second one of the storage nodes;
receiving, at an arbitrary one of the plurality of storage nodes, a request for a statistics value within the statistics group; and
responding to the request by;
blindly querying, by the arbitrary storage node, each of the other storage nodes in the plurality for statistics values associated with the managed object, receiving, by the arbitrary storage node, the statistics values collected on at least one of the first storage nodes and the second one of the storage nodes, combining, by the arbitrary storage node, the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes, and returning the combined statistics values; and
using the combined statistics values to scale out the distributed storage system with cluster-level functions distributed evenly among the plurality of storage nodes.
8 Assignments
0 Petitions
Accused Products
Abstract
Systems and processes for statistics management in a distributed storage system using a flat cluster architecture. Statistics for managed objects are collected using virtual statistics groups across multiple storage nodes. The systems and processes are compatible with storage systems that utilize microservice architectures.
29 Citations
14 Claims
-
1. A method for use with a distributed storage system comprising a plurality of storage devices, the method comprising:
-
initializing a statistics group on a plurality of storage nodes, the statistics group associated with a managed object; assigning ownership of the managed object to a first one of the storage nodes having a data chunk management service and storage devices; collecting statistics values for the managed object on the first one of the storage nodes; changing ownership of the managed object to a second one of the storage nodes, while continuing to store statistics values collected by the first one of the storage nodes on the first one of the storage nodes after the change of ownership, the second one of the storage nodes having a data chunk management service and storage devices; collecting statistics values for the managed object on the second one of the storage nodes; receiving, at an arbitrary one of the plurality of storage nodes, a request for a statistics value within the statistics group; and responding to the request by;
blindly querying, by the arbitrary storage node, each of the other storage nodes in the plurality for statistics values associated with the managed object, receiving, by the arbitrary storage node, the statistics values collected on at least one of the first storage nodes and the second one of the storage nodes, combining, by the arbitrary storage node, the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes, and returning the combined statistics values; andusing the combined statistics values to scale out the distributed storage system with cluster-level functions distributed evenly among the plurality of storage nodes. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A distributed storage system, comprising:
-
a plurality of storage nodes each having a plurality of storage devices and configured to; initialize a statistics group on a plurality of storage nodes, the statistics group associated with a managed object; assign ownership of the managed object to a first one of the storage nodes having a data chunk management service and storage devices; collect statistics values for the managed object on the first one of the storage nodes; change ownership of the managed object to a second one of the storage nodes, while continuing to store statistics values collected by the first one of the storage nodes on the first one of the storage nodes after the change of ownership, the second one of the storage nodes having a data chunk management service and storage devices; collect statistics values for the managed object on the second one of the storage nodes; receive, at an arbitrary one of the plurality of storage nodes, a request for a statistics value within the statistics group; respond to the request by;
blindly querying, by a statistics manager included in the arbitrary storage node, a statistics client included in each of the other storage nodes in the plurality for statistics values associated with the managed object, receiving, by the arbitrary storage node, the statistics values collected on at least one of the first storage nodes and the second one of the storage nodes, combining, by the arbitrary storage node, the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes, and returning the combined statistics values; anduse the combined statistics values to scale out the distributed storage system with cluster-level functions distributed evenly among the plurality of storage nodes. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14)
-
Specification