Coalescing metadata for mirroring to a remote storage node in a cluster storage system
First Claim
1. A computing device, comprising:
- a memory containing machine readable medium comprising machine executable code having stored thereon instructions for performing a method of facilitating storage system mirroring anda processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to;
receive a plurality of data and metadata sets from a client, each received data or metadata set comprising a data or metadata request from the client to store the data or metadata set to a remote node;
produce a plurality of metadata chains, each metadata chain comprising a grouping of at least two received metadata requests wherein at least one of the metadata chains comprises at least a new received metadata request and a previous received metadata request to be stored to a same storage address location at the remote node;
store each received metadata request to a metadata request (MR) data structure according to the time order the requests are received, each metadata chain comprising a head metadata request comprising an earliest received metadata request in the metadata chain and a tail metadata request comprising a last received metadata request in the metadata chain; and
transmit a representative metadata request that comprises the tail metadata in the metadata chain to the remote node for storage.
0 Assignments
0 Petitions
Accused Products
Abstract
Described herein are a system and method for remote mirroring/copying data and metadata sets from a local node to a remote node that reduces the number of metadata sets that are mirrored. In some embodiments, the local node may coalesce metadata sets into metadata chains, each metadata chain comprising a grouping of two or more metadata sets. In some instances, a “representative” metadata set of a metadata chain may be selected for sending to the remote node for storing, wherein the other metadata sets of the metadata chain are not sent to the remote node. In these embodiments, the selected metadata set may represent all the metadata sets in the chain and be the only metadata set in the chain that is transmitted and stored to the remote node. As such, the network congestion between the local and remote nodes may be reduced.
-
Citations
18 Claims
-
1. A computing device, comprising:
-
a memory containing machine readable medium comprising machine executable code having stored thereon instructions for performing a method of facilitating storage system mirroring and a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to; receive a plurality of data and metadata sets from a client, each received data or metadata set comprising a data or metadata request from the client to store the data or metadata set to a remote node; produce a plurality of metadata chains, each metadata chain comprising a grouping of at least two received metadata requests wherein at least one of the metadata chains comprises at least a new received metadata request and a previous received metadata request to be stored to a same storage address location at the remote node; store each received metadata request to a metadata request (MR) data structure according to the time order the requests are received, each metadata chain comprising a head metadata request comprising an earliest received metadata request in the metadata chain and a tail metadata request comprising a last received metadata request in the metadata chain; and transmit a representative metadata request that comprises the tail metadata in the metadata chain to the remote node for storage. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method, comprising:
-
receiving a plurality of data and metadata sets from a client, each received data or metadata set comprising a data or metadata request from the client to store the data or metadata set to a remote node; producing a plurality of metadata chains, each metadata chain comprising a grouping of at least two received metadata requests wherein at least one of the metadata chains comprises at least a new received metadata request and a previous received metadata request to be stored to a same storage address location at the remote node; storing each received metadata request to a metadata request (MR) data structure according to the time order the requests are received, each metadata chain comprising a head metadata request comprising an earliest received metadata request in the metadata chain and a tail metadata request comprising the last received metadata request in the metadata chain; and transmitting a representative metadata request that comprises the tail metadata in the metadata chain to the remote node for storage. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A non-transitory computer readable medium having stored thereon instructions for performing a method of facilitating storage system mirroring, which when executed by a at least one machine, causes the machine to:
-
receive a plurality of data and metadata sets from a client, each received data or metadata set comprising a data or metadata request from the client to store the data or metadata set to a remote node; produce a plurality of metadata chains, each metadata chain comprising a grouping of at least two received metadata requests wherein at least one of the metadata chains comprises at least a new received metadata request and a previous received metadata request to be stored to a same storage address location at the remote node; store each received metadata request to a metadata request (MR) data structure according to the time order the requests are received, each metadata chain comprising a head metadata request comprising an earliest received metadata request in the metadata chain and a tail metadata request comprising a last received metadata request in the metadata chain; and transmit a representative metadata request that comprises the tail metadata in the metadata chain to the remote node for storage. - View Dependent Claims (14, 15, 16, 17, 18)
-
Specification