FILE SYSTEM MODE SWITCHING IN A DISTRIBUTED STORAGE SERVICE
First Claim
1. A distributed storage service, comprising:
- a plurality of computing devices that implement;
one or more low latency (LL) servers configured to support one or more of a plurality of file systems that are in LL mode, wherein the one or more LL servers are configured to;
determine write operations according to metadata requests received from one or more sources;
write journal entries for the write operations to metadata journals for respective file systems; and
send notifications to respective ones of the sources indicating results of the metadata requests, wherein metadata write operations specified by the journal entries are committed in a storage system of the distributed storage service subsequent to sending the notifications; and
a high throughput (HT) metadata subsystem configured to support one or more of the plurality of file systems that are in HT mode, wherein the HT metadata subsystem is configured to communicate with the storage system using distributed transactions to perform metadata operations indicated by metadata requests received from one or more sources and to notify respective sources after completion of the transactions.
2 Assignments
0 Petitions
Accused Products
Abstract
A distributed file storage services (DFSS) that provides low latency (LL) and high throughput (HT) modes for file systems. A HT metadata subsystem (HTMS) may use a distributed transaction system for data and metadata reads and writes for file systems in HT mode. A LL metadata subsystem (LLMS) may process metadata requests for file systems in LL mode. For metadata read requests, the LLMS may locally cache at least some of the file system metadata. For metadata write requests, the LLMS may write entries to a journal and notify the access node after the entries are committed to the journal. Data reads and writes for file systems in LL mode may be handled similarly to data reads and writes for file systems in HT mode. A file system may be converted from LL to HT mode, or from HT to LL mode.
-
Citations
21 Claims
-
1. A distributed storage service, comprising:
a plurality of computing devices that implement; one or more low latency (LL) servers configured to support one or more of a plurality of file systems that are in LL mode, wherein the one or more LL servers are configured to; determine write operations according to metadata requests received from one or more sources; write journal entries for the write operations to metadata journals for respective file systems; and send notifications to respective ones of the sources indicating results of the metadata requests, wherein metadata write operations specified by the journal entries are committed in a storage system of the distributed storage service subsequent to sending the notifications; and a high throughput (HT) metadata subsystem configured to support one or more of the plurality of file systems that are in HT mode, wherein the HT metadata subsystem is configured to communicate with the storage system using distributed transactions to perform metadata operations indicated by metadata requests received from one or more sources and to notify respective sources after completion of the transactions. - View Dependent Claims (2, 3, 4, 5, 6)
-
7. A method, comprising:
performing, by a plurality of computing devices; receiving requests for a plurality of file systems in a distributed storage service; for at least one request; communicating with a storage system of the distributed storage service using one or more distributed transactions to perform one or more operations indicated by the request; and notifying a source of the request after completion of the one or more distributed transactions; and for at least one other request; writing at least one journal entry specifying one or more write operations indicated by the request to a metadata journal for the respective file system; and notifying a source of the request to indicate results of the request, wherein the write operations specified by the at least one journal entry are committed in the storage system subsequent to the notification. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
18. A non-transitory computer-readable storage medium storing program instructions that when executed on one or more computers cause the one or more computers to implement:
-
a low latency (LL) metadata subsystem comprising one or more servers, the servers associated with one or more of a plurality of file systems stored in a distributed storage service, wherein the one or more servers are configured to; determine write operations according to metadata requests received from the distributed storage service; write journal entries for the write operations to metadata journals for respective file systems; and send notifications indicating results of the metadata requests, wherein write operations specified by the journal entries are committed in the storage subsystem subsequent to sending the notifications; and a high throughput (HT) metadata subsystem configured to communicate using distributed transactions according to a distributed transaction system to transactionally perform metadata operations indicated by metadata requests and to send notifications after completion of the transactions. - View Dependent Claims (19, 20, 21)
-
Specification