METHOD TO OPTIMIZE INLINE I/O PROCESSING IN TIERED DISTRIBUTED STORAGE SYSTEMS

• US 20160011816A1
• Filed: 12/04/2014
• Published: 01/14/2016
• Est. Priority Date: 07/09/2014
• Status: Abandoned Application

• Current Assignee: Nexenta Systems Incorporated (DataDirect Networks Incorporated)
• Original Assignee: Nexenta Systems Incorporated (DataDirect Networks Incorporated)
• Inventors: Aizman, Alexander
• Application Number:
  US14/560,186
• Publication Number:
  US 20160011816A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

The present disclosure provides methods and systems for input/output processing workflows in distributed multi-tiered distributed storage systems (tDSS). One implementation relates to a method of writing data to a heterogeneous tDSS. A class of storage tier for the first copy or the first subset of coded slices of data is selected using operating modes for the tiers, where the operating mode for a tier instance depends in part on statistical measures of operating parameters for that tier. Lower tiers are selected to store additional replicas of data using operating modes for those lower tiers. Another implementation relates to a method of reading data from a heterogeneous tDSS. To execute the read, tiers that store a copy of the data are selected using operating modes for the tiers, where the operating mode for a tier instance depends in part on statistical measures of operating parameters for that tier.

Claims

1. A system comprising:

a processor;

a distributed storage system including a plurality of storage tiers, each storage tier including a plurality of storage servers; and

an electronic storage medium containing program instructions executable on the processor for;

associating a service level rule with a service requester;

measuring operational parameters associated with writing data to each storage tier of the plurality of storage tiers;

receiving a request to write a data set as part of an input/output operation from the service requester;

writing a first portion of the data set to one or more storage servers associated with a first storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the first storage tier.

2. The system of claim 1, wherein the processor writes a second portion of the first data set to one or more storage servers associated with a second storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the second storage tier.

3. The system of claim 1, wherein the processor, during writing, performs erasure encoding of the first portion of the data set to a plurality of storage servers associated with one or more storage tiers based on the service level rule associated with the requester and the measured operational parameters associated with the one or more storage tiers.

4. The system of claim 1, wherein the processor writes a copy of the first portion of the data set to one or more storage servers associated with a second storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the second storage tier.

5. The system of claim 1, wherein the service requester includes one of a user and an application.

6. The system of claim 1, wherein the service level rule is based on a service level agreement (SLA).

7. The system of claim 6, wherein the SLA includes at least one of a static rule and a dynamic rule.

8. The system of claim 7, wherein the static rule includes an administrative requirement.

9. The system of claim 7, wherein the dynamic rule includes a probabilistic requirement.

10. The system of claim 1, wherein the service level rule is based at least in part on maximum allowable I/O latency, minimum allowable storage capacity, maximum allowable cost of storage, minimum allowable sequential throughput, minimum allowable random throughput, minimum allowable sequential IOPS, minimum allowable random IOPS, storage location, and class of storage (CoS).

11. The system of claim 1, wherein each storage tier of the plurality of storage tiers is associated with a class of storage (CoS) descriptor.

12. The system of claim 11, wherein the CoS descriptor includes at least one of a read function pointer to read from an associated storage tier and write function pointer to write to an associated storage tier.

13. The system of claim 1, wherein measuring includes a statistical measure over a period of time.

14. The system of claim 1, wherein the first storage tier is at least one of a persistent storage tier and a non-persistent storage tier.

15. The system of claim 1, wherein the processor measures the operational parameters of the first storage tier during writing to the first storage tier.

16. The system of claim 15, wherein the processor dynamically determines, based on the measured operational parameters, which storage tier of the plurality of storage tiers to write other portions of the data set.

17. The system of claim 1, wherein each of the plurality of storage tiers is determined based on requirements including price, performance, capacity, and function.

18. The system of claim 1, wherein the processor associates each storage tier of the plurality of storage tiers with a class of storage, wherein each class of storage is associated with data access mechanisms used to write data to each of a plurality of storage disks.

19. The system of claim 1, wherein the processor executes a match function to map each of a plurality of service level rules to one or more of a plurality of a class of storage (CoS) labels, the match function determining that the first storage tier satisfies the service level rule based on a CoS label associated with the first storage tier.

20. The system of claim 19, wherein the processor executes a cost function to determine the cost of executing an I/O request on at least one of the first storage tier and a storage server of the first storage tier.

21. The system of claim 1, wherein the writing includes at least one of synchronous writing and asynchronous writing.

22. The system of claim 21, wherein asynchronous writing includes scheduling when a writing of the first portion of the data to the first storage tier or another storage tier will occur.

23. The system of claim 1, wherein the writing occurs simultaneously with respect to a plurality of tiers of the distributed storage system.

24. A method for writing data to a distributed storage system including a plurality of storage tiers comprising:

associating each storage tier of the plurality of storage tiers with a plurality of storage servers;

associating a service level rule with a service requester;

measuring operational parameters associated with writing data to each storage tier of the plurality of storage tiers;

receiving a request to write a data set as part of an input/output operation from the service requester;

writing a first portion of the data set to one or more storage servers associated with a first storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the first storage tier.

25. A system comprising:

a processor;

a distributed storage system including a plurality of storage tiers, each storage tier including a plurality of storage servers; and

an electronic storage medium containing program instructions executable on the processor for;

associating a service level rule with a service requester;

measuring operational parameters associated with reading data from each storage tier of the plurality of storage tiers;

receiving a request from the service requester for a data set as part of an input/output operation from the service requester;

reading a first portion of the data set from one or more storage servers associated with a first storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the first storage tier.

26. The system of claim 25, wherein the processor reads a second portion of the data set from one or more storage servers associated with a second storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the second storage tier.

27. A method for reading data from a distributed storage system including a plurality of storage tiers comprising:

associating each storage tier of the plurality of storage tiers with a plurality of storage servers;

associating a service level rule with a service requester;

measuring operational parameters associated with reading data from each storage tier of the plurality of storage tiers;

receiving a request for a data set as part of an input/output operation from the service requester;

reading a first portion of the data set from one or more storage servers associated with a first storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the first storage tier.

28. The method of claim 27, comprising reading a second portion of the data set from one or more storage servers associated with a second storage tier based on the service level rule associated with the requester and the measured operational parameters associated with the second storage tier.