Primary data storage system with quality of service

• US 9,176,708 B2
• Filed: 11/07/2012
• Issued: 11/03/2015
• Est. Priority Date: 11/07/2011
• Status: Expired due to Fees

• Current Assignee: Pivot3, Inc., NexGen Storage, Inc. (Western Digital Corporation)
• Original Assignee: NexGen Storage, Inc. (Western Digital Corporation)
• Inventors: Gallant, David A., Long, Kelly E., Ashmore, Paul A., Sobolewski, Sebastian Piotr
• Primary Examiner(s): Tseng, Cheng-Yuan
• Assistant Examiner(s): Ahmed, Zubair
• Application Number:
  US13/671,544
• Publication Number:
  US 20130117286A1
• Time in Patent Office: 1,091 Days
• Field of Search: 711/114, 707/752
• US Class Current: 1/1
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 7/24 Sorting, i.e. extracting data from one or more carriers, rearranging the data in numerical or other ordered sequence, and rerecording the sorted data on the original carrier or on a different carrier or set of carriers sorting methods in generalG06F7/36 takes precedence

Abstract

The invention is directed to a primary data storage system for use in a computer network in which a network allows user computers to transfer data to/from the primary data storage system. In one embodiment, the primary data storage system allows an administrator of the computer network to define two or more volumes on the primary data storage system and define quality of service goals for each volume. The primary data storage system operates so as allocate resources within the primary data storage system to the volumes based upon criticality and performance goals specified for each of the volumes.

Claims

1. A primary data storage system for use in a computer network and having a quality of service capability, the system comprising:

an input/output port configured to receive a block command packet that embodies one of a read block command and a write block command and transmitting a block result packet in reply to a block command packet;

a data store system having at least one data store configured to receive and store data in response to a write block command and retrieve and provide data in response to a read block command;

wherein the data store system is adaptable to accommodating at least a first volume with a first quality of service goals and a second volume with a second quality of service goals;

a statistics database configured to receive, store, and provide data for use in making decisions related to the pursuit of the first and second quality of service goals for whatever first and second volumes the data store system is adapted to accommodate; and

a sorting processor configured to sort an input string comprised of multiple read/write block commands with one or more of the commands relating to whatever first volume the data store system is adapted to accommodate and one or more of the commands relating to whatever second volume the data store system is adapted to accommodate into an output string of the multiple read/write block commands, wherein the sorting processor is configured to order the multiple read/write block commands in the output string based on the first and second quality of service goals associated with whatever first and second volumes the data store system is adapted to accommodate and statistical data provided by the statistics database, wherein the sorting processor is also configured, in connection with the sorting of read/write block command, to make a first calculated decision in connection with the sorting of a read/write block command when the making of the first calculated decision is unlikely to violate a time constraint and otherwise make a second calculated decision that takes less time than the first calculated decision.

2. The primary data storage system of claim 1, wherein the sorting processor includes:

a sub-string processor for sorting a string of read/write block commands into a plurality of sub-strings of read/write block commands; and

a merging processor for merging a plurality of sub-strings of read/write block commands into a string of read/write block commands.

3. The primary data storage system of claim 2, wherein the sub-string processor, in sorting a read/write block command, is capable of acquiring a combination of a criticality, throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data associated with whatever criticality is associated with whichever one of a first volume and a second volume of a read/write block command is associated.

4. The primary data storage system of claim 2, wherein the sub-string processor, in sorting a read/write block command, is capable of acquiring a combination of a criticality, throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data associated with whichever one of a first volume and a second volume of a read/write block command is associated.

5. The primary data storage system of claim 2, wherein the sub-string processor, in sorting a read/write block command, is capable of acquiring:

a combination of a criticality, throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data associated with whichever one of the first and second volumes the read/write block command is associated; and

a combination of a criticality, throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data associated with the other of the first and second volumes in deciding the sorting of the read/write block command.

6. The primary data storage system of claim 2, wherein the sub-string processor comprises a port for receiving data from and providing data to the statistics database.

7. The primary data storage system of claim 2, wherein the merging processor, in merging read/write block commands into a string, is capable of accessing a combination of a criticality, throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data relating to hardware used in moving data to, from, or within the data store system with the data store system.

8. The primary data storage system of claim 1, wherein the sorting processor includes:

a first sub-string processor for sorting a string of read/write block commands into a plurality of sub-strings of storage commands;

a second sub-string processor for sorting sub-strings of read/write block commands into a plurality of sub-sub-strings of read/write commands; and

a merging processor for merging a plurality of sub-sub-strings of read/write block commands into a string of read/write block commands.

9. The primary data storage system of claim 8, wherein the first sub-string processor, in sorting a read/write block command, is capable of performing a sort based upon one of:

(a) a criticality and (b) a combination of throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data, associated with whichever one of the first volume and second volume the read/write block command is associated.

10. The primary data storage system of claim 8, wherein the second sub-string processor, in sorting a read/write block command, is capable of performing a sort based upon one of:

(a) a criticality and (b) a combination of throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data, associated with whichever one of the first volume and second volume the read/write block command is associated.

11. The primary data storage system of claim 8, wherein the merging processor, in merging read/write block commands into a string, is capable of acquiring a combination of a criticality, throughput, queue depth, latency, and input-output operations per second (IOPS) statistical data relating to hardware used in moving data to, from, and within the data store system with the data store system.

12. The primary data storage system of claim 1, wherein the sorting processor capable of determining a priority of a read/write block command relative to other read/write block commands using a weighted sum of weighted factors, the factors comprising:

(a) the criticality of the volume with which the read/write command is associated;

(b) the relationship of the read/write block command to the quality of service goals for the volume with which the read/write command is associated;

(c) the relationship of the read/write block command to the quality of service goals for any other volumes having the same criticality as the volume with which the read/write command is associated;

(d) the relationship of the read/write block command to hardware used in moving data to, from, and within the data store system; and

(e) the relationship of the read/write block command to the quality of service goals for any other volumes having a different criticality than the volume with which the read/write command is associated.

13. The primary data storage system of claim 12, wherein at least one factor has a value that is a current statistic value.

14. The primary data storage system of claim 12, wherein at least one factor has a value that is a historic statistic value.

15. The primary data storage system of claim 12, wherein each factor is weighted by a coefficient whose value relates to:

(a) the criticality and (b) reducing the difference between quality of service goals for the first and second volumes and the actual service obtained.

16. The primary data storage system of claim 12, wherein each factor is weighted by a coefficient that changes over time.

17. The primary data storage system of claim 1, wherein the statistics database is capable of providing the sorting processor with current statistical data that relates to a first time frame and historical statistical data that relates to a second time frame that is greater than the first time frame.

18. The primary data storage system of claim 17, wherein the current statistical data and the historical statistical data relate to both the first volume and the second volume.

19. The primary data storage system of claim 17, wherein the current statistical data and the historical statistical data relate to a first criticality associated with the first volume and a second criticality associated with second volume.

20. The primary data storage system of claim 1, wherein the statistics database is capable of providing the sorting processor with a combination of throughput data, queue depth data, latency data, and input-output operations per second (IOPS) related data.

21. The primary data storage system of claim 1, wherein the statistics database is capable of providing the sorting processor with a combination of:

(a) current throughput data, (b) current queue depth data, (c) current latency data, (d) current input-output operations per second (IOPS) related data, (e) historical throughput data, (f) historical queue depth data, (g) historical latency data, and (h) historical input-output operations per second (IOPS) related data.

22. The primary data storage system of claim 1, wherein the statistics database is capable of providing the sorting processor with a combination of:

(a) current read related throughput data, (b) current read related queue depth data, (c) current read related latency data, (d) current read related input-output operations per second (IOPS) related data, (e) historical read related throughput data, (f) historical read related queue depth data, (g) historical read related latency data, (h) historical read related input-output operations per second (IOPS) related data, (i) current write related throughput data, (j) current write related queue depth data, (k) current write related latency data, (l) current write related input-output operations per second (IOPS) related data, (m) historical write related throughput data, (n) historical write related queue depth data, (o) historical write related latency data, and (p) historical write related input-output operations per second (IOPS) related data.

23. The primary data storage system of claim 1, wherein the statistics database is capable of providing the sorting processor with a combination of latency, throughput, and IOPS related statistical data relating to one or more of a first volume and a second volume.

24. The primary data storage system of claim 1, wherein the statistics database is capable of providing the sorting processor with a combination of latency, throughput, and IOPS related statistical data relating to hardware used in moving data to, from, and within the data store system.

25. The primary data storage system of claim 1, wherein one or more of the first quality of service goal associated with the first volume and the second quality of service goal associated with the second volume are defined by an administrator of the storage system.

26. The primary data storage system of claim 1, wherein one or more of the first quality of service goal associated with the first volume and the second quality of service goal associated with the second volume are adjustable.

27. The primary data storage system of claim 1, wherein the block storage command comprises one of a read command and a write command.

28. A primary data storage system, as claimed in claim 2, wherein:

the merging processor comprising a port for receiving data from and providing data to the statistics database.

29. A primary data storage system, as claimed in claim 17, wherein:

the current statistical data and the historical statistical data relate to a first volume.

30. A primary data storage system, as claimed in claim 17, wherein:

the current statistical data and the historical statistical data relate to a first criticality associated with the first volume.

31. A primary data storage system, as claimed in claim 1, wherein:

the combination includes at least latency data.

32. A primary data storage system, as claimed in claim 1, wherein:

the statistics database is capable of providing the sorting processor with a combination of latency, throughput, and IOPS related statistical data that is related to criticality.