Dynamic allocation of segments in a flash storage system

• US 10,191,662 B2
• Filed: 01/30/2017
• Issued: 01/29/2019
• Est. Priority Date: 10/04/2016
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Brennan, Timothy W., Doshi, Nidhi Pankaj, Wang, Xiaohui
• Primary Examiner(s): Nguyen, Than
• Application Number:
  US15/419,900
• Publication Number:
  US 20180095662A1
• Time in Patent Office: 729 Days
• Field of Search: 711103, 711170
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

Apparatus and methods of operating solid-state drives in a storage system are described. A method includes adjusting, by a host controller of a storage system during run-time, storage bandwidth for a storage system process responsive to an input output (I/O) write request to write data to the storage system that includes multiple solid-state storage drives by determining an allocation share for the storage system process requesting to write the data, and responsive to determining an open segment usage by the storage system process is under the allocation share for the storage system process, opening a new segment for the storage system process.

Claims

1. A method comprising:

adjusting, by a host controller of a storage system during run-time, storage bandwidth for a storage system process responsive to an input output (I/O) write request to write data to the storage system that comprises a plurality of solid-state storage drives by;

calculating an allocation share for the storage system process requesting to write the data using a target ratio of open segments assigned to the storage system process, a target ratio of open segments assigned to other storage system processes having open segments, and a target number of open segments for the storage system; and

responsive to determining an open segment usage by the storage system process is under the allocation share for the storage system process, opening a new segment for the storage system process.

2. The method of claim 1, wherein determining the allocation share for the storage system process comprises:

determining a ratio between a target ratio of open segments assigned to the storage system process and an aggregate of target ratios of open segments assigned to a plurality of storage system processes having open segments;

determining a target number of open segments for the storage system; and

calculating the allocation share for the storage system process using the ratio and the target number of open segments.

3. The method of claim 1, wherein adjusting the storage bandwidth for the storage system process further comprises:

determining whether an open segment usage of the storage system is under a target number of open segments for the storage system; and

responsive to determining the open segment usage of the storage system is under the target number of open segments for the storage system, opening a new segment for the storage system process.

4. The method of claim 3, wherein determining the allocation share for the storage system process is responsive to determining the open segment usage of the storage system is not under the target number of open segments for the storage system.

5. The method of claim 1, further comprising:

receiving the I/O write request to write data to the storage system from the storage system process;

determining whether the storage system process has an open segment;

responsive to determining the storage system process does not have an open segment, opening a new segment for the storage system process; and

responsive to determining the storage system process does have an open segment, adjusting the storage bandwidth for the storage system process.

6. The method of claim 1, wherein the plurality of solid-state storage drives are flash-based storage drives.

7. The method of claim 1, wherein the host controller is communicatively coupled to the storage drives and resides outside of the storage drive.

8. A method comprising:

adjusting, by a host controller of a storage system during run-time, storage bandwidth for a storage system process responsive to an input output (I/O) write request to write data to the storage system that comprises a plurality of solid-state storage drives by;

determining an allocation share for the storage system process requesting to write the data;

responsive to determining an open segment usage by the storage system process is under the allocation share for the storage system process, opening a new segment for the storage system process;

determining whether the open segment usage by the storage system process is under the allocation share for the storage system process;

responsive to determining the open segment usage by the storage system process is not under the allocation share for the storage system process;

determining other allocation shares for other storage system process having open segments;

determining open segment usage for the other storage system processes;

identifying a pool of open segments unused by the other storage system processes by determining a difference between the other allocation shares and open segment usage for the other storage system processes; and

distributing a new segment from the pool of segments to the storage system process.

9. A storage system comprising:

a memory; and

a host controller, operatively coupled to the memory, to;

adjust, during run-time, storage bandwidth for a storage system process responsive to an input output (I/O) write request to write data to the storage system that comprises a plurality of solid-state storage drives, the host controller to;

determine an allocation share for the storage system process requesting to write the data;

responsive to determining an open segment usage by the storage system process is under the allocation share for the storage system process, open a new segment for the storage system process

determine whether the open segment usage by the storage system process is under the allocation share for the storage system process;

responsive to determining the open segment usage by the storage system process is not under the allocation share for the storage system process, the host controller to;

determine other allocation shares for other storage system process having open segments;

determine open segment usage for the other storage system processes;

identify a pool of open segments unused by the other storage system processes by determining a difference between the other allocation shares and open segment usage for the other storage system processes; and

distribute a new segment from the pool of segments to the storage system process.

10. The storage system of claim 9, wherein to determine the allocation share for the storage system process, the host controller to:

determine a ratio between a target ratio of open segments assigned to the storage system process and an aggregate of target ratios of open segments assigned to a plurality of storage system processes having open segments;

determine a target number of open segments for the storage system; and

calculate the allocation share for the storage system process using the ratio and the target number of open segments.

11. The storage system of claim 9, wherein to adjust the storage bandwidth for the storage system process, the host controller further to:

determine whether an open segment usage of the storage system is under a target number of open segments for the storage system; and

responsive to determining the open segment usage of the storage system is under the target number of open segments for the storage system, open a new segment for the storage system process.

12. The storage system of claim 11, wherein to determine the allocation share for the storage system process is responsive to determining the open segment usage of the storage system is not under the target number of open segments for the storage system.

13. The storage system of claim 9, the host controller further to:

receive the I/O write request to write data to the storage system from the storage system process;

determine whether the storage system process has an open segment;

responsive to determining the storage system process does not have an open segment, open a new segment for the storage system process; and

responsive to determining the storage system process does have an open segment, adjust the storage bandwidth for the storage system process.

14. A non-transitory computer-readable medium that, when executed by a processing device, causes the processing device to:

adjust, by the processing device during run-time, storage bandwidth for a storage system process responsive to an input output (I/O) write request to write data to the storage system that comprises a plurality of solid-state storage drives, the processing device to;

determine an allocation share for the storage system process requesting to write the data;

responsive to determining an open segment usage by the storage system process is under the allocation share for the storage system process, open a new segment for the storage system process

determine whether the open segment usage by the storage system process is under the allocation share for the storage system process;

responsive to determining the open segment usage by the storage system process is not under the allocation share for the storage system process, the processing device to;

determine other allocation shares for other storage system process having open segments;

determine open segment usage for the other storage system processes;

identify a pool of open segments unused by the other storage system processes by determining a difference between the other allocation shares and open segment usage for the other storage system processes; and

distribute a new segment from the pool of segments to the storage system process.

15. The non-transitory computer-readable medium of claim 14, wherein to determine the allocation share for the storage system process, the processing device to:

determine a ratio between a target ratio of open segments assigned to the storage system process and an aggregate of target ratios of open segments assigned to a plurality of storage system processes having open segments;

determine a target number of open segments for the storage system; and

calculate the allocation share for the storage system process using the ratio and the target number of open segments.

16. The non-transitory computer-readable medium of claim 14, wherein to adjust the storage bandwidth for the storage system process, the processing device further to:

determine whether an open segment usage of the storage system is under a target number of open segments for the storage system; and

responsive to determining the open segment usage of the storage system is under the target number of open segments for the storage system, open a new segment for the storage system process.

17. The non-transitory computer-readable medium of claim 14, the processing device further to:

receive the I/O write request to write data to the storage system from the storage system process;

determine whether the storage system process has an open segment;

responsive to determining the storage system process does not have an open segment, open a new segment for the storage system process; and

responsive to determining the storage system process does have an open segment, adjust the storage bandwidth for the storage system process.