Unified indirection in a multi-device hybrid storage unit

• US 10,474,397 B2
• Filed: 06/13/2017
• Issued: 11/12/2019
• Est. Priority Date: 06/13/2017
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: Lamberts, Bernd, Karamcheti, Vijay
• Primary Examiner(s): Schnee, Hal
• Application Number:
  US15/621,932
• Publication Number:
  US 20180356992A1
• Time in Patent Office: 882 Days
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0658 Controller construction arrangements
• CPC Class Codes: G06F 3/068 Hybrid storage device
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

The disclosed multi-device platform includes, by way of example, a system that receives a host command including a logical address and determines a hybrid storage device unit based on the logical address. The hybrid storage device unit has a set of hybrid physical storage devices and the set of hybrid physical storage devices includes one or more magnetic storage devices and one or more flash storage devices. The system selects a first plurality of physical storage devices from the set of hybrid physical storage devices, generates a plurality of device commands for the first plurality of physical storage devices based on the host command, and executes the plurality of device commands on the first plurality of physical storage devices.

Claims

1. A method comprising:

receiving a host command including a logical address;

determining a hybrid storage device unit based on the logical address, wherein the hybrid storage device unit comprises;

a set of hybrid physical storage devices, wherein the set of hybrid physical storage devices includes;

one or more magnetic storage devices; and

one or more flash storage devices;

a unified indirection table for the set of hybrid physical storage devices, wherein the unified indirection table includes a plurality of mapping entries mapping logical addresses to physical addresses for all host data stored on the set of hybrid physical storage devices;

a unified host command queue for the set of hybrid physical storage devices, wherein the unified host command queue manages a priority for host commands for host data stored on the set of hybrid physical storage devices; and

a set of predefined rules for using the unified indirection table and the unified host command queue to determine host command processing and corresponding physical addresses;

selecting, based on the priority and from the unified host command queue, the host command for processing;

selecting, using the unified indirection table and the set of predefined rules to process the host command, a first plurality of physical storage devices from the set of hybrid physical storage devices;

generating, based on the host command and physical addresses for the first plurality of physical storage devices from the unified indirection table, a plurality of device commands for the first plurality of physical storage devices; and

executing the plurality of device commands on the first plurality of physical storage devices.

2. The method of claim 1, wherein selecting the first plurality of physical storage devices includes:

determining a type of physical storage device for executing the host command from a magnetic storage device type and a flash storage device type; and

responsive to the determined type of physical storage device being the magnetic storage device type;

identifying one or more first magnetic storage devices included in the set of hybrid physical storage devices;

determining an available storage capacity for each of the one or more first magnetic storage devices; and

selecting one or more second magnetic storage devices from the one or more first magnetic storage devices based on the available storage capacity of each of the one or more first magnetic storage devices.

3. The method of claim 1, wherein selecting the first plurality of physical storage devices includes:

determining a type of physical storage device for executing the host command from a magnetic storage device type and a flash storage device type; and

responsive to the determined type of physical storage device being the flash storage device type;

identifying one or more first flash storage devices included in the set of hybrid physical storage devices;

determining an amount of writes and an available storage capacity for each of the one or more first flash storage devices; and

selecting one or more second flash storage devices from the one or more first flash storage devices based on the amount of writes and the available storage capacity of each of the one or more first flash storage devices.

4. The method of claim 1, wherein the host command is associated with a data item, and the method further comprises:

determining a data type of the data item;

identifying, from the set of predefined rules, a predefined rule associated with the data type; and

determining a type of physical storage device for the data item based on the data type and the predefined rule.

5. The method of claim 1, wherein the host command is associated with a data item and specifies a device type for the data item, and the method further comprises:

determining a type of physical storage device for the data item to be the device type specified in the host command.

6. The method of claim 1, wherein the host command includes a write operation of a data item, and generating the plurality of device commands includes:

partitioning the data item into a plurality of data blocks based on the first plurality of physical storage devices; and

generating a plurality of device write commands for writing the plurality of data blocks to the first plurality of physical storage devices.

7. The method of claim 1, further comprising:

determining a frequency at which the logical address has been accessed;

determining that the frequency satisfies a threshold frequency;

determining that a data block associated with the logical address is stored in a magnetic storage device included in the set of hybrid physical storage devices; and

relocating the data block to a flash storage device included in the set of hybrid physical storage devices.

8. The method of claim 1, further comprising:

determining a frequency at which the logical address has been accessed;

determining that the frequency satisfies a threshold frequency;

determining that a data block associated with the logical address is stored in a flash storage device included in the set of hybrid physical storage devices; and

relocating the data block to a magnetic storage device included in the set of hybrid physical storage devices.

9. The method of claim 1, wherein the unified indirection table is stored in a flash storage device included in the set of hybrid physical storage devices.

10. The method of claim 1, wherein the unified indirection table is stored in at least one of the one or more flash storage devices in the set of hybrid physical storage devices.

11. A system comprising:

one or more non-transitory hybrid storage device units, wherein each of the hybrid storage device units comprises;

a set of hybrid physical storage devices, wherein the set of hybrid physical storage devices includes;

one or more magnetic storage devices; and

one or more flash storage devices;

a unified indirection table for the set of hybrid physical storage devices, wherein the unified indirection table is configured to include a plurality of mapping entries mapping logical addresses to physical addresses for all host data stored on the set of hybrid physical storage devices;

a unified host command queue for the set of hybrid physical storage devices, wherein the unified host command queue is configured to manage a priority for host commands for host data stored on the set of hybrid physical storage devices; and

a set of predefined rules for using the unified indirection table and the unified host command queue to determine host command processing and corresponding physical addresses; and

a storage processor coupled to the one or more non-transitory hybrid storage device units and storing a multi-device platform firmware, the multi-device platform firmware executable by the storage processor to;

receive a host command including a logical address;

determine a first hybrid storage device unit from the one or more hybrid storage device units based on the logical address;

select, based on the priority and from the unified host command queue, the host command for processing;

select, using the unified indirection table and the set of predefined rules to process the host command, a first plurality of physical storage devices from the set of hybrid physical storage devices of the first hybrid storage device unit;

generate, based on the host command and physical addresses for the first plurality of physical storage devices from the unified indirection table, a plurality of device commands for the first plurality of physical storage devices; and

execute the plurality of device commands on the first plurality of physical storage devices.

12. The system of claim 11, wherein to select the first plurality of physical storage devices, the multi-device platform firmware, when executed, further causes the system to:

determine a type of physical storage device for executing the host command from a magnetic storage device type and a flash storage device type;

responsive to the determined type of physical storage device being the magnetic storage device type, identify one or more first magnetic storage devices included in the set of hybrid physical storage devices;

determine an available storage capacity for each of the one or more first magnetic storage devices; and

select one or more second magnetic storage devices from the one or more first magnetic storage devices based on the available storage capacity of each of the one or more first magnetic storage devices.

13. The system of claim 11, wherein to select the first plurality of physical storage devices, the multi-device platform firmware, when executed, further causes the system to:

determine a type of physical storage device for executing the host command from a magnetic storage device type and a flash storage device type;

responsive to the determined type of physical storage device being the flash storage device type, identify one or more first flash storage devices included in the set of hybrid physical storage devices;

determine an amount of writes and an available storage capacity for each of the one or more first flash storage devices; and

select one or more second flash storage devices from the one or more first flash storage devices based on the amount of writes and the available storage capacity of each of the one or more first flash storage devices.

14. The system of claim 11, wherein the host command is associated with a data item, and wherein the multi-device platform firmware, when executed, further causes the system to:

determine a data type of the data item;

identify, from the set of predefined rules, a predefined rule associated with the data type; and

determine a type of physical storage device for the data item based on the data type and the predefined rule.

15. The system of claim 11, wherein the host command is associated with a data item and specifies a device type for the data item, and wherein the multi-device platform firmware, when executed, further causes the system to:

determine a type of physical storage device for the data item to be the device type specified in the host command.

16. The system of claim 11, wherein the host command includes a write operation of a data item, and wherein to generate the plurality of device commands, the multi-device platform firmware, when executed, further causes the system to:

partition the data item into a plurality of data blocks based on the first plurality of physical storage devices; and

generate a plurality of device write commands for writing the plurality of data blocks to the first plurality of physical storage devices.

17. The system of claim 11, wherein the multi-device platform firmware, when executed, further causes the system to:

determine a frequency at which the logical address has been accessed;

determine that the frequency satisfies a threshold frequency;

determine that a data block associated with the logical address is stored in a magnetic storage device included in the set of hybrid physical storage devices; and

relocate the data block to a flash storage device included in the set of hybrid physical storage devices.

18. The system of claim 11, wherein the multi-device platform firmware, when executed, further causes the system to:

determine a frequency at which the logical address has been accessed;

determine that the frequency satisfies a threshold frequency;

determine that a data block associated with the logical address is stored in a flash storage device included in the set of hybrid physical storage devices; and

relocate the data block to a magnetic storage device included in the set of hybrid physical storage devices.

19. The system of claim 11, wherein the unified indirection table is stored in at least one of the one or more flash storage devices in the set of hybrid physical storage devices.

20. A data storage system, comprising:

means for receiving a host command including a logical address;

means for determining a hybrid storage device unit based on the logical address, wherein the hybrid storage device unit comprises;

a set of hybrid physical storage devices, wherein the set of hybrid physical storage devices includes;

one or more magnetic storage devices; and

one or more flash storage devices;

a unified indirection table for the set of hybrid physical storage devices, wherein the unified indirection table is configured to include a plurality of mapping entries mapping logical addresses to physical addresses for all host data stored on the set of hybrid physical storage devices;

a unified host command queue for the set of hybrid physical storage devices, wherein the unified host command queue is configured to manage a priority for host commands for host data stored on the set of hybrid physical storage devices; and

a set of predefined rules for using the unified indirection table and the unified host command queue to determine host command processing and corresponding physical addresses;

means for selecting, based on the priority and from the unified host command queue, the host command for processing;

means for selecting, using the unified indirection table and the set of predefined rules to process the host command, a first plurality of physical storage devices from the set of hybrid physical storage devices;

means for generating, based on the host command and physical addresses for the first plurality of physical storage devices from the unified indirection table, a plurality of device commands for the first plurality of physical storage devices; and

means for executing the plurality of device commands on the first plurality of physical storage devices.