Thin provisioning using cloud based ranks

• US 10,372,363 B2
• Filed: 09/14/2017
• Issued: 08/06/2019
• Est. Priority Date: 09/14/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Gupta, Lokesh, Borlick, Matthew G.
• Primary Examiner(s): Giardino, Jr., Mark A
• Application Number:
  US15/704,712
• Publication Number:
  US 20190079686A1
• Time in Patent Office: 691 Days
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A computer-implemented method for thin provisioning using cloud based ranks comprises determining a total amount of unused physical storage space for all of a plurality of local ranks associated with a storage controller; comparing the total amount of unused physical storage space to a first threshold; in response to determining that the total amount of unused physical storage space is less than the first threshold, creating one or more cloud based ranks. Creating each of the one or more cloud based ranks comprises allocating storage space on one or more corresponding cloud storage devices via a cloud interface; mapping the allocated storage space to corresponding virtual local addresses; and grouping the virtual local addresses as a virtual local rank associated with the storage controller.

Claims

1. A computer-implemented method comprising:

determining a total amount of unused physical storage space for all of a plurality of local ranks associated with a storage controller;

comparing the total amount of unused physical storage space to a first threshold;

in response to determining that the total amount of unused physical storage space is less than the first threshold, creating one or more cloud based ranks;

wherein creating each of the one or more cloud based ranks comprises;

allocating storage space on one or more corresponding cloud storage devices via a cloud interface;

mapping the allocated storage space to corresponding virtual local addresses; and

grouping the virtual local addresses as a virtual local rank associated with the storage controller;

wherein the method further comprises;

determining a total amount of used storage space for the plurality of local ranks and the one or more cloud based ranks;

determining a difference between a total amount of storage space for the plurality of local ranks and the determined total amount of used storage space; and

in response to determining that the difference is greater than a second threshold, moving data from the one or more cloud based ranks to the plurality of local ranks.

2. The computer-implemented method of claim 1, further comprising storing, on the one or more cloud based ranks, new data written after creating the one or more cloud based ranks.

3. The computer-implemented method of claim 1, further comprising:

moving, to the one or more cloud based ranks, data stored on the plurality of local ranks prior to creating the one or more cloud based ranks; and

storing new data written after creating the one or more cloud based ranks on the plurality of local ranks.

4. The computer-implemented method of claim 1, further comprising:

converting local data access requests for one of the cloud based ranks to cloud data access requests configured for the cloud interface; and

communicating the cloud data access requests to the one or more corresponding cloud storage devices via the cloud interface.

5. The computer-implemented method of claim 1, wherein the first threshold is different from the second threshold.

6. The computer-implemented method of claim 1, further comprising removing the one or more cloud based ranks after moving all of the data from the one or more cloud based ranks to the plurality of local ranks.

7. A storage system comprising:

a host adapter having one or more ports configured to communicatively couple the host adapter to one or more host devices;

a storage controller comprising a processor and a memory, the storage controller communicatively coupled to the host adapter; and

a device adapter comprising a processor and a memory, the device adapter communicatively coupled to the storage controller;

wherein the device adapter further comprises a plurality of ports communicatively coupled to a plurality of local storage drives and at least one network port communicatively coupled to a plurality of cloud storage devices via a network;

wherein one of the device adapter or the storage controller is further configured to implement a cloud provisioning module configured to;

create one or more cloud based ranks in response to a determination that a total amount of unused physical storage space on the plurality of local storage drives is less than a first predetermined threshold;

wherein, to create each of the one or more cloud based ranks, the cloud provisioning module is configured to;

allocate storage space on one or more corresponding cloud storage devices via a cloud interface;

assign the allocated storage space to corresponding virtual local addresses; and

organize the assigned virtual local addresses into a corresponding virtual local RAID array associated with the storage controller such that the allocated storage space on the one or more corresponding cloud storage devices appears to the storage controller as a local array of storage devices; and

wherein the cloud provisioning module is further configured to;

determine a total amount of used storage space for the plurality of local storage drives and the one or more cloud based ranks;

determine a difference between a total amount of storage space for the plurality of local storage drives and the determined total amount of used storage space; and

in response to determining that the difference is greater than a second predetermined threshold, move data from the one or more cloud based ranks to the plurality of local storage drives.

8. The system of claim 7, wherein the cloud provisioning module is further configured to store, on the one or more cloud based ranks, new data written after creating the one or more cloud based ranks.

9. The system of claim 7, wherein the cloud provisioning module is further configured to:

move, to the one or more cloud based ranks, data stored on the plurality of local storage drives prior to creating the one or more cloud based ranks; and

store new data written after creating the one or more cloud based ranks on the plurality of local storage drives.

10. The system of claim 7, wherein the cloud provisioning module is further configured to:

convert local data access requests for one of the cloud based ranks to cloud data access requests configured for the cloud interface; and

communicate the cloud data access requests to the one or more corresponding cloud storage devices via the cloud interface.

11. The system of claim 7, wherein the first predetermined threshold is different from the second predetermined threshold.

12. The system of claim 7, wherein the cloud provisioning module is further configured to remove the one or more cloud based ranks after moving all of the data from the one or more cloud based ranks to the plurality of local storage drives.

13. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed by a processor, causes the processor to:

determine a total amount of unused physical storage space for all of a plurality of local redundant array of independent disks (RAID) arrays associated with a storage controller;

compare the total amount of unused physical storage space to a first predetermined threshold;

in response to determining that the total amount of unused physical storage space is less than the first predetermined threshold, create one or more cloud based ranks;

wherein to create each of the one or more cloud based ranks, the computer readable program is configured to cause the processor to;

allocate storage space on one or more corresponding cloud storage devices via a cloud interface;

assign the allocated storage space to corresponding virtual local addresses; and

organize the assigned virtual local addresses into a corresponding virtual local RAID array associated with the storage controller such that the allocated storage space on the one or more corresponding cloud storage devices appears to the storage controller as a local array of storage devices;

wherein the computer readable program is further configured to cause the processor to;

determine a total amount of used storage space for the plurality of local RAID arrays and the one or more cloud based ranks;

determine a difference between a total amount of storage space for the plurality of local RAID arrays and the determined total amount of used storage space; and

in response to determining that the difference is greater than a second predetermined threshold, move data from the one or more cloud based ranks to the plurality of local RAID arrays.

14. The computer program product of claim 13, wherein the computer readable program is further configured to cause the processor to store, on the one or more cloud based ranks, new data written after creating the one or more cloud based ranks.

15. The computer program product of claim 13, wherein the computer readable program is further configured to cause the processor to:

move, to the one or more cloud based ranks, data stored on the plurality of local RAID arrays prior to creating the one or more cloud based ranks; and

store new data written after creating the one or more cloud based ranks on the plurality of local RAID arrays.

16. The computer program product of claim 13, wherein the computer readable program is further configured to cause the processor to remove the one or more cloud based ranks after moving all of the data from the one or more cloud based ranks to the plurality of local RAID arrays.

17. The computer program product of claim 13, wherein the computer readable program is further configured to cause the processor to convert local data access requests for the one or more virtual local RAID arrays to cloud data access requests according to requirements of an application programming interface (API) of the cloud interface.

18. The computer program product of claim 13, wherein the computer readable program is further configured:

convert local data access requests for one of the cloud based ranks to cloud data access requests configured for the cloud interface; and

communicate the cloud data access requests to the one or more corresponding cloud storage devices via the cloud interface.

19. A computing device comprising:

a network adapter configured to communicatively couple the computing device to one or more cloud storage devices via a network;

a storage medium configured to store data; and

a processor communicatively coupled to the network adapter and to the storage medium, wherein the processor is configured to;

determine a total amount of unused physical storage space for all of a plurality of local ranks;

compare the total amount of unused physical storage space to a first threshold; and

create one or more cloud based ranks in response to determining that the total amount of unused physical storage space is less than the first threshold;

wherein to create each of the one or more cloud based ranks, the processor is configured to;

allocate storage space on one or more cloud storage devices via an application programming interface (API) associated with the one or more cloud storage devices; and

generate a map table which maps the allocated storage space to corresponding virtual local addresses and groups the virtual local addresses to form a corresponding virtual local rank from the allocated storage space on the one or more cloud storage devices, the map table stored on the storage medium;

wherein the processor is further configured to;

determine a subsequent total amount of unused storage space for the plurality of local ranks after creating the one or more cloud based ranks;

determine a difference between the subsequent total amount of unused storage space and a total amount of used storage space on the one or more cloud based ranks; and

in response to determining that the difference is greater than a second threshold, move data from the one or more cloud based ranks to the plurality of local ranks.

20. The computing device of claim 19, wherein the processor is further configured to:

move, to the one or more cloud based ranks, data stored on the plurality of local ranks prior to creating the one or more cloud based ranks; and

storing new data written after creating the one or more cloud based ranks on the plurality of local ranks.

21. The computing device of claim 19, wherein the first threshold is different from the second threshold.

22. The computing device of claim 19, wherein the processor is further configured to remove the one or more cloud based ranks after moving all of the data from the one or more cloud based ranks to the plurality of local ranks.

23. The computing device of claim 19, wherein the processor is further configured to store, on the one or more cloud based ranks, new data written after creating the one or more cloud based ranks.