Destaging cache data using a distributed freezer

• US 9,417,964 B2
• Filed: 06/05/2015
• Issued: 08/16/2016
• Est. Priority Date: 04/16/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chambliss, David D., Garmiza, Ehood, Lotem, Eyal, Shalev, Leah
• Primary Examiner(s): DUNCAN, MARC M
• Application Number:
  US14/731,669
• Publication Number:
  US 20150269026A1
• Time in Patent Office: 438 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 2211/1009 Cache, i.e. caches used in RAID system with parity
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 2211/1057 Parity-multiple bits-RAID6, i.e. RAID 6 implementations
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Methods, apparatus and computer program products implement embodiments of the present invention that enable digital information devices having respective storage devices and memories to distributedly store, for a logical volume, data and first and second parity values across corresponding regions of the storage devices. Freezers having a one-to-one correspondence with the storage devices are distributedly stored in the memories. Upon detecting, in a cache, updated data for one or more first regions on the storage devices, existing data from the one or more first regions, and additional data for parity calculations are retrieved from one or more corresponding second regions on the storage devices, and first and the second parity values are calculated using the updated data, the existing data and the additional data, and the updated data and the calculated first and second parity values are stored to the freezers.

Claims

1. A method, comprising:

arranging multiple digital information devices having respective storage devices and memories to communicate within a network;

distributedly storing, for a logical volume, data and first and second parity values across corresponding physical regions of the storage devices;

distributedly storing, in the memories, multiple freezer nodes having a one-to-one correspondence with each of the multiple storage devices;

detecting, in a cache for the logical volume, updated data for one or more first physical regions on the storage devices;

retrieving existing data from the one or more first physical regions, and additional data for use in parity calculations from one or more corresponding second physical regions on the storage devices;

calculating the first and the second parity values using the updated data, the existing data and the additional data; and

storing the updated data and the calculated first and second parity values to the freezer nodes.

2. The method according to claim 1, and comprising destaging the updated data and the calculated first and second parity values from the freezer nodes to the corresponding storage devices.

3. The method according to claim 2, and comprising upon detecting a success in destaging first data from a first set of the freezer nodes and a failure to destage second data from a second set of the freezer nodes, the second set comprising one or two of the freezer nodes, retrieving further data from further corresponding regions on the storage devices, and calculating the second data using the first data and the further data.

4. The method according to claim 1, wherein distributedly storing the data and the first and the second parity values comprises storing the data and the first and the second parity values in a redundant array of independent disks (RAID) 6 configuration.

5. The method according to claim 1, wherein each of the freezer nodes comprises a data structure configured to store a data element selected from a list comprising the updated data, the first parity value and the second parity value.

6. The method according to claim 1, wherein distributedly storing a given one of the freezer nodes comprises co-locating, on one of the digital information devices, the freezer node and its corresponding storage device.

7. The method according to claim 1, wherein distributedly storing a given one of the freezer nodes comprises co-locating, on one of the digital information devices, the freezer node and none of the storage devices.

8. The method according to claim 1, wherein the one or more corresponding second physical regions are selected from one or more corresponding physical regions on one or more of the storage devices configured to store the data for the logical volume and one or more corresponding physical regions on two of each the storage devices configured to store the first and the second parity values.

9. An apparatus, comprising:

multiple digital information devices arranged on a network and having respective memories and storage devices; and

a separate processor coupled to each of the respective memories and configured to distributedly store, for a logical volume, data and first and second parity values across corresponding physical regions of the storage devices, to distributedly store, in the memories, multiple freezer nodes having a one-to-one correspondence with each of the multiple storage devices, to detect, in a cache for the logical volume, updated data for one or more first physical regions on the storage devices, to retrieve existing data from the one or more first physical regions, and additional data for use in parity calculations from one or more corresponding second physical regions on the storage devices, to calculate the first and the second parity values using the updated data, the existing data and the additional data, and to store the updated data and the calculated first and second parity values to the freezer nodes.

10. The apparatus according to claim 9, wherein a given one of the separate processors is configured to destage the updated data and the calculated first and second parity values from the freezer nodes to the corresponding storage devices.

11. The apparatus according to claim 10, wherein a given one of the separate processors is configured, upon detecting a success in destaging first data from a first set of the freezer nodes and a failure to destage second data from a second set of the freezer nodes, the second set comprising one or two of the freezer nodes, to retrieve further data from further corresponding physical regions on the storage devices, and to calculate the second data using the first data and the further data.

12. The apparatus according to claim 9, wherein the multiple digital information devices comprise modules of a storage controller.

13. The apparatus according to claim 9, wherein a given one of the separate processors is configured to distributedly store the data and the first and the second parity values by storing the data and the first and the second parity values in a redundant array of independent disks (RAID) 6 configuration.

14. The apparatus according to claim 9, wherein each of the freezer nodes comprises a data structure configured to store a data element selected from a list comprising the updated data, the first parity value and the second parity value.

15. The apparatus according to claim 9, wherein a given one of the separate processors is configured to distributedly store a given one of the freezer nodes by co-locating, on one of the digital information devices, the freezer node and its corresponding storage device.

16. The apparatus according to claim 9, wherein a given one of the separate processors is configured to distributedly store a given one of the freezer nodes by co-locating, on one of the digital information devices, the freezer node and none of the storage devices.

17. The apparatus according to claim 9, wherein a given one of the separate processors is configured to select the one or more corresponding second physical regions from one or more corresponding physical regions on one or more of the storage devices configured to store the data for the logical volume and one or more corresponding physical regions on each of two of the storage devices configured to store the first and the second parity values.

18. A computer program product, the computer program product comprising:

a non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code configured to arrange multiple digital information devices having respective storage devices and memories to communicate within a network;

computer readable program code configured to distributedly store, for a logical volume, data and first and second parity values across corresponding physical regions of the storage devices;

computer readable program code configured to distributedly store, in the memories, multiple freezer nodes having a one-to-one correspondence with each of the multiple storage devices;

computer readable program code configured to detect, in a cache for the logical volume, updated data for one or more first physical regions on the storage devices;

computer readable program code configured to retrieve existing data from the one or more first physical regions, and additional data for use in parity calculations from one or more corresponding second physical regions on the storage devices;

computer readable program code configured to calculate the first and the second parity values using the updated data, the existing data and the additional data; and

computer readable program code configured to store the updated data and the calculated first and second parity values to the freezer nodes.

19. The computer program product according to claim 18, wherein the computer readable program code is configured to destage the updated data and the calculated first and second parity values from the freezer nodes to the corresponding storage devices.

20. The computer program product according to claim 19, and comprising computer readable program code configured, upon detecting a success in destaging first data from a first set of the freezer nodes and a failure to destage second data from a second set of the freezer nodes, the second set comprising one or two of the freezer nodes, to retrieve further data from further corresponding physical regions of the storage devices, and to calculate the second data using the first data and the further data.

21. The computer program product according to claim 18, wherein the computer readable program code is configured to distributedly store a given one of the freezer nodes by co-locating, on one of the digital information devices, the freezer node and its corresponding storage device.

22. The computer program product according to claim 18, wherein the computer readable program code is configured to distributedly store a given one of the freezer nodes by co-locating, on one of the digital information devices, the freezer node and none of the storage devices.

23. The computer program product according to claim 18, wherein the computer readable program code is configured to select the one or more corresponding second physical regions from one or more corresponding physical regions on one or more of the storage devices configured to store the data for the logical volume and one or more corresponding physical regions on two of each the storage devices configured to store the first and the second parity values.