ACCESSING DATA IN A STORAGE SYSTEM

• US 20140136802A1
• Filed: 11/09/2012
• Published: 05/15/2014
• Est. Priority Date: 11/09/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Becker-Szendy, Ralph A., Deenadhayalan, Veera W., Guthridge, D. Scott, Wyllie, James C.
• Granted Patent: US 8,959,301 B2
• Time in Patent Office: Days
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/186 Passive fault masking when reading multiple copies of the same data
• CPC Class Codes: G06F 12/16 Protection against loss of memory contents contains no material, see G06F11/00
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

Embodiments of the invention relate to accessing data that spans multiple storage devices in a storage system. A first index records identifiers of data blocks and their storage locations, and a second index records storage locations. An update request is processed by writing multiple copies of a received data block identifier and the updated data block to storage locations recorded in the second index. A read request is processed by performing a quorum read of the storage locations recorded in the second index to retrieve the updated data blocks. The processing of the read request also includes performing a quorum read of the first index to determine storage locations that contain data blocks to be read as part of processing the read request. The data blocks to be read exclude the updated data blocks.

Claims

1. A method for accessing data in a storage system, the method comprising:

writing data blocks to a first set of storage locations, the first set of storage locations spanning a plurality of storage devices and the writing comprising, for each data block;

writing multiple copies of the data block to a subset of the first set of storage locations, the subset of the first set of storage locations located on at least two of the storage devices; and

recording, in a first index, an identifier of the data block and identifiers of the subset of the first set of storage locations;

recording, in a second index, identifiers of storage locations in a second set of storage locations, the second set of storage locations spanning the plurality of storage devices;

processing an update request that includes an identifier of one of the data blocks to be updated and an updated data block, the processing an update request comprising writing multiple copies of the received identifier and the updated data block to a subset of the second set of storage locations, the subset of the second set of storage locations located on at least two of the storage devices and selected based on the second index; and

processing a read request, the processing a read request comprising;

performing a quorum read of the second set of storage locations to retrieve the updated data blocks; and

performing a quorum read of the first index to determine storage locations in the first set of storage locations that contain data blocks to be read as part of processing the read request, the data blocks to be read excluding the updated data blocks.

2. The method of claim 1, wherein performance of the processing of the update request is preserved by writing the received identifier and the updated data block to the second set of storage locations and the processing of the read request is preserved by utilizing the first index to locate storage locations to be read in the first set of storage locations.

3. The method of claim 1, wherein the data blocks comprise metadata.

4. The method of claim 3, wherein the first set of storage locations and the second set of storage locations are located in a metadata area on the storage devices, and the first index and the second index are located in one or more root blocks in the metadata area.

5. The method of claim 3, wherein the metadata includes a mapping between user data and physical data on the storage devices.

6. The method of claim 3, wherein the read request includes a request to read all of the metadata on the storage devices.

7. The method of claim 1, further comprising:

moving at least a portion of the updated data blocks to the first set of storage locations; and

updating the first and second indexes to reflect the moving of at least a portion of the updated data blocks to the first set of storage locations.

8. The method of claim 7, wherein the moving occurs responsive to a determination that a number of updated data items exceeds a threshold.

9. The method of claim 7, wherein the moving occurs responsive to a determination that a lull or idle period is reached in a workload on the storage system.

10. The method of claim 1, further comprising:

organizing the second set of storage locations as a number of n-tuples; and

writing the updated data blocks as whole n-tuples to the second set of storage locations.

11. A computer program product for accessing data in a storage system, the computer program product comprising:

a computer readable storage medium having program code embodied therewith, the program code executable by a processor to;

write data blocks to a first set of storage locations, the first set of storage locations spanning a plurality of storage devices and the writing comprising, for each data block;

writing multiple copies of the data block to a subset of the first set of storage locations, the subset of the first set of storage locations located on at least two of the storage devices; and

recording, in a first index, an identifier of the data block and identifiers of the subset of the first set of storage locations;

record, in a second index, identifiers of storage locations in a second set of storage locations, the second set of storage locations spanning the plurality of storage devices;

process an update request that includes an identifier of one of the data blocks to be updated and an updated data block, the processing an update request comprising writing multiple copies of the received identifier and the updated data block to a subset of the second set of storage locations, the subset of the second set of storage locations located on at least two of the storage devices and selected based on the second index; and

process a read request, the processing a read request comprising;

performing a quorum read of the second set of storage locations to retrieve the updated data blocks; and

performing a quorum read of the first index to determine storage locations in the first set of storage locations that contain data blocks to be read as part of processing the read request, the data blocks to be read excluding the updated data blocks.

12. The computer program product of claim 11, wherein the data blocks comprise metadata.

13. The computer program product of claim 12, wherein the first set of storage locations and the second set of storage locations are located in a metadata area on the storage devices, and the first index and the second index are located in one or more root blocks in the metadata area.

14. The computer program product of claim 12, wherein the metadata includes a mapping between user data and physical data on the storage devices.

15. The computer program product of claim 11, wherein the program code is further executable by the processor to:

move at least a portion of the updated data blocks to the first set of storage locations; and

update the first and second indexes to reflect the moving of at least a portion of the updated data blocks to the first set of storage locations.

16. The computer program product of claim 15, wherein the moving occurs responsive to at least one of a determination that a number of updated data items exceeds a threshold and a determination that a lull or idle period is reached in a workload on the storage system.

17. A storage system comprising:

a storage controller comprising a memory having computer readable computer instructions and a processor for executing the computer readable computer instructions, the computer readable computer instructions including;

writing data blocks to a first set of storage locations, the first set of storage locations spanning a plurality of storage devices and the writing comprising, for each data block;

writing multiple copies of the data block to a subset of the first set of storage locations, the subset of the first set of storage locations located on at least two of the storage devices; and

recording, in a first index, an identifier of the data block and identifiers of the subset of the first set of storage locations;

recording, in a second index, identifiers of storage locations in a second set of storage locations, the second set of storage locations spanning the plurality of storage devices;

processing an update request that includes an identifier of one of the data blocks to be updated and an updated data block, the processing an update request comprising writing multiple copies of the received identifier and the updated data block to a subset of the second set of storage locations, the subset of the second set of storage locations located on at least two of the storage devices and selected based on the second index; and

processing a read request, the processing a read request comprising;

performing a quorum read of the second set of storage locations to retrieve the updated data blocks; and

performing a quorum read of the first index to determine storage locations in the first set of storage locations that contain data blocks to be read as part of processing the read request, the data blocks to be read excluding the updated data blocks.

18. The system of claim 17, wherein the data blocks comprise metadata.

19. The system of claim 18, wherein the first set of storage locations and the second set of storage locations are located in a metadata area on the storage devices, and the first index and the second index are located in one or more root blocks in the metadata area.

20. The system of claim 17, wherein the computer readable computer instructions further include:

moving at least a portion of the updated data blocks to the first set of storage locations; and

updating the first and second indexes to reflect the moving of at least a portion of the updated data blocks to the first set of storage locations, wherein the moving occurs responsive to at least one of a determination that a number of updated data items exceeds a threshold and a determination that a lull or idle period is reached in a workload on the storage system.