Managing atomic updates on metadata tracks in a storage system

• US 7,885,921 B2
• Filed: 11/18/2004
• Issued: 02/08/2011
• Est. Priority Date: 11/18/2004
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Mahar, Aaron S, Springer, James A, Budaya, Angelique R
• Primary Examiner(s): Vo; Tim T.
• Assistant Examiner(s): SMITH, GARRETT A
• Application Number:
  US10/993,087
• Publication Number:
  US 20060106891A1
• Time in Patent Office: 2,273 Days
• Field of Search: None
• US Class Current: 707/610
• CPC Class Codes: G06F 16/10 File systems; File servers

Abstract

Methods, systems, computer program products and methods for deploying computing infrastructure for managing metadata in a storage subsystem are provided. A first metadata track is staged from disk storage to a cache storage after which a journal entry is stored in a nonvolatile storage (NVS). The journal entry includes an opcode and update data for the track. The opcode identifies the type of update to be performed and the number of tracks to be updated in the operation. Each of the other metadata tracks is staged and a corresponding journal entry stored. The journaled updates are then applied to the respective metadata track in the cache storage and the tracks destaged from cache to the disk storage.

Claims

1. A method for performing atomic updates on metadata tracks in a storage subsystem, comprising:

assigning to a plurality of metadata tracks a generation number identifying a most recent multi-track update operation in which the metadata tracks participated whereby all of the metadata tracks which participated in the same most recent multi-track update operation are assigned the same generation number;

commencing a new update operation on the plurality of the metadata tracks by storing a first journal entry in a nonvolatile storage (NVS), the journal entry including an opcode and metadata update data, the opcode identifying a type of update to be performed and a number of metadata tracks being updated;

determining the largest generation number in each of the selected metadata tracks being updated;

incrementing the generation number in each of the selected metadata tracks being updated;

staging a first of the metadata tracks being updated from a disk storage to a cache storage;

storing a second journal entry in a nonvolatile storage (NVS) the NVS for the first metadata track, the second journal entry comprising the opcode, the update data for the first metadata track, and the incremented generation number;

repeating the staging, storing and journaling steps for each other metadata track being updated in the new update operation;

applying each journaled update to the respective metadata track in the cache storage;

destaging each of the metadata tracks from the cache storage to the disk storage; and

managing an interruption encountered while performing the new update operation by;

after the storage subsystem recovers from the interruption, searching all of the second journal entries of the metadata tracks being updated for the incremented generation number to determine if the second journal entries have been made for all metadata tracks being updated;

if the second journal entries have been made for all metadata tracks being updated, applying each journaled update to the respective metadata track in the cache storage; and

if journal entries have been made for fewer than all metadata tracks being updated, discarding the second journal entries from the NVS and recommencing the new update operation.

2. The method of claim 1, further comprising:

after each second journal entry for all except a last of the metadata tracks being updated is stored in the NVS, applying the second journal entry of the first metadata track to an in-flight area;

after the second journal entry for the last of the metadata tracks being updated is stored in the NVS, applying the journaled update for the last metadata track to the respective metadata track in the cache storage; and

after destaging the last of the selected metadata tracks being updated from the cache storage to the disk storage and in an order which is the reverse of the order in which the second journal entries for the metadata tracks being updated were stored in the NVS;

staging a metadata track to the cache storage;

storing a second journal entry in NVS for the metadata track, the second journal entry comprising the generation number and the opcode;

applying the update data stored in the in-flight area to the respective metadata track in the cache storage; and

destaging the metadata track from the cache storage to the disk storage.

3. The method of claim 2, wherein the in-flight area comprises a disk storage area.

4. A system for performing atomic update on metadata tracks in a storage subsystem, comprising:

a cache storage;

a nonvolatile storage (NVS);

a memory comprising computer-executable instructions that when executed by a processor perform the method comprising;

assigning to a plurality of metadata tracks a generation number identifying a most recent multi-track update operation in which the metadata tracks participated whereby all of the metadata tracks which participated in the same most recent multi-track update operation are assigned the same generation number;

commencing a new update operation on the plurality of the metadata tracks by storing a first journal entry in a nonvolatile storage (NVS), the journal entry including an opcode and metadata update data, the opcode identifying a type of update to be performed and a number of metadata tracks being updated;

determining the largest generation number in each of the selected metadata tracks being updated;

incrementing the generation number in each of the selected metadata tracks being updated;

staging a first of the metadata tracks being updated from a disk storage to a cache storage;

storing a second journal entry in a nonvolatile storage (NVS) the NVS for the first metadata track, the second journal entry comprising the opcode, the update data for the first metadata track, and the incremented generation number;

staging each other metadata track being updated in the new update operation;

journaling each other metadata track being updated;

applying each journaled update to the respective metadata track in the cache storage;

destaging each of the metadata tracks from the cache storage to the disk storage; and

managing the atomic update after an interruption encountered while performing the atomic update, by;

after the storage subsystem recovers from the interruption, all of the second journal entries of the metadata tracks being updated for the incremented generation number to determine if the second journal entries have been made for all metadata tracks being updated;

if the second journal entries have been made for all metadata tracks being updated, applying each journaled update to the respective metadata track in the cache storage; and

if journal entries have been made for fewer than all metadata tracks being updated, discarding the second journal entries from the NVS and recommencing the new update operation.

5. The system of claim 4, further comprising:

applying the second journal entry to an in-flight area after each second journal entry for all except a last of the metadata tracks being updated is stored in the NVS;

applying the journaled update for the last of the metadata tracks being updated to the respective metadata track in the cache storage after the second journal entry for the last of the selected metadata track is stored in the NVS; and

after destaging the last of the selected metadata tracks being updated from the cache storage to the disk storage and in an order which is the reverse of the order in which the second journal entries for the metadata tracks being updated were stored in the NVS;

staging a metadata track to the cache storage;

storing a second journal entry in NVS for the metadata track, the second journal entry comprising the generation number and the opcode;

applying the update data stored in the in-flight area to the respective metadata track in the cache storage; and

destaging the metadata track from the cache storage to the disk storage.

6. The system of claim 5, wherein the in-flight area comprises a disk storage area.

7. A computer program product of a computer readable storage medium usable with a programmable computer, the computer program product having computer-readable code embodied therein for performing atomic updates on global metadata tracks in a storage subsystem, the computer-readable code comprising instructions for:

assigning to a plurality of metadata tracks a generation number identifying a most recent multi-track update operation in which the metadata tracks participated whereby all of the metadata tracks which participated in the same most recent multi-track update operation are assigned the same generation number;

commencing a new update operation on the plurality of the metadata tracks by storing a first journal entry in a nonvolatile storage (NVS), the journal entry including an opcode and metadata update data, the opcode identifying a type of update to be performed and a number of metadata tracks being updated;

determining the largest generation number in each of the selected metadata tracks being updated;

incrementing the generation number in each of the selected metadata tracks being updated;

staging a first of the metadata tracks being updated from a disk storage to a cache storage;

storing a second journal entry in a nonvolatile storage (NVS) the NVS for the first metadata track, the second journal entry comprising the opcode, the update data for the first metadata track, and the incremented generation number;

repeating the staging, storing and journaling steps for each other metadata track being updated in the new update operation;

applying each journaled update to the respective metadata track in the cache storage;

destaging each of the metadata tracks from the cache storage to the disk storage; and

managing an interruption encountered while performing the new update operation by;

after the storage subsystem recovers from the interruption, searching all of the second journal entries of the metadata tracks being updated for the incremented generation number to determine if the second journal entries have been made for all metadata tracks being updated;

if the second journal entries have been made for all metadata tracks being updated, applying each journaled update to the respective metadata track in the cache storage; and

if journal entries have been made for fewer than all metadata tracks being updated, discarding the second journal entries from the NVS and recommencing the new update operation.

8. The computer program product of claim 7, further comprising instructions for:

after each second journal entry for all except a last of the metadata tracks being updated is stored in the NVS, applying the first journal entry of the first metadata track to an in-flight area;

after the second journal entry for the last of the metadata tracks being updated is stored in the NVS, applying the journaled update for the last metadata track to the respective metadata track in the cache storage; and

after destaging the last of the metadata tracks being updated from the cache storage to the disk storage and in an order which is the reverse of the order in which the second journal entries for the metadata tracks being updated were stored in the NVS;

staging a metadata track to the cache storage;

storing a second journal entry in NVS for the metadata track, the second journal entry comprising the generation number and the opcode;

applying the update data stored in the in-flight area to the respective metadata track in the cache storage; and

destaging the metadata track from the cache storage to the disk storage.

9. The computer program product of claim 8, wherein the in-flight area comprises a disk storage area.