Method, system, and program for storing and using metadata in multiple storage locations

• US 7,444,360 B2
• Filed: 11/17/2004
• Issued: 10/28/2008
• Est. Priority Date: 11/17/2004
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ripberger, Richard Anthony, Vageline, Michael P., Frondozo, Rhea Reyes, Sheppard, Jacob Lee, Lovrien, Kurt Allen
• Primary Examiner(s): Wong; Don
• Assistant Examiner(s): Nguyen; Kim T
• Application Number:
  US10/991,664
• Publication Number:
  US 20060106898A1
• Time in Patent Office: 1,441 Days
• Field of Search: 707/10
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/2056 by mirroring
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users

Abstract

Provided are a method, system, and program for storing and using metadata in multiple storage location. Signature data is stored in a system storage indicating a plurality of metadata copy locations, each locating identifying a storage device and a copy location within the storage device. Each location contains one copy of the metadata, wherein the metadata includes system configuration information. A copy of the signature data is stored with each copy of the metadata.

Claims

1. A method, comprising:

generating signature data indicating a plurality of metadata copy locations, each location identifying one of a plurality of storage devices and a copy location within the storage device, wherein each location contains one copy of metadata, wherein the metadata includes system configuration information, wherein each copy of the signature data includes a generation number wherein a first and second processing systems are capable of accessing the metadata and signature data in the storage devices, and wherein the first processing system and second processing system maintain a first and second copy of the signature data, respectively;

storing a copy of the signature data with each copy of the metadata in the storage devices;

reading one copy of the metadata from one of the storage devices to obtain system configuration information to use to operate;

incrementing the generation number in each copy of the signature data in response to changing the locations in which the copy of the metadata is included;

performing an initialization by the first processing system;

determining a valid copy of the signature data on one of the storage devices or processing system;

staying off line in response to determining that no signature data is valid; and

updating all accessible copies of the signature data in the metadata locations indicated in the determined valid copy of signature data and the first and second copies of the signature data with the validated copy of the signature data.

2. The method of claim 1, wherein the location of the storage devices to store the copies of the metadata are selected to minimize a number of points of failure.

3. The method of claim 1, further comprising:

initiating an operation to alter the locations of the metadata copies in the storage devices storing the metadata;

determining new locations in the storage devices for the metadata;

updating each copy of the signature data to indicate the new locations for the metadata; and

copy metadata and the updated signature data to any of the new locations that do not already include metadata and signature data.

4. The method of claim 3, wherein the locations within the signature data comprises an ordered set, wherein the signature data is updated at the locations in an order according to the ordered set.

5. The method of claim 3, wherein the determination of the new location is made in response to a change in the set of storage devices and wherein the determination of the new location is performed in order to minimize a number of points of failure for the changed set of the storage devices.

6. The method of claim 1, wherein two processing systems are capable of accessing the metadata and signature data in the storage devices, and wherein each processing system has a computer readable medium including a copy of the signature data.

7. The method of claim 6, further comprising:

receiving an update to the metadata; and

serially copying the update to the metadata in the storage devices according to an ordering of the storage device locations indicated in the signature data.

8. The method of claim 6, further comprising:

receiving a request to read the metadata;

accessing the metadata in the storage locations until one valid copy of the metadata is found; and

updating copies of the metadata determined to be invalid with the accessed valid copy of the metadata.

9. The method of claim 1, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that matches the first and second copies of the signature data or validating one storage device signature data that has a generation number one greater than the generation number of the matching first and second copies of the signature data and where the one storage device signature data and the first and second copies of the signature data identify a common storage device.

10. The method of claim 1, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that has a generation number equal to or one greater than a largest generation number of the first and second copies of the signature data in response to determining that the generation numbers of the first and second copies of the signature data do not match and that the first and second copies of the signature data identify the validated storage device.

11. The method of claim 1, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that has a generation number greater by one or equal to the generation number in one of the first and second copies of the signature data in response to determining that signature data in the storage devices identifies the storage devices.

12. A system, comprising:

a plurality of storage devices

a first processing system having a system storage and in communication with the storage devices;

a second processing system, wherein both processing systems are capable of accessing metadata and signature data in the storage devices, and wherein each processing system has a local storage including a copy of the signature data; and

a computer readable medium including code executed by the first processing system to perform operations comprising;

generating signature data indicating a plurality of metadata copy locations, each location identifying one of a plurality of storage devices and a copy location within the storage device, wherein each location contains one copy of the metadata, wherein the metadata includes system configuration information, wherein each copy of the signature data includes a generation number;

storing a copy of the signature data with each copy of the metadata in the storage devices;

reading one copy of the metadata from one of the storage devices to obtain system configuration information to use to operate;

incrementing the generation number in each copy of the signature data in response to changing the locations in which the copy of the metadata is included;

performing an initialization by the first processing system;

determining a validity of one of the accessible signature data on the storage devices or processing system;

staying off line in response to determining that no signature data is valid; and

updating all accessible copies of the signature data in the metadata locations indicated in the validated signature data and the first and second copies of the signature data with the validated copy of the signature data.

13. The system of claim 12, wherein the locations of the storage devices to store the copies of the metadata are selected to minimize a number of points of failure.

14. The system of claim 12, wherein the operations caused by the code further comprises:

initiating an operation to alter the locations of the metadata copies in the storage devices storing the metadata;

determining new locations in the storage devices for the metadata;

updating each copy of the signature data to indicate the new locations for the metadata; and

copy metadata and the updated signature data to any of the new locations that do not already include metadata and signature data.

15. The system of claim 14, wherein the locations within the signature data comprises an ordered set, wherein the signature data is updated at the locations in an order according to the ordered set.

16. The system of claim 15, wherein the determination of the new location is made in response to a change in the set of storage devices and wherein the determination of the new location is performed in order to minimize a number of points of failure for the changed set of the storage devices.

17. The system of claim 12, wherein the processing system comprises a first processing system, further comprising:

a second processing system, wherein both processing systems are capable of accessing the metadata and signature data in the storage devices, and wherein each processing system has a local storage including a copy of the signature data.

18. The system of claim 17, wherein the code further causes operations comprising:

receiving an update to the metadata; and

serially copying the update to the metadata in the storage devices according to an ordering of the storage device locations indicated in the signature data.

19. The system of claim 17, wherein the code further causes operations comprising:

receiving a request to read the metadata;

accessing the metadata in the storage locations until one valid copy of the metadata is found; and

updating copies of the metadata determined to be invalid with the accessed valid copy of the metadata.

20. The system of claim 12, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that matches the first and second copies of the signature data or validating one storage device signature data that has a generation number one greater than the generation number of the matching first and second copies of the signature data and where the one storage device signature data and the first and second copies of the signature data identify a common storage device.

21. The system of claim 12, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that has a generation number equal to or one greater than a largest generation number of the first and second copies of the signature data in response to determining that the generation numbers of the first and second copies of the signature data do not match and that the first and second copies of the signature data identify the validated storage device.

22. The system of claim 12, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that has a generation number greater by one or equal to the generation number in one of the first and second copies of the signature data in response to determining that signature data in the storage devices identifies the storage devices.

23. An article of manufacture comprising at least one of a hardware device having hardware logic and a computer readable storage medium having executable code to communicate with a plurality of storage devices and a system storage and to cause a first and second processing systems to perform operations, the operations comprising:

generating signature data indicating a plurality of metadata copy locations, each location identifying one of a plurality of storage devices and a copy location within the storage device, wherein each location contains one copy of metadata, wherein the metadata includes system configuration information, wherein each copy of the signature data includes a generation number, wherein the first and second processing systems are capable of accessing the metadata and signature data in the storage devices, wherein the first processing system and second processing system maintain a first and second copy of the signature data;

storing a copy of the signature data with each copy of the metadata;

reading one copy of the metadata from one of the storage devices to obtain system configuration information to use to operate;

incrementing the generation number in each copy of the signature data in response to changing the locations in which the copy of the metadata is included;

performing an initialization;

determining a validity of one of the accessible signature data on the storage devices or processing system;

staying off line in response to determining that no signature data is valid; and

updating all accessible copies of the signature data in the metadata locations indicated in the validated signature data and the first and second copies of the signature data with the validated copy of the signature data.

24. The article of manufacture of claim 23, wherein the location of the storage devices to store the copies of the metadata are selected to minimize a number of points of failure.

25. The article of manufacture of claim 23, wherein the operations further comprise:

initiating an operation to alter the locations of the metadata copies in the storage devices storing the metadata;

determining new locations in the storage devices for the metadata;

updating each copy of the signature data to indicate the new locations for the metadata; and

copy metadata and the updated signature data to any of the new locations that do not already include metadata and signature data.

26. The article of manufacture of claim 25, wherein the locations within the signature data comprises an ordered set, wherein the signature data is updated at the locations in an order according to the ordered set.

27. The article of manufacture of claim 25, wherein the determination of the new location is made in response to a change in the set of storage devices and wherein the determination of the new location is performed in order to minimize a number of points of failure for the changed set of the storage devices.

28. The article of manufacture of claim 23, wherein two processing systems are capable of accessing the metadata and signature data in the storage devices, and wherein each processing system has a computer readable medium including a copy of the signature data.

29. The article of manufacture of claim 28, wherein the operations further comprise:

receiving an update to the metadata; and

serially copying the update to the metadata in the storage devices according to an ordering of the storage device locations indicated in the signature data.

30. The article of manufacture of claim 28, wherein the operations further comprise:

receiving a request to read the metadata;

accessing the metadata in the storage locations until one valid copy of the metadata is found; and

updating copies of the metadata determined to be invalid with the accessed valid copy of the metadata.

31. The article of manufacture of claim 23, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that matches the first and second copies of the signature data or validating one storage device signature data that has a generation number one greater than the generation number of the matching first and second copies of the signature data and where the one storage device signature data and the first and second copies of the signature data identify a common storage device.

32. The article of manufacture of claim 23, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that has a generation number equal to or one greater than a largest generation number of the first and second copies of the signature data in response to determining that the generation numbers of the first and second copies of the signature data do not match and that the first and second copies of the signature data identify the validated storage device.

33. The article of manufacture of claim 23, wherein determining the validity of one copy of the signature data comprises validating one storage device signature data that has a generation number greater by one or equal to the generation number in one of the first and second copies of the signature data in response to determining that signature data in the storage devices identifies the storage devices.