Resynchronization of mirrored storage devices

• US 7,143,249 B2
• Filed: 08/19/2002
• Issued: 11/28/2006
• Est. Priority Date: 10/04/2000
• Status: Expired due to Fees

• Current Assignee: Network Appliance Incorporated (NetApp, Inc.)
• Original Assignee: Network Appliance Incorporated (NetApp, Inc.)
• Inventors: Kleiman, Steven R., Doucette, Douglas P., Viswanathan, Srinivasan, Strange, Stephen H.
• Primary Examiner(s): Peugh, Brian R.
• Assistant Examiner(s): RUTZ, JARED IAN
• Application Number:
  US10/225,453
• Publication Number:
  US 20030084242A1
• Time in Patent Office: 1,562 Days
• Field of Search: 711/114, 711/161, 711/162, 711/112, 711/165, 714/7, 714/12, 714/6, 714/20
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2082 Data synchronisation

Abstract

In one embodiment, a first storage device and a second storage device form a mirror. When the first storage device loses synchronization with the second storage device, data present in the second storage device but not in the first storage device are identified. The identified data are then copied to the first storage device. In one embodiment, a method of rebuilding data in a storage device includes the act of replacing a failed storage device with a replacement storage device. Up-to-date data for the failed storage device, which may be stored in a corresponding mirror, may then be copied to the replacement storage device. Thereafter, the replacement storage device and any other storage devices that have lost synchronization with their mirror are resynchronized.

Claims

1. A method of rebuilding data in a storage device, the method comprising:

replacing a failed storage device in a first group of storage devices, the first group of storage devices belonging to a first set of storage devices;

writing up-to-date data to the first group of storage devices;

determining a difference between data stored in the first set of storage devices and data stored in a second set of storage devices, by comparing a first storage usage information created prior to failure of the failed storage device and a second storage usage information created after the up-to-date data is written to the first group of storage devices, wherein the first storage usage information is a point-in-time representation of a file system and the second storage usage information is another point-in-time representation of the file system; and

resynchronizing the first set of storage devices with the second set of storage devices based on the difference, wherein the difference between the first storage usage information and the second storage usage information represents data written to the second set of storage devices when the first set of storage devices is in a degraded state.

2. The method of claim 1 wherein the first set of storage devices forms a mirror with the second set of storage devices.

3. The method of claim 1 wherein storage devices in the first group of storage devices are configured in accordance with RAID level 4.

4. The method of claim 1 wherein determining the difference comprises:

identifying data stored in the first set of storage devices but not in the second set of storage devices.

5. The method of claim 1, wherein the difference is stored in a previously unused block in the first group of storage devices.

6. The method of claim 1, further comprising:

storing write data in a storage device in the first set of storage devices while concurrently resynchronizing the storage device.

7. A system for providing data storage services over a computer network, the system comprising:

a file system;

a storage device manager configured to service data access requests from the file system, the storage device manager configured to mirror a first set of storage devices with a second set of storage devices; and

wherein the storage device manager is configured to resynchronize the second set of storage devices with the first set of storage devices by using data from the first set of storage devices to rebuild data in a replacement storage device in the second set of storage devices and by copying data determined to be in the first set of storage devices but not in the second set of storage devices, wherein the storage device manager determines if data is in the first set but not in the second set by comparing a first storage usage information created prior to failure of the second set and a second storage usage information created after up-to-date data is written into the replacement storage device,

wherein the first storage usage information is a point-in-time representation of the file system and the second storage usage information is another point-in-time representation of the file system, wherein a difference between the first storage usage information and the second storage usage information represents data written to the first set of storage devices when the second set of storage devices is in a degraded state.

8. The system of claim 7 wherein the first set of storage devices and the second set of storage devices comprise groups of storage devices configured in accordance with RAID level 4.

9. The system of claim 7 wherein the first set of storage devices and the second set of storage devices are not housed in the same facility.

10. The system of claim 7, wherein the data that i&

in the first set but not in the second set comprises one or more blocks that are in the second storage usage information and are not in the first storage usage information.

11. The system of claim 7, wherein the difference comprises one or more blocks that are in the second storage usage information and are not in the first storage usage information.

12. The system of claim 7, wherein a difference the first storage usage information and the second storage usage information is stored in the first set of storage devices.

13. The system of claim 7, wherein the storage device manager is configured to store write data in a storage device in the second set of storage devices while concurrently resynchronizing the storage device.

14. A method of rebuilding data in a storage device, the method comprising:

replacing a failed storage device with a replacement storage device, the failed storage device belonging to a first set of storage devices that forms a mirror with a second set of storage devices;

writing up-to-date data to the replacement storage device;

determining a difference between a surviving storage device in the first set of storage devices and a storage device in the second set of storage devices, by comparing a first storage usage information created prior to failure of the failed storage device and a second storage usage information created after the up-to-date data is written to the replacement storage device, wherein the first storage usage information is a point-in-time representation of a file system and the second storage usage information is another point-in-time representation of the file system; and

updating data in the surviving storage device based on a difference between the first storage usage information and the second storage usage information, wherein the difference represents data written to the second set of storage devices when the first set of storage devices is in a degraded state.

15. The method of claim 14 wherein the first set of storage devices comprises groups of storage devices configured in accordance with RAID level 4.

16. The method of claim 14, wherein the difference is stored in a previously unused block in the second set of storage devices.

17. The method of claim 14, further comprising:

storing write data in a storage device in the first set of storage devices while concurrently resynchronizing the storage device.

18. A computer-readable storage medium comprising:

computer-readable program code for copying up-to-date data to a first group of storage devices, the first group of storage devices belonging to a first set of storage devices that also includes a second group of storage devices;

computer-readable program code for determining a difference between the first set of storage devices and a second set of storage devices, the first set of storage devices and the second set of storage devices forming a mirror, wherein the difference is determined by comparing a first storage usage information created prior to failure of a failed storage device in the second set and a second storage usage information created after the up-to-date data is written to the second set,

wherein the first storage usage information is a point-in-time representation of a file system in the mirror and the second storage usage information is another point-in-time representation of a file system in the mirror; and

computer readable-program code for resynchronizing the first set of storage devices with the second set of the storage devices based on a difference between the first storage usage information and the second storage usage information, wherein the difference represents data written to the first set of storage devices when the second set of storage devices is in a degraded state.

19. The computer-readable storage medium of claim 18 wherein the first group of storage devices comprises storage devices configured in accordance with RAID level 4.

20. The computer-readable storage medium of claim 18 wherein the second set of storage devices comprises a third group of storage devices that forms a mirror with the first group of storage devices and a fourth group of storage devices that forms a mirror with the second group of storage devices.

21. The computer-readable storage medium of claim 18, wherein the difference comprises one or more blocks that are in the second storage usage information and are not in the first storage usage information.

22. The computer-readable storage medium of claim 18, wherein the difference is stored in a previously unused block in the second group of storage devices.

23. The computer-readable storage medium of claim 18, wherein write data is stored in a storage device in the second set of storage devices while concurrently resynchronizing the storage device.

24. A method of resynchronizing mirrored-storage devices comprising:

copying up-to-date data to a first group of storage devices, the first group of storage devices belonging to a first set of storage devices that also includes a second group of storage devices;

determining a difference between the first set of storage devices and a second set of storage devices, the first set of storage devices and the second set of storage devices forming a mirror, wherein the difference is determined by comparing a first storage usage information created prior to failure of a failed storage device in the first set and a second storage usage information created after the up-to-date data is written to the first group, wherein the first storage usage information is a point-in-time representation of a file system in the mirror and the second storage usage information is another point-in-time representation of a file system in the mirror; and

resynchronizing the first set of storage devices with the second set of the storage devices based on a difference between the first storage usage information and the second storage usage information, wherein the difference represents data written to the second set of storage devices when the first set of storage devices is in a degraded state.

25. The method of claim 24 wherein the first group of storage devices comprises storage devices configured in accordance with RAID level 4.

26. The method of claim 24 wherein the second set of storage devices comprises a third group of storage devices that forms a mirror with the first group of storage devices and a fourth group of storage devices that forms a mirror with the second group of storage devices.

27. The method of claim 24, wherein the difference is stored in a previously unused block in the second group of storage devices.