Method and apparatus for storing and retrieving multiple point-in-time consistent data sets

• US 20060041823A1
• Filed: 08/03/2004
• Published: 02/23/2006
• Est. Priority Date: 08/03/2004
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wolfgang, John J., Day, Kenneth F. III, Boyd, Kenneth W., Doatmas, Philip M.
• Granted Patent: US 7,225,371 B2
• Time in Patent Office: Days
• US Class Current: 714/763
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2071 using a plurality of controllers

Abstract

A method, apparatus, and article of manufacture containing instructions for processing multiple point-in-time consistent data sets. The method consists of creating multiple point-in-time data sets associated with a backup appliance which is associated with backup storage. Upon the transfer of a first update from a primary storage controller to the backup appliance, a determination is made whether the update affects data stored in the backup storage has been unchanged following the creation of the respective data sets. If the update does affect data which is unchanged following the creation of a data set, the current, non-updated data is read from the backup storage. A copy of the current, non-updated data thus read from the backup storage is stored in a storage location which can be one of the data sets or an independent memory location. In addition, pointers are associated with the remaining applicable data sets and directed to the copy at its storage location. Subsequently, the update is applied to the data on the backup storage device. In the event an update is subsequently transferred from the primary storage controller to the backup appliance which affects data stored in backup storage which has already been changed since the creation of an applicable data set, no further data is written to the applicable data set and the update is applied to the backup storage.

Claims

1. A method of processing multiple point-in-time consistent data sets comprising:

creating a first data set;

creating a second data set wherein the first data set and the second data set are associated with a backup appliance which is associated with backup storage;

transferring a first update from a primary storage controller to the backup appliance;

determining that the first update affects first data stored in the backup storage that has been unchanged following the creation of the first data set and the second data set;

reading the first data from the backup storage;

writing a copy of the first data to the first data set;

saving a pointer associated with the second data set and directed to the copy of the first data; and

applying the update to the first data on the backup storage.

2. The method of claim 1 further comprising:

transferring a second update from the primary storage controller to the backup appliance;

determining that the second update affects second data stored in the backup storage that has been changed following the creation of the first data set and unchanged following the creation of the second data set;

reading the second data from the backup storage;

writing the second data to the second data set; and

applying the update to the second data on the backup storage.

3. The method of claim 2 further comprising:

transferring a third update from the primary storage controller to the backup appliance;

determining that the third update affects third data that has been changed following the creation of the first data set and changed following the creation of the second data set; and

applying the update to the third data on the backup storage.

4. The method of claim 1 further comprising reverting the backup storage to a state that existed at the time the first data set was created.

5. The method of claim 4 wherein reverting the backup storage to a state that existed at the time the first data set was created comprises:

reading the current version of the data stored on the backup storage for every data block that has been written to the first data set; and

overwriting the data stored on the backup storage with the data previously written to the first data set.

6. The method of claim 5 further comprising writing the data read from the backup storage in the reading step to a side file prior to overwriting the data.

7. The method of claim 1 further comprising:

determining which of the first and the second data sets has the longest persistence; and

writing the copy of the first data to the data set with the longest persistence.

8. The method of claim 7 further comprising associating a pointer to the copy of the first data with the data set that does not have the longest persistence.

9. The method of claim 8 wherein the step of creating a first data set comprises:

informing the backup appliance to create a new data set;

allocating a new tree header associated with the new data set; and

adding a new tree to an active tree list maintained in association with the backup appliance.

10. The method of claim 9 wherein the step of determining that the first update affects first data that has been unchanged following the creation of the first data set and the second data set comprises searching each tree maintained in the active tree list for a previous entry for the same data location.

11. The method of claim 1 further comprising

incrementing a use count associated with the first data in association with determining that the first update affects data included in multiple data sets.

12. A method of processing multiple point-in-time consistent data sets comprising:

creating a first data set;

creating a second data set wherein the first data set and the second data set are associated with a backup appliance having memory and which is associated with backup storage;

transferring a first update from a primary storage controller to the backup appliance;

determining that the first update affects first data stored in the backup storage that has been unchanged since following the creation of the first data set and the second data set;

reading the first data from the backup storage;

storing a copy of the first data to a memory location independent of the first and second data sets;

saving a pointer associated with each of the first data set and the second data set and directed to the copy of the first data; and

applying the update to the first data on the backup storage.

13. The method of claim 12 further comprising:

transferring a second update from the primary storage controller to the backup appliance;

determining that the second update affects second data stored in the backup storage that has been changed following the creation of the first data set and unchanged following the creation of the second data set;

reading the second data from the backup storage;

storing a copy of the second data to the memory location independent of the first and second data sets;

saving a pointer associated with the second data set and directed to the copy of the second data; and

applying the update to the second data on the backup storage.

14. The method of claim 13 further comprising:

transferring a third update from the primary storage controller to the backup appliance;

determining that the third update affects third data that has been changed following the creation of the first data set and changed following the creation of the second data set; and

applying the update to the third data on the backup storage.

15. A backup appliance associated with backup storage, the backup appliance having the capability to receive data updates from a primary storage controller and the backup appliance comprising:

means for creating a first data set;

means for creating a second data set;

means for determining whether a data update affects data that has been unchanged following the creation of the first data set and the second data set;

means for reading the first data from the backup storage;

means for writing a copy of the first data to a storage location associated with one of the first data set, the second data set and a memory location independent of the first and second data sets;

means for saving a pointer associated with one of the first data set and the second data set and directed to the copy of the first data; and

means for applying the update to the first data on the backup storage.

16. The backup appliance of claim 15 further comprising means for reverting the backup storage to a state that existed at the time the first data set was created.

17. The backup appliance of claim 16 further comprising:

means for reading the current version of the data stored on the backup storage for every data block that has been written to the storage location;

means for writing the data read from the backup storage to a side file; and

means for overwriting the data stored on the backup storage with the data previously written to the storage location.

18. The backup appliance of claim 15 further comprising means for determining which of the first and the second data sets has the longest persistence.

19. An article of manufacture for use in programming a backup device to process multiple point-in-time consistent data sets, the article of manufacture comprising instructions for:

creating a first data set;

creating a second data set wherein the first data set and the second data set are associated with a backup appliance which is associated with backup storage;

transferring a first update from a primary storage controller to the backup appliance;

determining that the first update affects first data stored in the backup storage that has been unchanged following the creation of the first data set and the second data set;

reading the first data from the backup storage;

writing a copy of the first data to the first data set;

saving a pointer associated with the second data set and directed to the copy of the first data; and

applying the update to the first data on the backup storage.

20. The article of manufacture of claim 19 further comprising instructions for:

transferring a second update from the primary storage controller to the backup appliance;

determining that the second update affects second data stored in the backup storage that has been changed following the creation of the first data set and unchanged following the creation of the second data set;

reading the second data from the backup storage;

writing the second data to the second data set; and

applying the update to the second data on the backup storage.

21. The article of manufacture of claim 20 further comprising instructions for:

transferring a third update from the primary storage controller to the backup appliance;

determining that the third update affects third data that has been changed following the creation of the first data set and changed following the creation of the second data set; and

applying the update to the third data on the backup storage.

22. The article of manufacture of claim 19 further comprising instructions for reverting the backup storage to a state that existed at the time the first data set was created.

23. The article of manufacture of claim 22 further comprising instructions for:

reading the current version of the data stored on the backup storage for every data block that has been written to the first data set;

writing the data read from the backup storage in the previous step to a side file; and

overwriting the data stored on the backup storage with the data previously written to the first data set.

24. The article of manufacture of claim 19 further comprising instructions for:

determining which of the first and the second data sets has the longest persistence; and

writing the copy of the first data to the data set with the longest persistence.

25. The article of manufacture of claim 24 further comprising instructions for associating a pointer to the copy of the first data with the data set that does not have the longest persistence.

26. The article of manufacture of claim 19 wherein the instructions for determining that the first update affects first data that has been unchanged following the creation of the first data set and the second data set further comprises instructions for searching each tree maintained in an active tree list for a previous entry for the same data location.

27. The article of manufacture of claim 19 further comprising instructions for:

incrementing a use count associated with the first data set in association with determining that the first update affects data that is included in multiple data sets.

28. An article of manufacture for use in programming a backup device to process multiple point-in-time consistent data sets, the article of manufacture comprising instructions for:

creating a first data set;

creating a second data set wherein the first data set and the second data set are associated with a backup appliance having memory and which is associated with backup storage;

transferring a first update from a primary storage controller to the backup appliance;

determining that the first update affects first data stored in the backup storage that has been unchanged since following the creation of the first data set and the second data set;

reading the first data from the backup storage;

storing a copy of the first data to a memory location independent of the first and second data sets;

saving a pointer associated with each of the first data set and the second data set and directed to the copy of the first data; and

applying the update to the first data on the backup storage.

29. The article of manufacture of claim 28 further comprising instructions for:

transferring a second update from the primary storage controller to the backup appliance;

determining that the second update affects second data stored in the backup storage that has been changed following the creation of the first data set and unchanged following the creation of the second data set;

reading the second data from the backup storage;

storing a copy of the second data to the memory location independent of the first and second data sets;

saving a pointer associated with the second data set and directed to the copy of the second data; and

applying the update to the second data on the backup storage.

30. The article of manufacture of claim 29 further comprising instructions for:

transferring a third update from the primary storage controller to the backup appliance;

determining that the third update affects third data that has been changed following the creation of the first data set and changed following the creation of the second data set; and

applying the update to the third data on the backup storage.