SYSTEMS AND METHODS FOR BACKING UP DATA FILES

• US 20070294321A1
• Filed: 05/29/2007
• Published: 12/20/2007
• Est. Priority Date: 09/30/2003
• Status: Active Grant

• Current Assignee: Keepitsafe
• Original Assignee: Autonomy Incorporated (HP Inc.)
• Inventors: Midgley, Christopher, Webb, John
• Granted Patent: US 7,860,832 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

Disclosed are systems and methods for maintaining, in a storage system having a source storage system and target storage system, information from which a set of source data files stored on a storage system can be retrieved. In one embodiment, the method comprises storing baseline images of one or more source data files in target files of the target storage system. For a selected target storage time, locations in the source storage system where changes have been made since a previous target storage time are dynamically identified. Contents that occupy the locations are read and sent to the target storage system. The contents are stored in the target storage system together with associations of the contents with the locations.

Claims

1. (canceled)

3-9. -9. (canceled)

12. (canceled)

24-37. -37. (canceled)

39. (canceled)

42. (canceled)

49. (canceled)

51. (canceled)

54. (canceled)

61. A method for maintaining, in a storage system having a source storage system and target storage system, information from which a set of source files stored on the source storage system can be retrieved, the method comprising

storing baseline images of one or more source data files in target files of the target storage system, and

for each of a sequence of target storage times:

A) dynamically identifying locations in the source storage system where changes have been made since the previous target storage time; and

B) in response to identifying the locations,

i) reading at that target storage time contents that occupy the locations, and

ii) sending the contents to the target storage system; and

C) storing the contents in the target storage system together with associations of the contents with the locations.

2. The method of claim 63, wherein the target storage times are based on one or more of:

an actual time, a time interval, and an event.

10. The method of claim 61, wherein storing the contents includes:

selecting at least one memory to store the contents.

11. The method of claim 10, wherein selecting at least one memory includes:

selecting the at least one memory to be distinct from a previously selected memory associated with a prior target storage time.

13. The method of claim 63, wherein providing the associations includes:

generating one or more indexes to associate;

the stored contents, the respective target storage times, the respective changed locations, and one or more respective file identifiers.

14. The method of claim 13, wherein the one or more indexes include:

a first index to the changed locations based on the one or more file identifiers, and

a second index to the stored contents based on the changed locations.

15. The method of claim 61, further comprising:

using the stored contents to create a version of a selected one of the one or more source data files.

16. The method of claim 15, wherein using the stored contents to create a version includes:

for each of one or more target storage times associated with the version;

querying one or more indexes that associate the stored contents, the respective target storage times, the respective changed locations, and one or more respective file identifiers, to identify stored contents and respective changed locations associated with the selected data file, and

combining the identified stored contents with data from a baseline image associated with the selected data file.

17. The method of claim 16, wherein querying includes:

determining that the changed locations are the same for two or more different target storage times, and,

identifying the stored contents of the changed locations associated with the latest of the two or more different target storage times.

18. The method of claim 63, further comprising:

receiving from a first server a request to create a version of a selected one of the one or more source data files, and based on the request;

for each of one or more target storage times associated with the version;

querying one or more indexes that associate the stored contents, the respective target storage times, the respective changed locations, and one or more respective file identifiers, to identify stored contents and respective changed locations associated with the selected data file, and

providing the identified stored contents and respective changed locations to the first server.

19. The method of claim 18, further comprising:

at the first server, combining the identified stored contents with data from a baseline image associated with the selected data file.

20. The method of claim 63, further comprising:

at a coalescence time, coalescing;

two or more stored contents associated with the same file and two or more different target storage times,

the respective changed locations associated with the two or more coalesced contents, and

one or more indexes to associate the coalesced contents, the respective coalesced changed locations, an identifier of the file with which those contents are associated, and the latest of the two or more different target storage times.

21. The method of claim 63, further comprising:

at a coalescence time, coalescing;

two or more stored contents associated with the same file and the same target storage time,

the respective changed locations associated with the two or more coalesced contents, and

one or more indexes to associate the coalesced contents, the respective coalesced changed locations, an identifier of the file with which those contents are associated, and the same target storage time.

22. The method of claim 21, wherein the coalescence time is based on one or more of:

an actual time, a time interval, and an event.

23. The method of claim 22, wherein the event includes an event based on an available storage capacity of a storage medium.

62. The method of claim 61, wherein the associations of the contents with the locations associate the contents with the files in the source storage system to which those contents were written.

63. The method of claim 62, further comprising providing in the target storage system associations between the contents there stored and the target storage times for which those contents were stored.

70. The method of claim 61, wherein dynamically identifying the locations further comprises:

at a time prior to that target storage time,

storing a baseline image of at least the one or more source data files, and

using one or more data integrity procedures to generate a baseline summary comprising a summary of the baseline image; and

thereafter,

storing a second image of at least the one or more source data files,

using one or more data integrity procedures to generate a second image summary comprising a summary of the second image, and

based on the baseline summary and the second image summary, determining whether the one or more source data files includes changed locations.

76. The method of claim 61, further comprising generating the baseline image, wherein the generating further comprises generating one or more of a volume image, a file image, and a snapshot image.

64. A storage medium containing instructions readable by a computer system that comprises a source storage system and a target storage system, the instructions comprising

instructions to configure the computer system to maintain in the target storage system information from which a set of source files stored on the source storage system can be retrieved, and

instructions to configure the computer system to store baseline images of one or more source data files in target files of the target storage system, and

instructions to configure the computer system for each of a sequence of target storage times to:

A) dynamically identify locations in the source storage system where changes have been made since the previous target storage time; and

B) in response to identifying the locations,

i) read at that target storage time contents that occupy the locations, and

ii) send the contents to the target storage system; and

C) store the contents in the target storage system together with associations of the contents with the locations.

38. The storage medium of claim 66, wherein the target storage times are based on one or more of:

an actual time, a time interval, and an event.

40. The storage medium of claim 64, wherein the instructions to store the contents include instructions to select at least one memory to store the contents.

41. The storage medium of claim 40, wherein the instructions to select at least one memory include instructions to select the at least one memory to be distinct from a previously selected memory associated with a prior target storage time.

43. The storage medium of claim 66, wherein the instructions to provide the associations include instructions to generate one or more indexes to associate:

the stored contents, the respective target storage times, the respective changed locations, and one or more respective file identifiers.

44. The storage medium of claim 43, wherein the one or more indexes include:

a first index to the changed locations based on the one or more file identifiers, and

a second index to the stored contents based on the changed locations.

45. The storage medium of claim 64, further comprising instructions to use the stored contents to create a version of a selected one of the one or more source data files.

46. The storage medium of claim 45, wherein the instructions to use the stored contents to create a version include instructions to:

for each of one or more target storage times associated with the version;

query one or more indexes that associate the stored contents, the respective arget storage times, the respective changed locations, and one or more respective file identifiers, to identify stored contents and respective changed locations associated with the selected data file, and

combine the identified stored contents with data from a baseline image associated with the selected data file.

47. The storage medium of claim 64, further comprising instructions to receive from a first server a request to create a version of a selected one of the one or more source data files, and

based on the request:

for each of one or more target storage times associated with the version;

query one or more indexes that associate the stored contents, the respective target storage times, the respective changed locations, and one or more respective file identifiers, to identify stored contents and respective changed locations associated with the selected data file, and

provide the identified stored contents and respective changed locations to the first server.

48. The storage medium of claim 47, further comprising instructions to, at the first server, combine the identified stored contents with data from a baseline image associated with the selected data file.

65. The storage medium of claim 64, wherein the associations of the contents with the locations associate the contents with the files in the source storage system to which those contents were written.

66. The storage medium of claim 65, wherein the instructions further configure the computer system to provide in the target storage system associations between the contents there stored and the target storage times for which those contents were stored.

71. The storage medium of claim 64, wherein the instructions to dynamically identify locations further comprises:

instructions at a time prior to that target storage time to;

store a baseline image of at least the one or more source data files, and

use one or more data integrity procedures to generate a baseline summary comprising a summary of the baseline image; and

thereafter,

store a second image of at least the one or more source data files,

use one or more data integrity procedures to generate a second image summary comprising a summary of the second image, and

based on the baseline summary and the second image summary, determine whether the one or more source data files includes changed locations.

67. A computer system comprising a source storage system and a target storage system in which information is maintained from which a set of source files stored on the source storage system can be retrieved, the system being configured to execute agents that perform operations comprising:

storing baseline images of one or more source data files in target files of the target storage system, and

for each of a sequence of target storage times;

A) dynamically identifying locations in the source storage system where changes have been made since the previous target storage time; and

B) in response to identifying the locations,

i) reading at that target storage time contents that occupy the locations, and

ii) sending the contents to the target storage system; and

C) storing the contents in the target storage system together with associations of the contents with the locations.

50. The system of claim 69, wherein the target storage times are based on one or more of:

an actual time, a time interval, and an event.

52. The system of claim 67, wherein at least one of the agents selects at least one memory to store the contents.

53. The system of claim 52, wherein the at least one memory is distinct from a previously selected memory associated with a prior target storage time.

55. The system of claim 69, wherein at least one of the agents provides the associations by generating one or more indexes to associate:

the stored contents, the respective target storage times, the respective changed locations, and the respective one or more respective file identifiers.

56. The system of claim 55, wherein the one or more indexes include:

a first index to the changed locations based on the one or more file identifiers, and

a second index to the stored contents based on the changed locations.

57. The system of claim 69, further configured comprising to use the stored contents to create a version of a selected one of the one or more source data files.

58. The system of claim 57, wherein the system is configured to use the stored contents to create a version by:

for each of one or more target storage times associated with the version;

querying one or more indexes that associate the stored contents, the respective target storage times, the respective changed locations, and one or more respective file identifiers, to identify stored contents and respective changed locations associated with the selected data file, and

combine the identified stored contents with data from a baseline image associated with the selected data file.

59. The system of claim 69, further configured to receive from a first server a request to create a version of a selected one of the one or more source data files, and

based on the request:

for each of one or more storage times associated with the version;

query one or more indexes that associate the stored contents, the respective arget storage times, the respective changed locations, and one or more respective file identifiers, to identify stored contents and respective changed locations associated with the selected source data file, and

provide the identified stored contents and respective changed locations to the first server.

60. The system of claim 59, further configured to, at the first server, combine the identified stored contents with data from a baseline image associated with the selected source data file.

68. The system of claim 67, wherein the associations of the contents with the locations associate the contents with the files in the source storage system to which those contents were written.

69. The system of claim 68, wherein at least one of the agents provides in the target storage system associations between the contents there stored and the target storage times for which those contents were stored.

72. The system of claim 67, wherein dynamically identifying locations further comprises:

at a time prior to the target storage time,

storing a baseline image of at least the one or more source data files, and

using one or more data integrity procedures to generate a baseline summary comprising a summary of the baseline image; and

thereafter,

storing a second image of at least the one or more source data files,

using one or more data integrity procedures to generate a second image summary comprising a summary of the second image, and

based on the baseline summary and the second image summary, determining whether the one or more source data files includes changed locations.

73. A method for performing operations on data files, the method comprising:

defining a policy file having data about a policy, the data comprising

information for identifying a set of data files with which the policy is associated,

identification of at least one operation with which the policy is associated, and

at least a selected time for executing the at least one operation associated with the policy; and

at the selected time, executing an operation with which the selected time is associated on the set of data files identified by the information.

74. A storage medium containing instructions readable by a computer system, the instructions comprising instructions to configure the computer system to:

define a policy file having data about a policy, the data comprising

information for identifying a set of data files with which the policy is associated,

identification of at least one operation with which the policy is associated, and

at least a selected time for executing the at least one operation associated with the policy; and

at the selected time, execute an operation with which the selected time is associated on the set of data files identified by the information.

75. A computer system that is configured to execute agents that perform operations, the operations comprising:

defining a policy file having data about a policy, the data comprising

information for identifying a set of data files with which the policy is associated,

identification of at least one operation with which the policy is associated, and

at least a selected time for executing the at least one operation associated with the policy; and

at the selected time, executing an operation with which the selected time is associated on the set of data files identified by the information.

77. A method for maintaining, in a storage system having a source storage system and a backup storage system, information from which a set of source files stored on the source storage system can be retrieved, the method comprising

storing baseline images of one or more source data files in backup files of the backup storage system, and

for a selected backup storage time:

A) dynamically identifying locations in the source storage system where changes have been made since a previous backup storage time; and

B) in response to identifying the locations,

i) reading contents that occupy the locations, and

ii) sending the contents to the backup storage system; and

C) storing the contents in the backup storage system together with associations of the contents with the locations.

78. A computer system comprising a source storage system and a backup storage system in which information is maintained from which a set of source files stored on the source storage system can be retrieved, the system being configured to execute agents that perform operations comprising:

storing baseline images of one or more source data files in backup files of the backup storage system, and

for a selected backup storage time;

A) dynamically identifying locations in the source storage system where changes have been made since a previous backup storage time; and

B) in response to identifying the locations,

i) reading contents that occupy the locations, and

ii) sending the contents to the backup storage system; and

C) storing the contents in the backup storage system together with associations of the contents with the locations.

79. A storage medium containing instructions readable by a computer system that comprises a source storage system and a backup storage system, the instructions comprising

instructions to configure the computer system to maintain in the backup storage system information from which a set of source files stored on the source storage system can be retrieved, and

instructions to configure the computer system to store baseline images of one or more source data files in backup files of the backup storage system, and

instructions to configure the computer system for a selected backup storage time to:

A) dynamically identify locations in the source storage system where changes have been made since a previous backup storage time; and

B) in response to identifying the locations,

i) read contents that occupy the locations, and

ii) send the contents to the backup storage system; and

C) store the contents in the backup storage system together with associations of the contents with the locations.

80. A method for maintaining, in a storage system having a source storage system and a target storage system, information from which a set of source files stored on the source storage system can be retrieved, the method comprising

storing baseline images of one or more source data files in target files of the target storage system, and

for a selected target storage time:

A) dynamically identifying locations in the source storage system where changes have been made since a previous target storage time; and

B) in response to identifying the locations,

i) reading contents that occupy the locations, and

ii) sending the contents to the target storage system; and

C) storing the contents in the target storage system together with associations of the contents with the locations.

81. A computer system comprising a source storage system and a target storage system in which information is maintained from which a set of source files stored on the source storage system can be retrieved, the system being configured to execute agents that perform operations comprising:

storing baseline images of one or more source data files in target files of the target storage system, and

for a selected target storage time;

A) dynamically identifying locations in the source storage system where changes have been made since a previous target storage time; and

B) in response to identifying the locations,

i) reading contents that occupy the locations, and

ii) sending the contents to the target storage system; and

C) storing the contents in the target storage system together with associations of the contents with the locations.

82. A storage medium containing instructions readable by a computer system that comprises a source storage system and a target storage system, the instructions comprising

instructions to configure the computer system to maintain in the target storage system information from which a set of source files stored on the source storage system can be retrieved, and

instructions to configure the computer system to store baseline images of one or more source data files in target files of the target storage system, and

instructions to configure the computer system for a selected target storage time to:

A) dynamically identify locations in the source storage system where changes have been made since a previous target storage time; and

B) in response to identifying the locations,

i) read contents that occupy the locations, and

ii) send the contents to the target storage system; and

C) store the contents in the target storage system together with associations of the contents with the locations.