System and method for performing snapshots in a storage environment employing distributed block virtualization

• US 7,389,394 B1
• Filed: 05/03/2004
• Issued: 06/17/2008
• Est. Priority Date: 05/02/2003
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Operating Corporation (NortonLifeLock Inc.)
• Inventors: Karr, Ronald S., Kekre, Anand A., Dhavale, Poonam, Arumugham, Kalaivani
• Primary Examiner(s): Shah; Sanjiv
• Assistant Examiner(s): Yu; Jae Un
• Application Number:
  US10/838,043
• Time in Patent Office: 1,506 Days
• Field of Search: 711/161, 711/162, 711/203
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2082 Data synchronisation
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0667 at data level, e.g. file, record or object virtualisation
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Systems and methods for performing snapshots in a storage environment employing distributed block virtualization. In one embodiment, the system may include a volume server, a first and a second host computer system, and a plurality of physical block devices. The volume server may be configured to aggregate storage in the plurality of physical block devices into a plurality of logical volumes, where a particular logical volume includes storage from at least two physical block devices. The volume server may further be configured to make a first and a second subset of the logical volumes available to the first and second host computer systems for input/output, respectively. The first subset and the second subset may be at least partially nonoverlapping, and a second logical volume may be configured to store a snapshot of data stored in a first logical volume logical volume.

Claims

1. A system comprising:

a volume server;

a first and a second host computer system; and

a plurality of physical block devices;

wherein the volume server is configured to;

aggregate storage in the plurality of physical block devices into a plurality of logical volumes, wherein at least a given one of the plurality of logical volumes includes storage from at least two physical block devices, wherein the volume server is further configured to present the given logical volume to a volume client on one or more of the host computer systems as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions are implemented by the given logical volume transparently to the volume client;

make a first subset of the plurality of logical volumes available to said first host computer system for input/output; and

make a second subset of the plurality of logical volumes available to said second host computer system for input/output;

wherein said first subset includes at least a particular one of the plurality of logical volumes, wherein the particular logical volume is not included in said second subset;

wherein the given logical volume is included in one or more of the first or second subsets;

wherein a second one of the plurality of logical volumes is configured to store a copy-on-write snapshot of data stored in the given logical volume, wherein for a particular data block of said given logical volume, said copy-on-write snapshot stored by said second logical volume comprises a copy of said particular data block prior to a write operation directed to said particular data block, wherein said copy of said particular data block of said given logical volume is stored to said second logical volume in response to detecting said write operation directed to said particular data block and before said particular data block is modified on said given logical volume;

wherein a fourth one of the plurality of logical volumes is configured to store a copy-on-write snapshot of data stored in a third one of the plurality of logical volumes, wherein for a given data block of said third logical volume, said copy-on-write snapshot stored by said fourth logical volume comprises a copy of said given data block prior to a write operation directed to said given data block, wherein said copy of said given data block is stored to said fourth logical volume in response to detecting said write operation directed to said given data block and before said given data block is modified on said third logical volume; and

wherein said fourth and said second logical volumes are configured to store at least a portion of respective snapshot data of said third and said given logical volumes in a shared logical or physical block storage device common to both said fourth and said second logical volumes.

2. The system as recited in claim 1, wherein said second logical volume is further configured to store said copy-on-write snapshot of data stored in said given logical volume as of a snapshot effective time, such that when a given data block of said given logical volume is written after the snapshot effective time, said second logical volume is configured to store an original value of said given data block prior to said writing.

3. The system as recited in claim 2, wherein a request to read said particular data block of copy-on-write snapshot data associated with said given logical volume returns a corresponding data block of a block device associated with said given logical volume if said particular data block has not been written after the snapshot effective time, and wherein said request returns a corresponding data block of a block device associated with said second logical volume if said particular data block has been written after the snapshot effective time.

4. The system as recited in claim 2, wherein a status indicative of whether said original value of said given data block has been stored in said second logical volume is stored in nonvolatile storage.

15. The system as recited in claim 1, wherein the virtualization functions comprise one or more of:

device striping, device spanning, device mirroring, device snapshotting, or device block size translation.

16. The system as recited in claim 1, wherein the volume server is further configured to present the second logical volume to said volume client as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions implemented by said second logical volume differ from the virtualization functions implemented by said given logical volume.

5. A method comprising:

aggregating storage in a plurality of physical block devices into a plurality of logical volumes, wherein at least a given one of the plurality of logical volumes includes storage from at least two physical block devices;

presenting the given logical volume to a volume client on one or more of a plurality of host computer systems as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions are implemented by the given logical volume transparently to the volume client;

making a first subset of the plurality of logical volumes available to a first one of the host computer systems for input/output; and

making a second subset of the plurality of logical volumes available to a second one of the host computer systems for input/output;

wherein said first subset includes at least a particular one of the plurality of logical volumes, wherein the particular logical volume is not included in said second subset;

wherein the given logical volume is included in one or more of the first or second subsets;

a second one of the plurality of logical volumes storing a copy-on-write snapshot of data stored in the given logical volume, wherein for a particular data block of said given logical volume, said second logical volume storing said copy-on-write snapshot comprises said second logical volume storing a copy of said particular data block prior to a write operation directed to said particular data block, wherein storing said copy of said particular data block of said given logical volume to said second logical volume occurs in response to detecting said write operation directed to said particular data block and before said particular data block is modified on said given logical volume;

a fourth one of the plurality of logical volumes storing a copy-on-write snapshot of data stored in a third one of the plurality of logical volumes, wherein for a given data block of said third logical volume, said fourth logical volume storing said copy-on-write snapshot comprises said fourth logical volume storing a copy of said given data block prior to a write operation directed to said given data block, wherein storing said copy of said given data block of said third logical volume to said fourth logical volume occurs in response to detecting said write operation directed to said given data block and before said given data block is modified on said third logical volume; and

wherein said fourth and said second logical volumes are configured to store at least a portion of respective snapshot data of said third and said given logical volumes in a shared logical or physical block storage device common to both said fourth and said second logical volumes.

6. The method as recited in claim 5, wherein said second logical volume is further configured to store said copy-on-write snapshot of data stored in said given logical volume as of a snapshot effective time, such that when a given data block of said given logical volume is written after the snapshot effective time, said second logical volume is configured to store an original value of said given data block prior to said writing.

7. The method as recited in claim 6, wherein a request to read said particular data block of copy-on-write snapshot data associated with said given logical volume returns a corresponding data block of a block device associated with said given logical volume if said particular data block has not been written after the snapshot effective time, and wherein said request returns a corresponding data block of a block device associated with said second logical volume if said particular data block has been written after the snapshot effective time.

8. The method as recited in claim 6, further comprising storing in nonvolatile storage a status indicative of whether said original value of said given data block has been stored in said second logical volume.

17. The method as recited in claim 5, wherein the virtualization functions comprise one or more of:

device striping, device spanning, device mirroring, device snapshotting, or device block size translation.

18. The method as recited in claim 5, further comprising presenting the second logical volume to said volume client as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions implemented by said second logical volume differ from the virtualization functions implemented by said given logical volume.

9. A computer-accessible storage medium comprising program instructions, wherein said program instructions are executable to:

aggregate storage in a plurality of physical block devices into a plurality of logical volumes, wherein at least a given one of the plurality of logical volumes includes storage from at least two physical block devices;

present the given logical volume to a volume client on one or more of a plurality of host computer systems as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions are implemented by the given logical volume transparently to the volume client;

make a first subset of the plurality of logical volumes available to a first one of the host computer systems for input/output; and

make a second subset of the plurality of logical volumes available to a second one of the host computer systems for input/output;

wherein said first subset includes at least a particular one of the plurality of logical volumes, wherein the particular logical volume is not included in said second subset;

wherein the given logical volume is included in one or more of the first or second subsets;

wherein a second logical volume is configured to store a copy-on-write snapshot of data stored in the given logical volume, wherein for a particular data block of said given logical volume, said copy-on-write snapshot stored by said second logical volume comprises a copy of said particular data block prior to a write operation directed to said particular data block, wherein said copy of said particular data block of said given logical volume is stored to said second logical volume in response to detecting said write operation directed to said particular data block and before said particular data block is modified on said given logical volume;

wherein a fourth one of the plurality of logical volumes is configured to store a copy-on-write snapshot of data stored in a third one of the plurality of logical volumes, wherein for a given data block of said third logical volume, said copy-on-write snapshot stored by said fourth logical volume comprises a copy of said given data block prior to a write operation directed to said given data block, wherein said copy of said given data block is stored to said fourth logical volume in response to detecting said write operation directed to said given data block and before said given data block is modified on said third logical volume; and

wherein said fourth and said second logical volumes are configured to store at least a portion of respective snapshot data of said third and said given logical volumes in a shared logical or physical block storage device common to both said fourth and said second logical volumes.

10. The computer-accessible storage medium as recited in claim 9, wherein said second logical volume is further configured to store said copy-on-write snapshot of data stored in said given logical volume as of a snapshot effective time, such that when a given data block of said given logical volume is written after the snapshot effective time, said second logical volume is configured to store an original value of said given data block prior to said writing.

11. The computer-accessible storage medium as recited in claim 10, wherein a request to read said particular data block of said copy-on-write snapshot data associated with said given logical volume returns a corresponding data block of a block device associated with said given logical volume if said particular data block has not been written after the snapshot effective time, and wherein said request returns a corresponding data block of a block device associated with said second logical volume if said particular data block has been written after the snapshot effective time.

12. The computer-accessible storage medium as recited in claim 10, wherein a status indicative of whether said original value of said given data block has been stored in said second logical volume is stored in nonvolatile storage.

19. The computer-accessible medium as recited in claim 9, wherein the virtualization functions comprise one or more of:

device striping, device spanning, device mirroring, device snapshotting, or device block size translation.

20. The computer-accessible medium as recited in claim 9, wherein the instructions are further executable to present the second logical volume to said volume client as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions implemented by said second logical volume differ from the virtualization functions implemented by said given logical volume.

13. A system comprising:

a volume server;

a first and a second host computer system; and

a plurality of physical block devices;

wherein the volume server is configured to;

aggregate storage in the plurality of physical block devices into a plurality of logical volumes, wherein at least a given one of the plurality of logical volumes includes storage from at least two physical block devices, wherein the volume server is further configured to present the given logical volume to a volume client on one or more of the host computer systems as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions are implemented by the given logical volume transparently to the volume client;

make a first subset of the plurality of logical volumes available to said first host computer system for input/output; and

make a second subset of the plurality of logical volumes available to said second host computer system for input/output, wherein the given logical volume is included in one or more of the first or second subsets;

wherein a second one of said plurality of logical volumes is configured to store a snapshot of data stored in said given logical volume as of a snapshot effective time, wherein for a particular data block of said given logical volume, said snapshot stored by said second logical volume comprises a copy of said particular data block prior to a write operation directed to said particular data block, wherein said write operation occurs after the snapshot effective time, and wherein said copy of said particular data block of said given logical volume is stored to said second logical volume in response to detecting said write operation directed to said particular data block and before said particular data block is modified on said given logical volume;

wherein a fourth one of said plurality of logical volumes is configured to store a snapshot of data stored in a third one of said plurality of logical volumes, wherein for a given data block of said third logical volume, said snapshot stored by said fourth logical volume comprises a copy of said given data block prior to a write operation directed to said given data block, wherein said copy of said given data block is stored to said fourth logical volume in response to detecting said write operation directed to said given data block and before said given data block is modified on said third logical volume; and

wherein said fourth and said second logical volumes are configured to store at least a portion of respective snapshot data of said third and said given logical volumes in a shared logical or physical block storage device common to both said fourth and said second logical volumes.

14. The system as recited in claim 13, wherein a request to read a particular data block of said snapshot data associated with said given logical volume returns a corresponding data block of a block device associated with said given logical volume if said particular data block has not been written after the snapshot effective time, and wherein said request returns a corresponding data block of a block device associated with said second logical volume if said particular data block has been written after the snapshot effective time.

21. The system as recited in claim 13, wherein the virtualization functions comprise one or more of:

device striping, device spanning, device mirroring, device snapshotting, or device block size translation.

22. The system as recited in claim 13, wherein the volume server is further configured to present the second logical volume to said volume client as a virtualized logical block device comprising a plurality of logical block devices hierarchically configured to implement a plurality of virtualization functions, wherein the virtualization functions implemented by said second logical volume differ from the virtualization functions implemented by said given logical volume.