Systems and methods for performing quiescence in a storage virtualization environment

• US 7,447,939 B1
• Filed: 02/27/2004
• Issued: 11/04/2008
• Est. Priority Date: 02/28/2003
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Faulkner, Kevin, Yim, Wai, Kopper, David, DeKoning, Rod
• Primary Examiner(s): Beausoliel; Robert
• Assistant Examiner(s): Mehrmanesh; Elmira
• Application Number:
  US10/787,321
• Time in Patent Office: 1,712 Days
• Field of Search: 714/5, 714/6, 714/8, 714/9, 714/34
• US Class Current: 714/6.13
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0766 Error or fault reporting or storing
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/201 between storage system components
• CPC Class Codes: G06F 11/2056 by mirroring
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Systems consistent with the present invention perform quiescence of a network storage system in a storage virtualization environment including a virtualization layer that interfaces between a host and at least one storage device, wherein the virtualization layer defines at least one virtual volume comprising objects defining a mapping to data in the at least one storage device and storing information about a state of the at least one storage device in a virtualization database that is distributed across more than one processor in the virtualization layer. A quiescence instruction may be implemented to maintain reliability and scalability of the storage virtualization environment.

Claims

1. A method comprising:

configuring a virtualization layer to interface between a host and at least one storage device, wherein the virtualization layer defines at least one virtual volume comprising objects defining a mapping from the at least one virtual volume to data in the at least one storage device, wherein the objects are distributed across more than one processor in the virtualization layer and comprise a virtualization database;

storing information about a state of the at least one storage device in the virtualization database;

establishing a state manager for each processor, wherein the state manager monitors the state of the at least one storage device;

issuing a quiescence instruction to the state manager for each processor; and

responsive to receiving the quiescence instruction by the state manager,

halting long term operations underway at the time the quiescence instruction is received, and

completing short term operations comprising operations that are other than long term operations and that are underway at the time the quiescence instruction is received.

2. The method of claim 1, further comprising:

issuing the quiescence instruction when a storage device fails.

3. The method of claim 1, further comprising:

issuing the quiescence instruction when a processor fails.

4. The method of claim 1, further comprising:

receiving notification from the state manager when short term operations are completed and long term operations are halted.

5. The method of claim 4, further comprising:

reconfiguring the virtualization layer after the notification has been received from the state manager.

6. The method of claim 5, wherein configuring further comprises configuring the virtualization layer not to interface with a device that has failed.

7. The method of claim 1, wherein the short term operations include at least one of a read operation and a write operation.

8. The method of claim 1, wherein the long term operations include at least one of rebuilding a virtual volume and scrubbing a virtual volume.

9. A system comprising:

a plurality of storage devices storing data corresponding to a host;

a virtualization layer between the host and the plurality of storage devices, the virtualization layer comprising objects defining a mapping from at least one virtual volume to data in the plurality of storage devices, wherein the objects are distributed across more than one processor in the virtualization layer and comprise a virtualization database,

the virtualization database storing information about a state of each of the plurality of storage devices;

a plurality of processors, each processor having a state manager that monitors the state of at least one of the plurality of storage devices corresponding to the processor, that receives a quiescence instruction in response to a change in the state of one of the plurality of storage devices, and, responsive to receiving the quiescence instruction, halts long term operations underway at the time the quiescence instruction is received and completes short term operations comprising operations that are other than long term operations and that are underway at the time the quiescence instruction is received.

10. The system of claim 9 wherein

one of the plurality of processors comprises a master processor that issues the quiescence instruction in response to a failure of one of the plurality of storage devices.

11. The system of claim 10, wherein each processor'"'"'s state manager further notifies the master processor when short term operations are complete and long term operations are halted.

12. The system of claim 11, wherein the master processor further reconfigures the virtualization layer after notification is received from each processor'"'"'s state manager that short term operations are complete and long term operations are halted.

13. A system for dynamically updating storage associated with a host, comprising:

means for configuring a virtualization layer to interface between the host and at least one storage device wherein the virtualization layer defines at least one virtual volume comprising objects defining a mapping from the at least one virtual volume to data in the at least one storage device, wherein the objects are distributed across more than one processor in the virtualization layer and comprise a virtualization database;

means for storing information about a state of the at least one storage device in the virtualization database;

means for receiving data about a new state of the at least one storage device;

means for updating the virtualization database with the data about the new state of the at least one storage device;

means for updating the mapping contained in the objects based on the data about the new state of the at least one storage devices

means for receiving a quiescence instruction;

means for halting long term operations underway at the time the quiescence instruction is received; and

means for completing short term operations comprising operations that are other than long term operations and that are underway at the time the quiescence instruction is received.

14. The system of claim 13, wherein the updating is responsive to the storage device becoming an available storage device.

15. The system of claim 14, further comprising:

means for reconfiguring the virtualization layer after the mapping has been updated to form a reconfigured virtualization layer, wherein the reconfigured virtualization layer interfaces with the available storage device.

16. The system of claim 13, wherein the updating is responsive to the storage device becoming an unavailable storage device.

17. The system of claim 16, further comprising:

means for reconfiguring the virtualization layer after the mapping has been updated to form a reconfigured virtualization layer, wherein the reconfigured virtualization layer does not interface with the unavailable storage device.

18. A computer-readable storage medium containing code for directing a processor to perform a method for dynamically updating storage associated with a host, the method comprising:

configuring a virtualization layer to interface between the host and at least one storage device wherein the virtualization layer defines at least one virtual volume comprising objects defining a mapping from the virtual volume to data in the at least one storage device, wherein the objects are distributed across more than one processor in the virtualization layer and comprise a virtualization database;

storing information about a state of the at least one storage device in the virtualization database;

receiving data about a new state of the at least one storage device;

updating the virtualization database with the data about the new state of the at least one storage device;

updating the mapping contained in the objects based on the data about the new state of the at least one storage device;

receiving a quiescence instruction; and

responsive to receiving the quiescence instruction,

halting long term operations underway at the time the quiescence instruction is received, and

completing short term operations comprising operations that are other than long term operations and that are underway at the time the quiescence instruction is received.

19. The computer-readable storage medium of claim 18, wherein the updating is responsive to the storage device becoming an available storage device.

20. The computer-readable storage medium of claim 19, the method further comprising:

reconfiguring the virtualization layer to form a reconfigured virtualization layer after the mapping has been updated, wherein the reconfigured virtualization layer interfaces with the available storage device.

21. The computer-readable storage medium of claim 18, wherein the updating is responsive to the storage device becoming an unavailable storage device.

22. The computer-readable storage medium of claim 21, the method further comprising:

reconfiguring the virtualization layer to form a reconfigured virtualization layer after the mapping has been updated, wherein the reconfigured virtualization layer does not interface with the unavailable storage device.