System and method for managing provisioning of storage resources in a network with virtualization of resources in such a network

• US 8,219,681 B1
• Filed: 03/30/2007
• Issued: 07/10/2012
• Est. Priority Date: 03/26/2004
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Glade, Bradford B., Harvey, David W., Kemeny, John, Waxman, Matthew D.
• Primary Examiner(s): Patel, Ashok
• Assistant Examiner(s): COSBY, LAWRENCE V
• Application Number:
  US11/731,469
• Time in Patent Office: 1,929 Days
• Field of Search: 709/226, 709/229, 711/204, 711/213, 711/112, 707/616, 707/827, 707/660, 707/647, 707/641
• US Class Current: 709/226
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

This invention is a system and method for managing provisioning of resources for one or more data storage networks using a new architecture.

Claims

1. A method for managing allocation of storage resources in a storage network, wherein the storage network includes physical data storage on one or more storage arrays that are in the storage network, and the network is in communication with one or more hosts and the network further includes a storage network management system that includes a storage virtualizer capable of intercepting and virtualizing an IO stream from the one or more hosts and which storage network management system further includes a storage and switch controller in communication with the storage virtualizer for storage network management, and the method comprises the steps of:

the storage network management system allocating one or more virtual data storage volumes for use by a host computer;

the storage network management system presenting the virtual data storage volumes to the host computer as representative of available physical storage on the one or more storage arrays, but not allocating physical data storage for the virtual data storage volumes, wherein the virtual data storage volumes can include regions that are either allocated to physical storage or are unallocated to physical storage pending an IO write request that would normally transform the unallocated regions to allocated regions;

if a write IO goes to an unallocated region of the virtual data storage volumes, the storage network management system determining if the write IO is a predictable write IO;

if the write IO is a predictable write IO, the storage network management system suppressing the predictable write IO by discarding the predictable write IO and not writing the predictable write IO to avoid allocation of the unallocated region of the virtual data storage volumes on the physical data storage volumes that would normally have been transformed to an allocated region, and upon a read IO for the discarded predicted write IO, responding to the read with a creation of the predicted write IO by an appropriate deterministic algorithm of the storage network management system, wherein the deterministic algorithm creates the IO data returned in response the read for the predictable write, to reduce what would otherwise be normal transformation of an unallocated region to an allocated region.

2. The method of claim 1, wherein the storage virtualizer is at least part of an intelligent multi-protocol switch (IMPS).

3. The method of claim 2, wherein execution of software running on the storage virtualizer and the storage and switch controller forms an instance of storage area network management that is separate from a host or the physical storage.

4. The method of claim 2, wherein the storage virtualizer includes software components for accelerating allocation.

5. The method of claim 1, wherein there are more than one of the storage network forming a plurality of storage area networks, and the plurality of storage networks are managed by the storage management system and the storage pool includes one and more storage arrays that are distributed over the plurality of storage area networks.

6. The method of claim 5, wherein the plurality of storage area networks are accessible from a management station over an IP network.

7. The method of claim 6, wherein the plurality of virtual storage area networks includes a plurality of virtual storage volumes.

8. The method of claim 5, wherein the storage virtualizer is at least part of an intelligent multi-protocol switch (IMPS).

9. The method of claim 6, wherein execution of software running on the storage virtualizer and the storage and switch controller forms an instance of storage area network management that is separate from a host or the physical storage.

10. The method of claim 9, wherein the storage virtualizer includes software components for accelerating allocation.

11. A system for managing allocation of storage resources in a storage network, wherein the storage network includes physical data storage on one or more storage arrays that are in the storage network, and the network is in communication with one or more hosts, the system comprising:

a storage network management system that includes a storage virtualizer capable of intercepting and virtualizing an IO stream from the one or more hosts and which storage network management system further includes a storage and switch controller in communication with the storage virtualizer for storage network management, and the storage network management system including computer hardware and/or software for carrying out the steps of;

allocating one or more virtual data storage volumes for use by a host computer;

presenting the virtual data storage volumes to the host computer as representative available physical storage on the one or more storage arrays, but not allocating physical data storage for the virtual data storage volumes, wherein the virtual data storage volumes can include regions that are either allocated to physical storage or are unallocated to physical storage pending an IO write request that would normally transform the unallocated regions to allocated regions; and

if a write IO goes to an unallocated region of the virtual data storage volumes, determining if the write IO is a predictable write IO;

if the write IO is a predictable write IO, the predictable write IO is suppressed by the storage network management system and the actual allocation of the virtual data storage volumes on the physical data storage volumes is avoided, and upon a read IO for the discarded predicted write IO, responding to the read with a creation of the predicted write IO by an appropriate deterministic algorithm, wherein the deterministic algorithm creates the IO data returned in response the read for the predictable write, to reduce what would otherwise be normal transformation of unallocated regions to allocated regions.

12. The system of claim 11, wherein the storage virtualizer is at least part of an intelligent multi-protocol switch (IMPS).

13. The system of claim 12, wherein execution of software running on the storage virtualizer and the storage and switch controller forms an instance of storage area network management that is separate from a host or the physical storage.

14. The system of claim 12, wherein the storage virtualizer includes software components for accelerating allocation.

15. The system of claim 11, wherein there are more than one of the storage network forming a plurality of storage area networks, and the plurality of storage networks are managed by the storage management system and the storage pool includes one and more storage arrays that are distributed over the plurality of storage area networks.

16. The system of claim 15, wherein the plurality of storage area networks are accessible from a management station over an IP network.

17. The system of claim 16, wherein the plurality of virtual storage area networks includes a plurality of virtual storage volumes.

18. The system of claim 15, wherein the storage virtualizer is at least part of an intelligent multi-protocol switch (IMPS).

19. The system of claim 16, wherein execution of software running on the storage virtualizer and the storage and switch controller forms an instance of storage area network management that is separate from a host or the physical storage.

20. The system of claim 19, wherein the storage virtualizer includes software components for accelerating allocation.