Storage area network emulation

• US 10,241,724 B1
• Filed: 09/27/2017
• Issued: 03/26/2019
• Est. Priority Date: 06/08/2015
• Status: Active Grant

• Current Assignee: Skytap Incorporated
• Original Assignee: Skytap Incorporated
• Inventors: Schick, Bradley M., Shelepov, Bulat, Slioussar, Nikolai
• Primary Examiner(s): Padmanabhan, Mano
• Assistant Examiner(s): Edouard, Jean C
• Application Number:
  US15/717,592
• Time in Patent Office: 545 Days
• Field of Search: 711161, 711114
• CPC Class Codes: G06F 2009/45579 I/O management, e.g. providing access to device drivers or storage
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 9/4406 Loading of operating system
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: H04L 41/08 Configuration management of networks or network elements address allocation H04L61/50
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Generating a virtual storage area network (VSAN) is disclosed. From the perspective of a customer'"'"'s virtual machine, the VSAN is a logical network of storage devices that provide features that are typically associated with a physical storage access network, such as block level data storage; logical disk arrays; tape libraries; optical jukeboxes; quality of service; disk mirroring, backup and restoration services; archival and retrieval of archived data; data migration from one virtual storage device to another; sharing of data among different virtual machines in a network; and the incorporation of virtual subnetworks.

Claims

1. A computer-implemented method, comprising:

establishing a virtual storage area network, wherein the virtual storage area network includes a virtual machine communicatively coupled to a storage pool, wherein the storage pool is at least an allocation of data storage at a physical block storage device, and wherein the virtual machine represents a portion of the storage pool as a mass storage device to other virtual machines;

receiving metadata, wherein the metadata defines at least one storage pool configuration of the storage pool and at least one virtual machine configuration of the at least one virtual machine; and

configuring the virtual machine and the storage pool of the virtual storage network in accordance with the received metadata.

2. The computer-implemented method of claim 1, further comprising:

booting an operating system of the at least one virtual machine, wherein the operating system is configured based at least on the metadata, wherein the metadata includes an entry for an I/O data rate for sending storage requests from the at least one virtual machine to the storage pool, and wherein a network controller of the at least one virtual machine is configured based on the entry.

3. The computer-implemented method of claim 1, further comprising:

booting a commodity operating system of the at least one virtual machine, wherein the commodity operating system is configured based at least on the metadata, and wherein the metadata includes an entry for an I/O data rate for sending storage requests from the at least one virtual machine to the storage pool.

4. The computer-implemented method of claim 1, further comprising:

configuring a network controller of the at least one virtual machine to traffic shape storage requests sent to the one or more storage pools, wherein the traffic shaping is based on the metadata.

5. The computer-implemented method of claim 1, further comprising:

in response to receiving storage access requests at a first I/O data rate, buffering one or more of the storage access requests in a network controller of the at least one virtual machine,

wherein at least one of the one or more buffered storage access requests is sent from the at least one virtual machine to the storage pool at a second I/O data rate that is equal to or less than a third I/O data rate defined in the metadata.

6. The computer-implemented method of claim 1, further comprising:

detecting a change to the metadata, and in response to the detected change, reconfiguring the virtual storage area network based on the detected change.

7. The computer-implemented method of claim 1, wherein the metadata defines a virtual size of the storage pool and a physical size of the storage pool.

8. The computer-implemented method of claim 1, wherein the metadata defines an I/O data rate limit for sending storage block access requests to the storage pool.

9. The computer-implemented method of claim 1, wherein storage block access requests are received at the at least one virtual machine, wherein the at least one virtual machine verifies an I/O data rate associated with the storage block requests, and wherein the storage block requests are sent from the at least one virtual machine to the storage pool at an I/O data rate defined in the metadata.

10. The computer-implemented method of claim 1, wherein a graphical interface displays selectable indicia for modifying a size of the storage pool and an I/O data rate for sending information to the storage pool.

11. The computer-implemented method of claim 10, wherein monetary value is received for modifying the size of the storage pool or the I/O data rate for sending information to the storage pool.

12. The computer-implemented method of claim 1, wherein storage access requests are sent from a customer'"'"'s virtual machine for delivery to the storage pool at a first I/O data rate, wherein data in the metadata defines a maximum I/O data rate for sending data to the storage pool, and wherein the first I/O data rate for sending the storage access requests to the storage pool is dynamically modified to an I/O data rate less than or equal to the maximum I/O data rate associated with the storage pool.

13. The computer-implemented method of claim 1, further comprising determining a new virtual storage area network, wherein the new virtual storage area network includes a new virtual machine communicatively coupled to a new storage pool at the physical block storage device.

14. The computer-implemented method of claim 1, further comprising:

remotely booting the virtual machine.

15. A virtual storage area network, comprising:

a first virtual machine;

a second virtual machine; and

a storage pool,

wherein the first virtual machine is programmed to;

receive one or more storage access requests from the second virtual machine, wherein the one or more storage access requests were sent at a first I/O data rate, and

send the one or more storage access requests to the storage pool at a second I/O data rate, wherein the second I/O data rate is within a storage pool I/O data rate limit defined by metadata associated with the storage pool.

16. The virtual storage area network of claim 15, wherein the first I/O data rate is faster than the I/O data rate limit defined in the metadata.

17. The virtual storage area network of claim 15, further comprising:

remotely booting the first virtual machine.

18. The virtual storage area network of claim 15, further comprising:

configuring an operating system of the first virtual machine, wherein configuring the operating system of the first virtual machine includes configuring a network controller of the first virtual machine, and wherein the configured network controller of the first virtual machine dynamically modifies sending the one or more storage access requests to the storage pool at a I/O data rate approximately equal to the I/O data rate limit defined by the metadata.

19. The virtual storage area network of claim 15, further comprising:

traffic shaping the one or more storage access requests from operating at the first I/O data rate to operating at the second I/O data rate.

20. The virtual storage area network of claim 15, wherein the first virtual machine receives one or more storage access requests from a third virtual machine for accessing the storage pool, wherein the one or more storage access requests from the third virtual machine were sent at a third I/O data rate, and wherein the sum of the second I/O data rate and the third I/O data rate are greater than the storage pool I/O data rate limit defined by the metadata associated with the storage pool.

21. The virtual storage area network of claim 20, wherein the one or more storage access requests from the second and the third virtual machines are throttled such that the one or more storage access requests are sent to the storage pool at I/O data rates within the storage pool I/O data rate limit defined by the metadata.

22. The virtual storage area network of claim 15, wherein the metadata defines one or more respective per-virtual machine I/O data rate limits different from and less than the storage pool I/O data rate limit for accessing the storage pool.

23. The virtual storage area network of claim 15, wherein in response to receiving a request to increase an amount of physical block storage space reserved at a physical block storage device for the storage pool, determining within the metadata whether the requested increase is within a maximum storage space limit associated with the storage pool, and reserving the requested increase at the physical block storage device if the increase of the storage space will not exceed the maximum storage space limit.

24. The virtual storage area network of claim 15, wherein the first virtual machine receives a request, via a graphical user interface, to change the storage pool I/O data rate limit for the storage pool, wherein the metadata associated with the storage pool is modified based on the request.

25. The virtual storage area network of claim 15, wherein the first virtual machine automatically decreases a per-virtual machine I/O data rate limit in response to determining that the per-virtual machine I/O data rate is at or near a threshold I/O data rate limit for the storage pool.

26. The virtual storage area network of claim 15, wherein monetary value is received for increasing the I/O data rate limit or a storage rate limit associated with the storage pool, wherein the customer sends a request to increase the I/O data rate limit or the storage rate limit via a graphical user interface.

27. The virtual storage area network of claim 15, wherein the metadata determines a data storage limit for the storage pool.

28. The virtual storage area network of claim 15, wherein a logical file system is determined for the storage pool and wherein the logical file system includes a dataset for storing data accessible, via a network, to the second virtual machine.

29. The virtual storage area network of claim 15, wherein the first virtual machine facilitates the second virtual machine'"'"'s access to the storage pool, wherein the storage pool hosts a virtual disk image for the second virtual machine.

30. The virtual storage area network of claim 15, wherein the storage pool is at least an allocation of data storage at a physical block storage device.

31. A computer-implemented method, comprising:

initiating one or more storage pools at a physical block storage device, wherein a each storage pool is at least an allocation of data storage at the physical block storage device, and wherein metadata associated with each storage pool determines characteristics of one or more of the initiated storage pools;

receiving storage operation requests from a virtual machine, wherein the storage operation requests are for accessing one of the storage pools at the physical block storage device;

adjusting a rate at which the storage operation requests are sent to the physical block storage device to comply with an I/O data rate limit defined by the metadata; and

sending the storage operation requests to the physical block storage device at the adjusted rate.

32. The computer-implemented method of claim 31, wherein adjusting the rate at which the storage operation requests are sent to the physical block storage device is based on traffic shaping the storage operation requests to conform to a network configuration of the virtual machine, wherein the network configuration is based on the metadata.

33. The computer-implemented method of claim 31, wherein storage operation requests are sent from the virtual machine to the storage pool at an I/O data rate defined in the metadata.

34. The computer-implemented method of claim 31, wherein storage operation requests are sent from the virtual machine for delivery to the storage pool at a first I/O data rate, wherein data in the metadata defines a maximum I/O data rate for sending data to the storage pool, and wherein the first I/O data rate for sending the storage operation requests to the storage pool is dynamically modified to an I/O data rate less than or equal to the maximum I/O data rate associated with the storage pool.

35. The computer-implemented method of claim 31, further comprising:

traffic shaping the storage operation requests from operating at a first I/O data rate to operating at a second data rate, wherein the first data rate is faster than a I/O data rate limit defined in the metadata, and wherein the second data rate is within the I/O data rate limit defined in the metadata.

36. A computer-implemented system including at least one processor, the system comprising:

virtual storage area network software executed on the at least one processor to;

establish a virtual storage network, wherein the virtual storage network include a virtual machine communicatively coupled to a storage pool, wherein the storage pool is at least an allocation of data storage at a physical block storage device, and wherein the virtual machine represents a portion of the storage pool as a mass storage device to other virtual machines;

determine metadata, wherein the metadata defines at least one storage pool configuration of the storage pool and at least one virtual machine configuration of the at least one virtual machine; and

configure the virtual machine and the storage pool of the virtual storage network in accordance with the determined metadata.

37. The computer-implemented system of claim 36, wherein the storage pool is at least an allocation of data storage at a physical block storage device.

38. The computer-implemented system of claim 36, wherein the metadata defines a data storage limit for the storage pool.

39. The computer-implemented system of claim 36, wherein the metadata defines one or more respective per-virtual machine I/O data rate limits different from and less than a storage pool I/O data rate limit for accessing the storage pool.