Method for efficient load balancing in virtual storage systems

• US 10,459,633 B1
• Filed: 07/21/2017
• Issued: 10/29/2019
• Est. Priority Date: 07/21/2017
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Konduru, Jayasekhar, Liang, Shuang, Ding, Yiqiang, Burkule, Shyam
• Primary Examiner(s): Matin, Tasnima
• Application Number:
  US15/656,327
• Time in Patent Office: 830 Days
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A data storage device includes virtual storage devices, hosted by physical storage devices, and a processor. The processor obtains a data storage request, divides a file specified by the data storage request into blocks, and stores the blocks in the virtual storage devices based on an input output (IO) limitation of the virtual storage devices.

Claims

1. A data storage device, comprising:

a plurality of virtual storage devices hosted by a plurality of physical storage devices; and

a processor programmed to;

obtain a data storage request;

divide a file specified by the data storage request into a plurality of blocks;

divide the plurality of virtual storage devices into a plurality of IO bound storage groups; and

store the plurality of blocks in the plurality of virtual storage devices based on an input output (IO) limitation of the plurality of virtual storage devices, wherein storing the plurality of blocks comprises;

distributing the blocks to the plurality of virtual storage devices based on the plurality of IO bound storage groups; and

storing the distributed blocks in the plurality of virtual storage devices based on the distribution.

2. The data storage device of claim 1, wherein the IO limitation is caused by a first virtual storage device of the plurality of virtual storage devices and a second virtual storage device of the plurality of virtual storage devices sharing a physical storage device of the plurality of physical storage devices.

3. The data storage device of claim 2, wherein a first portion of the physical storage device of the plurality of physical storage devices is allocated to the first virtual storage device and a second portion of the physical storage device of the plurality of physical storage devices is allocated to the second virtual storage device.

4. The data storage device of claim 1,

wherein all of the virtual storage devices specified by each IO bound storage group share a respective physical storage device.

5. The data storage device of claim 1, wherein the blocks are distributed evenly across the IO bound storage groups.

6. The data storage device of claim 1, wherein the blocks are distributed unevenly across the IO bound storage groups.

7. The data storage device of claim 1, wherein the distribution of the blocks to the plurality of virtual storage devices is also based on IO bound storage group utilization heuristics.

8. The data storage device of claim 7, further comprising:

the IO bound storage group utilization heuristics that specify a frequency of which blocks are distributed to each of the IO bound storage groups.

9. A method of operating a data storage device, comprising:

obtaining, by the data storage device, a data storage request;

dividing, by the data storage device, a file specified by the data storage request into a plurality of blocks;

dividing, by the data storage device, the plurality of virtual storage devices into a plurality of IO bound storage groups; and

storing, by the data storage device, the plurality of blocks in a plurality of virtual storage devices of the data storage device based on an input output (IO) limitation of the plurality of virtual storage devices, wherein storing the plurality of blocks comprises;

distributing the blocks to the plurality of virtual storage devices based on the plurality of IO bound storage groups; and

storing the distributed blocks in the plurality of virtual storage devices based on the distribution.

10. The method of claim 9, wherein dividing the plurality of virtual storage devices into the plurality of IO bound storage groups comprises:

identifying a first virtual storage device of the plurality of virtual storage devices and a second virtual storage device of the plurality of virtual storage devices that share a physical storage device, and

adding the first virtual storage device of the plurality of virtual storage devices and the second virtual storage device of the plurality of virtual storage devices to a first IO bound storage group specified by the IO bound storage groups.

11. The method of claim 10, wherein dividing the plurality of virtual storage devices into the plurality of IO bound storage groups further comprises:

identifying a third virtual storage device of the plurality of virtual storage devices that does not share any physical storage devices with the first virtual storage device of the plurality of virtual storage devices, and

adding the third virtual storage device of the plurality of virtual storage devices to a second IO bound storage group specified by the IO bound storage groups.

12. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for operating a data storage device, the method comprising:

obtaining, by the data storage device, a data storage request;

dividing, by the data storage device, a file specified by the data storage request into a plurality of blocks;

dividing, by the data storage device, the plurality of virtual storage devices into a plurality of IO bound storage groups before storing the plurality of blocks; and

storing, by the data storage device, the plurality of blocks in a plurality of virtual storage devices of the data storage device based on an input output (IO) limitation of the plurality of virtual storage devices, comprising;

distributing the blocks to the plurality of virtual storage devices based on the plurality of IO bound storage groups; and

storing the distributed blocks in the plurality of virtual storage devices based on the distribution.

13. The non-transitory computer readable medium of claim 12, wherein dividing the plurality of virtual storage devices into the plurality of IO bound storage groups comprises:

identifying a first virtual storage device of the plurality of virtual storage devices and a second virtual storage device of the plurality of virtual storage devices that share a physical storage device, and

adding the first virtual storage device of the plurality of virtual storage devices and the second virtual storage device of the plurality of virtual storage devices to a first IO bound storage group specified by the IO bound storage groups.

14. The non-transitory computer readable medium of claim 13, wherein dividing the plurality of virtual storage devices into the plurality of IO bound storage groups further comprises:

identifying a third virtual storage device of the plurality of virtual storage devices that does not share any physical storage devices with the first virtual storage device of the plurality of virtual storage devices, and

adding the third virtual storage device of the plurality of virtual storage devices to a second IO bound storage group specified by the IO bound storage groups.