Data processing method and apparatus

• US 10,628,050 B2
• Filed: 04/05/2018
• Issued: 04/21/2020
• Est. Priority Date: 11/05/2014
• Status: Active Grant

• Current Assignee: Xfusion Digital Technologies Company Limited
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Luo, Xiong
• Primary Examiner(s): Dennison, Jerry B
• Application Number:
  US15/946,484
• Publication Number:
  US 20180225048A1
• Time in Patent Office: 747 Days
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04L 65/40 Support for services or applications
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A data processing technology is provided, and is applied to a partition management device. The partition management device stores a partition view, the partition view records a correspondence between an ID of a current partition and an address of a storage disk, and a total quantity of current partitions may be less than a total quantity of final partitions.

Claims

1. A method, comprising:

managing, by a partition management controller, a plurality of current partitions for a first plurality of storage disks in a cluster of storage disks;

determining, by the partition management controller, that an additional one or more storage disks have been added to the cluster of storage disks;

when the addition of the one or more storage disks causes an average quantity of current partitions per storage disk of the cluster of storage disks to meet a first condition, and causes the average quantity of current partitions per storage disk of the cluster of storage disks to not meet a second condition, splitting, by the partition management controller, at least one of the current partitions to obtain at least one additional partition, which results in a new total quantity of current partitions; and

allocating, by the partition management controller, the at least one additional partition to a second plurality of storage disks in the cluster of storage disks.

2. The method according to claim 1, wherein:

each partition of the plurality of current partitions after splitting corresponds to at least one final partition.

3. The method according to claim 2, wherein after allocating the at least one additional partition, the method further comprises:

receiving a first visiting to the final partition; and

transforming the first visiting to a second visiting to a current partition, the current partition corresponding to the final partition of the first visiting.

4. The method according to claim 1, wherein:

the first condition is a first value; and

the second condition is a second value.

5. The method according to claim 1, wherein:

the new total quantity of current partitions for the first plurality of storage disks in the cluster of storage disks after the splitting is no more than a preset quantity of final partitions.

6. The method according to claim 1, wherein:

IDs of the plurality of current partitions for the first plurality of storage disks in the cluster of storage disks after the splitting are continuous natural numbers.

7. A device, comprising:

a processor; and

a computer-readable storage medium storing a program to be executed by the processor, the program including instructions for;

managing a plurality of current partitions for a first plurality of storage disks in a cluster of storage disks;

determining that an additional one or more storage disks have been added to the cluster of storage disks;

when the addition of the one or more storage disks causes an average quantity of current partitions per storage disk of the cluster of storage disks to meet a first condition, and causes the average quantity of current partitions per storage disk of the cluster of storage disks to not meet a second condition, splitting at least one of the current partitions to obtain at least one additional partition, which results in a new total quantity of current partitions; and

allocating the at least one additional partition to a second plurality of storage disks in the cluster of storage disks.

8. The device according to claim 7, wherein:

each partition of the plurality of current partitions after splitting corresponds to at least one final partition.

9. The device according to claim 8, wherein the program further includes instructions for:

receiving a first visiting to the final partition; and

transforming the first visiting to a second visiting to a current partition, the current partition corresponding to the final partition of the first visiting.

10. The device according to claim 7, wherein:

the first condition is a first value; and

the second condition is a second value.

11. The device according to claim 7, wherein:

the new total quantity of current partitions for the first plurality of storage disks in the cluster of storage disks after splitting is no more than a preset quantity of final partitions.

12. The device according to claim 7, wherein:

IDs of the plurality of current partitions for the first plurality of storage disks in the cluster of storage disks after the splitting are continuous natural numbers.

13. A non-transitory computer readable medium storing instructions that, when executed by one or more processors, causes a device to:

manage a plurality of current partitions for a first plurality of storage disks in a cluster of storage disks;

determine that an additional one or more storage disks have been added to the cluster of storage disks;

when the addition of the one or more storage disks causes an average quantity of current partitions per storage disk of the cluster of storage disks to meet a first condition, and causes the average quantity of current partitions per storage disk of the cluster of storage disks to not meet a second condition, split at least one of the current partitions to obtain at least one additional partition, which results in a new total quantity of current partitions; and

allocate the at least one additional partition to a second plurality of storage disks in the cluster of storage disks.

14. The medium according to claim 13, wherein:

each partition of the plurality of current partitions after the splitting corresponds to at least one final partition.

15. The medium according to claim 14, wherein the instructions, when executed by the one or more processors, further causes the device to:

receive a first visiting to the final partition; and

transform the first visiting to a second visiting to a current partition, the current partition corresponding to the final partition of the first visiting.

16. The medium according to claim 13, wherein:

the first condition is a first value; and

the second condition is a second value.

17. The medium according to claim 13, wherein:

the new total quantity of current partitions for the first plurality of storage disks in the cluster of storage disks after splitting is no more than a preset quantity of final partitions.

18. The medium according to claim 13, wherein:

IDs of the plurality of current partitions for the first plurality of storage disks in the cluster of storage disks after splitting are continuous natural numbers.