Computer system, data allocation management method, and program

• US 9,898,518 B2
• Filed: 04/12/2012
• Issued: 02/20/2018
• Est. Priority Date: 04/12/2012
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Fukunaka, Katsuhiro
• Primary Examiner(s): Hershley, Mark E
• Application Number:
  US14/385,532
• Publication Number:
  US 20150046399A1
• Time in Patent Office: 2,140 Days
• Field of Search: 707634
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/3404 for parallel or distributed programming
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54

Abstract

A computer system comprises a plurality of computers for executing a service by using databases constructed of storage areas included in the plurality of computers. Each of the plurality of computers is configured to hold performance management information for managing respective performances of the plurality of computers. The each of the plurality of computers is allocated master data and replicated data of the master data managed by one of the plurality of computers other than the each of the plurality of computers. The computer system comprises a performance information management part configured to update the performance management information; and a cluster configuration management part configured to determine, based on the performance management information, the management range of the master data managed by a computer and a sub-computers configured to hold the replicated data of the master data managed by the computer.

Claims

1. A computer system, comprising:

a plurality of computers coupled to one another via a network, for executing a service by using a database constructed of a plurality of storage apparatuses included in the computers, each of the computers including;

a processor;

one of the storage apparatuses coupled to the processor; and

a network interface coupled to the processor and configured to communicate with the other computers via the network,

wherein, in each of the computers, the storage apparatus stores instructions that, when executed by the processor, causes the processor to;

store performance management information for managing respective performances of the computers, the performance management information including a plurality of storage capacities of the respective storage apparatuses included in each of the computers,

manage a plurality of pieces of data formed of a key and a data value in the database,

wherein each of the computers is allocated;

a plurality of pieces of master data which are respectively managed based on a distributed algorithm for determining a management range indicating a range of the keys allocated thereto, and

a plurality of pieces of replicated data corresponding to the pieces of master data managed by the other computers, and

wherein, in each of the computers, the storage apparatus further stores instructions that, when executed by the processor, causes the processor to;

obtain information on the performance from the each of the computers and update the performance management information based on the obtained information,

determine, based on comparing the storage capacities of the respective storage apparatuses included in the performance management information, the management range of the plurality of pieces of master data managed by each of the computers and a plurality of sub-computers, from among the computers, configured to store the pieces of replicated data corresponding to the pieces of master data managed by each of the computers,

wherein the management range of each of the computers and the sub-computers is determined so that a difference between the storage capacity of the storage apparatus included in one of the computers and the storage capacity of the storage apparatus included in one of the sub-computers corresponding to the one of the computers becomes smaller.

2. The computer system according to claim 1,

wherein, in each of the computers, the storage apparatus includes a memory and a disk apparatus,

wherein the database includes a memory store constructed of a storage area of the memory included in each of the computers and a disk store constructed of the disk apparatus included in each of the computers, and

wherein, in each of the computers, the storage apparatus further stores instructions that, when executed by the processor, causes the processor to:

calculate a combination of one of the computers and one of the sub-computers such that a difference in the storage capacity of the memory of the one of the computers and the storage capacity of the memory of the one of the sub-computers becomes smaller;

set the sub-computers for the each of the computers based on the calculated combination of the one of the computers and the one of the sub-computers;

determine an assigned width of the management range for each of the computers based on the calculated combination of the one of the computers and the one of the sub-computers; and

apply the distributed algorithm based on the determined assigned width of the management range to thereby determine the management range of each of the computers.

3. The computer system according to claim 2,

wherein, in each of the computers, the storage apparatus stores instructions that, when executed by the processor, causes the processor to:

store index information designating a processing performance of the database,

refer to the index information to determine whether or not an access performance of the database is required;

when it is determined that the access performance of the database is required, calculate the combination of the one of the computers and the one of the sub-computers such that the storage capacity of the memory included in the one of the computers is equal to or larger than the storage capacity of the memory included in the one of the sub-computers corresponding to the one of the computers and such that the difference in the storage capacity of the memory of the one of the computers and the storage capacity of the memory of the one of the sub-computers becomes smaller, and

determine the assigned width of the management range of each of the computers based on the storage capacity of the memory in each of the computers.

4. The computer system according to claim 3, wherein, in each of the computers, the storage apparatus stores instructions that, when executed by the processor, causes the processor to:

display an entry screen for entering the index information, and

obtain the index information based on an operation performed through the entry screen.

5. The computer system according to claim 2,

wherein, in each of the computers, the storage apparatus stores instructions that, when executed by the processor, causes the processor to:

store index information designating a processing performance of the database,

refer to the index information to determine whether or not an access performance of the database and a usage efficiency of the storage capacity of the database are required;

when it is determined that the access performance of the database and the usage efficiency of the storage capacity of the database are required, calculate the combination of the one of the computers and the one of the sub-computers such that differences among the storage capacity of the memory included in the one of the computers that manages the plurality of pieces of master data corresponding to the plurality of pieces of replicated data held by the one of the computers, the storage capacity of the memory of the one of the computers, and the storage capacity of the memory of the one of the sub-computers corresponding to the one of the computers become smaller, and

determine the assigned width of the management range of each of the computers based on the storage capacity of the memory in each of the computers.

6. The computer system according to claim 1, wherein, in each of the computers, the storage apparatus stores instructions that, when executed by the processor, causes the processor to:

generate display information for displaying a difference in performance between each of the computers and each of the sub-computers corresponding to each of the computers and an assigned width of the management range of each of the computers.

7. A data allocation management method for a computer system including a plurality of computers coupled to one another via a network and being configured to execute a service by using a database constructed of a plurality of storage apparatuses included in the computers, the data allocation management method comprising:

storing performance management information for managing respective performances of the computers, the performance management information including a plurality of storage capacities of the respective storage apparatuses included in each of the computers;

managing a plurality of pieces of data formed of a key and a data value in the database, each of the computers being allocated a plurality of pieces of master data based on a distributed algorithm for determining a management range indicating a range of the keys allocated to each of the computers, and a plurality of pieces of replicated data corresponding to the pieces of master data managed by the other computers;

obtaining, by each of the computers, information on the performance from each of the computers and updating the performance management information based on the obtained information; and

determining, by each of the computers, based on comparing the storage capacities of the respective storage apparatuses included in the performance management information, the management range of the plurality of pieces of master data managed by each of the computers and a plurality of sub-computers, from among the computers, configured to store the pieces of replicated data corresponding to the pieces of master data managed by each of the computers,

wherein the management range of each of the computers and the sub-computers is determined so that a difference between the storage capacity of the storage apparatus included in one of the computers and the storage capacity of the storage apparatus included in one of the sub-computers corresponding to the one of the computers becomes smaller.

8. The data allocation management method according to claim 7,

wherein, in each of the computers, the storage apparatus includes a memory and a disk apparatus,

wherein the database includes a memory store constructed of a storage area of the memory included in each of the computers and a disk store constructed of the disk apparatus included in each of the computers, and

the data allocation management method further comprising:

calculating a combination of one of the computers and one of the sub-computers such that a difference in the storage capacity of the memory of the one of the computers and the storage capacity of the memory of the one of the sub-computers becomes smaller;

setting the sub-computers for the each of the computers based on the calculated combination of the one of the computers and the one of the sub-computers;

determining an assigned width of the management range for each of the computers based on the calculated combination of the one of the computers and the one of the sub-computers; and

applying the distributed algorithm based on the determined assigned width of the management range to thereby determine the management range of each of the computers.

9. The data allocation management method according to claim 8, further comprising:

storing, by each of the computers, index information designating a processing performance of the database;

referring to the index information to determine whether or not an access performance of the database is required; and

when it is determined that the access performance of the database is required, calculating the combination of the one of the computers and the one of the sub-computers such that the storage capacity of the memory included in the one of the computers is equal to or larger than the storage capacity of the memory included in the one of the sub-computers corresponding to the one of the computers and such that the difference in the storage capacity of the memory of the one of the computers and the storage capacity of the memory of the one of the sub-computers becomes smaller; and

determining the assigned width of the management range of each of the computers based on the storage capacity of the memory in each of the computers.

10. The data allocation management method according to claim 9, further comprising:

displaying an entry screen for entering the index information; and

obtaining the index information based on an operation performed through the entry screen.

11. The data allocation management method according to claim 8, further comprising:

storing, by each of the computers, index information designating a processing performance of the database;

referring to the index information to determine whether or not an access performance of the database and a usage efficiency of the storage capacity of the database are required; and

when it is determined that the access performance of the database and the usage efficiency of the storage capacity of the database are required, calculating the combination of the one of the computers and the one of the sub-computers such that differences among the storage capacity of the memory included in the one of the computers that manages the plurality of pieces of master data corresponding to the plurality of pieces of replicated data held by the one of the computers, the storage capacity of the memory of the one of the computers, and the storage capacity of the memory of the one of the sub-computers corresponding to the one of the computers become smaller; and

determining the assigned width of the management range of each of the computers based on the storage capacity of the memory in each of the computers.

12. The data allocation management method according to claim 7, further comprising:

generating display information for displaying a difference in performance between each of the computers and each of the sub-computers corresponding to each of the computers and an assigned width of the management range of each of the computers.

13. One or more non-transitory computer readable media with an executable program stored thereon, where the executable program causes each of a plurality of computers included in a computer system to execute a data allocation management method,

the computer system including the plurality of computers coupled to one another via a network and being configured to execute a service by using a database constructed of a plurality of storage apparatuses included in the computers,

each of the computers including:

a processor;

a storage apparatus coupled to the processor; and

a network interface configured to communicate to and from the plurality of computers other than the each of the plurality of computers via the network,

the data allocation method comprising;

storing performance management information for managing respective performances of the computers, the performance management information including a plurality of storage capacities of the respective storage apparatuses included in each of the computers;

managing a plurality of pieces of data formed of a key and a data value in the database, each of the computers being allocated a plurality of pieces of master data based on a distributed algorithm for determining a management range indicating a range of the keys allocated to each of the computers, and a plurality of pieces of replicated data corresponding to the pieces of master data managed by the other computers;

obtaining, by each of the computers, information on the performance from each of the computers and updating the performance management information based on the obtained information; and

determining, by each of the computers, based on comparing the storage capacities of the respective storage apparatuses included in the performance management information, the management range of the plurality of pieces of master data managed by each of the computers and a plurality of sub-computers, from among the computers, configured to store the pieces of replicated data corresponding to the pieces of master data managed by each of the computers,

wherein the management range of each of the computers and the sub-computers is determined so that a difference between the storage capacity of the storage apparatus included in one of the computers and the storage capacity of the storage apparatus included in one of the sub-computers corresponding to the one of the computers becomes smaller.

14. The one or more non-transitory computer readable media according to claim 13,

wherein, in each of the computers, the storage apparatus includes a memory and a disk apparatus,

wherein the database includes a memory store constructed of a storage area of the memory included in each of the computers and a disk store constructed of the disk apparatus included in each of the computers, and

the data allocation management method further comprising:

calculating a combination of one of the computers and one of the sub-computers such that a difference in the storage capacity of the memory of the one of the computers and the storage capacity of the memory of the one of the sub-computers becomes smaller;

setting the sub-computers for the each of the computers based on the calculated combination of the one of the computers and the one of the sub-computers;

determining an assigned width of the management range for each of the computers based on the calculated combination of the one of the computers and the one of the sub-computers; and

applying the distributed algorithm based on the determined assigned width of the management range to thereby determine the management range of each of the computers.

15. The one or more non-transitory computer readable media according to claim 14, the data allocation management method further comprising:

storing, by each of the computers, index information designating a processing performance of the database;

referring to the index information to determine whether or not an access performance of the database is required; and

when it is determined that the access performance of the database is required, calculating the combination of the one of the computers and the one of the sub-computers such that the storage capacity of the memory included in the one of the computers is equal to or larger than the storage capacity of the memory included in the one of the sub-computers corresponding to the one of the computers and such that the difference in the storage capacity of the memory of the one of the computers and the storage capacity of the memory of the one of the sub-computers becomes smaller; and

determining the assigned width of the management range of each of the computers based on the storage capacity of the memory in each of the computers.

16. The one or more non-transitory computer readable media according to claim 14, the data allocation management method further comprising:

storing, by each of the computers, index information designating a processing performance of the database;

referring to the index information to determine whether or not an access performance of the database and a usage efficiency of the storage capacity of the database are required; and

when it is determined that the access performance of the database and the usage efficiency of the storage capacity of the database are required, calculating the combination of the one of the computers and the one of the sub-computers such that differences among the storage capacity of the memory included in the one of the computers that manages the plurality of pieces of master data corresponding to the plurality of pieces of replicated data held by the one of the computers, the storage capacity of the memory of the one of the computers, and the storage capacity of the memory of the one of the sub-computers corresponding to the one of the computers become smaller; and

determining the assigned width of the management range of each of the computers based on the storage capacity of the memory in each of the computers.

17. The one or more non-transitory computer readable media according to claim 13, the data allocation management method further comprising:

displaying an entry screen for entering the index information; and

obtaining the index information based on an operation performed through the entry screen.

18. The one or more non-transitory computer readable media according to claim 13, the data allocation management method further comprising:

generating display information for displaying a difference in performance between each of the computers and each of the sub-computers corresponding to each of the computers and an assigned width of the management range of each of the computers.