COMPUTER SYSTEM

• US 20170039263A1
• Filed: 06/18/2014
• Published: 02/09/2017
• Est. Priority Date: 06/18/2014
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: HANAOKA, Miyuki, KAWAMOTO, Shinichi, KATSUNUMA, Satoshi
• Granted Patent: US 10,664,496 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/2462 Approximate or statistical queries
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/282 Hierarchical databases, e.g. IMS, LDAP data stores or Lotus Notes
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18

Abstract

A computer system, comprising a plurality of computers; and a management computer, wherein a plurality of data stores which store data obtained from a data source and having differing attributes, wherein the management computer has a request allocation unit and holds metadata management information. The request allocation unit is configured to: refer to the metadata management information to select a candidate data store based on analysis results of the data obtaining request including the time attribute of the requested data; determine whether the requested data can be obtained from the candidate data store; determine a data store to which to issue a request for obtaining the requested data; and issue the request to the determined data store.

Claims

1. A computer system, comprising:

a plurality of computers; and

a management computer,

each of the plurality of computers having a first processor, a first memory coupled to the first processor, and a first network interface coupled to the first processor,

the management computer having a second processor, a second memory coupled to the second processor, and a second network interface coupled to the second processor,

wherein a plurality of data stores are formed by using the plurality of computers in the computer system,

wherein each of the plurality of data stores stores data obtained from a data source and having differing attributes,

wherein the management computer has a request allocation unit configured to receive a data obtaining request for obtaining requested data from the plurality of data stores and determine at least one data store from which to obtain the requested data by analyzing the data obtaining request,

wherein the management computer holds metadata management information including a time attribute of data stored in each of the plurality of data stores, and

wherein the request allocation unit is configured to;

refer to the metadata management information to select at least one candidate data store based on analysis results of the data obtaining request in a case of receiving the data obtaining request including the time attribute of the requested data;

determine whether the requested data can be obtained from the at least one candidate data store;

determine at least one data store to which to issue a request for obtaining the requested data based on the determination results; and

issue the request to the at least one determined data store.

2. The computer system according to claim 1,

wherein the plurality of data stores include:

a first data store that stores real time statistical data calculated by aggregating real time data of a prescribed number of minutes constituting an aggregation unit time, the real time data is obtained from the data source; and

a second data store that stores history statistical data that is a history of the real time statistical data,

wherein the first data store stores the real time statistical data in a time range from the current time to a time when the retention time is reached,

wherein the metadata management information includes first metadata information that manages the retention time pertaining to the real time statistical data stored in the first data store,

wherein the time attribute of the requested data included in the data obtaining request includes a designated time indicating the time range of the obtained data, and

wherein the request allocation unit is configured to;

determine whether there is a possibility that the requested data can be obtained from the first data store based on the retention time included in the first metadata information and the designated time included in the data obtaining request;

select the first data store as a candidate data store in a case where it is determined that the requested data can be obtained from the first data store; and

select the second data store as the candidate data store in a case where it is determined that the requested data cannot be obtained from the first data store.

3. The computer system according to claim 2,

wherein the designated time included in the data obtaining request includes a start time and an end time, and

wherein the request allocation unit is configured to:

obtain the current time;

calculate a first time by subtracting the retention time included in the first metadata information from the current time;

determines whether the first time is prior to the end time;

select the second data store as the candidate data store in a case where it is determined that the first time is after the end time;

determine whether the first time is after the start time in a case where it is determined that the first time is prior to the end time;

select the first data store as the candidate data store in a case where it is determined that the first time is prior to the start time; and

select the second data store as the candidate data store to obtain the requested data from the start time to the first time and select the first data store as the candidate data store to obtain the requested data from the first time to the end time, in a case where it is determined that the first time is after the start time.

4. The computer system according to claim 3,

wherein the plurality of data stores include a third data store that stores a history of the real time data obtained from the data source,

wherein the first metadata information includes, as first aggregation information, a type and the aggregation unit time of data aggregated when calculating the real time statistical data,

wherein the metadata management information includes second metadata information that includes, as second aggregation information, the type and the aggregation unit time of data aggregated when calculating the real time statistical data corresponding to the history statistical data,

wherein the data obtaining request includes, as third aggregation information, the type and the aggregation unit time of data for identifying the requested data, and

wherein the request allocation unit is configured to:

determine, in a case where the first data store has been selected as the candidate data store, whether a first determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the first aggregation information, and the aggregation unit time of the third aggregation information matches the aggregation unit time of the first aggregation information;

determine the first data store to be the data store to which to issue the request in a case where it is determined that the first determination condition is satisfied;

determine the third data store to be the data store to which to issue the request in a case where it is determined that the first determination condition is not satisfied;

determine, in a case where the second data store has been selected as the candidate data store, whether a second determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the second aggregation information, and the aggregation unit time of the third aggregation information matches the aggregation unit time of the second aggregation information;

determine the second data store to be the data store to which to issue the request in a case where it is determined that the second determination condition is satisfied, and

determine the third data store to be the data store to which to issue the request in a case where it is determined that the second determination condition is not satisfied.

5. The computer system according to claim 4,

wherein the management computer has an output processing unit configured to generate response information, as a response to the data obtaining request, by using data obtained from the plurality of data stores,

wherein the request allocation unit is configured to:

determine, in a case where the first data store has been selected as the candidate data store, whether a third determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the first aggregation information and the aggregation unit time of the third aggregation information is a divisor of the aggregation unit time of the first aggregation information;

determine the first data store to be the data store to which to issue the request in a case where it is determined that the third determination condition is satisfied;

determine the third data store to be the data store to which to issue the request in a case where it is determined that the third determination condition is not satisfied;

determine, in a case where the second data store has been selected as the candidate data store, whether a fourth determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the second aggregation information, and the aggregation unit time of the third aggregation information is a divisor of the aggregation unit time of the second aggregation information;

determine the second data store to be the data store to which to issue the request in a case where it is determined that the fourth determination condition is satisfied; and

determine the third data store to be the data store to which to issue the request in a case where it is determined that the fourth determination condition is not satisfied; and

wherein the output processing unit is configured to;

refer to the first metadata information in a case where data has been obtained from the first data store;

determine whether the aggregation unit time of the data obtained from the first data store is less than the aggregation unit time of the third aggregation information;

generate the requested data by aggregating the data obtained from the first data store in a case where it is determined that the aggregation unit time of the data obtained from the first data store is less than the aggregation unit time of the third aggregation information;

refer to the second metadata information in a case where data has been obtained from the second data store;

determine whether the aggregation unit time of the data obtained from the second data store is less than the aggregation unit time of the third aggregation information;

generate the requested data by aggregating the data obtained from the second data store in a case where it is determined that the aggregation unit time of the data obtained from the second data store is less than the aggregation unit time of the third aggregation information; and

generates response information as a response to the data obtaining request using the requested data.

6. A data access management method in a computer system, including a plurality of computers that store data, and a management computer,

wherein each of the plurality of computers has a first processor, a first memory coupled to the first processor, and a first network interface coupled to the first processor,

wherein the management computer has a second processor, a second memory coupled to the second processor, and a second network interface coupled to the second processor,

wherein a plurality of data stores are formed by using the plurality of computers in the computer system,

wherein each of the plurality of data stores stores data obtained from a data source and having differing attributes,

wherein the management computer has a request allocation unit configured to receive a data obtaining request for obtaining requested data from the plurality of data stores and determine at least one data store from which to obtain the requested data by analyzing the data obtaining request,

wherein the management computer holds metadata management information including a time attribute of data stored in each of the plurality of data stores, and

wherein the data access management method includes:

a first step of referring, by the request allocation unit, to the metadata management information to select at least one candidate data store based on analysis results of the data obtaining request in a case of receiving the data obtaining request including the time attribute of the requested data;

a second step of determining, by the request allocation unit, whether the requested data can be obtained from the at least one candidate data store, and determining at least one data store to which to issue a request to obtain the requested data based on the determination results; and

a third step of issuing the request to the at least one determined data store.

7. The data access management method according to claim 6,

wherein the plurality of data stores include:

a first data store that stores real time statistical data calculated by aggregating real time data of a prescribed number of minutes constituting an aggregation unit time, the real time data is obtained from the data source; and

a second data store that stores history statistical data that is a history of the real time statistical data,

wherein the first data store stores the real time statistical data in a time range from the current time to a time when the retention time is reached,

wherein the metadata management information includes first metadata information that manages the retention time pertaining to the real time statistical data stored in the first data store,

wherein the time attribute of the requested data included in the data obtaining request includes a designated time indicating the time range of the obtained data, and

wherein the first step includes;

a step of determining, by the request allocation unit, whether there is a possibility that the requested data can be obtained from the first data store based on the retention time included in the first metadata information and the designated time included in the data obtaining request;

a step of selecting, by the request allocation unit, the first data store as the candidate data store in a case where it is determined that the requested data can be obtained from the first data store; and

a step of selecting, by the request allocation unit, the second data store as the candidate data store in a case where it is determined that the requested data cannot be obtained from the first data store.

8. The data access management method according to claim 7,

wherein the designated time included in the data obtaining request includes a start time and an end time, and

wherein the first step includes:

a step of obtaining, by the request allocation unit, the current time;

a step of calculating, by the request allocation unit, a first time by subtracting the retention time included in the first metadata information from the current time;

a step of determining, by the request allocation unit, whether the first time is prior to the end time;

a step of selecting, by the request allocation unit, the second data store as the candidate data store in a case where it is determined that the first time is after the end time;

a step of determining, by the request allocation unit, whether the first time is after the start time in a case where it is determined that the first time is prior to the end time;

a step of selecting, by the request allocation unit, the first data store as the candidate data store in a case where it is determined that the first time is prior to the start time;

a step of selecting, by the request allocation unit, the second data store as the candidate data store to obtain the requested data from the start time to the first time and selecting the first data store as the candidate data store to obtain the requested data from the first time to the end time, in a case where it is determined that the first time is after the start time.

9. The data access management method according to claim 8,

wherein the plurality of data stores include a third data store that stores a history of the real time data obtained from the data source,

wherein the first metadata information includes, as first aggregation information, a type and the aggregation unit time of data aggregated when calculating the real time statistical data,

wherein the metadata management information includes second metadata information that includes, as second aggregation information, the type and the aggregation unit time of data aggregated when calculating the real time statistical data corresponding to the history statistical data,

wherein the data obtaining request includes, as third aggregation information, the type and the aggregation unit time of data for identifying the requested data, and

wherein the second step includes:

a step of determining, by the request allocation unit, in a case where the first data store has been selected as the candidate data store, whether a first determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the first aggregation information, and the aggregation unit time of the third aggregation information matches the aggregation unit time of the first aggregation information;

a step of determining, by the request allocation unit, the first data store to be the data store to which to issue the request in a case where it is determined that the first determination condition is satisfied;

a step of determining, by the request allocation unit, the third data store to be the data store to which to issue the request in a case where it is determined that the first determination condition is not satisfied;

a step of determining, by the request allocation unit, in a case where the second data store has been selected as the candidate data store, whether a second determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the second aggregation information, and the aggregation unit time of the third aggregation information matches the aggregation unit time of the second aggregation information;

a step of determining, by the request allocation unit, the second data store to be the data store to which to issue the request in a case where it is determined that the second determination condition is satisfied; and

a step of determining, by the request allocation unit, the third data store to be the data store to which to issue the request in a case where it is determined that the second determination condition is not satisfied.

10. The data access management method according to claim 9,

wherein the management computer has an output processing unit configured to generate response information, as a response to the data obtaining request, by using data obtained from the plurality of data stores,

wherein the second step includes:

a step of determining, by the request allocation unit, in a case where the first data store has been selected as the candidate data store, whether a third determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the first aggregation information, and the aggregation unit time of the third aggregation information is a divisor of the aggregation unit time of the first aggregation information;

a step of determining, by the request allocation unit, the first data store to be the data store to which to issue the request in a case where it is determined that the third determination condition is satisfied;

a step of determining, by the request allocation unit, the third data store to be the data store to which to issue the request in a case where it is determined that the third determination condition is not satisfied;

a step of determining, by the request allocation unit, in a case where the second data store has been selected as the candidate data store, whether a fourth determination condition is satisfied in which the type of the data of the third aggregation information matches the type of the data of the second aggregation information, and the aggregation unit time of the third aggregation information is a divisor of the aggregation unit time of the second aggregation information;

a step of determining, by the request allocation unit, the second data store to be the data store to which to issue the request in a case where it is determined that the fourth determination condition is satisfied; and

a step of determining, by the request allocation unit, the third data store to be the data store to which to issue the request in a case where it is determined that the fourth determination condition is not satisfied, and

wherein the data access management method includes;

a step of referring, by the output processing unit, to the first metadata information in a case where data has been obtained from the first data store;

a step of determining, by the output processing unit, whether the aggregation unit time of the data obtained from the first data store is less than the aggregation unit time of the third aggregation information;

a step of generating, by the output processing unit, the requested data by aggregating the data obtained from the first data store in a case where it is determined that the aggregation unit time of the data obtained from the first data store is less than the aggregation unit time of the third aggregation information;

a step of referring, by the output processing unit, to the second metadata information in a case where data has been obtained from the second data store;

a step of determining, by the output processing unit, whether the aggregation unit time of the data obtained from the second data store is less than the aggregation unit time of the third aggregation information;

a step of generating, by the output processing unit, the requested data by aggregating the data obtained from the second data store in a case where it is determined that the aggregation unit time of the data obtained from the second data store is less than the aggregations unit time of the third aggregation information; and

a step of generating, by the output processing unit, response information as a response to the data obtaining request using the requested data.