Method and apparatus for automated migration of data among storage centers

• US 9,311,020 B2
• Filed: 08/19/2013
• Issued: 04/12/2016
• Est. Priority Date: 12/17/2012
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Reohr, William R., Pfitzmann, Birgit M., Kingsbury, Kevin M., Richardson, Laura A., Urbanetz, Peter, Yoes, William B.
• Primary Examiner(s): Parikh, Kalpit
• Application Number:
  US13/970,357
• Publication Number:
  US 20140173232A1
• Time in Patent Office: 967 Days
• Field of Search: 711/162
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

A method for controlling the storage of data among multiple regional storage centers coupled through a network in a global storage system is provided. The method includes steps of: defining at least one dataset comprising at least a subset of the data stored in the global storage system; defining at least one ruleset for determining where to store the dataset; obtaining information regarding a demand for the dataset through one or more data requesting entities operating in the global storage system; and determining, as a function of the ruleset, information regarding a location for storing the dataset among regional storage centers having available resources that reduces the total distance traversed by the dataset in serving at least a given one of the data requesting entities and/or reduces the latency of delivery of the dataset to the given one of the data requesting entities.

Claims

1. An apparatus for controlling a storage of data among a plurality of regional storage centers operatively coupled through a network in a global storage system, the apparatus comprising:

memory; and

at least one processor connected with the memory, the at least one processor being configured;

(i) to define at least one dataset comprising at least a subset of the data stored in the global storage system;

(ii) to define at least one ruleset for determining where to store the at least one dataset;

(iii) to track at least one attribute relating to at least one data requesting entity operating in the global storage system, the at least one data requesting entity requesting the at least one dataset; and

(iv) to determine, as a function of said at least one ruleset and said at least one attribute relating to the at least one data requesting entity, information regarding a location for storing the at least one dataset among the plurality of regional storage centers having available resources that reduces at least one of total distance traversed by the at least one dataset in serving the at least one data requesting entity and latency of delivery of the at least one dataset to the at least one data requesting entity;

wherein the at least one processor is further configured to determine whether a migration of the at least one dataset is worthwhile, and, when it is determined that migration is not worthwhile, continue to obtain information regarding the demand for the at least one dataset;

wherein determining whether a migration of the at least one dataset is worthwhile comprises determining a new location, L^, for the dataset, among the plurality of regional storage centers having available resources, which satisfies an expression a₁·

d(l₁, L^)+ . . . +a_n·

d(l_n, L^)+b·

d(L′

, L^)≦

a₁·

d(l₁, L)+ . . . +a_n·

d(l_n, L)+b·

d(L′

, L) for every other possible location L of the plurality of regional storage centers, where d(l_j, l_k) is a network distance function indicative of a distance between any two locations l_j and l_k, a₁, . . . , a_n represent amounts of data of respective data transfers, l₁, . . . , l_n represent locations from where usage of the at least one dataset occurs, b represents a size of the at least one dataset, and L′

represents a location of a given one of the plurality of regional storage centers in which the at least one dataset resides prior to migration of the dataset.

2. The apparatus of claim 1,

wherein in determining whether a migration of the at least one dataset is worthwhile, the at least one processor is further configured to determine whether a physical location of the at least one of the one or more data requesting entities is permanent.

3. The apparatus of claim 1, wherein the at least one processor is further configured to migrate the at least one dataset to the location determined to reduce the total distance traversed by the dataset, among the plurality of regional storage centers having available resources, in serving the at least one of the one or more data requesting entities when it is determined that migration is worthwhile.

4. The apparatus of claim 1, further comprising at least one address redirection module, the address redirection module configured to at least one of transform and route a request for the at least one dataset to a corresponding one of the plurality of regional storage centers in which at least one of the at least one dataset and a copy of the at least one dataset is stored.

5. The apparatus of claim 1, wherein said at least one attribute relating to at least one data requesting entity comprises geographical location of the at least one data requesting entity.

6. A non-transitory machine-accessible storage medium for controlling a storing of data among a plurality of regional storage centers operatively coupled through a network in a global storage system, the storage medium comprising:

computer readable program code configured to define at least one dataset comprising at least a subset of the data stored in the global storage system;

computer readable program code configured to define at least one ruleset for determining where to store the at least one dataset;

computer readable program code configured to obtain information regarding a demand for the at least one dataset through one or more data requesting entities operating in the global storage system; and

computer readable program code configured to determine, as a function of the at least one ruleset, information regarding a location for storing the at least one dataset among a plurality of regional storage centers having available resources that reduces at least one of (i) total distance traversed by the at least one dataset in serving at least one of the one or more data requesting entities and (ii) latency of delivery of the at least one dataset to the at least one of the one or more data requesting entities;

wherein the storage medium further comprises computer readable program code configured to determine whether a migration of the at least one dataset is worthwhile, and, when it is determined that migration is not worthwhile, to continue to obtain information regarding the demand for the at least one dataset;

wherein determining whether a migration of the at least one dataset is worthwhile comprises determining a new location, L^, for the dataset, among the plurality of regional storage centers having available resources, which satisfies an expression a₁·

d(l₁, L^)+ . . . +a_n·

d(l_n, L^)+b·

d(L′

, L^)≦

a₁·

d(l₁, L)+ . . . +a_n·

d(l_n, L)+b·

d(L′

, L) for every other possible location L of the plurality of regional storage centers, where d(l_j, l_k) is a network distance function indicative of a distance between any two locations l_j and l_k, a₁, . . . , a_n represent amounts of data of respective data transfers, l₁, . . . l_n represent locations from where usage of the at least one dataset occurs, b represents a size of the at least one dataset, and L′

represents a location of a given one of the plurality of regional storage centers in which the at least one dataset resides prior to migration of the dataset.

7. The storage medium of claim 6, wherein in determining whether a migration of the at least one dataset is worthwhile, the storage medium further comprises computer readable program code configured to determine whether a physical location of the at least one of the one or more data requesting entities is permanent.

8. The storage medium of claim 6, wherein the storage medium further comprises computer readable program code configured to migrate the at least one dataset to the location determined to reduce the total distance traversed by the dataset, among the plurality of regional storage centers having available resources, in serving the at least one of the one or more data requesting entities when it is determined that migration is worthwhile.

9. The storage medium of claim 6, wherein the storage medium further comprises computer readable program code configured to at least one of transform and route a request for the at least one dataset to a corresponding one of the plurality of regional storage centers in which at least one of the at least one dataset and a copy of the at least one dataset is stored.

10. The storage medium of claim 6, wherein said at least one attribute relating to at least one data requesting entity comprises geographical location of the at least one data requesting entity.