Method and apparatus for automated migration of data among storage centers

• US 9,317,223 B2
• Filed: 12/17/2012
• Issued: 04/19/2016
• Est. Priority Date: 12/17/2012
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Reohr, William R., Pfitzmann, Birgit M., Kingsbury, Kevin M., Richardson, Laura A., Urbanetz, Peter, Yoes, William B.
• Primary Examiner(s): Parikh, Kalpit
• Application Number:
  US13/717,216
• Publication Number:
  US 20140173229A1
• Time in Patent Office: 1,219 Days
• Field of Search: 711/162
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

A method for controlling the storage of data among multiple regional storage centers coupled through a network in a global storage system is provided. The method includes steps of: defining at least one dataset comprising at least a subset of the data stored in the global storage system; defining at least one ruleset for determining where to store the dataset; obtaining information regarding a demand for the dataset through one or more data requesting entities operating in the global storage system; and determining, as a function of the ruleset, information regarding a location for storing the dataset among regional storage centers having available resources that reduces the total distance traversed by the dataset in serving at least a given one of the data requesting entities and/or reduces the latency of delivery of the dataset to the given one of the data requesting entities.

Claims

1. A method for controlling a storage of data among a plurality of regional storage centers operatively coupled through a network in a global storage system, the method comprising steps of:

defining at least one dataset comprising at least a subset of the data stored in the global storage system;

defining at least one ruleset for determining where to store the at least one dataset;

obtaining information regarding a demand for the at least one dataset through one or more data requesting entities operating in the global storage system; and

determining, as a function of the at least one ruleset, information regarding a location for storing the at least one dataset among a plurality of regional storage centers having available resources that reduces at least one of (i) total distance traversed by the at least one dataset in serving at least one of the one or more data requesting entities, and (ii) latency of delivery of the at least one dataset to the at least one of the one or more data requesting entities;

wherein the step of determining information regarding a location for storing the at least one dataset comprises determining whether a migration of the at least one dataset is worthwhile, and, when it is determined that migration is not worthwhile, continuing the step of obtaining information regarding a demand for the at least one dataset; and

wherein the step of determining whether a migration of the at least one dataset is worthwhile comprises determining a new location, L^, for the dataset, among the plurality of regional storage centers having available resources, which satisfies an expression a₁·

d(l₁, L^)+ . . . +a_n·

d(l_n, L^)+b·

d(L′

, L^)≦

a₁·

d(l₁, L)+ . . . +a_n·

d(l_n, L)+b·

d(L′

, L) for every other possible location L of the plurality of regional storage centers, where d(l_j, l_k) is a network distance function indicative of a distance between any two locations l_j and l_k, a₁, . . . , a_n represent amounts of data of respective data transfers, l₁, . . . , l_n represent locations from where usage of the at least one dataset occurs, b represents a size of the at least one dataset, and L′

represents a location of a given one of the plurality of regional storage centers in which the at least one dataset resides prior to migration of the dataset.

2. The method of claim 1,

wherein the step of determining whether a migration is worthwhile comprises determining whether a physical location of the at least one of the one or more data requesting entities is permanent.

3. The method of claim 1, wherein, when it is determined that migration is worthwhile, the method further comprises migrating the at least one dataset to the location determined to reduce the total distance traversed by the dataset, among the plurality of regional storage centers having available resources, in serving the at least one of the one or more data requesting entities.

4. The method of claim 3, wherein the step of migrating comprises determining at least one of a schedule and a process of delivery of the at least one dataset.

5. The method of claim 1, wherein, when it is determined that migration is worthwhile, the method further comprises migrating the at least one dataset to the location determined to reduce the latency of delivery of the at least one dataset to the at least one of the one or more data requesting entities.

6. The method of claim 1, wherein the step of determining whether a migration of the at least one dataset is worthwhile is performed as a function of at least one of:

(i) the information regarding a demand for the at least one dataset;

(ii) the information regarding the location for storing the at least one dataset among the plurality of regional storage centers having available resources; and

(iii) information regarding a size of the at least one dataset, whereby the determining whether a migration of the at least one dataset is worthwhile reduces the total distance traversed by the at least one dataset, among the plurality of regional storage centers having available resources, in serving the at least one of the one or more data requesting entities.

7. The method of claim 1, wherein the step of determining whether the physical location of the at least one of the one or more data requesting entities is permanent is performed as a function of one or more heuristics comprising at least one of a duration of location change, age, travel habit classification, wealth and personal attributes associated with the at least one of the one or more data requesting entities, and attributes of a current location of the at least one of the one or more data requesting entities.

8. The method of claim 1, wherein the step of determining whether a migration of the at least one dataset is worthwhile comprises evaluating a storage capacity of at least a subset of the plurality of regional storage centers.

9. The method of claim 1, further comprising migrating the at least one dataset to the location determined to reduce the total distance traversed by the dataset, among the plurality of regional storage centers having available resources, in serving the at least one of the one or more data requesting entities.

10. The method of claim 1, wherein the total distance traversed by the at least one dataset is a function of at least one of distance along a shortest physical network connection between two locations, an inverse of maximum bandwidth of the network between the two locations, an inverse of average bandwidth given observed data traffic, turnaround time of data packets transferred between the two locations, network cost between the two locations, latency, and power consumption by the network between the two locations.

11. The method of claim 1, wherein the at least one ruleset comprises one or more optimization parameters for determining where to store the at least one dataset.

12. The method of claim 1, wherein at least a subset of the one or more data requesting entities comprises at least one of a mobile entity and a mobile user.

13. The method of claim 1, wherein the information regarding a location for storing the at least one dataset is obtained as a function of at least one of an Internet Protocol address of the at least one of the one or more data requesting entities, information obtained from a location monitoring device associated with the at least one of the one or more data requesting entities, and information obtained from a location revealing device associated with the at least one of the one or more data requesting entities.

14. The method of claim 1, further comprising establishing an association between the at least one dataset and the at least one of the one or more data requesting entities.

15. The method of claim 1, wherein the step of obtaining information regarding the demand for the at least one dataset comprises weighting an importance of a first of the one or more data requesting entities with respect to at least a second of the one or more data requesting entities.

16. The method of claim 1, further comprising:

creating at least one copy of the at least one dataset, the copy of the at least one dataset being stored in a different storage center than the at least one dataset; and

determining, as a function of a location of the at least one of the one or more data requesting entities relative to a location of the at least one dataset and the copy of the at least one dataset, whether to one of utilize the at least one dataset, utilize the copy of the at least one dataset, and move at least one of the at least one dataset and the copy of the at least one dataset.

17. The method of claim 1, further comprising assigning a quality-of-service tag with the at least one dataset.

18. The method of claim 17, further comprising restraining a location to where the at least one dataset is migrated as a function of the quality of service tag assigned to the at least one dataset.

19. The method of claim 1, wherein the at least one attribute relating to at least one data requesting entity comprises geographical location of said at least one data requesting entity.