Server load management for data migration

• US 10,447,774 B2
• Filed: 05/04/2018
• Issued: 10/15/2019
• Est. Priority Date: 04/14/2015
• Status: Active Grant

• Current Assignee: Skykick
• Original Assignee: SkyKick, Inc.
• Inventors: Dennis, John, Richman, Evan, Schwartz, Todd, Younge, Bradley, Panse, Manoj
• Primary Examiner(s): Eskandarnia, Arvin
• Application Number:
  US15/971,864
• Publication Number:
  US 20180255128A1
• Time in Patent Office: 529 Days
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 41/5025 by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
• CPC Class Codes: H04L 43/0888 Throughput
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/148 Migration or transfer of sessions
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols

Abstract

A system and method for controlling a migration of data items in a data directory from a source system to a destination system by setting one or more target properties for implementing the migration are disclosed. A migration controller can be employed to obtain statistical information regarding the migration. The statistical information can then be used to compute the one or more target properties. For example, a target number of network connections for achieving an optimal total throughput and concurrency can be computed based on an average throughput per network connection. The target number of network connections may be determined by a migration monitor, which may set the determined target number of network connections as a policy to be enforced by the migration controller.

Claims

1. A method for optimizing performance of a source server configured to facilitate migration of data items in a data directory through network connections provided by the source server to a destination server, the method comprising:

determining a set of average throughputs per network connection provided by the source server for migrating the data items in the data directory to the destination server, each of the average throughputs in the set corresponding to a number of network connections provided by the source server;

identifying a target number of network connections corresponding to a specific change in average throughput per connection based on a change in the number of network connections provided by the source server;

setting the target number of network connections for managing network connections provided by the source server; and

implementing, by a migration controller, migration of the data items in the data directory from the source server to the destination system using the target number of network connections.

2. The method of claim 1, wherein the target number of network connections is identified such that a decrease in average throughput per connection is greatest from the target number to target number plus one.

3. The method of claim 1, wherein the amount of the data requested to be processed for each network connection is the same.

4. The method of claim 1, wherein identifying the target number of network connections comprises:

plotting a series of points in a Cartesian coordinate system, wherein the X coordinate of each of the series of the points corresponds to the number of network connections corresponding to each of the average throughputs in the set and the Y coordinate of each of the series of the points corresponds to the average throughputs per network connection in the set;

connecting the series of points to form a curve; and

identifying the target number of network connections using the curve.

5. The method of claim 1, wherein identifying the target number of network connections comprises:

determining a function of average throughput per network connection with respect to a quantity of network connections provided by the source server; and

fitting the set of average throughputs against the number of network connections corresponding to each of the average throughputs in the set to obtain variables of the function.

6. A system for optimizing performance of a source server configured to facilitate migration of data items in a data directory through network connections provided by the source server to a destination server, the system comprising one or more processors configured to perform:

determining a set of average throughputs per network connection provided by the source server for migrating the data items in the data directory to the destination server, each of the average throughputs in the set corresponding to a number of network connections provided by the source server;

identifying a target number of network connections corresponding to a specific change in average throughput per connection based on a change in the number of network connections provided by the source server;

setting the target number of network connections for managing network connections provided by the source server; and

implementing, by a migration controller, migration of the data items in the data directory from the source server to the destination system using the target number of network connections.

7. The system of claim 6, wherein the target number of network connections is identified such that a decrease in average throughput per connection is greatest from the target number to target number plus one.

8. The system of claim 6, wherein the amount of the data requested to be processed for each network connection is the same.

9. The system of claim 6, wherein identifying the target number of network connections comprises:

plotting a series of points in a Cartesian coordinate system, wherein the X coordinate of each of the series of the points corresponds to the number of network connections corresponding to each of the average throughputs in the set and the Y coordinate of each of the series of the points corresponds to the average throughputs per network connection in the set;

connecting the series of points to form a curve; and

identifying the target number of network connections using the curve.

10. The method of claim 6, wherein identifying the target number of network connections comprises:

determining a function of average throughput per network connection with respect to a quantity of network connections provided by the source server; and

fitting the set of average throughputs against the number of network connections corresponding to each of the average throughputs in the set to obtain variables of the function.