Adaptive performance control of multi-stream data transfer from a source system to a target system

• US 9,699,233 B1
• Filed: 10/27/2016
• Issued: 07/04/2017
• Est. Priority Date: 06/30/2015
• Status: Active Grant

• Current Assignee: EMC Corporation (Dell Technologies Inc.), Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Armorer, Peter, Muchalambe, Uday Devidas, Fernandes, Roland Anthony, Chai, Mu, Kulkarni, Gururaj
• Primary Examiner(s): Orgad, Edan
• Assistant Examiner(s): Song, Rebecca
• Application Number:
  US15/336,700
• Time in Patent Office: 250 Days
• Field of Search: None
• CPC Class Codes: H04L 43/0888 Throughput
• CPC Class Codes: H04L 47/12 Avoiding congestion; Recovering from congestion
• CPC Class Codes: H04L 47/41 by acting on aggregated flows or links
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/75 Media network packet handling

Abstract

According to one embodiment, in response to a request to transfer a data set from a source system to a target system over a network, an adaptive performance control (APC) controller allocates a plurality of data streams for transferring the data set. The APC controller activates one or more data streams from the allocated data streams to transfer the data set from the source system to the target system. The APC controller monitors an overall throughput of the activated data streams assigned to transfer the data set from the source system to the target system. The APC controller dynamically adjusts a number of the activated data streams based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

Claims

1. A computer-implemented method for managing data streams for data transfer operations, the method comprising:

in response to a request to transfer a data set from a source system to a target system over a network, activating, by an adaptive performance control (APC) controller, a primary data stream and a first secondary data stream from a set of allocated data streams to transfer the data set from the source system to the target system;

monitoring an overall throughput of the activated data streams for a first predetermined period of time;

deactivating the first secondary data stream from the activated data streams if the overall throughput drops below a first predetermined threshold over the first predetermined period of time;

suspending an operation of the APC controller for a second predetermined period of time in response to determining that the overall throughput drop is not greater than the first predetermined threshold and there is at least one allocated data stream that has been previously deactivated; and

reactivating the first secondary data stream that has been previously deactivated, after the second predetermined period of time.

2. The method of claim 1, wherein the primary data stream remains activated during the transfer of the data set, and a secondary data stream can be activated, deactivated, or reactivated during the transfer of the data set.

3. The method of claim 1, wherein a number of the activated data streams is adjusted based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

4. The method of claim 1, further comprising:

determining whether all allocated data streams have been activated if the overall throughput does not drop below the first predetermined threshold;

iteratively performing monitoring the overall throughput for the first predetermined period of time and deactivating a secondary data stream, in response to determining that all allocated data streams have been activated.

5. The method of claim 1, further comprising deactivating a third secondary data stream from the activated data streams, in response to determining that the overall throughput has gained less than a second predetermined threshold after activating of the first secondary data stream.

6. The method of claim 1, further comprising iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time, if the overall throughput has gained more than or equal to the second predetermined threshold.

7. The method of claim 5, further comprising determining whether all allocated data streams have been activated, wherein iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time is performed only if there is at least one allocated data stream that has not been activated.

8. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of managing data streams for data transfer operations, the operations comprising:

in response to a request to transfer a data set from a source system to a target system over a network, activating, by an adaptive performance control (APC) controller, a primary data stream and a first secondary data stream from a set of allocated data streams to transfer the data set from the source system to the target system;

monitoring an overall throughput of the activated data streams for a first predetermined period of time;

deactivating the first secondary data stream from the activated data streams if the overall throughput drops below a first predetermined threshold over the first predetermined period of time;

suspending an operation of the APC controller for a second predetermined period of time in response to determining that the overall throughput drop is not greater than the first predetermined threshold and there is at least one allocated data stream that has been previously deactivated; and

reactivating the first secondary data stream that has been previously deactivated, after the second predetermined period of time.

9. The machine-readable medium of claim 8, wherein the primary data stream remains activated during the transfer of the data set, and a secondary data stream can be activated, deactivated, or reactivated during the transfer of the data set.

10. The machine-readable medium of claim 8, wherein a number of the activated data streams is adjusted based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

11. The machine-readable medium of claim 8, wherein the operations further comprise:

determining whether all allocated data streams have been activated if the overall throughput does not drop below the first predetermined threshold;

iteratively performing monitoring the overall throughput for the first predetermined period of time and deactivating a secondary data stream, in response to determining that all allocated data streams have been activated.

12. The machine-readable medium of claim 8, wherein the operations further comprise deactivating a third secondary data stream from the activated data streams, in response to determining that the overall throughput has gained less than a second predetermined threshold after activating of the first secondary data stream.

13. The machine-readable medium of claim 8, wherein the operations further comprise iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time, if the overall throughput has gained more than or equal to the second predetermined threshold.

14. The machine-readable medium of claim 12, wherein the operations further comprise determining whether all allocated data streams have been activated, wherein iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time is performed only if there is at least one allocated data stream that has not been activated.

15. A data processing system operating as a source system, comprising:

a processor; and

a memory storing instructions, which when executed by the processor, cause the processor to perform operations, the operations including

in response to a request to transfer a data set from a source system to a target system over a network, activating, by an adaptive performance control (APC) controller, a primary data stream and a first secondary data stream from a set of allocated data streams to transfer the data set from the source system to the target system,

monitoring an overall throughput of the activated data streams for a first predetermined period of time,

deactivating the first secondary data stream from the activated data streams if the overall throughput drops below a first predetermined threshold over the first predetermined period of time,

suspending an operation of the APC controller for a second predetermined period of time in response to determining that the overall throughput drop is not greater than the first predetermined threshold and there is at least one allocated data stream that has been previously deactivated, and

reactivating the first secondary data stream that has been previously deactivated, after the second predetermined period of time.

16. The system of claim 15, wherein the primary data stream remains activated during the transfer of the data set, and a secondary data stream can be activated, deactivated, or reactivated during the transfer of the data set.

17. The system of claim 15, wherein a number of the activated data streams is adjusted based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

18. The system of claim 15, wherein the operations further comprise:

determining whether all allocated data streams have been activated if the overall throughput does not drop below the first predetermined threshold;

iteratively performing monitoring the overall throughput for the first predetermined period of time and deactivating a secondary data stream, in response to determining that all allocated data streams have been activated.

19. The system of claim 15, wherein the operations further comprise deactivating a third secondary data stream from the activated data streams, in response to determining that the overall throughput has gained less than a second predetermined threshold after activating of the first secondary data stream.

20. The system of claim 15, wherein the operations further comprise iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time, if the overall throughput has gained more than or equal to the second predetermined threshold.

21. The system of claim 19, wherein the operations further comprise determining whether all allocated data streams have been activated, wherein iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time is performed only if there is at least one allocated data stream that has not been activated.