Autonomic learning method to load balance output transfers of two peer nodes

• US 7,370,089 B2
• Filed: 07/11/2003
• Issued: 05/06/2008
• Est. Priority Date: 07/11/2003
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Day, Kenneth Fairclough III, Boyd, Kenneth Wayne, Wolfgang, John Jay, Dudas, Philip Matthew
• Primary Examiner(s): NGUYEN, THU HA T
• Application Number:
  US10/617,932
• Publication Number:
  US 20050021575A1
• Time in Patent Office: 1,761 Days
• Field of Search: 709/217, 709/219, 709/229, 709/231, 709/232, 370/229, 370/395.2, 711/112, 711/113, 711/114, 711/162, 710/20
• US Class Current: 709/219
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2071 using a plurality of controllers
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 16/1837 Management specially adapted to peer-to-peer storage networks topology management mechanisms of peer-to-peer networks H04L67/1042

Abstract

Disclosed are a system, a method, and a computer program product to provide for the optimization of the output transfer load balance between the peer computers transferring data to one or more storage devices. The peer computers receive, organize and transfer the data to storage devices. The data set is composed of a plurality of data transfers. After an initial division of the data transfers between the two peers, each peer will have assigned responsibility for a number of data transfers. If the one of the peer computers completes offloading transactions earlier than the other peer, then the peer that is still transferring data will employ the other peer to execute a portion of the remaining data transfers. The operation of the system is symmetrical in that either peer may assist the other peer depending upon which peer has idle time. In addition the operation is autonomous and self-adjusting resulting in the peer nodes optimizing the size of the portion of data transfers that are reassigned during the operation of the invention resulting in the minimization of idle time for either peer. The self-adjusting feature allows the system to react to changing conditions that affect data transfer rates to the storage devices.

Claims

1. A method for a first peer and a second peer to share a plurality of data transfers to one or more storage devices, said first peer and said second peer each having access to said data transfers, where said method comprises the steps of:

1.1. said first peer transferring a first number of data transfers to said one or more storage devices;

1.2. said second peer transferring a second number of data transfers to said one or more storage devices;

1.3. in response to said first peer completing said transfer of said first number of data transfers to said one or more storage devices, said first peer assisting said second peer with said second number of data transfers;

1.4. in response to said second peer completing said transfer of said second number of data transfers to said one or more storage devices, said second peer assisting said first peer with said first number of data transfers; and

1.5. in response to said first peer and said second peer not completing all data transfers, returning to step 1.3;

wherein step 1.3 further comprises the steps of;

2.1. determining if said second peer needs assistance to transfer said second number of data transfers to said one or more storage devices;

2.2. in response to determining that said second peer needs assistance to transfer said second number of data transfers to said one or more storage devices;

2.2.1. assigning a portion of said second number of data transfers from said second peer to said first peer as said first number of data transfers;

2.2.2. adjusting a first peer ratio and a second peer ratio; and

2.2.3. said first peer transferring said portion of said second number of data transfers to said one or more storage devices.

2. The method of claim 1, wherein step 1.4 further comprises the steps of:

3.1. determining if said first peer needs assistance to transfer said first number of data transfers to said one or more storage devices;

3.2. in response to determining that said first peer needs assistance to transfer said first number of data transfers to said one or more storage devices;

3.2.1. adjusting a first peer ratio and a second peer ratio;

3.2.2. assigning a portion of said first number of data transfers from said first peer to said second peer as said second number of data transfers; and

3.2.3. said second peer transferring said portion of said first number of data transfers to said one or more storage devices.

3. The method of claim 2, wherein step 3.1 further comprises the steps of:

5.1. determining a first peer ratio and a second peer ratio;

5.2. determining a portion of first number of transfers that is equal to said first peer ratio multiplied by a remaining first number of transfers;

5.3. in response to said portion of first number of transfers being greater than a first peer minimum number of transfers, said first peer sending an “

assistance needed”

message to said second peer; and

5.4. in response to said portion of first number of transfers being less than or equal to said first peer minimum number of transfers, said first peer sending a “

no assistance needed”

message to said second peer.

4. The method of claim 3, wherein step 5.1 further comprises:

7.1. in response to determining that said second peer assisted said first peer with said first number of data transfers at the previous execution of step 1.4, increasing said first peer ratio by a first increment;

7.2. in response to determining that said first peer assisted said second peer with said second number of data transfers at the previous execution of step 1.3, decreasing said second peer ratio by a second increment.

5. The method of claim 1, wherein step 2.1 further comprises the steps of:

4.1. determining a first peer ratio and a second peer ratio;

4.2. determining a portion of second number of transfers that is equal to said second peer ratio multiplied by a remaining second number of transfers;

4.3. in response to said portion of second number of transfers being greater than a second peer minimum number of transfers, said second peer sending an “

assistance needed”

message to said first peer; and

4.4. in response to said portion of second number of transfers being less than or equal to said second peer minimum number of transfers, said second peer sending a “

no assistance needed”

message to said first peer.

6. The method of claim 5, wherein step 4.1 further comprises:

6.1. in response to determining that said first peer assisted said second peer with said second number of data transfers at the previous execution of step 1.3, increasing said second peer ratio by a second increment; and

6.2. in response to determining that said second peer assisted said first peer with said first number of data transfers at the previous execution of step 1.4, decreasing said first peer ratio by a first increment.

7. An article of manufacture comprising a data storage medium tangibly embodying a program of machine-readable instructions executable by a digital processing apparatus to perform method steps for a first peer and a second peer to share a plurality of data transfers to one or more storage devices, said first peer and said second peer each having access to said data transfers, said method steps comprising:

8.1. said first peer transferring a first number of data transfers to said one or more storage devices;

8.2. said second peer transferring a second number of data transfers to said one or more storage devices;

8.3. in response to said first peer completing said transfer of said first number of data transfers to said one or more storage devices, said first peer assisting said second peer with said second number of data transfers;

8.4. in response to said second peer completing said transfer of said second number of data transfers to said one or more storage devices, said second peer assisting said first peer with said first number of data transfers; and

8.5. in response to said first peer and said second peer not completing all data transfers, returning to step 8.3;

wherein step 8.3 further comprises the steps of;

9.1. determining if said second peer needs assistance to transfer said second number of data transfers to said one or more storage devices;

9.2. in response to determining that said second peer needs assistance to transfer said second number of data transfers to said one or more storage devices;

9.2.1. assigning a portion of said second number of data transfers from said second peer to said first peer as said first number of data transfers;

9.2.2. adjusting a first peer ratio and a second peer ratio; and

9.2.3. said first peer transferring said portion of said second number of data transfers to said one or more storage devices.

8. The article of manufacture of claim 7, wherein step 8.4 further comprises the steps of:

10.1. determining if said first peer needs assistance to transfer said first number of data transfers to said one or more storage devices;

10.2. in response to determining that said first peer needs assistance to transfer said first number of data transfers to said one or more storage devices;

10.2.1. adjusting a first peer ratio and a second peer ratio;

10.2.2. assigning a portion of said first number of data transfers from said first peer to said second peer as said second number of data transfers; and

10.2.3. said second peer transferring said portion of said first number of data transfers to said one or more storage devices.

9. The article of manufacture of claim 8, wherein step 10.1 further comprises the steps of:

12.1. determining a first peer ratio and a second peer ratio;

12.2. determining a portion of first number of transfers that is equal to said first peer ratio multiplied by a remaining first number of transfers;

12.3. in response to said portion of first number of transfers being greater than a first peer minimum number of transfers, said first peer sending an “

assistance needed”

message to said second peer; and

12.4. in response to said portion of first number of transfers being less than or equal to said first peer minimum number of transfers, said first peer sending a “

no assistance needed”

message to said second peer.

10. The article of manufacture of claim 9, wherein step 12.1 further comprises the steps of:

14.1. in response to determining that said second peer assisted said first peer with said first number of data transfers at the previous execution of step 8.4, increasing said first peer ratio by a first increment;

14.2. in response to determining that said first peer assisted said second peer with said second number of data transfers at the previous execution of step 8.3, decreasing said second peer ratio by a second increment.

11. The article of manufacture of claim 7, wherein step 9.1 further comprises the steps of:

11.1. determining a first peer ratio and a second peer ratio;

11.2. determining a portion of second number of transfers that is equal to said second peer ratio multiplied by a remaining second number of transfers;

11.3. in response to said portion of second number of transfers being greater than a second peer minimum number of transfers, said second peer sending an “

assistance needed”

message to said first peer; and

11.4. in response to said portion of second number of transfers being less than or equal to said second peer minimum number of transfers, said second peer sending a “

no assistance needed”

message to said first peer.

12. The article of manufacture of claim 11, wherein step 11.3 further comprises the steps of:

13.1. in response to determining that said first peer assisted said second peer with said second number of data transfers at the previous execution of step 8.3, increasing said second peer ratio by a second increment; and

13.2. in response to determining that said second peer assisted said first peer with said first number of data transfers at the previous execution of step 8.4, decreasing said first peer ratio by a first increment.

13. A data storage system comprising:

one or more storage devices;

a storage management device for providing access to said one or more storage devices;

a first peer for transferring data to said one or more storage devices;

a second peer for transferring data to said one or more storage devices, wherein said first peer and said second peer are programmed to perform method steps for said first peer and said second peer to share a plurality of data transfers to said one or more storage devices, said first peer and said second peer each having access to said data transfers, comprising the steps of;

15.1. said first peer transferring a first number of data transfers to said one or more storage devices;

15.2. said second peer transferring a second number of data transfers to said one or more storage devices;

15.3. in response to said first peer completing said transfer of said first number of data transfers to said one or more storage devices, said first peer assisting said second peer with said second number of data transfers;

15.4. in response to said second peer completing said transfer of said second number of data transfers to said one or more storage devices, said second peer assisting said first peer with said first number of data transfers; and

15.5. in response to said first peer and said second peer not completing all data transfers, returning to step 15.3;

wherein step 15.3 further comprises the steps of;

16.1. determining if said second peer needs assistance to transfer said second number of data transfers to said one or more storage devices;

16.2. in response to determining that said second peer needs assistance to transfer said second number of data transfers to said one or more storage devices;

16.2.1. assigning a portion of said second number of data transfers from said second peer to said first peer as said first number of data transfers;

16.2.2. adjusting a first peer ratio and a second peer ratio; and

16.2.3. said first peer transferring said portion of said second number of data transfers to said one or more storage devices.

14. The system of claim 13, wherein step 15.4 further comprises the steps of:

17.1. determining if said first peer needs assistance to transfer said first number of data transfers to said one or more storage devices;

17.2. in response to determining that said first peer needs assistance to transfer said first number of data transfers to said one or more storage devices;

17.2.1. adjusting a first peer ratio and a second peer ratio;

17.2.2. assigning a portion of said first number of data transfers from said first peer to said second peer as said second number of data transfers; and

17.2.3. said second peer transferring said portion of said first number of data transfers to said one or more storage devices.

15. The system of claim 14, wherein step 17.1 further comprises the steps of:

19.1. determining a first peer ratio and a second peer ratio;

19.2. determining a portion of first number of transfers that is equal to said first peer ratio multiplied by a remaining first number of transfers;

19.3. in response to said portion of first number of transfers being greater than a first peer minimum number of transfers, said first peer sending an “

assistance needed”

message to said second peer; and

19.4. in response to said portion of first number of transfers being less than or equal to said first peer minimum number of transfers, said first peer sending a “

no assistance needed”

message to said second peer.

16. The system of claim 15, wherein step 19.1 further comprises:

21.1. in response to determining that said second peer assisted said first peer with said first number of data transfers at the previous execution of step 15.4, increasing said first peer ratio by a first increment;

21.2. in response to determining that said first peer assisted said second peer with said second number of data transfers at the previous execution of step 15.3, decreasing said second peer ratio by a second increment.

17. The system of claim 13, wherein step 16.1 further comprises the steps of:

18.1. determining a first peer ratio and a second peer ratio;

18.2. determining a portion of second number of transfers that is equal to said second peer ratio multiplied by a remaining second number of transfers;

18.3. in response to said portion of second number of transfers being greater than a second peer minimum number of transfers, said second peer sending an “

assistance needed”

message to said first peer; and

18.4. in response to said portion of second number of transfers being less than or equal to said second peer minimum number of transfers, said second peer sending a “

no assistance needed”

message to said first peer.

18. The system of claim 17, wherein step 18.1 further comprises:

20.1. in response to determining that said first peer assisted said second peer with said second number of data transfers at the previous execution of step 15.3, increasing said second peer ratio by a second increment; and

20.2. in response to determining that said second peer assisted said first peer with said first number of data transfers at the previous execution of step 15.4, decreasing said first peer ratio by a first increment.