Apparatus and method to dynamically allocate bandwidth in a data storage and retrieval system

• US 7,191,207 B2
• Filed: 06/11/2003
• Issued: 03/13/2007
• Est. Priority Date: 06/11/2003
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Mannenbach, David F., Jarvis, Thomas C., Blount, Lawrence C., Lowe, Steven R.
• Primary Examiner(s): DINH, KHANH Q
• Application Number:
  US10/459,645
• Publication Number:
  US 20040255026A1
• Time in Patent Office: 1,371 Days
• Field of Search: 709/105, 709/200, 709/226, 709/227, 370/208, 370/280, 370/466, 711/112
• US Class Current: 709/200
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

An apparatus and a method to allocate device adapter bandwidth, where that device adapter is disposed in an information storage and retrieval system capable of communicating with one or more host computers, and where that device adapter interconnects a data cache with information storage devices. The data storage and retrieval system receives a plurality of requests from the host computers to read information from, or to write information to, information storage devices. The method determines a read/write request ratio and a non-volatile storage utilization ratio. The method allocates device adapter bandwidth based upon the read/write request ratio and/or the non-volatile storage utilization ratio.

Claims

1. A method to allocate device adapter bandwidth, wherein said device adapter is disposed in an information storage and retrieval system capable of communicating with one or more host computers, wherein said information storage and retrieval system further comprises non-volatile storage having NVS total storage capacity, a data cache, and one or more information storage devices, wherein said device adapter interconnects said data cache and said one or more information storage devices, said method comprising the steps of:

establishing (N) storage arrays, wherein said (N) arrays comprise said one or more information storage devices;

initializing a plurality of task control blocks;

setting an initial (i)th stage task control block threshold, wherein said initial (i)th stage task control block threshold comprises one or more of said plurality of task control blocks, and wherein (i) is an integer greater than or equal to 1 and less than or equal to (N);

defining a stage task control block adjustment function;

determining the (i)th read request/write request ratio for the (i)th storage array;

setting an adjusted (i)th stage task control block threshold using said stage task control block adjustment function and said (i)th read request/write request ratio, wherein said adjusted (i)th stage task control block threshold comprises one or more of said plurality of task control blocks;

receiving a plurality of requests from said one or more host computers, wherein said plurality of requests comprises one or more read requests and one or more write requests, and wherein said one or more write requests comprise second information;

determining a read request/write request ratio;

allocating device adapter bandwidth to transfer first information from said one or more information storage devices to said cache based upon said read request/write request ratio;

writing said second information to said non-volatile memory and to said data cache, wherein said second information utilizes actual NVS storage;

determining a utilization ratio by dividing said actual NVS storage by said NVS total storage capacity;

allocating device adapter bandwidth to transfer said second information from said data cache to said one or more information storage devices based said utilization ratio.

2. The method of claim 1, further comprising the steps of:

maintaining a running reads table;

maintaining a running writes table;

receiving a host computer request;

determining if said host computer request comprises a read request;

operative if said host computer request comprises a read request, adding 1 to said running reads table; and

operative if said host computer request does not comprise a read request, adding 1 to said running writes table.

3. The method of claim 2, further comprising the step of:

clearing said running reads table; and

clearing said running writes table.

4. The method of claim 1, wherein said a stage task control block adjustment function comprises a look-up table.

5. The method of claim 1, further comprising the steps of:

receiving a request against said (i)th storage array for a stage operation comprising (M) task control blocks;

determining if said adjusted (i)th stage task control block threshold is greater than or equal to (M);

operative if said adjusted (i)th stage task control block threshold is greater than or equal to (M), allocating (M) task control blocks for said stage operation;

operative if said adjusted (i)th stage task control block threshold is not greater than or equal to (M), queuing said stage operation.

6. The method of claim 1, further comprising the steps of:

setting the (i)th destage task control block threshold, wherein said (i)th destage task control block threshold comprises one or more of said task control blocks;

defining a destage task control block adjustment function;

setting the (i)th non-volatile storage threshold, wherein said (i)th non-volatile storage threshold comprises a first percentage of said NVS total storage capacity;

receiving (i)th information, wherein said (i)th information comprises data to be written to said (i)th storage array;

writing said (i)th information to said non-volatile storage, wherein said (i)th information utilizes a second percentage of said NVS total storage capacity;

determining the (i)th utilization ratio by dividing said first percentage by said second percentage;

setting an adjusted (i)th destage task control block threshold using said destage task control block adjustment function and said (i)th utilization ratio, wherein said adjusted (i)th destage task control block threshold comprises one or more of said plurality of task control blocks.

7. The method of claim 6, wherein said a destage task control block adjustment function comprises a look-up table.

8. The method of claim 6, further comprising the steps of:

receiving a request against said (i)th storage array for a destage operation comprising (M) task control blocks;

determining if said adjusted (i)th destage task control block threshold is greater than or equal to (M);

operative if said adjusted (i)th destage task control block threshold is greater than or equal to (M), allocating (M) task control blocks for said destage operation;

operative if said adjusted (i)th destage task control block threshold is not greater than or equal to (M), queuing said destage operation.

9. An article of manufacture comprising a computer readable medium having computer readable program code disposed therein to allocate device adapter bandwidth, wherein said device adapter is disposed in an information storage and retrieval system capable of communicating with one or more host computers, wherein said information storage and retrieval system further comprises non-volatile storage having NVS total storage capacity, a data cache and one or more information storage devices, wherein said device adapter interconnects said data cache and said one or more information storage devices, the computer readable program code comprising a series of computer readable program steps to effect:

establishing (N) storage arrays, wherein said (N) arrays comprise said one or more information storage devices;

initializing a plurality of task control blocks;

setting an initial (i)th stage task control block threshold, wherein said initial (i)th stage task control block threshold comprises one or more of said plurality of task control blocks, and wherein (i) is an integer greater than or equal to 1 and less than or equal to (N);

defining a stage task control block adjustment function;

determining the (i)th read request/write request ratio for the (i)th storage array;

setting an adjusted (i)th stage task control block threshold using said stage task control block adjustment function and said (i)th read request/write request ratio, wherein said adjusted (i)th stage task control block threshold comprises one or more of said plurality of task control blocks;

receiving a plurality of requests from said one or more host computers, wherein said plurality of requests comprises one or more read requests and one or more write requests, and wherein said one or more write requests comprise second information;

determining a read request/write request ratio;

allocating device adapter bandwidth to transfer first information from said one or more information storage devices to said cache based upon said read request/write request ratio;

writing said second information to said non-volatile memory and to said data cache, wherein said second information utilizes actual NVS storage;

determining a utilization ratio by dividing said actual NVS storage by said NVS total storage capacity;

allocating device adapter bandwidth to transfer said second information from said data cache to said one or more information storage devices based said utilization ratio.

10. The article of manufacture of claim 9, said computer readable program code further comprising a series of computer readable program steps to effect:

maintaining a running reads table;

maintaining a running writes table;

receiving a host computer request;

determining if said host computer request comprises a read request;

operative if said host computer request comprises a read request, adding 1 to said running reads table; and

operative if said host computer request does not comprise a read request, adding 1 to said running writes table.

11. The article of manufacture of claim 10, said computer readable program code further comprising a series of computer readable program steps to effect:

clearing said running reads table; and

clearing said running writes table.

12. The article of manufacture of claim 9, wherein said stage task control block adjustment function comprises a look-up table.

13. The article of manufacture of claim 9, said computer readable program code further comprising a series of computer readable program steps to effect:

receiving a request against said (i)th storage array for a stage operation comprising (M) task control blocks;

determining if said adjusted (i)th stage task control block threshold is greater than or equal to (M);

operative if said adjusted (i)th stage task control block threshold is greater than or equal to (M), allocating (M) task control blocks for said stage operation;

operative if said adjusted (i)th stage task control block threshold is not greater than or equal to (M), queuing said stage operation.

14. The article of manufacture of claim 9, said computer readable program code further comprising a series of computer readable program steps to effect:

setting the (i)th destage task control block threshold, wherein said (i)th destage task control block threshold comprises one or more of said task control blocks;

retrieving a predetermined a destage task control block adjustment function;

setting the (i)th non-volatile storage threshold, wherein said (i)th non-volatile storage threshold comprises a first percentage of said NVS total storage capacity;

receiving (i)th information, wherein said (i)th information comprises data to be written to said (i)th storage array;

writing said (i)th information to said non-volatile storage, wherein said (i)th information utilizes a second percentage of said NVS total storage capacity;

determining the (i)th utilization ratio comprising said first percentage and said second percentage;

setting an adjusted (i)th destage task control block threshold using said destage task control block adjustment function and said (i)th utilization ratio, wherein said adjusted (i)th destage task control block threshold comprises one or more of said plurality of task control blocks.

15. The article of manufacture of claim 14, wherein said destage task control block adjustment function comprises a look-up table.

16. The article of manufacture of claim 14, said computer readable program code further comprising a series of computer readable program steps to effect:

receiving a request against said (i)th storage array for a destage operation comprising (M) task control blocks;

determining if said adjusted (i)th destage task control block threshold is greater than or equal to (M);

operative if said adjusted (i)th destage task control block threshold is greater than or equal to (M), allocating (M) task control blocks for said destage operation;

operative if said adjusted (i)th destage task control block threshold is not greater than or equal to (M), queuing said destage operation.

17. A computer program product embodied in an information storage medium, said computer program product being usable with a programmable computer processor to allocate device adapter bandwidth, wherein said device adapter is disposed in an information storage and retrieval system capable of communicating with one or more host computers, wherein said information storage and retrieval system further comprises non-volatile storage having a total NVS storage capacity, a data cache and one or more information storage devices, wherein said device adapter interconnects said data cache and said one or more information storage devices, comprising:

computer readable program code which causes said programmable computer processor to establish (N) storage arrays, wherein said (N) arrays comprise said one or more information storage devices;

computer readable program code which causes said programmable computer processor to initialize a plurality of task control blocks;

computer readable program code which causes said programmable computer processor to set an initial (i)th stage task control block threshold, wherein said initial (i)th stage task control block threshold comprises one or more of said plurality of task control blocks, and wherein (i) is an integer greater than or equal to 1 and less than or equal to (N);

computer readable program code which causes said programmable computer processor to define a stage task control block adjustment function;

computer readable program code which causes said programmable computer processor to determine the (i)th read request/write request ratio for the (i)th storage array;

computer readable program code which causes said programmable computer processor to set an adjusted (i)th stage task control block threshold using said stage task control block adjustment function and said (i)th read request/write request ratio, wherein said adjusted (i)th stage task control block threshold comprises one or more of said plurality of task control blocks;

computer readable program code which causes said programmable computer processor to receive a plurality of requests from said one or more host computers, wherein said plurality of requests comprises one or more read requests and one or more write requests, and wherein said one or more write requests comprise second information;

computer readable program code which causes said programmable computer processor to determine a read request/write request ratio;

computer readable program code which causes said programmable computer processor to allocate device adapter bandwidth to transfer first information from said one or more information storage devices to said cache based upon said read request/write request ratio;

computer readable program code which causes said programmable computer processor to write said second information to said non-volatile memory and to said data cache, wherein said second information utilizes actual NVS storage;

computer readable program code which causes said programmable computer processor to determine a utilization ratio by dividing said actual NVS storage by said NVS total storage capacity;

computer readable program code which causes said programmable computer processor to allocate device adapter bandwidth to transfer said second information from said data cache to said one or more information storage devices based said utilization ratio.

18. The computer program product of claim 17, further comprising:

computer readable program code which causes said programmable computer processor to maintain a running reads table;

computer readable program code which causes said programmable computer processor to maintain a running writes table;

computer readable program code which causes said programmable computer processor to receive a host computer request;

computer readable program code which causes said programmable computer processor to determine if said host computer request comprises a read request;

computer readable program code which, if said host computer request comprises a read request, causes said programmable computer processor to add 1 to said running reads table; and

computer readable program code which, if said host computer request does not comprise a read request, causes said programmable computer processor to add 1 to said running writes table.

19. The computer program product of claim 18, further comprising

computer readable program code which causes said programmable computer processor to clear said running reads table;

and

computer readable program code which causes said programmable computer processor to clear said running writes table.

20. The computer program product of claim 17, wherein said stage task control block adjustment function comprises a look-up table.

21. The computer program product of claim 17, further comprising:

computer readable program code which causes said programmable computer processor to receive a request against said (i)th storage array for a stage operation comprising (M) task control blocks;

computer readable program code which causes said programmable computer processor to determine if said adjusted (i)th stage task control block threshold is greater than or equal to (M);

computer readable program code which, if said adjusted (i)th stage task control block threshold is greater than or equal to (M), causes said programmable computer processor to allocate (M) task control blocks for said stage operation;

computer readable program code which, if said adjusted (i)th stage task control block threshold is not greater than or equal to (M), causes said programmable computer processor to queue said stage operation.

22. The computer program product of claim 17, further comprising:

computer readable program code which causes said programmable computer processor to set the (i)th destage task control block threshold, wherein said (i)th destage task control block threshold comprises one or more of said task control blocks;

computer readable program code which causes said programmable computer processor to retrieve a predetermined destage task control block adjustment function;

computer readable program code which causes said programmable computer processor to set the (i)th non-volatile storage threshold, wherein said (i)th non-volatile storage threshold comprises a first percentage of said total NVS storage capacity;

computer readable program code which causes said programmable computer processor to receive (i)th information, wherein said (i)th information comprises data to be written to said (i)th storage array;

computer readable program code which causes said programmable computer processor to write said (i)th information to said non-volatile storage, wherein said (i)th information utilizes a second percentage of said total NVS storage capacity;

computer readable program code which causes said programmable computer processor to determine the (i)th utilization ratio by dividing said second percentage by said first percentage;

computer readable program code which causes said programmable computer processor to set an adjusted (i)th destage task control block threshold using said destage task control block adjustment function and said (i)th utilization ratio, wherein said adjusted (i)th destage task control block threshold comprises one or more of said plurality of task control blocks.

23. The computer program product of claim 22, wherein said destage task control block adjustment function comprises a look-up table.

24. The computer program product of claim 22, further comprising:

computer readable program code which causes said programmable computer processor to receive a request against said (i)th storage array for a destage operation comprising (M) task control blocks;

computer readable program code which causes said programmable computer processor to determine if said adjusted (i)th destage task control block threshold is greater than or equal to (M);

computer readable program code which, if said adjusted (i)th destage task control block threshold is greater than or equal to (M), causes said programmable computer processor to allocate (M) task control blocks for said destage operation;

computer readable program code which, if said adjusted (i)th destage task control block threshold is not greater than or equal to (M), causes said programmable computer processor to queue said destage operation.