Method, controller, and system for service flow control in object-based storage system

• US 9,984,013 B2
• Filed: 09/26/2017
• Issued: 05/29/2018
• Est. Priority Date: 10/22/2014
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Tong, Yanqun
• Primary Examiner(s): Sun, Michael
• Application Number:
  US15/716,163
• Publication Number:
  US 20180018293A1
• Time in Patent Office: 245 Days
• Field of Search: None
• CPC Class Codes: G06F 13/36 for access to common bus or bus system
• CPC Class Codes: G06F 2209/5013 Request control
• CPC Class Codes: G06F 2209/5022 Workload threshold
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues
• CPC Class Codes: H04L 47/26 using explicit feedback to the source, e.g. choke packets
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method, a controller, and a system for service flow control in an object-based storage system are disclosed. The method is: receiving, by a controller, a first object IO request; acquiring a processing quantity threshold and a to-be-processed quantity; if the to-be-processed quantity is less than the processing quantity threshold, sending the first object IO request to a storage device client, and updating the to-be-processed quantity; receiving a first response message replied by the storage device client for the first object IO request, where the first response message carries a processing result of the first object IO request; and adjusting the processing quantity threshold according to a received processing result of an object IO request when a preset condition is met. The storage device is not overloaded with object IO requests and can use all resources to effectively, thereby improving performance and a success rate of the object-based storage system.

Claims

1. A method for controlling service flow in an object-based storage system, wherein the object-based storage system includes a controller and multiple storage devices, the method comprising:

sending, by the controller, in the object-based storage system, a first object input/output (IO) request to a target storage device that is one of the multiple storage devices, when a quantity of pending object IO requests has not reach a processing quantity threshold, wherein the processing quantity threshold indicates a maximum quantity of object IO requests processed by the object-based storage system;

receiving, by the controller, a first response message from the target storage device in response to the first object IO request, wherein the first response message includes a processing result of the first object IO request; and

adjusting, by the controller, the processing quantity threshold based on one or more processing results that include the processing result of the first object IO request.

2. The method according to claim 1, further comprising:

entering, by the controller, a dormancy state after sending the first object IO request, wherein the controller does not send any object IO request during a period of the dormancy state; and

after the period of the dormancy state, sending, by the controller, a second object IO request to one of the multiple storage devices.

3. The method according to claim 2, further comprising:

updating, by the controller, a value that indicates a quantity of object IO requests being successfully processed, when the processing result included in the first response message shows the first object IO request has been successfully processed;

obtaining, by the controller, a ratio of the value to a total quantity of object IO requests sent by the controller; and

adjusting, by the controller, the period of the dormancy state based on the ratio.

4. The method according to claim 1, further comprising:

dividing, by the controller, the first object IO request into multiple sub-object IO requests, based on a determination that a size of the first object IO request is greater than a preset threshold.

5. The method according to claim 4, wherein the sending the first object IO request to the target storage device comprises:

sending, by the controller, a first sub-object IO request of the multiple sub-object IO requests to the target storage device;

entering, by the controller, a sub-dormancy state after sending the first sub-object IO request, wherein the controller does not send any sub-object IO request during a period of the sub-dormancy state;

after the period of the sub-dormancy state, sending, by the controller, a second sub-object IO request to the target storage device; and

entering, by the controller, a next sub-dormancy state after sending the second sub-object IO request, until all of the multiple sub-object IO requests are sent to the target storage device.

6. The method according to claim 1, further comprising:

updating, by the controller, a value that indicates a quantity of object IO requests being successfully processed, when the processing result included in the first response message shows the first object IO request has been successfully processed; and

obtaining, by the controller, a ratio of the value to a total quantity of object IO requests sent by the controller.

7. The method according to claim 6,

wherein the adjusting the processing quantity threshold comprises adjusting the processing quantity threshold based on the ratio.

8. An object-based storage system, comprising:

multiple storage devices; and

a controller coupled to the multiple storage devices,

wherein the controller is configured to;

send a first object input/output (IO) request to a target storage device what is one of the multiple storage devices, when a quantity of pending object IO requests has not reach a processing quantity threshold, wherein the processing quantity threshold indicates a maximum quantity of object IO requests processed by the object-based storage system;

receive a first response message from the target storage device in response to the first object IO request, wherein the first response message includes a processing result of the first object IO request; and

adjust the processing quantity threshold based on one or more processing results that include the processing result of the first object IO request.

9. The object-based storage system according to claim 8, wherein the controller is further configured to:

enter a dormancy state after sending the first object IO request, wherein the controller does not send any object IO request during a period of the dormancy state; and

send a second object IO request to one of the multiple storage devices after the period of the dormancy state.

10. The object-based storage system according to claim 9, wherein the controller is further configured to:

update a value that indicates a quantity of object IO requests being successfully processed, when the processing result included in the first response message shows the first object IO request has been successfully processed;

obtain a ratio of the value to a total quantity of object IO requests sent by the controller; and

adjust the period of the dormancy state based on the ratio.

11. The object-based storage system according to claim 8, wherein the controller is further configured to:

divide the first object IO request into multiple sub-object IO requests, based on a determination that a size of the first object IO request is greater than a preset threshold.

12. The object-based storage system according to claim 11, wherein the controller is specifically configured to:

send a first sub-object IO request of the multiple sub-object IO requests to the target storage device;

enter a sub-dormancy state after sending the first sub-object IO request, wherein the controller does not send any sub-object IO request during a period of the sub-dormancy state;

send a second sub-object IO request to the target storage device after the period of the sub-dormancy state; and

enter a next sub-dormancy state after sending the second sub-object IO request, until all of the multiple sub-object IO requests are sent to the target storage device.

13. The object-based storage system according to claim 8, wherein the controller is further configured to:

update a value that indicates a quantity of object IO requests being successfully processed, when the processing result included in the first response message shows the first object IO request has been successfully processed; and

obtain a ratio of the value to a total quantity of object IO requests sent by the controller.

14. The object-based storage system according to claim 13,

wherein the controller is specifically configured to adjust the processing quantity threshold based on the ratio.

15. A non-transitory computer-readable storage medium storing program instructions for use by a controller that controls service flow in an object-based storage system, wherein the object-based storage system includes the controller and multiple storage devices coupled to the controller, and wherein the program instructions instruct the controller to perform a process that comprises:

sending in the object-based storage system, a first object input/output (IO) request to a target storage device that is one of the multiple storage devices, when a quantity of pending object IO requests has not reach a processing quantity threshold, wherein the processing quantity threshold indicates a maximum quantity of object IO requests processed by the object-based storage system;

receiving a first response message from the target storage device in response to the first object IO request, wherein the first response message includes a processing result of the first object IO request; and

adjusting the processing quantity threshold based on one or more processing results that include the processing result of the first object IO request.

16. The storage medium according to claim 15, wherein the program instructions instruct the controller to perform the process that further comprises:

entering a dormancy state after sending the first object IO request, wherein the controller does not send any object IO request during a period of the dormancy state; and

after the period of the dormancy state, sending a second object IO request to one of the multiple storage devices.

17. The storage medium according to claim 16, wherein the program instructions instruct the controller to perform the process that further comprises:

updating a value that indicates a quantity of object IO requests being successfully processed, when the processing result included in the first response message shows the first object IO request has been successfully processed;

obtaining a ratio of the value to a total quantity of object IO requests sent by the controller; and

adjusting the period of the dormancy state based on the ratio.

18. The storage medium according to claim 15, wherein the program instructions instruct the controller to perform the process that further comprises:

dividing the first object IO request into multiple sub-object IO requests, based on a determination that a size of the first object IO request is greater than a preset threshold.

19. The storage medium according to claim 18, wherein the sending the first object IO request to the target storage device comprises:

sending a first sub-object IO request of the multiple sub-object IO requests to the target storage device;

entering a sub-dormancy state after sending the first sub-object IO request, wherein the controller does not send any sub-object IO request during a period of the sub-dormancy state;

after the period of the sub-dormancy state, sending a second sub-object IO request to the target storage device; and

entering a next sub-dormancy state after sending the second sub-object IO request, until all of the multiple sub-object IO requests are sent to the target storage device.

20. The storage medium according to claim 15, wherein the program instructions instruct the controller to perform the process that further comprises:

updating a value that indicates a quantity of object IO requests being successfully processed, when the processing result included in the first response message shows the first object IO request has been successfully processed; and

obtaining a ratio of the value to a total quantity of object IO requests sent by the controller.

21. The storage medium according to claim 20, wherein the adjusting the processing quantity threshold comprises adjusting the processing quantity threshold based on the ratio.