Systems and methods of managing resource utilization on a threaded computer system

• US 20080256545A1
• Filed: 04/13/2007
• Published: 10/16/2008
• Est. Priority Date: 04/13/2007
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Godman, Peter J., Fachan, Neal T., Dire, Nate E., Loafman, Zachary M., Akidau, Tyler Arthur
• Granted Patent: US 8,966,080 B2
• Time in Patent Office: Days
• US Class Current: 718/104
• CPC Class Codes: G06F 9/466 Transaction processing

Abstract

Embodiments of the invention relate generally to incremental computing. Specifically, embodiments of the invention include systems and methods for the concurrent processing of multiple, incremental changes to a data value while at the same time monitoring and/or enforcing threshold values for that data value. Embodiments of the invention also include systems and methods of managing utilization of a resource of a computer system having a number of threads.

Claims

1. A method of managing utilization of a resource of a computer system having a number of threads, the method comprising:

receiving a usage threshold for a resource on the computer system;

determining a usage for the resource on the system;

organizing the system into a number of subsystems, wherein the number of subsystems is two or more, and wherein the number is determined at least in part on factors including the number of threads, the usage threshold, and the usage;

allocating the subsystems among the threads;

tracking resource usage for each subsystem; and

distributing a request to modify resource usage to at least one subsystem.

2. The method of claim 1, wherein the computer system comprises a distributed system comprising one or more nodes.

3. The method of claim 2, wherein at least one node of the distributed system is allocated one or more subsystems.

4. The method of claim 2, wherein the distributed system comprises at least one of a distributed storage system and a distributed file system.

5. The method of claim 1, wherein the resource comprises physical space on a storage device.

6. The method of claim 1, wherein the resource comprises quantity of files stored on a storage device.

7. The method of claim 6, wherein the quantity of files comprises a count associated with the number of files.

8. The method of claim 6, wherein the quantity of files comprises physical space associated with the files.

9. The method of claim 1, wherein the resource comprises logical space on a storage device.

10. The method of claim 9, wherein the logical space comprises physical space less space relating to metadata associated with a protection level for the resource.

11. The method of claim 1, wherein organizing the system into a number of subsystems comprises determining a subsystem usage threshold for each subsystem, and wherein tracking resource usage for each subsystem comprises determining a subsystem usage for the resource.

12. The method of claim 10, wherein the sum of the subsystem usage thresholds equals the usage threshold.

13. The method of claim 10, wherein the sum of the subsystem usages equals the usage.

14. The method of claim 10, wherein the request to modify resource usage comprises a delta request for the resource.

15. The method of claim 14, wherein tracking resource usage comprises determining whether the delta request could cause the subsystem usage to pass the subsystem usage threshold in combination with any subset of delta requests pending on the subsystem.

16. The method of claim 1, wherein allocating the subsystems among the threads comprises allocating at most one subsystem to any thread.

17. The method of claim 1, wherein the factors for determining the number of subsystems further include a protection level for the resource.

18. The method of claim 17, wherein allocating the subsystems among the threads comprises mirroring the subsystems based at least in part on the protection level.

19. The method of claim 1, further comprising:

reorganizing the system into one or more subsystems based on occurrence of an event.

20. The method of claim 19, wherein the event comprises a subsystem usage level passing a subsystem usage threshold.

21. The method of claim 19, wherein the event comprises adding a new thread to the system.

22. The method of claim 19, wherein the event comprises updating a usage threshold for the system or a subsystem.

23. The method of claim 19, wherein the event comprises a possible value range boundary associated with subsystem usage passing a subsystem usage threshold.

24. The method of claim 18, wherein said reorganizing comprises determining a number of the subsystems for reorganization, wherein the number is one or more.

25. The method of claim 24, wherein the number is one.

26. The method of claim 24, wherein the number is based at least in part on factors including the number of threads, the usage threshold, and the usage.

27. The method of claim 26, wherein the factors further include a protection level for the resource.

28. A computer-readable medium having instructions stored thereon for managing, when the instructions are executed, utilization of a resource of a computer system having a number of threads, the instructions comprising:

receiving a usage threshold for a resource on the computer system;

determining a usage for the resource on the computer system;

organizing the computer system into a number of subsystems, wherein the number of subsystems is two or more, and wherein the number is determined at least in part on factors including the number of threads, the usage threshold, and the usage;

allocating the subsystems among the threads;

tracking resource usage for each subsystem; and

distributing a request to modify resource usage to at least one subsystem.

29. A system for managing utilization of a resource of a computer system having a number of threads, the system comprising:

a module configured to receive a usage threshold and to determine usage for a resource on the computer system;

wherein the module is further configured to organize the computer system into a number of subsystems, wherein the number is two or more and depends at least in part on factors including the number of threads, the usage threshold, and the usage; and

wherein the module is further configured to allocate the subsystems among the threads for tracking resource usage for each subsystem, and to distribute a request to modify resource usage to at least one subsystem.

30. The system of claim 29, wherein the computer system comprises a distributed system comprising one or more nodes.

31. The system of claim 30, wherein at least one node of the distributed system is allocated one or more subsystems.

32. The system of claim 29, wherein the distributed system comprises at least one of a distributed storage system and a distributed file system.

33. The system of claim 29, wherein the resource comprises physical space on a storage device.

34. The system of claim 29, wherein the resource comprises quantity of files stored on a storage device.

35. The system of claim 34, wherein the quantity of files comprises a count associated with the number of files.

36. The system of claim 34, wherein the quantity of files comprises physical space associated with the files.

37. The system of claim 29, where the resource comprises logical space on a storage device.

38. The system of claim 37, wherein the logical space comprises physical space less space relating to metadata associated with a protection level for the resource.

39. The system of claim 29, wherein the module is further configured to determine a subsystem usage threshold for each subsystem and to determine a subsystem usage level for the resource usage tracked by each subsystem.

40. The system of claim 39, wherein the sum of all the subsystem usage thresholds equals the usage threshold.

41. The system of claim 39, wherein the sum of all the subsystem usage levels equals the usage.

42. The system of claim 39, wherein the request to modify resource usage comprises a delta request for the resource.

43. The system of claim 42, wherein the module is further configured to determine whether the delta request could cause the subsystem usage to pass the subsystem usage threshold in combination with any subset of delta requests pending on the subsystem.

44. The system of claim 29, wherein the module is configured to allocate at most one subsystem to any thread.

45. The system of claim 29, wherein the factors for determining the number of subsystems further include a protection level for the resource.

46. The system of claim 45, wherein module is further configured to mirror the subsystems based at least in part on the protection level.

47. The system of claim 29, wherein the module is further configured to reorganize the system into one or more subsystems based on occurrence of an event.

48. The system of claim 47, wherein the event comprises a subsystem usage level passing a subsystem usage threshold.

49. The system of claim 47, wherein the event comprises adding a new thread to the computer system.

50. The system of claim 47, wherein the event comprises updating a usage threshold for the computer system or a subsystem.

51. The system of claim 47, wherein the event comprises a possible value range boundary associated with the subsystem usage level passing a subsystem usage threshold.

52. The system of claim 29, wherein said reorganizing comprises determining a number of the subsystems for reorganization, wherein the number is one or more.

53. The system of claim 52, wherein the number is one.

54. The system of claim 52, wherein the number is based at least in part on factors including the number of threads, the usage threshold, and the usage.

55. The system of claim 54, wherein the factors further include a protection level for the resource.