Job management and resource allocation in a data protection system

• US 10,496,442 B2
• Filed: 06/15/2018
• Issued: 12/03/2019
• Est. Priority Date: 03/27/2015
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kochunni, Jaidev Oppath, Liu, Chong, Mishra, Hemant
• Primary Examiner(s): Chen, Qing
• Assistant Examiner(s): Thatcher, Clint
• Application Number:
  US16/010,184
• Publication Number:
  US 20190012203A1
• Time in Patent Office: 536 Days
• Field of Search: 718104
• CPC Class Codes: G06F 3/0622 in relation to access
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: G06F 9/5022 Mechanisms to release resources

Abstract

A system according to certain aspects improves the process of managing jobs and allocating resources to those jobs. The system can include a job manager that processes and generates resource allocation requests for a plurality of jobs and a resource allocator that allocates computing resources for the plurality of jobs based on the resource allocation requests. The process of allocating resources may involve locking one or more resource objects before allocating the computing resources for the plurality of jobs and unlocking the locked resource objects after the computing resources have been allocated for the plurality of jobs.

Claims

1. A method for managing resource allocation in a data storage system having computing resources, the method comprising:

with one or more computing devices in the data storage system,

receiving a first request to allocate a portion of the computing resources of the data storage system for a first data protection job;

receiving a second request to allocate a portion of the computing resources of the data storage system for a second data protection job different from the first data protection job;

locking one or more resource objects associated with the computing resources of the data storage system;

allocating, while the one or more resource objects are locked, a portion of the computing resources of the data storage system for the first data protection job and another portion of the computing resources of the data storage system for the second data protection job; and

unlocking, subsequent to the allocation, the one or more resource objects associated with the computing resources of the data storage system.

2. The method of claim 1, wherein the computing resources of the data storage system include storage space in one or more secondary storage devices.

3. The method of claim 1, wherein the one or more resource objects remain locked while the computing resources are being allocated for the first and second data protection jobs.

4. The method of claim 1, further comprising allocating the computing resources for one or more additional data protection jobs until the computing resources have been allocated for a predetermined number of data protection jobs before unlocking the one or more resource objects.

5. The method of claim 1, further comprising selecting the first request and the second request for resource allocation from a plurality of requests based on the first request and the second request being received earlier than one or more other requests in the plurality of requests.

6. The method of claim 1, further comprising selecting the first request and the second request for resource allocation from a plurality of requests based on priority associated with the first data protection job and the second data protection job being higher than one or more other jobs in the plurality of requests.

7. The method of claim 6, wherein restore operations have higher priority than backup operations.

8. The method of claim 1, further comprising selecting, for resource allocation, all requests received since the most recent resource allocation prior to the locking of the one or more resource objects.

9. The method of claim 1, wherein the first request is associated with a first group of client devices to be allocated storage space in a first group of secondary storage devices, and the second request is associated with a second group of client devices to be allocated storage space in a second group of secondary storage devices different from the first group of secondary storage devices.

10. The method of claim 1, wherein the first request specifies a first amount of computing resources to be allocated for the first data protection job, and the second request specifies a second amount of computing resources for the second data protection job.

11. A system comprising:

computing resources; and

one or more hardware processors configured to;

receive a first request to allocate a portion of the computing resources for a first data protection job;

receive a second request to allocate a portion of the computing resources for a second data protection job different from the first data protection job;

lock one or more resource objects associated with the computing resources;

allocate, while the one or more resource objects are locked, a portion of the computing resources for the first data protection job and another portion of the computing resources for the second data protection job; and

unlock, subsequent to the allocation, the one or more resource objects associated with the computing resources.

12. The system of claim 11, wherein the computing resources include storage space in one or more secondary storage devices.

13. The system of claim 11, wherein the one or more resource objects remain locked while the computing resources are being allocated for the first and second data protection jobs.

14. The system of claim 11, wherein the one or more hardware processors are further configured to allocate the computing resources for one or more additional data protection jobs until the computing resources have been allocated for a predetermined number of data protection jobs before unlocking the one or more resource objects.

15. The system of claim 11, wherein the one or more hardware processors are further configured to select the first request and the second request for resource allocation from a plurality of requests based on the first request and the second request being received earlier than one or more other requests in the plurality of requests.

16. The system of claim 11, wherein the one or more hardware processors are further configured to select the first request and the second request for resource allocation from a plurality of requests based on priority associated with the first data protection job and the second data protection job being higher than one or more other jobs in the plurality of requests.

17. The system of claim 16, wherein restore operations have higher priority than backup operations.

18. The system of claim 11, wherein the one or more hardware processors are further configured to select, for resource allocation, all requests received since the most recent resource allocation prior to the locking of the one or more resource objects.

19. The system of claim 11, wherein the first request is associated with a first group of client devices to be allocated storage space in a first group of secondary storage devices, and the second request is associated with a second group of client devices to be allocated storage space in a second group of secondary storage devices different from the first group of secondary storage devices.

20. Non-transitory computer-readable memory comprising instructions which, when executed by a computer in a data storage system, cause the computer to:

receive a first request to allocate a portion of computing resources of the data storage system for a first data protection job;

receive a second request to allocate a portion of the computing resources of the data storage system for a second data protection job different from the first data protection job;

lock one or more resource objects associated with the computing resources of the data storage system;

allocate, while the one or more resource objects are locked, a portion of the computing resources of the data storage system for the first data protection job and another portion of the computing resources of the data storage system for the second data protection job; and

unlock, subsequent to the allocation, the one or more resource objects associated with the computing resources of the data storage system.