Job management and resource allocation in a data protection system

• US 10,025,632 B2
• Filed: 06/27/2017
• Issued: 07/17/2018
• Est. Priority Date: 03/27/2015
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kochunni, Jaidev Oppath, Liu, Chong, Mishra, Hemant
• Primary Examiner(s): Chen, Qing
• Assistant Examiner(s): THATCHER, CLINT A
• Application Number:
  US15/634,885
• Publication Number:
  US 20180018202A1
• Time in Patent Office: 385 Days
• Field of Search: 718104
• CPC Class Codes: G06F 3/0622 in relation to access
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: G06F 9/5022 Mechanisms to release resources

Abstract

A system according to certain aspects improves the process of managing jobs and allocating resources to those jobs. The system can include a job manager that processes and generates resource allocation requests for a plurality of jobs and a resource allocator that allocates computing resources for the plurality of jobs based on the resource allocation requests. The process of allocating resources may involve locking one or more resource objects before allocating the computing resources for the plurality of jobs and unlocking the locked resource objects after the computing resources have been allocated for the plurality of jobs.

Claims

1. A method for managing resource allocation in a data storage system, the method comprising:

with one or more computing devices in a networked data storage system, initiating processing of a first data protection job of a plurality of data protection jobs;

requesting allocation of a first portion of one or more computing resources within the data storage system for use in performing the first data protection job;

initiating processing of a second data protection job of the plurality of data protection jobs prior to the allocation of the first portion associated with the first data protection job; and

requesting allocation of a second portion of the computing resources within the data storage system for use in performing the second data protection job prior to the allocation of the first portion associated with the first data protection job.

2. The method of claim 1, wherein the computing resources include storage space in one or more secondary storage devices.

3. The method of claim 1, wherein the one or more computing devices initiate the processing of the second data protection job without waiting for the first portion to be allocated.

4. The method of claim 1, wherein said requesting of the allocation of the first portion does not prevent the one or more computing devices from processing additional data protection jobs prior to the allocation of the first portion.

5. The method of claim 1, further comprising, after the allocation of the first portion is requested but has not yet been fulfilled, performing one or more job management tasks associated with the first data protection job.

6. The method of claim 1, wherein said requesting of the allocation of the first portion comprises specifying a first amount of computing resources for performing the first data protection job, and said requesting of the allocation of the second portion comprises specifying a second amount of computing resources for performing the second data protection job.

7. The method of claim 1, further comprising sending a single combined resource allocation request for the allocation of the first and second portions such that the first and second portions are allocated without locking and unlocking one or more resource objects associated with the computing resources more than once.

8. The method of claim 1, further comprising sending a first combined resource allocation request for the allocation of the first portion associated with the first data protection job and allocation of one or more other portions associated with a first group of clients, and sending a second combined resource allocation request for the allocation of the second portion associated with the second data protection job and allocation of one or more other portions associated with a second group of clients different from the first group of clients.

9. The method of claim 8, wherein the first group of clients is to be allocated storage space in one or more first secondary storage devices and the second group of clients is to be allocated storage space in one or more second secondary storage devices different from the first secondary storage devices.

10. The method of claim 1, further comprising sending a first resource allocation request for the allocation of the first portion associated with the first data protection job and a second resource allocation request for the allocation of the second portion associated with the second data protection job such that allocating the first and second portions result in locking and unlocking one or more resource objects associated with the computing resources more than once.

11. A system comprising:

one or more hardware processors within a networked data storage system and programmed to;

initiate processing of a first data protection job of a plurality of data protection jobs;

request allocation of a first portion of one or more computing resources within the data storage system for use in performing the first data protection job;

initiate processing of a second data protection job of the plurality of data protection jobs prior to the allocation of the first portion associated with the first data protection job; and

request allocation of a second portion of the computing resources within the data storage system for use in performing the second data protection job prior to the allocation of the first portion associated with the first data protection job.

12. The system of claim 11, wherein the computing resources include storage space in one or more secondary storage devices.

13. The system of claim 11, wherein the one or more hardware processors are programmed to initiate the processing of the second data protection job without waiting for the first portion to be allocated.

14. The system of claim 11, wherein said requesting of the allocation of the first portion does not prevent the one or more hardware processors from processing additional data protection jobs prior to the allocation of the first portion.

15. The system of claim 11, wherein the one or more hardware processors are further programmed to, after the allocation of the first portion is requested, perform one or more job management tasks associated with the first data protection job.

16. The system of claim 11, wherein the one or more hardware processors are programmed to specify a first amount of computing resources for performing the first data protection job, and to specify a second amount of computing resources for performing the second data protection job.

17. The system of claim 11, wherein the one or more hardware processors are programmed to asynchronously send a single combined resource allocation request for allocation of the first and second portions such that the first and second portions are allocated without locking and unlocking one or more resource objects associated with the computing resources more than once.

18. The system of claim 11, wherein the one or more hardware processors are programmed to send a first combined resource allocation request for the allocation of the first portion associated with the first data protection job and allocation of one or more other portions associated with a first group of clients, and send a second combined resource allocation request for the allocation of the second portion associated with the second data protection job and allocation of one or more other portions associated with a second group of clients different from the first group of clients.

19. The system of claim 18, wherein the first group of clients is to be allocated storage space in one or more first secondary storage devices and the second group of clients is to be allocated storage space in one or more second secondary storage devices different from the first secondary storage devices.

20. Non-transitory computer-readable memory comprising instructions which, when executed by a computer, cause the computer to perform a method for requesting resource allocation in a data storage system, the method comprising:

initiating processing of a first data protection job of a plurality of data protection jobs;

requesting allocation of a first portion of one or more computing resources within the data storage system for use in performing the first data protection job;

initiating processing of a second data protection job of the plurality of data protection jobs prior to the allocation of the first portion associated with the first data protection job; and

requesting allocation of a second portion of the computing resources within the data storage system for use in performing the second data protection job prior to the allocation of the first portion associated with the first data protection job.