METHOD, DEVICE AND COMPUTER READABLE MEDIUM FOR SCHEDULING DEDICATED PROCESSING RESOURCE

• US 20190324810A1
• Filed: 04/19/2019
• Published: 10/24/2019
• Est. Priority Date: 04/20/2018
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Zhao, Junping, Wang, Kun, Peng, Layne Lin, Chen, Fei
• Granted Patent: US 11,061,731 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 8/43 Checking; Contextual analysis
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/505 considering the load

Abstract

A method of scheduling a dedicated processing resource includes: obtaining source code of an application to be compiled; extracting, during compiling of the source code, metadata associated with the application, the metadata indicating an amount of the dedicated processing resource required by the application; and obtaining, based on the metadata, the dedicated processing resource allocated to the application. In this manner, performance of the dedicated processing resource scheduling system and resource utilization is improved.

Claims

1. A method of scheduling a dedicated processing resource, comprising:

obtaining a source code of an application to be compiled;

extracting, during compiling of the source code, metadata associated with the application, the metadata indicating an amount of the dedicated processing resource required by the application; and

obtaining, based on the metadata, the dedicated processing resource allocated to the application.

2. The method of claim 1, wherein extracting the metadata associated with the application comprises:

extracting the metadata through an extraction function embedded in a compiler for compiling the source code.

3. The method of claim 1, wherein obtaining the dedicated processing resource allocated to the application comprises:

analyzing the metadata to predict the dedicated processing resource required by the application;

requesting the dedicated processing resource from a remote controller; and

receiving a dedicated processing resource notification from the remote controller, the dedicated processing resource notification indicating the dedicated processing resource allocated by the remote controller to the application.

4. The method of claim 1, wherein obtaining the dedicated processing resource allocated to the application comprises:

sending the metadata to a remote database;

requesting the dedicated processing resource from a remote controller to enable the controller to access the remote database and analyze the metadata; and

receiving a dedicated processing resource notification from the remote controller, the dedicated processing resource notification indicating the dedicated processing resource allocated by the remote controller to the application.

5. The method of claim 1, wherein the application comprises a deep learning application, and wherein the metadata comprises at least one of:

a type of at least one layer in a model of the deep learning application;

the number of layers in the model of the deep learning application; and

a format of data input to the deep learning application.

6. The method of claim 1, wherein the dedicated processing resource required by the application is a graphical processing unit (GPU), and wherein the metadata comprises at least one of:

the number of kernels of the GPU required by the application;

an amount of a computing resource of the GPU required by the application; and

an amount of a memory resource of the GPU required by the application.

7. The method of claim 6, wherein the application obtains the required GPU from a GPU resource pool via a network connection.

8. The method of claim 1, wherein extracting the metadata associated with the application comprises:

obtaining a journal generated during compiling of the source code; and

extracting, based on the journal, the metadata associated with the application.

9. A device for scheduling a dedicated processing resource, comprising:

at least one processing unit; and

at least one memory coupled to the at least one processing unit and storing instructions executed by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to execute acts, the acts comprising;

obtaining a source code of an application to be compiled;

extracting, during compiling of the source code, metadata associated with the application, the metadata indicating an amount of the dedicated processing resource required by the application; and

obtaining, based on the metadata, the dedicated processing resource allocated to the application.

10. The device of claim 9, wherein extracting the metadata associated with the application comprises:

extracting the metadata through an extraction function embedded in a compiler for compiling the source code.

11. The device of claim 9, wherein obtaining the dedicated processing resource allocated to the application comprises:

analyzing the metadata to predict the dedicated processing resource required by the application;

requesting the dedicated processing resource from a remote controller; and

receiving a dedicated processing resource notification from the remote controller, the dedicated processing resource notification indicating the dedicated processing resource allocated by the remote controller to the application.

12. The device of claim 9, wherein obtaining the dedicated processing resource allocated to the application comprises:

sending the metadata to a remote database;

requesting the dedicated processing resource from a remote controller to enable the controller to access the remote database and analyze the metadata; and

receiving a dedicated processing resource notification from the remote controller, the dedicated processing resource notification indicating the dedicated processing resource allocated by the remote controller to the application.

13. The device of claim 9, wherein the application comprises a deep learning application, and wherein the metadata comprise at least one of:

a type of one of layers in a model of the deep learning application;

the number of the layers in the model of the deep learning application; and

a format of data input to the deep learning application.

14. The device of claim 9, wherein the dedicated processing resource required by the application is a graphical processing unit (GPU), and wherein the metadata comprises at least one of:

the number of kernels of the GPU required by the application;

an amount of a computing resource of the GPU required by the application; and

an amount of a memory resource of the GPU required by the application.

15. The device of claim 14, wherein the application obtains the required GPU from a GPU resource pool via a network connection.

16. The device of claim 9, wherein extracting the metadata associated with the application comprises:

obtaining a journal generated during compiling of the source code; and

extracting, based on the journal, the metadata associated with the application.

17. A computer readable program product, which stores machine executable instructions thereon, the machine executable instructions, when executed by at least one processor, causing the at least one processor to implement a method of scheduling a dedicated processing resource, comprising:

obtaining a source code of an application to be compiled;

extracting, during compiling of the source code, metadata associated with the application, the metadata indicating an amount of the dedicated processing resource required by the application; and

obtaining, based on the metadata, the dedicated processing resource allocated to the application.

18. The computer readable program product of claim 17, wherein extracting the metadata associated with the application comprises:

extracting the metadata through an extraction function embedded in a compiler for compiling the source code.

19. The computer readable program product of claim 17, wherein obtaining the dedicated processing resource allocated to the application comprises:

analyzing the metadata to predict the dedicated processing resource required by the application;

requesting the dedicated processing resource from a remote controller; and

receiving a dedicated processing resource notification from the remote controller, the dedicated processing resource notification indicating the dedicated processing resource allocated by the remote controller to the application.

20. The computer readable program product of claim 17, wherein obtaining the dedicated processing resource allocated to the application comprises:

sending the metadata to a remote database;

requesting the dedicated processing resource from a remote controller to enable the controller to access the remote database and analyze the metadata; and

receiving a dedicated processing resource notification from the remote controller, the dedicated processing resource notification indicating the dedicated processing resource allocated by the remote controller to the application.