Auto-Adaptive Serverless Function Management

• US 20190065238A1
• Filed: 08/03/2018
• Published: 02/28/2019
• Est. Priority Date: 08/24/2017
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Ling, Wei, Tian, Chen, Zu, Ziang
• Granted Patent: US 10,642,648 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 9/461 Saving or restoring of program or task context
• CPC Class Codes: G06F 9/465 Distributed object oriented systems remote method invocation [RMI] G06F9/548
• CPC Class Codes: G06F 9/485 Task life-cycle, e.g. stopping, restarting, resuming execution G06F9/4881 takes precedence
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/547 Remote procedure calls [RPC]; Web services
• CPC Class Codes: G06F 9/548 Object oriented; Remote method invocation [RMI] non-remote method invocation G06F9/449

Abstract

A method implemented by a cloud computing devices comprises removing, by the cloud computing device, data associated with a function from an execution data structure in response to determining that the function is waiting for an input event, adding, by the cloud computing device, a context associated with the function to a management data structure while the function is waiting for the input event, the context associated with the function comprising software components associated with the function and an intermediate variable associated with the function, executing, by the cloud computing device, the function with the input event in response to receiving the input event, and removing, by the cloud computing device, the context associated with the function from the management data structure in response to receiving the input event.

Claims

1. A method implemented by a cloud computing device comprising:

removing, by the cloud computing device, data associated with a function from an execution data structure in response to determining that the function is waiting for an input event;

adding, by the cloud computing device, a context associated with the function to a management data structure while the function is waiting for the input event, the context associated with the function comprising software components associated with the function and an intermediate variable associated with the function;

executing, by the cloud computing device, the function with the input event in response to receiving the input event; and

removing, by the cloud computing device, the context associated with the function from the management data structure in response to receiving the input event.

2. The method of claim 1, further comprising executing, by the cloud computing device, one or more other functions in the execution data structure while the function is waiting for the input event, the execution data structure comprising layers, each layer corresponding to a different one of the other functions.

3. The method of claim 1, wherein the management data structure comprises contexts for a plurality of different functions that are each respectively waiting for an input event.

4. The method of claim 1, further comprising storing, by the cloud computing device, a waiting event data structure that maintains a plurality of input events that are each respectively waiting to be received by a corresponding function.

5. The method of claim 4, further comprising determining, by the cloud computing device, that the input event has been received based on the input event being in a ready state in the waiting event data structure.

6. The method of claim 1, wherein the function is associated with a first tenant of the cloud computing device, and wherein the input event that is received is associated with the first tenant of the cloud computing device.

7. The method of claim 1, wherein the function is partially executed using a second input event prior to removing the data associated with the function from the execution data structure and while waiting for the input event.

8. The method of claim 7, wherein the intermediate variable is computed in response to partially executing the function.

9. An apparatus implemented as a computing device, comprising:

memory storage comprising instructions; and

one or more processors in communication with the memory storage, the one or more processors being configured to execute the instructions to;

remove data associated with a function from an execution data structure in response to determining that the function is waiting for an input event;

add a context associated with the function to a management data structure while the function is waiting for the input event, the context associated with the function comprising software components associated with the function and an intermediate variable associated with the function;

execute the function with the input event in response to receiving the input event; and

remove the context associated with the function from the management data structure in response to receiving the input event.

10. The apparatus of claim 9, wherein the software components associated with the function comprise pointers to the software components.

11. The apparatus of claim 9, wherein the execution data structure comprises an entry for the function, an entry for the input event, and an entry for the output event.

12. The apparatus of claim 9, wherein the execution data structure is a stack.

13. The apparatus of claim 9, wherein the one or more processors are further configured to execute the instructions to execute one or more other functions in the execution data structure while the function is waiting for the input event, the execution data structure comprising layers, each layer corresponding to a different one of the other functions.

14. The apparatus of claim 9, wherein the management data structure comprises contexts for a plurality of different functions that are each respectively waiting for an input event.

15. The apparatus of claim 9, wherein the one or more processors are further configured to execute the instructions to store a waiting event data structure that maintains a plurality of input events that are each respectively waiting to be received by a corresponding function.

16. A non-transitory computer readable medium configured to store a computer program product comprising computer executable instructions that when executed by a processor cause the processor to:

remove data associated with a function from an execution data structure in response to determining that the function is waiting for an input event;

add a context associated with the function to a management data structure while the function is waiting for the input event, the context associated with the function comprising software components associated with the function and an intermediate variable associated with the function;

execute the function with the input event in response to receiving the input event; and

remove the context associated with the function from the management data structure in response to receiving the input event.

17. The non-transitory computer readable medium of claim 16, wherein the computer executable instructions that when executed by the processor further cause the processor to add the data associated with the function back onto the execution data structure before executing the function with the input event.

18. The non-transitory computer readable medium of claim 16, wherein the function is partially processed using a second input event prior to removing the data associated with the function from the execution data structure and while waiting for the input event.

19. The non-transitory computer readable medium of claim 16, wherein the execution data structure comprises an entry for the function, an entry for the input event, and an entry for the output event.

20. The non-transitory computer readable medium of claim 16, wherein the computer executable instructions that when executed by the processor further cause the processor to store a waiting event data structure that maintains a plurality of input events that are each respectively waiting to be received by a corresponding function.