Session idle optimization for streaming server

• US 10,347,013 B2
• Filed: 07/31/2017
• Issued: 07/09/2019
• Est. Priority Date: 11/11/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Taraki, Quais, Vahlsing, Matthew, Mamtani, Vinod Murli, Morris, James Jonathan, Heinz, II, Gerard Joseph
• Primary Examiner(s): Chen, Yu
• Application Number:
  US15/664,203
• Publication Number:
  US 20170330352A1
• Time in Patent Office: 708 Days
• Field of Search: None
• CPC Class Codes: G06F 1/3209 Monitoring remote activity, e.g. over telephone lines or network connections
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77

Abstract

Graphics rendering services may be provided to a client device by a remote computing facility. One or more rendering processes may be executed on a virtual machine operating on a host computing device. Client state information may be monitored to detect periods of inactivity. A rendering process may be inactivated by suspending the virtual machine on which it executes. Upon resumption of activity, the rendering process may be reactivated by resuming execution of the virtual machine.

Claims

1. A system comprising:

one or more processors; and

one or more memories to store a set of instructions, which if executed by the one or more processors, causes the one or more processors to perform operations comprising;

performing, by a rendering process operating on a virtual machine, graphics rendering services for one or more clients;

receiving a first request for the graphics rendering services from the one or more clients by a monitoring component at a first time;

performing a first determination that no subsequent request for the graphics rendering services is received from the one or more clients by the monitoring component within a first threshold amount of time since the first time;

performing a second determination that a number of active rendering processes on the virtual machine has fallen below a threshold number of active rendering processes that is greater than one;

transferring one or more of the active rendering processes on the virtual machine to one or more other virtual machines based at least in part on the second determination;

suspending operation of the virtual machine based at least in part on the first determination and the second determination; and

resuming operation of the virtual machine based at least in part on receiving information indicative of receiving a second request for the graphics rendering services from the one or more clients.

2. The system of claim 1, wherein the operations further comprise:

storing a state of the virtual machine in a low-latency cache.

3. The system of claim 1, wherein the operations further comprise:

storing a state of the virtual machine on a storage device in response to determining that no subsequent request for the graphics rendering services is received from the one or more clients by the monitoring component within a second threshold amount of time since receiving the first request for the graphics rendering services at the first time.

4. The system of claim 1, wherein suspending the operation of the virtual machine comprises retaining a state of the virtual machine in memory.

5. The system of claim 1, wherein the operations further comprise:

receiving a request indicative of performing the graphics rendering services for the one or more clients, the one or more clients executing a process associated with a set of graphics resources; and

activate the virtual machine, wherein the virtual machine is selected for activation based at least in part on the virtual machine being configured to execute the rendering process having access to the set of graphics resources.

6. The system of claim 1, wherein the operations further comprise:

transferring a state of a rendering process from the virtual machine to another virtual machine.

7. The system of claim 1, wherein a request to keep the rendering process in an active state is based at least in part on entering a state in which no user input is expected for a period of time.

8. The system of claim 1, wherein the operations further comprise:

receiving a request indicative of performing the graphics rendering services for the one or more clients, the one or more clients executing a process associated with a set of graphics resources; and

selecting the virtual machine from a plurality of virtual machines to execute the rendering process based at least in part on content that is rendered by one or more other processes executing on the virtual machine.

9. The system of claim 1, wherein the operations further comprise:

send information indicative of a time to resume operation of the rendering process to a client of the one or more clients.

10. A method comprising:

performing, by a rendering process operating on a virtual machine, graphics rendering services for one or more clients;

receiving a first request for the graphics rendering services from the one or more clients by a monitoring component at a first time;

performing a first determination that no subsequent request for the graphics rendering services is received from the one or more clients by the monitoring component within a first threshold amount of time since the first time;

performing a second determination that a number of active rendering processes on the virtual machine has fallen below a threshold number of active rendering processes that is greater than one;

transferring one or more of the active rendering processes on the virtual machine to one or more other virtual machines based at least in part on the second determination;

suspending operation of the virtual machine based at least in part on the first determination and the second determination; and

resuming operation of the virtual machine based at least in part on receiving information indicative of receiving a second request for the graphics rendering services from the one or more clients.

11. The method of claim 10, further comprising:

storing a state of the virtual machine in a low-latency cache.

12. The method of claim 10, further comprising:

storing a state of the virtual machine on a storage device in response to.

13. The method of claim 10, wherein suspending the operation of the virtual machine comprises retaining a state of the virtual machine in memory.

14. The method of claim 10, further comprising:

transferring a state of a rendering process from the virtual machine to another virtual machine.

15. The method of claim 10, further comprising:

receiving a request indicative of performing the graphics rendering services for the one or more clients, the one or more clients executing a process associated with a set of graphics resources; and

selecting the virtual machine from a plurality of virtual machines to execute the rendering process based at least in part on content that is rendered by one or more other processes executing on the virtual machine.

16. The method of claim 10, further comprising:

send information indicative of a time to resume operation of the rendering process to a client of the one or more clients.

17. A non-transitory computer-readable medium having stored thereon a set of instructions, which if performed by one or more processors, causes the one or more processors to perform operations comprising:

performing, by a rendering process operating on a virtual machine, graphics rendering services for one or more clients;

receiving a first request for the graphics rendering services from the one or more clients by a monitoring component at a first time;

performing a first determination that no subsequent request for the graphics rendering services is received from the one or more clients by the monitoring component within a first threshold amount of time since the first time;

performing a second determination that a number of active rendering processes on the virtual machine has fallen below a threshold number of active rendering processes that is greater than one;

transferring one or more of the active rendering processes on the virtual machine to one or more other virtual machines based at least in part on the second determination;

suspending operation of the virtual machine based at least in part on the first determination and the second determination; and

resuming operation of the virtual machine based at least in part on receiving information indicative of receiving a second request for the graphics rendering services from the one or more clients.