Remote execution of applications over a dispersed network

• US 9,954,718 B1
• Filed: 01/11/2012
• Issued: 04/24/2018
• Est. Priority Date: 01/11/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Qin, Xiaochuan, Moura, Alexandre P., Evans, Ethan Z., Bone, Ian M., Baptiste, Eden Jn, Krog, Richard D., Chang, Kerry, Adoc, Jr., Mario Vargas, Zhou, Jun
• Primary Examiner(s): Vu, Viet D
• Assistant Examiner(s): Edwards, James A
• Application Number:
  US13/348,052
• Time in Patent Office: 2,295 Days
• Field of Search: 709203, 709201, 709202
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: H04L 65/40 Support for services or applications
• CPC Class Codes: H04L 67/148 Migration or transfer of sessions
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display

Abstract

Disclosed are various embodiments of a server application that facilitates selecting a computing device in which to host execution of an application. The selected application host provides application output to a client, and the client provides application input to the application host. In some embodiments, the application server may be a communications proxy between the client and a remote application host.

Claims

1. A non-transitory computer-readable medium comprising a program having instructions that, when executed, cause at least one computing device to:

obtain a request to launch an application from a client over a network;

identify a plurality of candidate application hosts;

select an application host from the plurality of candidate application hosts;

transmit a first message to the application host, wherein the first message comprises an instruction directing the application host to initiate execution of the application;

obtain a media stream from a wrapper for the application that is installed on the application host and emulates an output device for the application host, wherein the media stream comprises an audio stream and a video stream;

forward the media stream from the application host to the client;

obtain a plurality of input commands from the client over the network, wherein a portion of the plurality of input commands comprise metadata indicating a temporal position of the video stream with which the ones of the plurality of input commands are associated;

forward the plurality of input commands to the application host;

obtain state data from the application host, wherein the state data comprises data corresponding to a state of the execution of the application;

monitor a plurality of performance characteristics associated with the execution of the application;

identify a plurality of successive application hosts, wherein the plurality of performance characteristics of individual ones of the plurality of successive application hosts exceed the performance characteristics of the application host;

select one of the plurality of successive application hosts; and

transmit a second message to the one of the plurality of successive application hosts, wherein the second message comprises a portion of the state data and a second instruction directing the one of the plurality of successive application hosts to initiate a successive execution of the application based at least in part on at least the portion of the state data.

2. The non-transitory computer-readable medium of claim 1, wherein the application corresponds to a game selected from a library of games.

3. The non-transitory computer-readable medium of claim 1, wherein the first message further comprises the state data, wherein the state data was saved from a previous use of the application by the client.

4. A system, comprising:

at least one computing device comprising a hardware processor and a memory; and

an application comprising machine readable instructions stored in the memory that, when executed by the hardware processor of the at least one computing device, causes the at least one computing device to at least;

select an application host from a plurality of candidate application hosts;

transmit a first message to the application host, wherein the first message comprises a first instruction directing the application host to initiate execution of an application and forward a media stream associated with the execution of the application to a client via a network, the media stream having been generated by a wrapper of the application installed on the application host that emulates an output device of the application host;

transmit a second message to the client, wherein the second message comprises a second instruction directing the client to establish communications with the application host over the network, wherein the communications include a plurality of input commands generated by the client, wherein a portion of the plurality of input commands comprise metadata indicating a temporal position of the media stream with which the ones of the plurality of input commands are associated;

obtain state data from the application host, wherein the state data comprises data corresponding to a state of the execution of the application;

monitor a plurality of performance characteristics associated with an interactive execution of the application in the application host by the client;

select one of a plurality of successive application hosts, wherein the plurality of performance characteristics of individual ones of the plurality of successive application hosts exceed the plurality of performance characteristics of the application host; and

transmit a third message to the application host, wherein the third message comprises a portion of the state data and a third instruction directing the one of the plurality of successive application hosts to initiate a successive execution of the application based at least in part on at least the portion of the state data.

5. The system of claim 4, wherein the application corresponds to a game selected from a library of games.

6. The system of claim 4, wherein the second message further comprises authentication data, wherein the client is configured to use the authentication data to authenticate with the application host.

7. The system of claim 5, wherein the state data further comprise at least one of a plurality of predefined save points in the game.

8. The system of claim 4, wherein the state data further comprises at least one memory image of the application.

9. The system of claim 4, wherein at least one of the plurality of performance characteristics further comprise at least one of a measure of graphics processor utilization or a measure of network bandwidth.

10. The system of claim 4, wherein the application further comprises machine readable instructions stored in the memory that, when executed by the hardware processor, further cause the at least one computing device to at least transmit a fourth message to the client, wherein the fourth message comprises a fourth instruction directing the client to establish communications with the one of the plurality of successive application hosts over the network.

11. A method, comprising:

selecting, in at least one computing device, an application host from a plurality of candidate application hosts;

transmitting, in the at least one computing device, at least one message to the application host, wherein the at least one message comprises an instruction directing the application host to initiate execution of an application;

obtaining over a network, in the at least one computing device, a video stream generated by a wrapper of the application installed on the application host that emulates an output device of the application host;

obtaining, in the at least one computing device, a plurality of input commands from a client over the network, wherein a portion of the plurality of input commands comprise metadata indicating a temporal position of the video stream with which individual ones of the plurality of input commands are associated;

obtaining, in the at least one computing device, state data from the application host, wherein the state data comprises data corresponding to a state of execution of the application;

monitoring, in the at least one computing device, a plurality of performance characteristics associated with the execution of the application in the application host; and

selecting, in the at least one computing device, a successive application host from a plurality of candidate successive application hosts, wherein the plurality of performance characteristics of individual ones of the plurality of candidate successive application hosts exceed the performance characteristics of the application host.

12. The method of claim 11, wherein the application corresponds to a game selected from a library of games.

13. The method of claim 11, wherein the plurality of input commands are generated by at least a game controller.

14. The method of claim 11, wherein the plurality of input commands further comprise a timestamp associated with generation of individual ones of the plurality of input commands.

15. The method of claim 11, further comprising:

forwarding, in the at least one computing device, the video stream to the client via the network; and

forwarding, in the at least one computing device, the plurality of input commands to the application host via the network.

16. The method of claim 11, wherein selecting the application host is further based at least in part on a geographical proximity to the client.

17. The method of claim 11, wherein the state data further comprises at least one memory image of the application.

18. The method of claim 11, wherein at least one of the plurality of performance characteristics further comprises a measure of graphics processor utilization or a measure of network bandwidth.

19. The method of claim 11, further comprising transmitting, in the at least one computing device, a switch message to the successive application host, wherein the switch message comprises a portion of the state data and a switch instruction directing the successive application host to initiate the execution of the application based at least in part on at least the state data.