Persisting state of a streaming application

• US 10,326,806 B1
• Filed: 07/19/2016
• Issued: 06/18/2019
• Est. Priority Date: 07/19/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Toksoz, Tuna, Price, Thomas Graham
• Primary Examiner(s): Keehn, Richard G
• Application Number:
  US15/213,994
• Time in Patent Office: 1,064 Days
• CPC Class Codes: H04L 65/40 Support for services or applications
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/53 using third party service providers

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for persisting state of a streaming application are disclosed. In one aspect, a method includes the actions of receiving data indicating interaction with third-party content that is displayed with first-party content at a client device. The interaction with the third-party content initiates an application request for a streaming version of an application (“streaming application”). The actions further include generating a representation of the streaming application in response to the interaction with the third-party content at the client device. The actions further include receiving data indicating a user interaction with the representation of the streaming application at the client device. The actions further include generating and storing data indicating a first state of the streaming application at a first time based on the user interaction with the representation of the streaming application.

Claims

1. A computer-implemented method comprising:

receiving, by a controller of a cloud server system, data indicating interaction with third-party content that is displayed with first-party content at a first user device;

in response to the interaction with the third-party content at the first user device, initiating, by the controller of the cloud server system, an application request for a streaming version of an application (“

streaming application”

);

in response to the request for the streaming application;

executing, by a virtual machine of the cloud server system, the streaming application, and

generating, by the virtual machine of the cloud server system, a graphical representation of the streaming application;

providing, by the virtual machine of the cloud server system and to the first user device, the graphical representation of the streaming application and instructions to display the graphical representation of the streaming application on a display of the first user device;

receiving, from the first user device and by the virtual machine of the cloud server system, data indicating a user interaction with the representation of the streaming application at the first user device;

determining, by the virtual machine of the cloud server system, that the user interaction changed a state of the streaming application being executed by the virtual machine of the cloud server system;

based on determining that the user interaction changed the state of the streaming application, generating and storing, by the controller of the cloud server system, data indicating the changed state of the streaming application;

after storing the data indicating the changed state of the streaming application, receiving, from a second user device that is locally executing a locally-installed version of the application (“

installed application”

) and by the controller of the cloud server system, a request for a current state of the streaming application; and

in response to the request for the current state of the streaming application, updating, by the controller of the cloud server system, a state of the installed application to match the first changed state of the streaming application by providing, to the second user device, (i) state data specifying the changed state of the streaming application and (ii) instructions to update the state of the installed application being locally executed by the second user device to match the changed state of the streaming application.

2. The method of claim 1, wherein the display of the first user device is updated to present the graphical representation of the streaming application without installing the application on the first user device.

3. The method of claim 1, wherein generating and storing data indicating the changed state of the streaming application comprises:

receiving data identifying the first user device,

wherein the data indicating the changed state of the streaming application identifies the first user device.

4. The method of claim 1, wherein generating and storing data indicating the changed state of the streaming application comprises:

receiving data identifying a user of the first user device,

wherein the data indicating the changed state of the streaming application identifies the user of the first user device.

5. The method of claim 1, comprising:

receiving, by the controller of the cloud server system, additional data indicating interaction with additional third-party content that is displayed with additional first-party content at the first user device;

in response to the interaction with the additional third-party content at the first user device, initiating, by the controller of the cloud server system, an additional application request for a streaming version of an additional application (“

additional streaming application”

);

in response to the additional request for the additional streaming application;

executing, by the virtual machine of the cloud server system, the additional streaming application, and

generating, by the virtual machine of the cloud server system, a graphical representation of the additional streaming application;

providing, by the virtual machine of the cloud server system and to the first user device, the graphical representation of the additional streaming application and additional instructions to display the graphical representation of the additional streaming application on the display of the first user device;

receiving, from the first user device and by the virtual machine of the cloud server system, data indicating a user interaction with the representation of the additional streaming application at the first user device;

determining, by the virtual machine of the cloud server system, that the user interaction changed a state of the additional streaming application;

based on determining that the user interaction changed the state of the additional streaming application, generating and storing, by the controller of the cloud server system, data indicating the changed state of the additional streaming application; and

after a particular period of time has elapsed after storing the data indicating the changed state of the additional streaming application, deleting the data indicating the changed state of the additional streaming application.

6. The method of claim 1, comprising:

generating data for requesting permission from a user of the first user device to generate and store the changed state of the streaming application; and

receiving, from the user, data indicating permission to generate and store the changed state of the streaming application,

wherein the data indicating the changed state of the streaming application is generated and stored based on receiving the data indicating permission to generate and store the changed state of the streaming application.

7. The method of claim 1, wherein the data indicating the changed state of the streaming application is serialized data.

8. The method of claim 1, comprising:

in response to receiving the data indicating interaction with the third-party content, generating data for prompting a user of the first user device to either install or stream the application; and

receiving, from the user, data indicating a request to stream the application,

wherein the virtual machine executes the streaming application and generates the graphical representation of the streaming application based on receiving the data indicating the request to stream the application.

9. The method of claim 1, comprising:

authenticating the state request for the current state of the streaming application,

wherein the state data specifying the changed state of the streaming application is provided to the second user device based on authenticating the state request for the current state of the streaming application.

10. The method of claim 1, comprising:

determining an availability of the state data for the streaming application,

wherein the state data specifying the changed state of the streaming application is provided to the second user device based on determining the availability of the state data for the streaming application.

11. A system comprising:

a controller that is configured to;

receive data indicating interaction with third-party content that is displayed with first-party content at a first user device; and

in response to the interaction with the third-party content at the first user device, initiate an application request for a streaming version of an application (“

streaming application”

);

a virtual machine that is configured to;

in response to the request for the streaming application;

execute the streaming application, and

generate a graphical representation of the streaming application;

provide, to the first user device the graphical representation of the streaming application and instructions to display the graphical representation of the streaming application on a display of the first user device;

receive, from the first user device, data indicating a user interaction with the representation of the streaming application at the first user device;

determine that the user interaction changed a state of the streaming application being executed by the virtual machine of the cloud server system; and

a data storage device that is configured to store state data;

wherein the controller is further configured to;

generate data indicating the changed state of the streaming application;

store, in the data storage device, the data indicating the changed state of the streaming application;

after storing the data indicating the changed state of the streaming application, receive, from a second user device that is locally executing a locally-installed version of the application (“

installed application”

), a request for a current state of the streaming application; and

in response to the request for the current state of the streaming application, update a state of the installed application to match the changed state of the streaming application by providing, to the second user device, (i) state data specifying the changed state of the streaming application and (ii) instructions to update the state of the installed application being locally executed by the second user device to match the changed state of the streaming application.

12. The system of claim 11, wherein the display of the first user device is updated to present the graphical representation of the streaming application without installing the application on the first user device.

13. The system of claim 11, wherein generating and storing data indicating the changed state of the streaming application comprises:

receiving data identifying the first user device,

wherein the data indicating the changed state of the streaming application identifies the first user device.

14. The system of claim 11, wherein generating and storing data indicating the changed state of the streaming application comprises:

receiving data identifying a user of the first user device,

wherein the data indicating the changed state of the streaming application identifies the user of the first user device.

15. The system of claim 11, wherein:

the controller is further configured to;

receive additional data indicating interaction with additional third-party content that is displayed with additional first-party content at the first user device; and

in response to the interaction with the additional third-party content at the first user device, initiate an additional application request for a streaming version of an additional application (“

additional streaming application”

);

the virtual machine is further configured to;

in response to the additional request for the additional streaming application,

execute the additional streaming application, and

generate a graphical representation of the additional streaming application in response;

provide, to the first user device, the graphical representation of the additional streaming application and additional instructions to display the graphical representation of the additional streaming application on the display of the first user device;

receive, from the first user device, data indicating a user interaction with the representation of the additional streaming application at the first user device;

determine that the user interaction changed a state of the additional streaming application; and

the controller is further configured to;

based on determining that the user interaction changed the state of the additional streaming application, generate and store data indicating the changed state of the additional streaming application; and

after a particular period of time has elapsed after storing the data indicating the changed state of the additional streaming application, delete the data indicating the changed state of the additional streaming application.

16. The system of claim 11, wherein the controller is further configured to:

generate data for requesting permission from a user of the first user device to generate and store the changed state of the streaming application; and

receive, from the user, data indicating permission to generate and store the changed state of the streaming application,

wherein the data indicating the changed state of the streaming application is generated and stored based on receiving the data indicating permission to generate and store the changed state of the streaming application.

17. The system of claim 11, wherein the controller is further configured to:

in response to receiving the data indicating interaction with the third-party content, generate data for prompting a user of the first user device to either install or stream the application; and

receive, from the user, data indicating a request to stream the application,

wherein the virtual machine executes the streaming application and generates the graphical representation of the streaming application based on receiving the data indicating the request to stream the application.

18. The system of claim 11, wherein the controller is further configured to:

authenticate the state request for the current state of the streaming application,

wherein the state data specifying the changed state of the streaming application is provided to the second user device based on authenticating the request for the current state of the streaming application.

19. The system of claim 11, wherein the controller is further configured to:

determine an availability of the state data for the streaming application,

wherein the state data specifying the changed state of the streaming application is provided to the second user device based on determining the availability of the state data for the streaming application.

20. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving, by a controller of a cloud server system, data indicating interaction with third-party content that is displayed with first-party content at a first user device;

in response to the interaction with the third-party content at the first user device, initiating, by the controller of the cloud server system, an application request for a streaming version of an application (“

streaming application”

);

in response to the request for the streaming application;

executing, by a virtual machine of the cloud server system, the streaming application, and

generating, by the virtual machine of the cloud server system, a graphical representation of the streaming application;

providing, by the virtual machine of the cloud server system and to the first user device, the graphical representation of the streaming application and instructions to display the graphical representation of the streaming application on a display of the first user device;

receiving, from the first user device and by the virtual machine of the cloud server system, data indicating a user interaction with the representation of the streaming application at the first user device;

determining, by the virtual machine of the cloud server system, that the user interaction changed a state of the streaming application being executed by the virtual machine of the cloud server system;

based on determining that the user interaction changed the state of the streaming application, generating and storing, by the controller of the cloud server system, data indicating the changed state of the streaming application;

after storing the data indicating the changed state of the streaming application, receiving, from a second user device that is locally executing a locally-installed version of the application (“

installed application”

) and by the controller of the cloud server system, a request for a current state of the streaming application; and

in response to the request for the current state of the streaming application, updating, by the controller of the cloud server system, a state of the installed application to match the changed state of the streaming application by providing, to the second user device, (i) state data specifying the changed state of the streaming application and (ii) instructions to update the state of the installed application being locally executed by the second user device to match the changed state of the streaming application.