Fragment-based mobile device application streaming utilizing crowd-sourcing

• US 10,814,229 B2
• Filed: 07/19/2017
• Issued: 10/27/2020
• Est. Priority Date: 10/02/2012
• Status: Active Grant

• Current Assignee: Razer (Asia-Pacific) Pte. Ltd. (Razer Incorporated)
• Original Assignee: Razer (Asia-Pacific) Pte. Ltd. (Razer Incorporated)
• Inventors: Quan, Justin, Chan, Michael A.
• Primary Examiner(s): Obeid, Fahd A
• Assistant Examiner(s): Moore, Reva R
• Application Number:
  US15/653,701
• Publication Number:
  US 20170312630A1
• Time in Patent Office: 1,196 Days
• Field of Search: 705 34, 707703, 709223
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/34 using peer-to-peer connections
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/60 Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• CPC Class Codes: A63F 13/61 using advertising information
• CPC Class Codes: A63F 13/77 involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: G06F 2209/5017 Task decomposition
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355

Abstract

Some examples include decomposing an application into fragments and streaming the application in fragments. For instance, a plurality of application fragments may include a first application fragment and a second application fragment that each correspond to a portion of a mobile game application. When streaming the first application fragment to the mobile device, a system may determine that the second application fragment follows the first application fragment based on a fragments relationship data structure. The fragments relationship data structure may associate the first application fragment with the second application fragment based on an analysis of the fragment information that indicates that the second application fragment follows the first application fragment during operation of the mobile game application. The system may stream the second application fragment to the mobile device based on the determination that the second application fragment follows the first application fragment.

Claims

1. A server comprising:

a processor;

a network component, coupled to the processor, through which to communicate over a network with remote devices; and

a storage device coupled to the processor, the storage device storing instructions which, when executed by the processor, cause the server to perform operations including;

sending one or more messages to cause execution of a crowd sourced compute task at a plurality of computing devices, the crowd sourced compute task including execution of a plurality of computer simulations at the plurality of computing devices that includes running a mobile game application on respective mobile device emulators that simulate the mobile game application running on an environment of a selected mobile device to determine application fragments of the mobile gaming application;

collecting fragment information associated with a plurality of the application fragments determined as a result of the crowd sourced compute task, the plurality of application fragments including a first application fragment and a second application fragment, wherein each application fragment of the plurality of application fragments corresponds to a portion of the mobile game application;

storing the fragment information at the storage device;

receiving, from a mobile device, an indication to stream the first application fragment;

streaming, via the network component, the first application fragment to the mobile device in response to the indication to stream the first application fragment;

determining that the second application fragment follows the first application fragment based on a fragments relationship data structure, the fragments relationship data structure associating the first application fragment with the second application fragment, based on an analysis of the fragment information that indicates that the second application fragment follows the first application fragment during operation of the mobile game application; and

streaming, via the network component, the second application fragment to the mobile device based on the determination that the second application fragment follows the first application fragment.

2. The server of claim 1, wherein the first application fragment corresponds to a first user interface that corresponds to displaying a first level of the mobile game application, wherein the second application fragment corresponds to a second user interface that corresponds to displaying a second level of the mobile game application, and wherein the second application fragment follows the first application fragment in response to a transition from the first level of the mobile game application to the second level of the mobile game application.

3. The server of claim 1, wherein the first application fragment corresponds to a first scene in the mobile game application, wherein the second application fragment corresponds to a second scene in the mobile game application, and wherein the second application fragment follows the first application fragment in response to a transition from the first scene to the second scene.

4. The server of claim 1, wherein the first application fragment is determined based on an analysis of a first user interface by running the mobile game application on the mobile device emulator that simulates the mobile game application running on the environment of the selected mobile device, to determine resources for displaying the first user interface on the selected mobile device.

5. A method comprising:

in response to an indication to initiate a crowd sourced compute task, sending one or more messages to initiate execution of the crowd sourced compute task at a plurality of computing devices, the crowd sourced compute task including execution of a plurality of computer simulations at the plurality of computing devices that includes running a mobile entertainment application on respective mobile device emulators that simulate the mobile entertainment application running on an environment of a selected mobile device to determine a plurality of application fragments of the mobile entertainment application, including a first application fragment and a second application fragment, wherein each application fragment of the plurality of application fragments corresponds to a portion of the mobile entertainment application;

receiving fragment information associated with the plurality of application fragments;

storing the fragment information at a storage device;

determining that the second application fragment follows the first application fragment based on a fragments relationship data structure, the fragments relationship data structure associating the first application fragment with the second application fragment based on an analysis of the fragment information that indicates that the second application fragment follows the first application fragment during operation of the mobile game application;

receiving, from a mobile device, an indication to stream the first application fragment;

in response to the indication to stream the first application fragment, streaming, via a network component, the first application fragment to the mobile device for execution by the mobile device;

receiving, from the mobile device, an indication that the execution of the first application fragment is to transition to another application fragment; and

streaming, via the network component, the second application fragment to the mobile device based on an analysis of the fragment information that indicates that the second application fragment follows the first application fragment during operation of the mobile game application.

6. The method of claim 5, wherein the storage device is provided as part of a cloud storage service.

7. The method of claim 5, further comprising:

receiving, from the mobile device, resource information indicating that the mobile device has adequate resources to accommodate the second fragment.

8. The method of claim 5, wherein the plurality of application fragments include multiple versions.

9. The method of claim 8, wherein the multiple versions include an Android environment version and an iOS environment version.

10. A non-transitory computer-readable medium storing computer executable code, comprising instructions for:

sending one or more messages to cause execution of a crowd sourced compute task at a plurality of computing devices, the crowd sourced compute task including execution of a plurality of computer simulations at the plurality of computing devices that includes running a mobile game application on respective mobile device emulators that simulate the mobile game application running on an environment of a selected mobile device to determine application fragments of the mobile gaming application;

collecting fragment information associated with a plurality of the application fragments determined as a result of the crowd sourced compute task, the plurality of application fragments including a first application fragment and a second application fragment, wherein each application fragment of the plurality of application fragments corresponds to a portion of the mobile game application;

storing the fragment information at a storage device;

receiving, from a mobile device, an indication to stream the first application fragment;

streaming the first application fragment to the mobile device in response to the indication to stream the first application fragment;

determining that the second application fragment follows the first application fragment based on a fragments relationship data structure, the fragments relationship data structure associating the first application fragment with the second application fragment, based on an analysis of the fragment information that indicates that the second application fragment follows the first application fragment during operation of the mobile game application; and

streaming the second application fragment to the mobile device based on the determination that the second application fragment follows the first application fragment.

11. The non-transitory computer-readable medium of claim 10, wherein the first application fragment corresponds to a first user interface that corresponds to displaying a first level of the mobile game application, wherein the second application fragment corresponds to a second user interface that corresponds to displaying a second level of the mobile game application, and wherein the second application fragment follows the first application fragment in response to a transition from the first level of the mobile game application to the second level of the mobile game application.

12. The non-transitory computer-readable medium of claim 10, wherein the first application fragment corresponds to a first scene in the mobile game application, wherein the second application fragment corresponds to a second scene in the mobile game application, and wherein the second application fragment follows the first application fragment in response to a transition from the first scene to the second scene.

13. The non-transitory computer-readable medium of claim 10, wherein the first application fragment is determined based on an analysis of a first user interface by running the mobile game application on the mobile device emulator that simulates the mobile game application running on the environment of the selected mobile device, to determine resources for displaying the first user interface on the selected mobile device.