Client-side rendering for virtual mobile infrastructure

• US 9,654,603 B1
• Filed: 11/20/2015
• Issued: 05/16/2017
• Est. Priority Date: 05/21/2013
• Status: Active Grant

• Current Assignee: Trend Micro Inc.
• Original Assignee: Trend Micro Inc.
• Inventors: Dong, Kan, Xu, Yaozhou, Chen, Gen
• Primary Examiner(s): Boutah, Alina N
• Application Number:
  US14/947,426
• Time in Patent Office: 543 Days
• Field of Search: 345418, 345522, 715740, 709203
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

A virtual mobile infrastructure performs client-side rendering by intercepting and redirecting screen data for generating a screen image of a remote mobile operating system from a server computer to a mobile client device. The mobile client device receives the screen data and generates the final screen image of the remote mobile operating system. The screen data include drawing application programming interface (API) calls to generate surfaces for applications running on the remote mobile operating system and data for compositing the surfaces together. The mobile client device makes the drawing API calls to generate the surfaces and generates the final screen image of the remote mobile operating system by compositing the surfaces in accordance with the compositing data.

Claims

1. A system comprising:

a server computer that hosts a plurality of remote mobile operating systems, communicates with a mobile client device over a computer network, connects the mobile client device to access a remote mobile application running on a remote mobile operating system in the plurality of remote mobile operating systems, and generates screen data for generating a screen Image for the remote mobile application; and

a mobile client device that runs a local mobile operating system, accesses the remote mobile application over the computer network, receives the screen data over the computer network, processes the screen data to generate the screen image, and displays the screen image on the mobile client device, wherein the mobile client device generates the screen image by generating surfaces and compositing the surfaces in accordance with the screen data.

2. The system of claim 1, wherein the server computer redirects drawing application programming interface (API) calls to the mobile client device, and the mobile client device makes the drawing API calls in the mobile client device to generate the surfaces.

3. The system of claim, 2 wherein the server computer redirects compositing data to the mobile client device, and the mobile client device generates the screen image by compositing the surfaces in accordance with the compositing data.

4. The system of claim 1, wherein the mobile client device comprises a smartphone.

5. The system of claim 1, wherein the mobile client device comprises a tablet.

6. The system of claim 1, wherein the local mobile operating system of the mobile client device has a system layer that has a Dalvik process virtual machine.

7. A computer-implemented method comprising:

making application programming interface (API) calls for generating a plurality of surfaces for a plurality of applications that are running on an application layer of a remote mobile operating system, the remote mobile operating system running on a server computer;

generating compositing data for compositing the plurality of surfaces to generate a final screen image of the remote mobile operating system;

providing the API calls and the compositing data from the server computer to a mobile client device over a computer network, the mobile client device running a local mobile operating system;

making the API calls in the mobile client device to generate the plurality of surfaces of the plurality of applications in the mobile client device; and

compositing the plurality of surfaces to generate the final screen image of the remote mobile operating system in the mobile client device in accordance with the compositing data.

8. The computer-implemented method of claim 7, wherein the mobile client device comprises a smartphone.

9. The computer-implemented of claim 7, wherein the mobile client device comprises a tablet.

10. The computer-implemented method of claim 7, wherein the local mobile operating system has a system layer with a Dalvik process virtual machine.

11. A computer-implemented method comprising:

a mobile client device accessing over a computer network a remote mobile application that is running on one of a plurality of remote mobile operating systems hosted by a server computer;

the mobile client device receiving over the computer network screen data for generating a screen image for the remote mobile application, wherein the screen data 15 comprise a plurality of drawing calls made by the remote mobile application and the mobile client device makes the drawing calls to a local graphics engine in the mobile client device to locally generate the screen image in the mobile client device;

the mobile client device processing the screen data to generate the screen image in the mobile client device; and

displaying the screen image on the mobile client device.

12. The computer-implemented method of claim 11, wherein the screen image comprises a final screen image of a remote mobile operating system in the plurality of remote mobile operating systems hosted by the server computer.

13. The computer-implemented method of claim 11, further comprising:

intercepting drawing calls made by the remote mobile application;

the server computer providing the drawing calls to the mobile client device over the computer network; and

the mobile client device generating the screen image by making the drawing calls in the mobile client device.