Remote visualization and control for virtual mobile infrastructure

• US 9,569,161 B2
• Filed: 01/08/2014
• Issued: 02/14/2017
• Est. Priority Date: 03/21/2013
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Coviello, Giuseppe, Sankaradass, Murugan, Chakradhar, Srimat, Pelliccia, Valentina
• Primary Examiner(s): Bautista, Xiomar L
• Application Number:
  US14/150,741
• Publication Number:
  US 20140289637A1
• Time in Patent Office: 1,133 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally

Abstract

A method for running application software for a mobile device by virtualizing a mobile device operating system (OS); running a virtual instance of the mobile device OS with the application software on a server on the cloud; and rendering on the server and sending a display image for the mobile device screen to be displayed on the mobile device.

Claims

1. A method for running application software for a mobile device, comprising

virtualizing a mobile device operating system (OS);

running a virtual instance of the mobile device OS with the application software on a server on the cloud; and

rendering on the server and sending a display image for the mobile device screen to be displayed on the mobile device;

scanning row by row a matrix previously sent to the mobile device and comparing to an actual frame buffer and if a difference exists, sending to the mobile device the number of different rows, an array of indexes of the rows and the value of rows to update and otherwise sending an empty response to the mobile device to keep the current frame buffer contents and replying to events forwarded by the client by executing commands in a local operating system; and

when an event is captured, sending a request to the server and upon an input event, touchscreen or button, forwarding the event to the server to replicate the event on the virtual instance with a timer based event used for synchronizing the frame buffer and wherein the server responds to the timed event by communicating changed parts since the latest synchronization, and sending an empty reply to indicate the frame buffer has not changed.

2. The method of claim 1, wherein a frame-buffer is displayed on the mobile device, and the application software appears to be running locally on the mobile device.

3. The method of claim 1, comprising interacting with the displayed image by using a touch sensor.

4. The method of claim 1, comprising transmitting a touch command to the server on the cloud.

5. The method of claim 4, wherein the server in the cloud executes the touch command and re-sends a new frame-buffer to the mobile device.

6. The method of claim 1, comprising receiving an input event, touchscreen or button.

7. The method of claim 6, comprising forwarding the event to the server and handling the event on the mobile device OS instance.

8. The method of claim 1, comprising synchronizing a frame buffer with a timer based event, wherein the server responds to the timer-based event by communicating only changed data since the last synchronization.

9. A system, comprising:

a mobile device; and

a server on a cloud that runs a virtual instance of a mobile device operating system (OS) with an application software, wherein the server renders data intended for a mobile device and sending a display image for the mobile device screen for rendering on the mobile device and the server scanning row by row a matrix previously sent to the mobile device and comparing to an actual frame buffer and if a difference exists, sending to the mobile device the number of different rows, an array of indexes of the rows and the value of rows to update and otherwise sending an empty response to the mobile device to keep the current frame buffer contents and replying to the events forwarded by the client by executing the commands in the local operating system; and

when an event is captured, sending a request to the server and upon an input event, touchscreen or button, forwarding the event to the server to replicate the event on the virtual instance with a timer based event used for synchronizing the frame buffer and wherein the server responds to the timed event by communicating changed parts since the latest synchronization, and sending an empty reply to indicate the frame buffer has not changed.

10. The system of claim 9, wherein a frame-buffer is displayed on the mobile device, and the application software appears to be running locally on the mobile device.

11. The system of claim 9, comprising code for interacting with the displayed image by using a touch sensor.

12. The system of claim 9, comprising code for transmitting a touch command to the server on the cloud.

13. The system of claim 12, wherein the server in the cloud executes the touch command and re-sends a new frame-buffer to the mobile device.

14. The system of claim 9, comprising code for receiving an input event, touchscreen or button.

15. The system of claim 14, comprising code for forwarding the event to the server and handling the event on the mobile device OS instance.

16. The system of claim 9, comprising code for synchronizing a frame buffer with a timer based event, wherein the server responds to the timer-based request by communicating only changed data since the last synchronization.

17. A method for running application software for a mobile device, comprising

virtualizing a mobile device operating system (OS);

and

running the OS and a virtual instance of the mobile device with the application software on a server on the cloud; and

rendering a mobile device screen on the server and sending the mobile device screen for display on a frame-buffer of the mobile device so that a user thinks that the application is running locally on the mobile device;

scanning row by row a matrix previously sent to the mobile device and comparing to a actual frame buffer and if a difference exists, sending to the mobile device the number of different rows, an array of indexes of the rows and the value of rows to update and otherwise sending an empty response to the mobile device to keep the current frame buffer contents and replying to the events forwarded by the client by executing the commands in the local operating system; and

when an event is captured, sending a request to the server and upon an input event, touchscreen or button, forwarding the event to the server to replicate the event on the virtual instance with a timer based event used for synchronizing the frame buffer and wherein the server responds to the timed event by communicating changed parts since the latest synchronization, and sending an empty reply to indicate the frame buffer has not changed.

18. The method of claim 17, comprising transmitting a touch command to the server on the cloud.

19. The method of claim 17, wherein the server in the cloud executes the touch command and re-sends a new frame-buffer to the mobile device.

20. The method of claim 17, comprising receiving an input event, touchscreen or button and forwarding the event to the server and handling the event on the mobile device OS instance.