Watermarking and scalability techniques for a virtual desktop planning tool

• US 10,453,161 B2
• Filed: 09/26/2016
• Issued: 10/22/2019
• Est. Priority Date: 12/18/2008
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Agrawal, Banit, Bidarkar, Rishi N., Satnur, Sunil, Makhija, Vikram
• Primary Examiner(s): Jean, Frantz B
• Application Number:
  US15/276,525
• Publication Number:
  US 20170011486A1
• Time in Patent Office: 1,121 Days
• Field of Search: 709203
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2201/005 Image watermarking

Abstract

A method for measuring performance of virtual desktop services offered by a server including a processor is described. A first encoded watermark is embedded into user interface display generated by a virtual desktop when initiating an operation. The first encoded watermark includes pixels identifying the operation and indicating its initiation. A second encoded watermark is embedded into the user interface upon completion of the operation indicating completion of the operation. An action performance time is then computed and stored in a memory. Multiple performance times may be compiled from multiple operations of multiple virtual desktops to assess the performance of the system as a whole.

Claims

1. A method comprising:

receiving a user initiated action from a remote desktop provided on a client computer, wherein the remote desktop provides a display for a corresponding virtual machine, and wherein the action provides input to the virtual machine through the remote desktop;

in response to receiving the user action, encoding a first watermark into image data of a first updated display that is communicated to the client when initiating an operation of an application running on the virtual machine based on the received action, wherein the first watermark includes an identifier of the first watermark and an event code at a location indicative of a start time of the operation;

providing the updated display to the client for presentation in the remote desktop; and

receiving data based on detection of the first watermark and a subsequent watermark by the client computer, wherein the data is indicative of a performance time of the operation.

2. The method of claim 1, comprising:

completing the operation; and

in response to completing the operation, encoding a second watermark into image data of a second updated display that is communicated to the client, wherein the second watermark is includes an identifier of the second watermark and the event code at a location indicative of an end of the operation.

3. The method of claim 2, wherein the event code is positioned at a start location in the first watermark and wherein the event code is positioned at a different end location of the second watermark.

4. The method of claim 2, further comprising:

determining a screen resolution for the remote desktop on the client computer; and

determining a location for the first watermark and the second watermark based on the determined screen resolution.

5. The method of claim 1, wherein the event code identifies the operation and a sub-operation.

6. The method of claim 5, wherein the operation identifies a specific application and the sub-operation identifies a particular sub-operation for the specific application.

7. The method of claim 1, wherein the received data includes timestamps corresponding to detection of each watermark by the client computer.

8. The method of claim 1, wherein the identifier and the event code are each encoded with respective pixels.

9. The method of claim 1, further comprising:

generating statistical performance metrics based at least in part on the received data.

10. The method of claim 1, wherein first watermark is encoded in a particular location of the remote desktop that does not interfere with applications or other functionality of the remote desktop.

11. The method of claim 1, wherein the operation is associated with a particular application executed by the virtual machine.

12. A system comprising:

one or more computers configured to perform operations comprising;

receiving a user initiated action from a remote desktop provided on a client computer, wherein the remote desktop provides a display for a corresponding virtual machine, and wherein the action provides input to the virtual machine through the remote desktop;

in response to receiving the user action, encoding a first watermark into image data of a first updated display that is communicated to the client when initiating an operation of an application running on the virtual machine based on the received action, wherein the first watermark includes an identifier of the first watermark and an event code at a location indicative of a start time of the operation;

providing the updated display to the client for presentation in the remote desktop; and

receiving data based on detection of the first watermark and a subsequent watermark by the client computer, wherein the data is indicative of a performance time of the operation.

13. The system of claim 12, wherein the one or more computers are further configured to perform operations comprising:

completing the operation; and

in response to completing the operation, encoding a second watermark into image data of a second updated display that is communicated to the client, wherein the second watermark is includes an identifier of the second watermark and the event code at a location indicative of an end of the operation.

14. The system of claim 13, wherein the event code is positioned at a start location in the first watermark and wherein the event code is positioned at a different end location of the second watermark.

15. The system of claim 13, wherein the one or more computers are further configured to perform operations comprising:

determining a screen resolution for the remote desktop on the client computer; and

determining a location for the first watermark and the second watermark based on the determined screen resolution.

16. The system of claim 12, wherein the event code identifies the operation and a sub-operation.

17. The system of claim 16, wherein the operation identifies a specific application and the sub-operation identifies a particular sub-operation for the specific application.

18. The system of claim 12, wherein the received data includes timestamps corresponding to detection of each watermark by the client computer.

19. The system of claim 12, wherein first watermark is encoded in a particular location of the remote desktop that does not interfere with applications or other functionality of the remote desktop.

20. A non-transitory computer readable medium including computer code that when executed performs operations comprising:

receiving a user initiated action from a remote desktop provided on a client computer, wherein the remote desktop provides a display for a corresponding virtual machine, and wherein the action provides input to the virtual machine through the remote desktop;

in response to receiving the user action, encoding a first watermark into image data of a first updated display that is communicated to the client when initiating an operation of an application running on the virtual machine based on the received action, wherein the first watermark includes an identifier of the first watermark and an event code at a location indicative of a start time of the operation;

providing the updated display to the client for presentation in the remote desktop; and

receiving data based on detection of the first watermark and a subsequent watermark by the client computer, wherein the data is indicative of a performance time of the operation.