Watermarking and scalability techniques for a virtual desktop planning tool

• US 9,214,004 B2
• Filed: 10/13/2011
• Issued: 12/15/2015
• Est. Priority Date: 12/18/2008
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Agrawal, Banit, Satnur, Sunil, Bidarkar, Rishi N., Makhija, Vikram
• Primary Examiner(s): Jean, Frantz
• Application Number:
  US13/273,071
• Publication Number:
  US 20130097426A1
• Time in Patent Office: 1,524 Days
• Field of Search: 709/203, 709/223, 709/217, 709/219, 713/176, 382/317
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2201/005 Image watermarking

Abstract

A method for measuring performance of virtual desktop services offered by a server including a processor is described. A first encoded watermark is embedded into user interface display generated by a virtual desktop when initiating an operation. The first encoded watermark includes pixels identifying the operation and indicating its initiation. A second encoded watermark is embedded into the user interface upon completion of the operation indicating completion of the operation. An action performance time is then computed and stored in a memory. Multiple performance times may be compiled from multiple operations of multiple virtual desktops to assess the performance of the system as a whole.

Claims

1. A method for measuring performance of virtual desktop services offered by a server including a processor, the method comprising:

overlaying at the server a first encoded watermark onto a user interface display that is communicated to a client when initiating an operation, the first encoded watermark including a distinct first location, a second location, and a third location, wherein the first location, second location, and third location are defined as specific locations within the first encoded watermark, and wherein the first location includes pixels encoding an identification of the first encoded watermark and the second location includes pixels encoding a first identification value corresponding to an application executing on the virtual desktop and a start time of an operation within the application;

overlaying at the server a second encoded watermark onto the user interface display upon completion of the operation, the second encoded watermark including the first location, the second location, and the third location, wherein the first location includes pixels encoding an identification of the second encoded watermark and the third location includes pixels encoding a second identification value corresponding to an end time of the operation for the application; and

storing in memory an operation performance time, the operation performance time being a time difference between detection at the client of the first encoded watermark and detection at the client of the second encoded watermark.

2. The method of claim 1, wherein:

the second location of the first encoded watermark further includes a first operation identifier and a first sub-operation identifier for the application; and

the third location of the second encoded watermark further includes a second operation identifier and a second sub-operation identifier for the application.

3. The method of claim 1, wherein the first encoded watermark and the second encoded watermark are defined in a region of the virtual desktop that is constantly displayed in the virtual desktop.

4. The method of claim 1, further comprising:

determining a screen resolution of the client;

determining a location of the first and second encoded watermarks on the virtual desktop based on the determined screen resolution of the client.

5. The method of claim 1, wherein the operation is a video playback operation, the detection of the first encoded watermark at the client triggering activation of a video plug-in at the client for detecting encoded information in the video, and the detection of the second encoded watermark at the client triggering deactivation of the video plug-in.

6. The method of claim 1, further including storing in the memory action performance times from a plurality of clients.

7. The method of claim 6, further including, generating statistical performance metrics based on the stored action performance times.

8. The method of claim 1, wherein each of the first and second encoded watermarks comprise plurality of binary encoded pixels.

9. The method of claim 8, wherein the binary encoded pixels of the first encoded watermark and the second encoded watermark each include a first set of binary encoded pixels for the respective identification value and a second set of binary encoded pixels that defines an operation event code.

10. The method of claim 9, wherein the first identification value and the second identification value uniquely identify the start and end of the operation for the event code.

11. The method of claim 10, wherein the identification of the first encoded watermark and the identification of the second encoded watermark have defined values that sum to a predetermined value.

12. The method of claim 1, further comprising receiving from a client an action request to be executed at the server, wherein the operation is initiated in response to the action request.

13. The method of claim 1, further comprising:

defining a workload at the server, the workload defining a plurality of operations; and

sequentially executing each of the operations of the workload.

14. The method of claim 13, further comprising receiving from the client a key event to trigger initiation of each of the operations of the workload.

15. The method of claim 13, further comprising upon failure of an operation after retrying the operation the preset number of times, ignoring additional operations of the workload relating to a same application as the failed operation.

16. The method of claim 13, further comprising periodically detecting the progress of the operations of the workload, and terminating the workload if no progress is detected.

17. A method for measuring performance at a client of virtual desktop services offered by a server, the client including a processor, the method comprising:

polling image updates to a user interface display generated by a virtual desktop, the image updates being received at the client from the server;

detecting a first encoded watermark in the display indicating initiation of an operation at the server, the first encoded watermark including a distinct first location, a second location, and a third location, wherein the first location, second location, and third location are defined as specific locations within the first encoded watermark, and wherein the first location includes pixels encoding an identification of the first encoded watermark and the second location includes pixels encoding a first identification value corresponding to an application executing on the virtual desktop and a start time of an operation within the;

detecting a second encoded watermark in the display indicating completion of the operation, the second encoded watermark including the first location, the second location, and the third location, wherein the first location includes pixels encoding an identification of the second encoded watermark and the third location includes pixels encoding a second identification value corresponding to an end time of the operation for the application; and

storing in memory an action performance time, the action performance time being a time difference between detection of the first encoded watermark and detection of the second encoded watermark.

18. The method of claim 17, wherein the first encoded watermark indicates the initiation of the operation at the server by having pixels encoding an event code located at the second location within the first encoded watermark and the second encoded watermark indicates the completion of the operation by having pixels encoding the event code located at the third location within second encoded watermark.

19. The method of claim 17, wherein the identification of the first encoded watermark and the identification of the second encoded watermark comprise values summing to a predefined value.

20. The method of claim 17, wherein:

the first encoded watermark indicates the initiation of the operation at the server by having pixels encoding an operation identifier located at the second location within the first encoded watermark;

the second encoded watermark indicates the completion of the operation at the server by having pixels encoding the operation identifier located at the third location within the second encoded watermark; and

wherein the start location and the end location have different locations within the display.

21. The method of claim 17, wherein the operation is a video playback operation, the detection of the first encoded watermark at the client triggering activation of a video plug-in at the client for detecting encoded information in the video, and the detection of the second encoded watermark at the client triggering deactivation of the video plug-in.

22. The method of claim 17, wherein each of the first and second encoded watermarks comprise a plurality of binary-encoded pixels.

23. The method of claim 22, wherein the first encoded watermark and the second encoded watermark each include a first set of binary encoded pixels defining the first or second identification value and a second set of binary encoded pixels defining the operation event code.

24. The method of claim 17, further comprising, sending an action request to be executed at the server, the action request triggering initiation of the operation at the server.

25. The method of claim 17, further comprising, sending a key event to the server, the server having a workload defining a plurality of operations to be sequentially executed, the key event triggering initiation of an operation of the workload.

26. A method of measuring performance of a virtual desktop infrastructure, the method comprising:

creating a plurality of virtual desktops within a virtual desktop infrastructure, the plurality of virtual desktops each comprising a virtual machine running a guest operating system and having installed a plurality of desktop applications intended for interaction by users, the plurality of virtual desktops running on a number of hosts, each host being a physical computer system, the number of hosts being fewer than a number of the virtual desktops;

creating a plurality of virtual clients within a virtual client infrastructure, the virtual client infrastructure comprising a plurality of virtual clients each comprising a virtual machine with virtual desktop client software running thereon, each virtual client being configured to receive display updates of user displays from a corresponding one of the virtual desktops;

transmitting a workload definition to each of the virtual desktops, the workload definition identifying a sequence of operations to be performed with one or more of the installed desktop applications, each of the operations having a corresponding operation event code;

automatically performing at each virtual desktop the sequence of operations, the performing including overlaying a first watermark at a start of each operation, the first watermark including a distinct first location, a second location, and a third location, wherein the first location, second location, and third location are defined as specific locations within the first encoded watermark, and wherein the first location includes pixels encoding an identification of the first encoded watermark and the second location includes pixels encoding a first identification value corresponding to the start of the first operation, detecting a completion of the operation and embedding a second watermark at the completion of each operation, the second watermark including the first location, the second location, and the third location, wherein the first location includes pixels encoding an identification of the second encoded watermark and the third location includes pixels encoding a second identification value corresponding to the completion of the first operation;

receiving at each of the virtual clients display updates including the first and second watermarks; and

receiving from each of the virtual clients at a central location action performance times for each of the operations defined in the workloads and calculating a performance metric based at least in part on the performance times received from the virtual clients.