Rendering windows having transparent properties from a remote desktop environment

• US 9,471,194 B2
• Filed: 01/30/2014
• Issued: 10/18/2016
• Est. Priority Date: 10/29/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Schmieder, Robert Wilhelm, Ungureanu, Oreste Dorin, Abdo, Nadim
• Primary Examiner(s): Caschera, Antonio A
• Application Number:
  US14/168,239
• Publication Number:
  US 20150121243A1
• Time in Patent Office: 992 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77

Abstract

Embodiments of the present disclosure relate to a remote desktop system which allows an application that executes on a remote computing device to be presented to a remote terminal as if the application is executing on the remote terminal. This system determines which of the remote computing device'"'"'s application windows are top-level windows, and creates a rendering target for each top-level window. The rendering target is a graphics surface that is marshaled to the remote terminal. A PDU (Protocol Data Channel) is produced over this first graphics surface that includes a mapping of the location of the top-level window. A second graphics surface containing transparency information is created for a top-level window that contains a transparency characteristic. This second graphics surface is encoded and marshaled to the remote terminal separately from the first graphics surface. The client computing device receives and merges the two graphics surfaces, and renders a window with the expected transparency.

Claims

1. A method for rendering a window in a remote desktop session between a server computing device and a client computing device, the method comprising:

determining a window rendered on the server computing device is a top-level window;

determining one or more sub-components of the top-level window;

determining the one or more sub-components of the top-level window possesses a transparency characteristic; and

when the one or more sub-components of the top-level window possesses a transparency characteristic;

encoding the one or more sub-components of the top-level window possessing the transparency characteristic using a first encoding scheme;

encoding one or more other sub-components of the top-level window not possessing the transparency characteristic; and

transmitting the encoded one or more sub-components of the top-level window possessing the transparency characteristic and the encoded one or more sub-components of the top-level window not possessing the transparency characteristic to the client computing device.

2. The method of claim 1, wherein the first encoding scheme is an alpha codec encoding scheme and wherein the individual graphics surface comprises padding data, wherein the padding data stores information for at least a portion of the top-level window, further comprising:

determining whether one or more sub-components of the top-level window have changed between a first rendering pass and a second rendering pass; and

not transmitting, on a screen refresh, the unchanged one or more sub-components of the top-level window when it is determined that one or more sub-components of the top-level window have changed.

3. The method of claim 1, wherein the top-level window is rendered on an individual graphics surface.

4. The method of claim 3, wherein the individual graphics surface comprises padding data, wherein the padding data stores information for at least a portion of the top-level window.

5. The method of claim 1, wherein at least one of the one or more sub-components are encoded using a second encoding scheme.

6. The method of claim 1, wherein the top-level window comprises at least one of a client portion and a non-client portion.

7. The method of claim 1, wherein the first encoding scheme is an alpha codec encoding scheme.

8. The method of claim 1, wherein at least one of the one or more sub-components comprises metadata information corresponding to at least one of:

(i) frame start and stop information;

or (ii) window information.

9. The method of claim 1 further comprising determining whether one or more sub-components of the top-level window have changed between a first rendering pass and a second rendering pass.

10. The method of claim 9, further comprising transmitting the changed one or more sub-components of the top-level window when it is determined that one or more sub-components of the top-level window have changed.

11. A computer-readable storage medium encoding computer executable instructions which, when executed by at least one processor, performs a method for rendering a window in a remote desktop session between a server computing device and a client computing device, the method comprising:

determining whether a window rendered on the server computing device is a top-level window;

determining one or more sub-components of the top-level window;

determining whether the one or more sub-components of the top-level window possesses a transparency characteristic; and

when the one or more sub-components of the top-level window possesses a transparency characteristic;

encoding the one or more sub-components of the top-level window possessing the transparency characteristic using a first encoding scheme;

encoding one or more other sub-components of the top-level window not possessing the transparency characteristic using a second encoding scheme; and

transmitting the encoded one or more sub-components of the top-level window possessing the transparency characteristic and the encoded one or more sub-components of the top-level window not possessing the transparency characteristic to the client computing device.

12. The computer-readable storage medium of claim 11, wherein the top-level window is rendered on an individual graphics surface.

13. The computer-readable storage medium of claim 12, wherein the individual graphics surface comprises padding, wherein the padding data stores information for at least a portion of the top-level window.

14. The computer-readable storage medium of claim 13, wherein the individual graphics surface is associated with one or more bitmaps.

15. The computer-readable storage medium of claim 11, wherein the top-level window comprises at least one of a client portion and a non-client portion.

16. The computer-readable storage medium of claim 11, wherein the first encoding scheme is an alpha codec encoding scheme.

17. A system comprising:

one or more processors; and

a memory coupled to the one or more processors, the memory for storing instructions which, when executed by the one or more processors, performs a method for rendering a window in a remote desktop session between a server computing device and a client computing device, the method comprising;

determining a window to be rendered on the server computing device is a top-level window;

when the window to be rendered on the server computing device is a top-level window;

associating the top-level window with a particular surface;

determining one or more sub-components of the top-level window;

rendering each sub-component of the top-level window on the particular surface;

determining the one or more sub-components of the top-level window possesses a transparency characteristic; and

when the one or more sub-components of the top-level window possesses a transparency characteristic;

encoding the one or more sub-components of the top-level window possessing the transparency characteristic using an alpha channel codec;

encoding one or more other sub-components of the top-level window not possessing the transparency characteristic using a non-alpha channel codec; and

transmitting the encoded one or more sub-components of the top-level window possessing the transparency characteristic and the encoded one or more sub-components of the top-level window not possessing the transparency characteristic to the client computing device.

18. The system of claim 17, wherein the particular surface comprises a plurality of top-level windows.

19. The system of claim 17, further comprising instructions for:

determining whether metadata associated with the one or more sub-components of the top-level window has changed in a subsequent rendering pass; and

transmitting the metadata to the client computing device.

20. The system of claim 17, further reciting:

transmitting the encoded one or more sub-components of the top-level window not possessing the transparency characteristic to a second client computing device without transmitting the encoded one or more sub-components of the top-level window possessing the transparency characteristic to the second computing device, based on at least one indication selected from the group consisting of;

(i) an indication that the first client computing device supports decoding transparency;

(ii) an indication that the first client computing device wants to receive transparency information;

(iii) an indication that the second client computing device does not support decoding transparency;

or (iv) an indication that the second client computing device does not want to receive transparency information.