Systems and Methods of Providing Rich User Interface and Animation to Auxiliary Display Devices

• US 20100299626A1
• Filed: 05/20/2009
• Published: 11/25/2010
• Est. Priority Date: 05/20/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chan, Chibong, Ho, Jen-Hung, Hegde, Sachin, Swaney, Richard James, Luengen, Ross, Mapes, Teague Curtiss
• Application Number:
  US12/469,463
• Publication Number:
  US 20100299626A1
• Time in Patent Office: Days
• US Class Current: 715/781
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory
• CPC Class Codes: G09G 5/395 Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen G09G5/399 takes precedence

Abstract

Systems and methods of providing rich user interface (UI) and/or animation from a main computing device to an auxiliary display device (ADD) are disclosed. A renderer driver may be communicatively coupled to the ADD and to an application at the main computing device that provides rich UI or animation. The renderer driver may use one or more interfaces in a renderer library to create a bitmap of the rich UI content/animation in a hidden window and communicate the bitmap to the ADD. For rendering animation at the ADD, updated bitmaps may be repeatedly generated and communicated. The renderer driver may receive an indication of a user input received at the ADD in response to the bitmap, interpret the indication, and communicate to the application the corresponding user response. Some or all portions of the system may reside at the auxiliary device, the main computing device, or both devices.

Claims

1. A system for providing a rich user interface at an auxiliary display device coupled to a computer, comprising:

an application executing on the computer;

a renderer driver communicatively coupled to both the application and the auxiliary display device and configured to receive a rich user interface (UI) display content from the application;

a renderer library communicatively coupled to the renderer driver and exposing a set of interfaces; and

a hidden window communicatively coupled to the renderer library,

wherein the renderer driver is configured to use at least one interface from the set of interfaces in the renderer library to;

create, in the hidden window, a bitmap of the rich UI display content, and

communicate the bitmap to the auxiliary display device for display.

2. The system of claim 1, wherein the renderer library resides on the computer.

3. The system of claim 1, wherein the renderer library resides on the auxiliary display device.

4. The system of claim 1, wherein the application is an animation application and the renderer driver is further configured to, at a selected interval, generate in the hidden window an updated bitmap of the rich UI display content and communicate the updated bitmap to the auxiliary display device.

5. The system of claim 4, wherein a duration of the selected interval is based on at least one of:

a change to the rich UI display content or a user selection.

6. The system of claim 1, wherein the rich UI display content comprises one of XAML (Extensible Application Markup Language), JavaScript, AJAX (Asynchronous JavaScript and XML (Extensible Markup Language)), CSS (Cascading Style Sheets) content.

7. The system of claim 1, wherein the rich UI display content is received in a string buffer.

8. The system of claim 1, wherein the rich UI display content includes at least one of:

an animation, a hyperlink, a modification of an image, media content or multimedia content.

9. The system of claim 1, wherein the renderer driver is further configured to use at least one other interface of the set of interfaces in the renderer library to:

receive, from the auxiliary display device, an indication of a user input generated at the auxiliary display device in response to the bitmap;

apply the indication of the user input to the bitmap in the hidden window; and

communicate a translation of the indication of the user input to the application.

10. The system of claim 1, wherein a portion of the set of interfaces are exposed by the renderer library, the portion including a render bitmap interface, an update user interface element interface, a clear rendered bitmap interface, and a user selection event interface.

11. The method of claim 1, wherein the renderer library includes a separate interface for at least one of:

registering the application with an endpoint, creating the hidden window, or communicating a particular bitmap to the auxiliary display device.

12. A method of providing animation at an auxiliary display device coupled to a computer, comprising:

communicatively coupling a rendering driver to an application executing on the computer, to the auxiliary display device and to a renderer library, the renderer library including a set of application interfaces;

receiving animation content from the application;

creating, via a first application interface from the set of application interfaces, a hidden window;

generating, in the hidden window via a second application interface from the set of application interfaces, a first bitmap of the animation content;

communicating, via a third application interface from the set of application interfaces, the first bitmap to the auxiliary display device for display;

clearing, via a fourth application interface from the set of application interfaces, the first bitmap from the hidden window;

generating, in the hidden window via the second application interface, a second bitmap of the animation content; and

communicating, via the third application interface, the second bitmap to the auxiliary display device for display,

wherein communicating the second bitmap is performed at a pre-determined time interval after communicating the first bitmap and a duration of the pre-determined time interval based on at least one of;

a user selection or a change to the animation content.

13. The method of claim 12, further comprising exposing at least a portion of the set of application interfaces to the application.

14. The method of claim 12, further comprising at the rendering driver:

receiving, from the auxiliary display device via a fifth interface from the set of application interfaces, an indication of a user response corresponding to the first bitmap;

applying, via a sixth interface from the set of application interfaces, the indication of the user response to the first bitmap in the hidden window;

communicating to the application, via a seventh interface from the set of application interfaces, a translation of the indication of the user response.

15. The method of claim 12, further comprising creating an XAML (Extensible Markup Language) endpoint, and wherein receiving the animation content from the application comprises receiving XAML content from the application wherein the application is registered with the XAML endpoint.

16. The method of claim 12, wherein communicatively coupling the rendering driver to the renderer library comprises communicatively coupling the rendering driver to a renderer library resident on the computer.

17. The method of claim 12, wherein communicatively coupling the rendering driver to the renderer library comprises communicatively coupling the rendering driver to a renderer library resident on the auxiliary display device.

18. A computer-readable storage medium having thereon computer-executable instructions for providing animation at an auxiliary display device coupled to a computer, comprising computer-executable instructions for:

exposing at least a portion of a set of interfaces in a renderer library, the set of interfaces for providing the animation at the auxiliary display device;

creating an endpoint for XAML (Extensible Markup Language) with which an application executing on the computer registers, the application enabled to generate XAML content for display on the auxiliary display device; and

at a driver corresponding to the auxiliary display device and communicatively coupled to the renderer library and to the application, using at least one interface from the set of interfaces in the renderer library to;

create a hidden window;

retrieve, from a string buffer, the XAML content generated by the application;

generate a first bitmap of the XAML content in the hidden window;

communicate the first bitmap to the auxiliary display device for display;

after a pre-determined time interval, generate a second bitmap of the XAML content in the hidden window, the pre-determined time interval based on at least one of a change to the XAML content or a user selection; and

communicate the second bitmap to the auxiliary display device for display.

19. The computer-readable storage medium of claim 18, further comprising using, at the driver, at least one other interface from the set of interfaces in the renderer library to:

receive, from the auxiliary display device, an indication of a user input in response to the first bitmap;

apply the indication of the user input to the first bitmap in the hidden window; and

trigger an event on the XAML content, the event corresponding to the user input.

20. The computer-readable storage medium of claim 18, further comprising computer-executable instructions for executing the renderer library on at least one of the auxiliary display device or the computer.