Virtual user interface including playback control provided over computer network for client device playing media from another source

• US 9,648,378 B2
• Filed: 09/25/2015
• Issued: 05/09/2017
• Est. Priority Date: 01/15/2010
• Status: Active Grant

• Current Assignee: Guest-tek Interactive Entertainment Ltd.
• Original Assignee: Guest-tek Interactive Entertainment Ltd.
• Inventors: Hulse, David Andrew, Thomas, Jason
• Primary Examiner(s): Srivastava, Vivek
• Assistant Examiner(s): Asres, Hermon
• Application Number:
  US14/865,210
• Publication Number:
  US 20160014450A1
• Time in Patent Office: 592 Days
• Field of Search: 709203
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: H04N 21/2143 located in a single building, e.g. hotel, hospital or museum arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106
• CPC Class Codes: H04N 21/231 Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 21/436 Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416

Abstract

A server is deployed on a network and manages operation of a plurality of server instances each with a virtual frame buffer. A client establishes a connection with the server at a start of a user session. The server allocates a server instance to the client and a user interface application renders a corresponding graphical user interface to the virtual frame buffer of the allocated server instance. The server forwards updates of the graphical user interface from the virtual frame buffer to the client, where at least some of the updates include transparency information for blending the graphical user interface with additional visual information at the client. When the session is complete the server reclaims the server instance allocated to the client. In-room device requirements in guest rooms of a hospitality establishment are thereby minimized while providing enhanced user interface performance. Locations in other applications include private residences and businesses.

Claims

1. A system for providing virtual user interfaces over a network, the system comprising:

one or more computer servers deployed on the network and managing operation of a plurality of server instances each with an associated virtual frame buffer, and managing operation of a plurality of user interface applications; and

a client device coupled to both the network and a display;

wherein the client device sends a request to the one or more servers over the network;

the one or more servers allocate one of the server instances to the client device in response to receiving the request, and associate one of the user interface applications with the server instance allocated to the client device, the user interface application rendering a graphical user interface to the virtual frame buffer of the server instance allocated to the client device;

the one or more servers forward to the client device updates of the graphical user interface from the virtual frame buffer of the server instance allocated to the client device, at least some of the updates including transparency information for use in blending the graphical user interface with video rendered by the client device;

the one or more servers receive user input from the client device, provide the user input to the user interface application, and generate playback instructions for controlling playback of the video on the client device according to the user input, the user input representing interaction by a user of the client device with a representation of the graphical user interface;

the one or more servers send the playback instructions to the client device via the network; and

the client device receives the graphical user interface updates and playback instructions from the one or more servers, receives media content for rendering the video from a source different than the one or more servers, plays the video on the display according to the media content, further renders on the display the representation of the graphical user interface overlaid on the video according to the updates and the transparency information, controls playback of the video shown on the display according to the playback instructions, and transmits the user input to the one or more servers.

2. The system of claim 1, wherein:

the client device sends the request to the one or more servers at a start of a user session; and

the one or more servers reclaim the server instance allocated to the client device when the user session is complete.

3. The system of claim 1, wherein the client device is implemented in a set top box providing interactive television services on an associated display coupled to the set top box.

4. The system of claim 1, wherein the graphical user interface comprises an interactive menu for navigating interactive television services.

5. The system of claim 1, wherein the client device is integrated within the display of the client device.

6. The system of claim 1, wherein the display is located in one of a plurality of guest rooms of a hospitality establishment.

7. The system of claim 1, wherein the one or more servers forward to the client device the updates of the graphical user interface utilizing a virtual network computing (VNC) connection, a remote desktop protocol (RDP) connection, or an Apple remote desktop protocol (ARD) connection.

8. The system of claim 1, wherein the one or more servers include the transparency information in at least some of the updates in response to a pseudo encoding message received from the client device.

9. The system of claim 1, wherein each update comprises only one or more portions of the graphical user interface that has changed since a previous update.

10. A computer-implemented method for providing a virtual user interface over a network;

the computer-implemented method comprising;

managing operation of a plurality of server instances each with an associated virtual frame buffer on one or more servers deployed on the network;

receiving by the one or more servers a request over the network, wherein the request is sent from a client device coupled to both the network and a display device;

in response to receiving the request, allocating one of the server instances to the client device by the one or more servers;

associating a user interface application operating on a first one of the one or more servers with the server instance allocated to the client device, wherein the user interface application renders a graphical user interface to the virtual frame buffer of the server instance allocated to the client device;

forwarding updates of the graphical user interface to the client device from the virtual frame buffer of the server instance allocated to the client device, at least some of the updates including transparency information for use in blending the graphical user interface with video rendered by the client device;

receiving user input from the client device, wherein the user input represents interaction by a user of the client device with a representation of the graphical user interface;

providing the user input to the user interface application;

generating playback instructions for controlling playback of the video on the client device according to the user input; and

sending the playback instructions to the client device via the network;

wherein the client device receives media content for rendering the video from a source different than the one or more servers, plays the video on the display according to the media content, further renders on the display the representation of the graphical user interface overlaid on the video according to the updates and the transparency information, and controls playback of the video shown on the display according to the playback instructions.

11. The computer-implemented method of claim 10, further comprising:

receiving by the one or more servers the request from the client device at a start of a user session; and

reclaiming by the one or more servers the server instance allocated to the client device when the user session is complete.

12. The computer-implemented method of claim 10, wherein the graphical user interface comprises an interactive menu for selecting the interactive television services.

13. The computer-implemented method of claim 10, further comprising forwarding to the client device the updates of the graphical user interface utilizing a virtual network computing (VNC) connection, a remote desktop protocol (RDP) connection, or an Apple remote desktop protocol (ARD) connection.

14. The computer-implemented method of claim 10, wherein the transparency information is included in at least some of the updates in response to a pseudo encoding message received from the client device.

15. The computer-implemented method of claim 10, wherein each update comprises only one or more portions of the graphical user interface that has changed since a previous update.

16. A non-transitory computer-readable medium comprising computer executable instructions that when executed by a computer cause the computer to perform a method of providing a virtual user interface over a network;

the method comprising;

managing operation of a plurality of server instances each with an associated virtual frame buffer on one or more servers deployed on the network;

receiving by the one or more servers a request over the network, wherein the request is sent from a client device coupled to both the network and a display device;

in response to receiving the request, allocating one of the server instances to the client device by the one or more servers;

associating a user interface application operating on a first one of the one or more servers with the server instance allocated to the client device, wherein the user interface application renders a graphical user interface to the virtual frame buffer of the server instance allocated to the client device;

forwarding updates of the graphical user interface to the client device from the virtual frame buffer of the server instance allocated to the client device, at least some of the updates including transparency information for use in blending the graphical user interface with video rendered by the client device;

receiving user input from the client device, wherein the user input represents interaction by a user of the client device with a representation of the graphical user interface;

providing the user input to the user interface application;

generating playback instructions for controlling playback of the video on the client device according to the user input; and

sending the playback instructions to the client device via the network;

wherein the client device receives media content for rendering the video from a source different than the one or more servers, plays the video on the display according to the media content, further renders on the display the representation of the graphical user interface overlaid on the video according to the updates and the transparency information, and controls playback of the video shown on the display according to the playback instructions.

17. A computing device providing a virtual user interface, the computing device comprising:

a memory device storing software instructions along with a plurality of virtual frame buffers each associated with one of a plurality of server instances;

a network interface coupled to a network at the hospitality establishment; and

one or more processors;

wherein, by executing the software instructions in the memory device, the one or more processors are configured to;

receive a request from a client device on the network, wherein the client device is coupled to a display;

allocate one of the server instances to the client device in response to receiving the request from the client device;

associate a user interface application with the virtual frame buffer, the user interface application rendering a graphical user interface to the virtual frame buffer of the server instance allocated to the client device;

forward updates of the graphical user interface to the client device from the virtual frame buffer of the server instance allocated to the client device, at least some of the updates including transparency information for use in blending the graphical user interface with video rendered by the client device;

receive user input from the client device and provide the user input to the user interface application, the user input representing interaction by a user of client device with a representation of the graphical user interface;

generate playback instructions for controlling playback of the video on the client device according to the user input; and

send the playback instructions to the client device via the network;

wherein the client device receives media content for rendering the video from a source different than the computing device, plays the video on the display according to the media content, further renders on the display the representation of the graphical user interface overlaid on the video according to the updates and the transparency information, and controls playback of the video shown on the display according to the playback instructions.

18. The computing device of claim 17, wherein the software instructions further configure the one or more processors to:

receive the request from the client device at a start of a user session; and

reclaim the server instance allocated to the client device when the user session is complete.

19. The computing device of claim 17, wherein the graphical user interface comprises an interactive menu for selecting the interactive television services.

20. The computing device of claim 17, wherein the display is located in one of a plurality of guest rooms of a hospitality establishment.