Scalable user interface

• US 8,082,507 B2
• Filed: 06/12/2007
• Issued: 12/20/2011
• Est. Priority Date: 06/12/2007
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Speicher, Ashley C, Bowra, Todd, Fang, Nicholas J, Prabhu, Sudhakar V
• Primary Examiner(s): ZAHR, ASHRAF A
• Application Number:
  US11/761,508
• Publication Number:
  US 20080313555A1
• Time in Patent Office: 1,652 Days
• Field of Search: 715/740, 715/744
• US Class Current: 715/740
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/64769 for rate control flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server

Abstract

The scaling of a user interface according to network or device limitations is disclosed. One embodiment provides a method of scaling a user interface, comprising sending a user interface over a network to a networked device, detecting a performance limitation of the user interface in at least one of the network or the networked device, and scaling a parameter of the user interface in response to the detected limitation to improve the performance of the user interface. In this manner, a user interface may be scaled in response to limitations on performance and end-user experience can be improved.

Claims

1. A method of scaling a user interface, the method comprising:

streaming media content over a first channel of a network to a networked device;

sending the user interface over a second channel of the network to the networked device, the first channel of the network being different from the second channel of the network, the user interface and media content being sent over the first channel and the second channel simultaneously;

detecting a performance limitation of at least one of the network and the networked device; and

in response to detecting the performance limitation;

determining if a user interface state is active or inactive;

if the user interface state is active, then transrating the media content while maintaining current user interface parameters; and

if the user interface state is inactive, then scaling a parameter of the user interface while maintaining a current media bit rate.

2. The method of claim 1, wherein scaling a parameter includes adjusting at least one of a color bit depth, an alpha channel, graphic resolution, an encoding scheme, and the level or fidelity of an animation displayed in the user interface.

3. The method of claim 1, wherein the performance limitation includes at least one of a network latency, a network throughput limitation, and a client bandwidth utilization limitation.

4. The method of claim 1, wherein scaling a parameter involves adjusting the parameter during encoding of user interface data.

5. The method of claim 1, wherein scaling a parameter involves adjusting the parameter by transrating user interface data that has been encoded.

6. The method of claim 1, further comprising dynamically scaling a parameter of the user interface in response to the detected performance limitation or end of said limitation as network or device performance changes.

7. The method of claim 1, further comprising:

receiving detailed profiling data of performance limitations in the network or in the device; and

adjusting multiple parameters of the user interface in response to the detailed profiling data.

8. A system comprising:

a networked device including memory, a processor, and instructions executable by the processor to;

send to a display device via a first channel of a network a user interface;

send to the display device via a second channel of the network media for compositing with the user interface at the display device, wherein the first channel is different from the second channel and wherein the user interface and the media are sent simultaneously;

determine if a user interface state is active or inactive;

determine a performance limitation of at least one of the network and the networked device;

if the user interface state is active, then transrate the media content while maintaining current user interface parameters; and

if the user interface state is inactive, then adjust a parameter of the user interface while maintaining a current media bit rate.

9. The system of claim 8, wherein the parameter includes at least one of a color bit depth, an alpha channel, graphic resolution, an encoding scheme, and a level or fidelity of an animation displayed in the user interface.

10. The system of claim 8, wherein the performance limitation includes at least one of a network latency, a network throughput limitation, and a client bandwidth utilization limitation.

11. The system of claim 8, wherein the parameter of the user interface is adjusted during encoding of user interface data.

12. The system of claim 8, wherein the parameter of the user interface is adjusted after user interface data has been encoded.

13. The system of claim 8, wherein the instructions are further executable to adjust a parameter of the user interface dynamically in response to detecting the performance limitation or end of said performance limitation as one or more of network performance and networked device performance changes.

14. The system of claim 8, wherein the instructions are further executable to receive detailed profiling data of performance limitations in the network or in the networked device and adjust multiple parameters of the user interface in response to the detailed profiling data.

15. A method of managing congestion at a networked device, the method comprising:

receiving media content from a first channel of a network;

receiving a user interface from a second channel of the network, the first channel of the network being different from the second channel of the network, wherein the media content and user interface are received from the channels simultaneously;

compositing the user interface and the media content for presentation at a display device;

detecting a performance limitation of the user interface caused by at least one of the network and the networked device;

determining if a user interface state is active or inactive;

if the user interface state is active, then transrating the media content while maintaining current user interface parameters; and

if the user interface state is inactive, then adjusting a current user interface parameter while maintaining a current media bit rate.

16. The method of claim 15, further comprising:

determining if the user interface or the media content is a secondary experience;

generating secondary experience data; and

transmitting the secondary experience data to a media server via the network.

17. The method of claim 15, further comprising:

generating performance limitation data; and

transmitting the performance limitation data to a media server via the network.