LOW LATENCY WIRELESS DISPLAY FOR GRAPHICS

• US 20130047189A1
• Filed: 02/02/2012
• Published: 02/21/2013
• Est. Priority Date: 02/04/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Raveendran, Vijayalakshmi R., Shaukat, Fawad, Wang, Xiaodong
• Granted Patent: US 9,503,771 B2
• Time in Patent Office: Days
• US Class Current: 725/81
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2352/00 Parallel handling of streams of display data
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: H04N 21/23 Processing of content or additional data; Elementary server operations; Server middleware
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

As part of a communication session, a wireless source device can transmit video component data and metadata to a wireless sink device. The wireless source device can intercept the video component data prior to the video component data being rendered by the wireless source device, and the wireless sink device can generate a frame of video data based on the video component data and the metadata.

Claims

1. A method of transmitting video data from a wireless source device to a wireless sink device:

intercepting a video component prior to the video component being rendered at the wireless source device;

generating metadata describing the video component;

transmitting the video component and the metadata to the wireless sink device.

2. The method of claim 1, further comprising:

intercepting a second video component prior to rendering at the source device;

generating second metadata describing the second video component, wherein the second metadata identifies a position of image data for the first video component relative to image data for the second video component;

transmitting the second video component to the wireless sink device.

3. The method of claim 2, further comprising:

rendering at the wireless source device a frame of video based on the first video component and the second video component.

4. The method of claim 1, further comprising;

exchanging capability information with the wireless sink device.

5. The method of claim 1, wherein the video component comprises a call to a graphics application program interface.

6. The method of claim 1, wherein the video component comprises compressed video data.

7. The method of claim 1, wherein the video component comprises pixel data.

8. The method of claim 1, wherein the video component comprises audio data.

9. The method of claim 1, wherein the metadata comprises an identifier of a frame for which the video component is associated.

10. The method of claim 1, wherein the metadata comprises an identifier of a screen location to which the video component is to be rendered.

11. The method of claim 1, wherein the metadata comprises a resolution of the video component.

12. The method of claim 1, wherein intercepting the video component comprises identifying a call to a graphics application program interface.

13. The method of claim 1, wherein intercepting the video component comprises detecting the initialization of a media parser.

14. A wireless source device comprising:

a metadata encoder configured to;

intercept a video component prior to rendering at the wireless source device;

generate metadata describing the video component;

a transport unit configured to transmit the video component and the metadata to a wireless sink device.

15. The wireless source device of claim 14, wherein:

the metadata encoder is further configured to;

intercept a second video component prior to rendering at the source device;

generate second metadata describing the second video component, wherein the second metadata identifies a position of image data for the first video component relative to image data for the second video component;

the transport unit is further configured to transmit the second video component to the wireless sink device.

16. The wireless source device of claim 15, further comprising:

a graphics composition module configured to render at the wireless source device a frame of video based on the first video component and the second video component.

17. The wireless source device of claim 14, further comprising;

exchanging capability information with the wireless sink device.

18. The wireless source device of claim 14, wherein the video component comprises a call to a graphics application program interface.

19. The wireless source device of claim 14, wherein the video component comprises compressed video data.

20. The wireless source device of claim 14, wherein the video component comprises pixel data.

21. The wireless source device of claim 14, wherein the video component comprises audio data.

22. The wireless source device of claim 14, wherein the metadata comprises an identifier of a frame for which the video component is associated.

23. The wireless source device of claim 14, wherein the metadata comprises an identifier of a screen location to which the video component is to be rendered.

24. The wireless source device of claim 14, wherein the metadata comprises a resolution of the video component.

25. The wireless source device of claim 14, wherein intercepting the video component comprises identifying a call to a graphics application program interface.

26. The wireless source device of claim 14, wherein intercepting the video component comprises detecting the initialization of a media parser.

27. A computer-readable storage medium storing instructions that upon execution by one or more processors cause the one or more processors to perform a method of transmitting video data from a wireless source device to a wireless sink device, the method comprising:

intercepting a video component prior to rendering at the wireless source device;

generating metadata describing the video component;

transmitting the video component and the metadata to the wireless sink device.

28. A wireless source device configured to transmit video data to a wireless sink device, the wireless source device comprising:

means for intercepting a video component prior to rendering at the wireless source device;

means for generating metadata describing the video component;

means for transmitting the video component and the metadata to the wireless sink device.

29. A method of receiving video data from a wireless source device at a wireless sink device:

receiving from a wireless source device a video component of a first type, a video component of a second type, and metadata, wherein the metadata identifies a position of image data for the video component of the first type relative to image data for the video component of the second type;

generating a frame of video based on the video component of the first type, the video component of the second type, and the metadata.

30. A wireless sink device comprising:

a transport unit configured to receive from a wireless source device video component of a first type, a video component of a second type, and metadata, wherein the metadata identifies a position of image data for the video component of the first type relative to image data for the video component of the second type;

a metadata decoder configured to;

generate a frame of video based on the video component of the first type, the video component of the second type, and the metadata.