USER INPUT BACK CHANNEL FOR WIRELESS DISPLAYS

• US 20130009996A1
• Filed: 01/05/2012
• Published: 01/10/2013
• Est. Priority Date: 01/21/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Raveendran, Vijayalakshmi R., Huang, Xiaolong, Wang, Xiaodong, Shaukat, Fawad
• Granted Patent: US 9,582,239 B2
• Time in Patent Office: Days
• US Class Current: 345/660
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2370/06 Consumer Electronics Control, i.e. control of another device by a display or vice versa
• CPC Class Codes: G09G 2370/10 Use of a protocol of communication by packets in interfaces along the display data pipeline
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information

Abstract

As part of a communication session, a wireless source device can transmit audio and video data to a wireless sink device, and the wireless sink device can transmit user input data received at the wireless sink device back to the wireless source device. In this manner, a user of the wireless sink device can control the wireless source device and control the content that is being transmitted from the wireless source device to the wireless sink device. The input data received at the wireless sink device can have associated coordinate information that is scaled or normalized by either the wireless sink device or the wireless source device.

Claims

1. A method of transmitting user data from a wireless sink device to a wireless source device, the method comprising:

obtaining user input data at the wireless sink device, wherein the user input data has associated coordinate data;

normalizing the associated coordinate data to generate normalized coordinate data;

generating a data packet comprising the normalized coordinate data;

transmitting the data packet to a wireless source device.

2. The method of claim 1, further comprising:

determining if the associated coordinate data is within a display window for content being received from the wireless source device.

3. The method of claim 1, further comprising:

determining a resolution of a display window for content being received from the wireless source device;

receiving from the source device, an indication of the resolution of a display of the source device.

4. The method of claim 3, wherein normalizing the coordinate data comprises scaling the associated coordinate data based on a ratio of the resolution of the display window and the resolution of the display of the source.

5. The method of claim 1, wherein the associated coordinate data corresponds to a location of a mouse click event.

6. The method of claim 1, wherein the associated coordinate data corresponds to a location of a touch event.

7. A wireless sink device for transmitting user data to a wireless source device, the wireless sink device comprising:

a memory storing instructions;

one or more processors configured to execute the instructions, wherein upon execution of the instructions the one or more processors cause;

obtaining user input data at the wireless sink device, wherein the user input data has associated coordinate data;

normalizing the associated coordinate data to generate normalized coordinate data;

generating a data packet comprising the normalized coordinate data;

a transport unit to transmit the data packet to a wireless source device.

8. The wireless sink device of claim 7, wherein upon execution of the instructions the one or more processors further cause:

determining if the associated coordinate data is within a display window for content being received from the wireless source device.

9. The wireless sink device of claim 7, wherein upon execution of the instructions the one or more processors further cause:

determining a resolution of a display window for content being received from the wireless source device;

receiving from the source device, an indication of the resolution of a display of the source device.

10. The wireless sink device of claim 9, wherein normalizing the coordinate data comprises scaling the associated coordinate data based on a ratio of the resolution of the display window and the resolution of the display of the source.

11. The wireless sink device of claim 7, wherein the associated coordinate data corresponds to a location of a mouse click event.

12. The wireless sink device of claim 7, wherein the associated coordinate data corresponds to a location of a touch event.

13. A computer-readable storage medium storing instructions that upon execution by one or more processors cause the one or more processors to perform a method of transmitting user data from a wireless sink device to a wireless source device, the method comprising:

obtaining user input data at the wireless sink device, wherein the user input data has associated coordinate data;

normalizing the associated coordinate data to generate normalized coordinate data;

generating a data packet comprising the normalized coordinate data;

transmitting the data packet to a wireless source device.

14. A wireless sink device for transmitting user data to a wireless source device, the wireless sink device comprising:

means for obtaining user input data at the wireless sink device, wherein the user input data has associated coordinate data;

means for normalizing the associated coordinate data to generate normalized coordinate data;

means for generating a data packet comprising the normalized coordinate data;

means for transmitting the data packet to a wireless source device.

15. A method of receiving user data from a wireless sink device at a wireless source device, the method comprising:

receiving a data packet at the wireless source device, wherein the data packet comprises user input data with associated coordinate data;

normalizing the associated coordinate data to generate normalized coordinate data;

processing the data packet based on the normalized coordinate data.

16. The method of claim 15, further comprising:

receiving from the wireless sink device a resolution of a display window for content being received from the wireless source device and location information for the display window;

determining a resolution of a display of the source device.

17. The method of claim 16, wherein normalizing the coordinate data comprises scaling the associated coordinate data based on a ratio of the resolution of the display window and the resolution of the display of the source.

18. The method of claim 15, wherein the associated coordinate data corresponds to a location of a mouse click event.

19. The method of claim 15, wherein the associated coordinate data corresponds to a location of a touch event.

20. A wireless source device for receiving user data from a wireless sink device, the wireless source device comprising:

a transport unit to receive a data packet at the wireless source device, wherein the data packet comprises user input data with associated coordinate data;

a memory storing instructions;

one or more processors configured to execute the instructions, wherein upon execution of the instructions the one or more processors cause;

normalizing the associated coordinate data to generate normalized coordinate data;

processing the data packet based on the normalized coordinate data.

21. The wireless source device of claim 20, wherein upon execution of the instructions the one or more processors further cause:

receiving from the wireless sink device a resolution of a display window for content being received from the wireless source device and location information for the display window;

determining a resolution of a display of the source device.

22. The wireless source device of claim 21, wherein normalizing the coordinate data comprises scaling the associated coordinate data based on a ratio of the resolution of the display window and the resolution of the display of the source.

23. The wireless source device of claim 20, wherein the associated coordinate data corresponds to a location of a mouse click event.

24. The wireless source device of claim 20, wherein the associated coordinate data corresponds to a location of a touch event.

25. A computer-readable storage medium storing instructions that upon execution by one or more processors cause the one or more processors to perform method of receiving user data from a wireless sink device at a wireless source device, the method comprising:

receiving a data packet at the wireless source device, wherein the data packet comprises user input data with associated coordinate data;

normalizing the associated coordinate data to generate normalized coordinate data;

processing the data packet based on the normalized coordinate data.

26. A wireless source device for receiving user data from a wireless sink device, the wireless source device comprising:

means for receiving a data packet at the wireless source device, wherein the data packet comprises user input data with associated coordinate data;

means for normalizing the associated coordinate data to generate normalized coordinate data;

means for processing the data packet based on the normalized coordinate data.