User input device for wireless back channel

• US 8,674,957 B2
• Filed: 02/02/2012
• Issued: 03/18/2014
• Est. Priority Date: 02/04/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Raveendran, Vijayalakshmi R., Wang, Xiaodong, Shaukat, Fawad, Huang, Xiaolong
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US13/364,568
• Publication Number:
  US 20130033435A1
• Time in Patent Office: 775 Days
• Field of Search: 345/173, 345156-160, 345/204, 345/502, 345/503, 345/519, 345/520
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information

Abstract

Aspects of this disclosure relate to a method that includes, in an example, sending, by a source device, display data to a sink device for rendering on the sink device. The method also includes receiving, by the source device, an indication of user input at a first display location of a touch-sensitive screen associated with the source device, wherein the user input specifies a modification of at least a portion of the display data rendered at the sink device, wherein the portion of the display data is rendered at a second display location of the sink device. The method also includes, in response to receiving the indication, sending, by the source device, second configuration data to modify the portion of the display data rendered at the second display location based at least in part on a mapping of the first display location to the second display location.

Claims

1. A method comprising:

sending, by a source device, display data to a sink device for rendering on the sink device;

receiving, by the source device, an indication of user input at a first display location of a touch-sensitive screen associated with the source device, wherein the user input specifies a modification of at least a portion of the display data rendered at the sink device, wherein the at least a portion of the display data to be modified is rendered at a second display location of the sink device; and

in response to receiving the indication, sending, by the source device, configuration data to modify the at least a portion of the display data rendered at the second display location based at least in part on a mapping of the first display location to the second display location.

2. The method of claim 1, wherein the mapping is further based at least in part on a mapping of a first display resolution associated with the touch-sensitive display to a second display resolution of the sink device.

3. The method of claim 1, further comprising:

receiving, at the touch sensitive screen of the source device, a second indication of user input;

in response to receiving the second indication, generating, by the source device, a first event based at least in part on the second indication that is associated with a first timestamp;

receiving, by the source device and from the sink device, a second event that is associated with a second timestamp;

determining, by the source device, whether the second timestamp represents an earlier time than the first timestamp; and

when the second timestamp represents the earlier time than the first timestamp, modifying the display data based at least in part on the second event before modifying the display data based at least in part on the first event.

4. The method of claim 1, further comprising, in response to receiving a second indication of user input, refraining from displaying, by the source device, the display data.

5. The method of claim 1, wherein the at least a portion of the display data rendered at the second display location comprises a graphical pointing object.

6. A wireless source device comprising:

a memory storing instructions;

one or more processors configured to execute the instructions, wherein upon execution of the instructions the one or more processors cause;

sending display data to a sink device for rendering on the sink device;

receiving an indication of user input at a first display location of a touch-sensitive screen associated with the source device, wherein the user input specifies a modification of at least a portion of the display data rendered at the sink device, wherein the at least a portion of the display data to be modified is rendered at a second display location of the sink device; and

in response to receiving the indication, sending configuration data to modify the at least a portion of the display data rendered at the second display location based at least in part on a mapping of the first display location to the second display location.

7. The wireless source device of claim 6, wherein the mapping is further based at least in part on a mapping of a first display resolution associated with the touch-sensitive display to a second display resolution of the sink device.

8. The wireless source device of claim 6, wherein upon execution of the instructions the one or more processors further cause:

receiving, at the touch sensitive screen of the source device, a second indication of user input;

in response to receiving the second indication, generating a first event based at least in part on the second indication that is associated with a first timestamp;

receiving, from the sink device, a second event that is associated with a second timestamp;

determining whether the second timestamp represents an earlier time than the first timestamp; and

when the second timestamp represents the earlier time than the first timestamp, modifying the display data based at least in part on the second event before modifying the display data based at least in part on the first event.

9. The wireless source device of claim 6, wherein upon execution of the instructions the one or more processors further cause:

in response to receiving a second indication of user input, refraining from displaying, by the source device, the display data.

10. The wireless source device of claim 6, wherein the at least a portion of the display data rendered at the second display location comprises a graphical pointing object.

11. A non-transitory computer-readable storage medium storing instructions that upon execution by one or more processors of a wireless source device cause the one or more processors to:

send display data to a sink device for rendering on the sink device;

receive an indication of user input at a first display location of a touch-sensitive screen associated with the wireless source device, wherein the user input specifies a modification of at least a portion of the display data rendered at the sink device, wherein the at least a portion of the display data to be modified is rendered at a second display location of the sink device; and

in response to receiving the indication, send configuration data to modify the at least a portion of the display data rendered at the second display location based at least in part on a mapping of the first display location to the second display location.

12. The non-transitory computer readable storage medium of claim 11, wherein the mapping is further based at least in part on a mapping of a first display resolution associated with the touch-sensitive display to a second display resolution of the sink device.

13. The non-transitory computer readable storage medium of claim 11, storing instructions that upon execution by one or more processors of the wireless source device further cause the one or more processors to:

receive, at the touch sensitive screen of the wireless source device, a second indication of user input;

in response to receiving the second indication, generate, by the wireless source device, a first event based at least in part on the second indication that is associated with a first timestamp;

receive, by the wireless source device and from the sink device, a second event that is associated with a second timestamp;

determine, by the wireless source device, whether the second timestamp represents an earlier time than the first timestamp; and

when the second timestamp represents the earlier time than the first timestamp, modify the display data based at least in part on the second event before modifying the display data based at least in part on the first event.

14. The non-transitory computer readable storage medium of claim 11, storing instructions that upon execution by one or more processors of the wireless source device further cause the one or more processors to, in response to receiving a second indication of user input, refrain from displaying, by the wireless source device, the display data.

15. The non-transitory computer readable storage medium of claim 11, wherein the at least a portion of the display data rendered at the second display location comprises a graphical pointing object.

16. A wireless source device comprising:

means for sending display data to a sink device for rendering on the sink device;

means for receiving an indication of user input at a first display location of a touch-sensitive screen associated with the source device, wherein the user input specifies a modification of at least a portion of the display data rendered at the sink device, wherein the at least a portion of the display data to be modified is rendered at a second display location of the sink device; and

means for sending, in response to receiving the indication, configuration data to modify the at least a portion of the display data rendered at the second display location based at least in part on a mapping of the first display location to the second display location.

17. The wireless source device of claim 16, wherein the mapping is further based at least in part on a mapping of a first display resolution associated with the touch-sensitive display to a second display resolution of the sink device.

18. The wireless source device of claim 16, further comprising:

means for receiving, at the touch sensitive screen of the source device, a second indication of user input;

means for generating, in response to receiving the second indication, a first event based at least in part on the second indication that is associated with a first timestamp;

means for receiving from the sink device, a second event that is associated with a second timestamp;

means for determining whether the second timestamp represents an earlier time than the first timestamp; and

means for modifying the display data, when the second timestamp represents the earlier time than the first timestamp, based at least in part on the second event before modifying the display data based at least in part on the first event.

19. The wireless source device of claim 16, further comprising:

means for refraining from displaying, in response to receiving a second indication of user input, the display data.

20. The wireless source device of claim 16, wherein the at least a portion of the display data rendered at the second display location comprises a graphical pointing object.

21. A method comprising:

receiving, by a wireless sink device, display data for rendering on the wireless sink device;

receiving, by the wireless sink device, configuration data to modify a portion of the display data rendered at a first location of the wireless sink device, wherein the portion of the display data to be modified is rendered at a second display location of a wireless source device; and

rendering, by the wireless sink device, the portion of the display data at the first location based at least in part on a mapping of the first display location and the second display location.

22. The method of claim 21, further comprising:

sending, by the wireless sink device, a display resolution of the wireless sink device to the wireless source device.

23. The method of claim 21, further comprising:

receiving, at a touch-sensitive screen of the wireless sink device, an indication of user input;

in response to receiving the indication, generating, by the wireless sink device, an event associated with a timestamp that indicates at least a time when the indication of user input was received; and

sending, by the wireless sink device and to the wireless source device, the event.

24. The method of claim 21, wherein the portion of the display data rendered at the first location comprises a graphical pointing object.

25. A wireless sink device comprising:

a memory storing instructions;

one or more processors configured to execute the instructions, wherein upon execution of the instructions the one or more processors cause;

receiving, by a wireless sink device, display data for rendering on the wireless sink device;

receiving, by the wireless sink device, configuration data to modify a portion of the display data rendered at a first location of the wireless sink device, wherein the portion of the display data to be modified is rendered at a second display location of a wireless source device; and

rendering, by the wireless sink device, the portion of the display data at the first location based at least in part on a mapping of the first display location and the second display location.

26. The wireless sink device of claim 25, wherein upon execution of the instructions the one or more processors further cause:

sending a display resolution of the wireless sink device to the wireless source device.

27. The wireless sink device of claim 25, wherein upon execution of the instructions the one or more processors further cause:

receiving, at a touch-sensitive screen of the wireless sink device, an indication of user input;

in response to receiving the indication, generating an event associated with a timestamp that indicates at least a time when the indication of user input was received; and

sending, to the wireless source device, the event.

28. The wireless sink device of claim 25, wherein the portion of the display data rendered at the first location comprises a graphical pointing object.

29. A non-transitory computer-readable storage medium storing instructions that upon execution by one or more processors of a wireless sink device cause the one or more processors to:

receive display data for rendering on the wireless sink device;

receive configuration data to modify a portion of the display data rendered at a first location of the wireless sink device, wherein the portion of the display data to be modified is rendered at a second display location of a wireless source device; and

render the portion of the display data at the first location based at least in part on a mapping of the first display location and the second display location.

30. The non-transitory computer readable storage medium of claim 29, storing instructions that upon execution by one or more processors of the sink device further cause the one or more processors to:

send a display resolution of the wireless sink device to the wireless source device.

31. The non-transitory computer readable storage medium of claim 29, storing instructions that upon execution by one or more processors of the sink device further cause the one or more processors to:

receive, at a touch-sensitive screen of the wireless sink device, an indication of user input;

in response to receiving the indication, generate an event associated with a timestamp that indicates at least a time when the indication of user input was received; and

send, to the wireless source device, the event.

32. The non-transitory computer readable storage medium of claim 29, wherein the portion of the display data rendered at the first location comprises a graphical pointing object.

33. A wireless sink device comprising:

means for receiving display data for rendering on the wireless sink device;

means for receiving configuration data to modify a portion of the display data rendered at a first location of the wireless sink device, wherein the portion of the display data to be modified is rendered at a second display location of a wireless source device; and

means for rendering the portion of the display data at the first location based at least in part on a mapping of the first display location and the second display location.

34. The wireless sink device of claim 33, further comprising:

means for sending a display resolution of the wireless sink device to the wireless source device.

35. The wireless sink device of claim 33, further comprising:

means for receiving an indication of user input;

means for generating, in response to receiving the indication, an event associated with a timestamp that indicates at least a time when the indication of user input was received; and

means for sending, to the wireless source device, the event.

36. The wireless sink device of claim 33, wherein the portion of the display data rendered at the first location comprises a graphical pointing object.