USER INPUT BACK CHANNEL FOR WIRELESS DISPLAYS

• US 20130013318A1
• Filed: 01/05/2012
• Published: 01/10/2013
• Est. Priority Date: 01/21/2011
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Huang, Xiaolong, Raveendran, Vijayalakshmi R., Wang, Xiaodong, Shaukat, Fawad
• Application Number:
  US13/344,512
• Publication Number:
  US 20130013318A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2370/06 Consumer Electronics Control, i.e. control of another device by a display or vice versa
• CPC Class Codes: G09G 2370/10 Use of a protocol of communication by packets in interfaces along the display data pipeline
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information

Abstract

As part of a communication session, a wireless source device can transmit audio and video data to a wireless sink device, and the wireless sink device can transmit user input data received at the wireless sink device back to the wireless source device. In this manner, a user of the wireless sink device can control the wireless source device and control the content that is being transmitted from the wireless source device to the wireless sink device. The input data received at the wireless sink device can be a voice command.

Claims

1. A method of receiving user input data from a wireless sink device at a wireless source device, the method comprising:

receiving a data packet comprising a packet header and payload data;

parsing the payload data to determine if the payload data comprises voice command data.

2. The method of claim 1, wherein parsing the payload data comprises identifying, in the payload data, a field indicating an input type, wherein a value in the field indicates that the payload data comprises voice command data.

3. The method of claim 1, further comprising:

negotiating via a series of messages, with the wireless sink device, voice command capabilities.

4. The method of claim 3, wherein the negotiating comprises identifying one or more audio codecs.

5. The method of claim 1, wherein the voice command data is RTP encapsulated voice data.

6. The method of claim 1, wherein the data packet header comprises a timestamp flag to identify if a timestamp field is present.

7. The method of claim 6, further comprising:

in response to the timestamp flag indicating a timestamp field is present and the payload data comprising voice command data, interpreting an entry in the timestamp field as a speech sampling time;

in response to the timestamp flag indicating a timestamp field is present and the payload data comprising command data other than voice command data, interpreting the entry in the timestamp field as a timestamp associated with a frame of video data being displayed at the wireless sink device at the time the user input data was captured.

8. The method of claim 1, wherein the data packet header comprises a field to identify an input category, and wherein the field identifies a generic input.

9. The method of claim 1, wherein the payload data comprises a field to identify an input type, and wherein the field to identify the input type identifies a voice command.

10. The method of claim 1, wherein the payload data comprises a describe field, and wherein the describe field comprises the voice command data.

11. The method of claim 10, wherein the payload data comprises a length field to identify a length of the describe field.

12. The method of claim 1, wherein obtaining the user input data comprises capturing the user input data through an input device of the wireless sink device.

13. The method of claim 1, wherein obtaining the user input data comprises receiving forwarded user input data from another wireless sink device.

14. The method of claim 1, wherein the data packet header is an application layer packet header.

15. The method of claim 1, wherein the data packet is to control audio data or video data of the wireless source device.

16. The method of claim 1, wherein the data packet is transmitted over TCP/IP.

17. A wireless source device configured to receive user input data from a wireless sink device, the wireless source device comprising:

a transport unit to receive a data packet comprising a packet header and payload data;

a memory storing instructions;

one or more processors configured to execute the instructions, wherein upon execution of the instructions the one or more processors cause;

parsing the payload data to determine if the payload data comprises voice command data.

18. The wireless source device of claim 17, wherein parsing the payload data comprises identifying, in the payload data, a field indicating an input type, wherein a value in the field indicates that the payload data comprises voice command data.

19. The wireless source device of claim 17, wherein upon execution of the instructions the one or more processors further cause:

negotiating via a series of messages, with the wireless sink device, voice command capabilities.

20. The wireless source device of claim 17, wherein the negotiating comprises identifying one or more audio codecs.

21. The wireless source device of claim 17, wherein the voice command data is RTP encapsulated voice data.

22. The wireless source device of claim 17, wherein the data packet header comprises a timestamp flag to identify if a timestamp field is present.

23. The wireless source device of claim 22, wherein upon execution of the instructions the one or more processors further cause:

in response to the timestamp flag indicating a timestamp field is present and the payload data comprising voice command data, interpreting an entry in the timestamp field as a speech sampling time;

in response to the timestamp flag indicating a timestamp field is present and the payload data comprising command data other than voice command data, interpreting the entry in the timestamp field as a timestamp associated with a frame of video data being displayed at the wireless sink device at the time the user input data was captured.

24. The wireless source device of claim 17, wherein the data packet header comprises a field to identify an input category, and wherein the field identifies a generic input.

25. The wireless source device of claim 17, wherein the payload data comprises a field to identify an input type, and wherein the field to identify the input type identifies a voice command.

26. The wireless source device of claim 17, wherein the payload data comprises a describe field, and wherein the describe field comprises the voice command data.

27. The wireless source device of claim 26, wherein the payload data comprises a length field to identify a length of the describe field.

28. The wireless source device of claim 17, wherein obtaining the user input data comprises capturing the user input data through an input device of the wireless sink device.

29. The wireless source device of claim 17, wherein obtaining the user input data comprises receiving forwarded user input data from another wireless sink device.

30. The wireless source device of claim 17, wherein the data packet header is an application layer packet header.

31. The wireless source device of claim 17, wherein the data packet is to control audio data or video data of the wireless source device.

32. The wireless source device of claim 17, wherein the data packet is transmitted over TCP/IP.

33. A computer-readable storage medium storing instructions that upon execution by one or more processors cause the one or more processors to perform a method of receiving user input data from a wireless sink device at a wireless source device, the method comprising:

receiving a data packet comprising a packet header and payload data;

parsing the payload data to determine if the payload data comprises voice command data.

34. A wireless source device configured to receive user input data from a wireless sink device, the wireless source device comprising:

means for receiving a data packet comprising a packet header and payload data; and

means for parsing the payload data to determine if the payload data comprises voice command data.

35. A method of transmitting user input data from a wireless sink device to a wireless source device, the method comprising:

obtaining voice command data at the wireless sink device;

generating a data packet header;

generating payload data comprising the voice command data;

generating a data packet comprising the data packet header and the payload data;

transmitting the data packet to the wireless source device.

36. The method of claim 35, further comprising:

negotiating voice command capabilities, with the wireless source device, via a series of messages.

37. The method of claim 36, wherein the negotiating comprises identifying one or more audio codecs.

38. The method of claim 35, wherein the voice command data is RTP encapsulated voice data.

39. The method of claim 35, wherein the data packet header comprises a timestamp flag to identify if a timestamp field is present.

40. The method of claim 39, further comprising:

setting the timestamp flag to indicate the timestamp field;

adding to the timestamp field a speech sampling time value.

41. The method of claim 35, wherein the data packet header comprises a field to identify an input category, and the field identifies a generic input.

42. The method of claim 35, wherein the payload data comprises a field to identify an input type, and the field to identify the input type identifies a voice command.

43. The method of claim 35, wherein the payload data comprises a describe field, and wherein the describe field comprises the voice command data.

44. The method of claim 43, wherein the payload data comprises a length field to identify a length of the describe field.

45. The method of claim 35, wherein obtaining the user input data comprises capturing the user input data through an input device of the wireless sink device.

46. The method of claim 35, wherein obtaining the user input data comprises receiving forwarded user input data from another wireless sink device.

47. The method of claim 35, wherein the data packet header is an application layer packet header.

48. The method of claim 35, wherein the data packet is to control audio data or video data of the wireless source device.

49. The method of claim 35, wherein the data packet is transmitted over TCP/IP.

50. A wireless sink device configured to transmit user input data to a wireless source device, the wireless sink device comprising:

a memory storing instructions;

one or more processors configured to execute the instructions, wherein upon execution of the instructions the one or more processors cause;

obtaining voice command data at the wireless sink device;

generating a data packet header;

generating payload data comprising the voice command data;

generating a data packet comprising the data packet header and the payload data;

a transport unit to transmit the data packet to the wireless source device.

51. The wireless sink device of claim 50, wherein upon execution of the instructions the one or more processors further cause:

negotiating voice command capabilities, with the wireless source device, via a series of messages.

52. The wireless sink device of claim 51, wherein the negotiating comprises identifying one or more audio codecs.

53. The wireless sink device of claim 50, wherein the voice command data is RTP encapsulated voice data.

54. The wireless sink device of claim 50, wherein the data packet header comprises a timestamp flag to identify if a timestamp field is present.

55. The wireless sink device of claim 54, wherein upon execution of the instructions the one or more processors further cause:

setting the timestamp flag to indicate the timestamp field;

adding to the timestamp field a speech sampling time value.

56. The wireless sink device of claim 50, wherein the data packet header comprises a field to identify an input category, and the field identifies a generic input.

57. The wireless sink device of claim 50, wherein the payload data comprises a field to identify an input type, and the field to identify the input type identifies a voice command.

58. The wireless sink device of claim 50, wherein the payload data comprises a describe field, and wherein the describe field comprises the voice command data.

59. The wireless sink device of claim 58, wherein the payload data comprises a length field to identify a length of the describe field.

60. The wireless sink device of claim 50, wherein obtaining the user input data comprises capturing the user input data through an input device of the wireless sink device.

61. The wireless sink device of claim 50, wherein obtaining the user input data comprises receiving forwarded user input data from another wireless sink device.

62. The wireless sink device of claim 50, wherein the data packet header is an application layer packet header.

63. The wireless sink device of claim 50, wherein the data packet is to control audio data or video data of the wireless source device.

64. The wireless sink device of claim 50, wherein the data packet is transmitted over TCP/IP.

65. A computer-readable storage medium storing instructions that upon execution by one or more processors cause the one or more processors to perform a method of transmitting user input data from a wireless sink device to a wireless source device, the method comprising:

obtaining voice command data at the wireless sink device;

generating a data packet header;

generating payload data comprising the voice command data;

generating a data packet comprising the data packet header and the payload data;

transmitting the data packet to the wireless source device.

66. A wireless sink device configured to transmit user input data to a wireless source device, the wireless sink device comprising:

means for obtaining voice command data at the wireless sink device;

means for generating a data packet header;

means for generating payload data comprising the voice command data;

means for generating a data packet comprising the data packet header and the payload data;

means for transmitting the data packet to the wireless source device.