Sending human input device commands over internet protocol

• US 9,106,651 B2
• Filed: 09/12/2012
• Issued: 08/11/2015
• Est. Priority Date: 09/19/2011
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Froelicher, Jeff S., Huang, Xiaolong, Raveendran, Vijayalakshmi R.
• Primary Examiner(s): Gillis, Brian J
• Assistant Examiner(s): GRIJALVA LOBOS, BORIS D
• Application Number:
  US13/612,210
• Publication Number:
  US 20130246565A1
• Time in Patent Office: 1,063 Days
• Field of Search: 709201-209, 709212-213, 709216-218, 709220-221, 709227-232, 709/247, 709/248, 709/237, 370/464, 370/466, 370/469, 370/474
• US Class Current: 1/1
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04N 21/4108 characterised by an identification number or address, e.g. local network address protecting specific internal or external computer components using identification number G06F21/73; network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/436 Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Abstract

A source device in a wireless display (WD) system stores a plurality of preconfigured formats. Each of the preconfigured formats is associated with a different type of human input device (HID). The source device receives one or more Internet Protocol (IP) packets from a sink device in the WD system. The one or more IP packets include a HID command (HIDC) input report. The source device identifies, based on data in the one or more IP packets, one of the preconfigured formats and parses the HIDC input report based on the identified preconfigured format in order to determine a user input. The source device then generates media data in response to the user input and sends the media data to the sink device.

Claims

1. A method comprising:

storing, at a source device, a plurality of preconfigured report formats prior to establishing a user input back channel (UIBC) with a sink device configured to receive an indication of user input from a human input device (HID), wherein each of the preconfigured report formats is associated with a different type of HID, wherein the source device does not receive schemas indicating formats for HID command (HIDC) input reports regarding input from particular HIDs, the sink device being a wireless display (WD) sink and the source device being a WD source;

establishing, by the source device, the UIBC with the sink device;

receiving, at the source device, one or more Internet Protocol (IP) packets from the sink device, the one or more IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising a HID command (HIDC) input report generated by the sink device for the user input received by the HID, the HIDC input report describing the user input received by the HID;

identifying, by the source device, based on data in the one or more IP packets, one of the preconfigured report formats;

parsing, by the source device, the HIDC input report based on the identified preconfigured report format in order to determine a user input;

generating, by the source device, media data in response to the user input; and

sending, by the source device, the media data from the source device to the sink device.

2. The method of claim 1, wherein the preconfigured report formats include schemas.

3. The method of claim 1, wherein receiving the one or more IP packets comprises receiving the one or more IP packets over a wireless communication network.

4. The method of claim 1, wherein the data comprises a numerical identifier that identifies one of the preconfigured report formats.

5. The method of claim 4, wherein the one or more IP packets comprise a message that includes a field that specifies the numerical identifier and a field that contains the HIDC input report.

6. The method of claim 1,

wherein the data comprises an IP address of the sink device, and

wherein identifying one of the preconfigured report formats comprises identifying, based at least in part on the IP address of the sink device, one of the preconfigured report formats.

7. The method of claim 6,

wherein the data comprises the IP address of the sink device and a source port, and

wherein identifying one of the preconfigured report formats comprises identifying, based at least in part on the IP address of the sink device and the source port, one of the preconfigured report formats.

8. The method of claim 1, further comprising:

in response to receiving the one or more IP packets from the sink device, determining whether the one or more IP packets comprise a generic input message or the HIDC input report, wherein the generic input message is generic to HIDs belonging to a class of HIDs.

9. A method comprising:

receiving, by a sink device, an indication of a user input received by a human input device (HID);

establishing, by the sink device, a user input back channel (UIBC) with a source device, the sink device being a wireless display (WD) sink and the source device being a WD source;

generating, by the sink device and based on the user input, a HID command (HIDC) input report that conforms to a report format, the HIDC input report describing the user input received by the HID;

sending, by the sink device, one or more Internet Protocol (IP) packets to a source device, the IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising the HIDC input report and a HID type indicator that identifies the report format, wherein the sink device does not send schemas to the source device indicating formats for HIDC input reports regarding input from particular HIDs, wherein the HID is one of the particular HIDs; and

receiving, by the sink device, media data from the source device, the media data based on the user input.

10. The method of claim 9, wherein the HID type indicator comprises a numerical identifier that identifies the report format.

11. The method of claim 10, wherein the one or more IP packets comprise a message that includes a field that specifies the numerical identifier and a field that contains the HIDC input report.

12. The method of claim 9, wherein sending the one or more IP packets comprises sending the IP packets over a wireless communication network.

13. A computing device comprising:

one or more processors configured to;

store a plurality of preconfigured report formats prior to establishing a user input back channel (UIBC) with a sink device configured to receive an indication of user input from a human input device (HID), wherein each of the preconfigured report formats is associated with a different type of HID, wherein the computing device does not receive schemas indicating formats for HID command (HIDC) input reports regarding input from particular HIDs, the sink device being a wireless display (WD) sink and the computing device being a WD source;

establish, by the source device, the UIBC with the sink device;

receive one or more Internet Protocol (IP) packets from the sink device, the one or more IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising a HID command (HIDC) input report generated by the sink device for the user input received by the HID, the HIDC input report describing the user input received by the HID;

identify, based on data in the one or more IP packets, one of the preconfigured report formats;

parse the HIDC input report based on the identified preconfigured report format in order to determine a user input; and

generate media data in response to the user input; and

a transmitter unit configured to send the media data from the computing device to the sink device.

14. The computing device of claim 13, wherein the preconfigured report formats include schemas.

15. The computing device of claim 13, wherein the computing device receives the one or more IP packets over a wireless communication network.

16. The computing device of claim 13, wherein the data comprises a numerical identifier that identifies one of the preconfigured report formats.

17. The computing device of claim 16, wherein the one or more IP packets comprise a message that includes a field that specifies the numerical identifier and a field that contains the HIDC input report.

18. The computing device of claim 13,

wherein the data comprises an IP address of the sink device, and

wherein the one or more processors are configured to identify, based at least in part on the IP address of the sink device, one of the preconfigured report formats.

19. The computing device of claim 18,

wherein the data comprises the IP address of the sink device and a source port, and

wherein the one or more processors are configured to identify, based at least in part on the IP address of the sink device and the source port, one of the preconfigured report formats.

20. The computing device of claim 13, wherein the one or more processors are configured to determine, in response to receiving the one or more IP packets from the sink device, whether the one or more IP packets comprise a generic input message or the HIDC input report, wherein the generic input message is generic to HIDs belonging to a class of HIDs.

21. A computing device that comprises:

one or more processors configured to;

receive an indication of user input received by a human input device (HID);

establish a user input back channel (UIBC) with a source device, the computing device being a wireless display (WD) sink and the source device being a WD source;

generate, based on the user input, a HID command (HIDC) input report that conforms to a report format, the HIDC input report describing the user input received by the HID; and

send one or more Internet Protocol (IP) packets to the source device, the IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising the HIDC input report and a HID type indicator that identifies the report format, wherein the computing device does not send schemas to the source device indicating formats for HIDC input reports regarding input from particular HIDs, wherein the HID is one of the particular HIDs; and

a receiver unit configured to receive media data from the source device, the media data based on the user input.

22. The computing device of claim 21, wherein the HID type indicator comprises a numerical identifier that identifies the report format.

23. The computing device of claim 22, wherein the one or more IP packets comprise a message that includes a field that specifies the numerical identifier and a field that contains the HIDC input report.

24. The computing device of claim 21, wherein sending the one or more IP packets comprises sending the one or more IP packets over a wireless communication network.

25. A computing device that comprises:

means for storing a plurality of preconfigured report formats prior to establishing a user input back channel (UIBC) with a sink device configured to receive an indication of user input from a human input device (HID), wherein each of the preconfigured report formats is associated with a different type of HID, wherein the computing device does not receive schemas indicating formats for HID command (HIDC) input reports regarding input from particular HIDs, the sink device being a wireless display (WD) sink and the computing device being a WD source;

means for establishing the UIBC with the sink device;

means for receiving one or more Internet Protocol (IP) packets from the sink device, the one or more IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising a HID command (HIDC) input report generated by the sink device for the user input received by the HID, the HIDC input report describing the user input received by the HID;

means for identifying, based on data in the one or more IP packets, one of the preconfigured report formats;

means for parsing the HIDC input report based on the identified preconfigured report format in order to determine a user input;

means for generating media data in response to the user input; and

means for sending the media data from the computing device to the sink device.

26. The computing device of claim 25, wherein the data comprises a numerical identifier that identifies one of the preconfigured report formats.

27. A computing device that comprises:

means for receiving an indication of user input received by a human input device (HID);

means for establishing a user input back channel (UIBC) with a source device, the computing device being a wireless display (WD) sink and the source device being a WD source;

means for generating, based on the user input, a HID command (HIDC) input report that conforms to a report format, the HIDC input report describing the user input received by the HID;

means for sending one or more Internet Protocol (IP) packets to a source device, the IP packets a UIBC message sent via the UIBC, the UIBC message comprising the HIDC input report and a HID type indicator that identifies the report format, wherein the computing device does not send schemas to the source device indicating formats for HIDC input reports regarding input from particular HIDs, wherein the HID is one of the particular HIDs; and

means for receiving media data from the source device, the media data based on the user input.

28. The computing device of claim 27, wherein the HID type indicator comprises a numerical identifier that identifies one of the preconfigured report formats.

29. A non-transitory computer readable storage medium that stores instructions that, when executed, configure one or more processors of a computing device to:

store, at the computing device, a plurality of preconfigured report formats prior to establishing a user input back channel (UIBC) with a sink device configured to receive an indication of user input from a human input device (HID), wherein each of the preconfigured report formats is associated with a different type of HID, wherein the computing device does not receive schemas indicating formats for HID command (HIDC) input reports regarding input from particular HIDs, the sink device being a wireless display (WD) sink and the computing device being a WD source;

establish the UIBC with the sink device;

receive one or more Internet Protocol (IP) packets from the sink device, the one or more IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising a HID command (HIDC) input report generated by the sink device for the user input received by the HID, the HIDC input report describing the user input received by the HID;

identify, based on data in the one or more IP packets, one of the preconfigured report formats;

parse the HIDC input report based on the identified preconfigured report format in order to determine a user input;

generate media data in response to the user input; and

send the media data from the source device to the sink device.

30. The computer program product of claim 29, wherein the data comprises a numerical identifier that identifies one of the preconfigured report formats.

31. A non-transitory computer readable storage medium that stores instructions that, when executed, configure one or more processors of a computing device to:

receive an indication of user input received by a human input device (HID);

establish a user input back channel (UIBC) with a source device, the computing device being a wireless display (WD) sink and the source device being a WD source;

generate, based on the user input, a HID command (HIDC) input report that conforms to a report format, the HIDC input report describing the user input received by the HID;

send one or more Internet Protocol (IP) packets to a source device, the IP packets comprising a UIBC message sent via the UIBC, the UIBC message comprising the HIDC input report and a HID type indicator that identifies the report format, wherein the computing device does not send to schemas to the source device indicating formats for HIDC input reports regarding input from particular HIDs, wherein the HID is one of the particular HIDs; and

receive media data from the source device, the media data based on the user input.

32. The computer program product of claim 31, wherein the HID type indicator comprises a numerical identifier that identifies one of the preconfigured report formats.