Method and apparatus for providing user input back channel in audio/video system

• US 9,473,744 B2
• Filed: 07/16/2015
• Issued: 10/18/2016
• Est. Priority Date: 11/02/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Jae-min, Na, Il-ju
• Primary Examiner(s): Bruckart, Benjamin R
• Assistant Examiner(s): TESFAYE, AKLIL M
• Application Number:
  US14/801,442
• Publication Number:
  US 20150326654A1
• Time in Patent Office: 460 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 65/1066 Session management
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

A method and apparatus for providing a user input back channel (UIBC) in an audio/video (AV) source device and an AV sink device communicating according to a wireless fidelity (Wi-Fi) display (WFD) standard is provided. The method includes: setting up an AV control session and an AV data session between the AV source devices according to the WFD standards; enabling the UIBC from the AV sink device to the AV source device by using the AV control session; and transmitting a user input from the AV sink device to the AV source device through the UIBC.

Claims

1. A method of communicating between a first AV device and a second AV device by establishing at least one control session and at least one data session using a peer to peer standard, the method comprising:

receiving a request of enabling a user input back channel (UIBC), from the second AV device, using the at least one control session;

receiving a user input; and

transmitting information regarding the user input to the second AV device through the UIBC.

2. The method of claim 1, wherein the information regarding the user input comprises at least one of a function code for controlling the second AV device, pointing information, and character data.

3. The method of claim 1, further comprising establishing the UIBC, the establishing the UIBC comprising:

receiving a query from the second AV device related to a UIBC capability of the first AV device;

transmitting a response related to the UIBC capability of the first AV device to the second AV device;

receiving a UIBC establishment request from the second AV device, using the UIBC capability of the first AV device; and

transmitting a response related to the UIBC establishment request to the second AV device.

4. The method of claim 1, wherein the information regarding the user input is transmitted to the second AV device through the UIBC using at least one of a real-time streaming protocol (RTSP), a real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

5. The method of claim 1, further comprising establishing the UIBC, the establishing the UIBC comprising:

transmitting a query about UIBC capability of the second AV device to the second AV device;

receiving, from the second AV device, a response related to the UIBC capability of the second AV device;

transmitting a UIBC establishment request to the second AV device using the UIBC capability of the second AV device; and

receiving a response related to the UIBC establishment request from the second AV device.

6. The method of claim 1, further comprising:

establishing the UIBC,

wherein the establishing the UIBC comprises setting up the at least one data session of the UIBC by using the at least one control session, and

wherein the transmitting the information regarding the user input comprises transmitting data about the user input through the at least one data session of the UIBC.

7. The method of claim 6, wherein the transmitting of the information regarding the user input further comprises transmitting control information regarding the user input through the control session.

8. The method of claim 6, wherein the transmitting of the information regarding the user input further comprises transmitting control information regarding the user input through a digital living network association (DLNA) session.

9. The method of claim 1, further comprising notifying a disablement of the UIBC to the second AV device.

10. The method of claim 1, wherein the first AV device comprises a sink device and the second AV device comprises a source device.

11. A first AV device configured to communicate with a second AV device by establishing at least one control session and at least one data session using a peer to peer standard, the first AV device comprising:

a user input receiver configured to receive a user input; and

a communicator configured to;

receive a request of enabling a user input back channel (UIBC), from the second AV device, using the at least one control session; and

transmit information regarding the user input to the second AV device through the UIBC.

12. The first AV device of claim 11, further comprising a controller configured to set up the at least one data session of the UIBC using the at least one control session,

wherein the communicator is further configured to transmit information regarding the user input through the data session of the UIBC.

13. The first AV device of claim 12, wherein the communicator is further configured to transmit information regarding the user input through the control session.

14. A method of communicating between a first AV device and a second AV device by establishing at least one control session and at least one data session using a peer to peer standard, the method comprising:

transmitting a request of enabling a user input back channel (UIBC), to the first AV device, using the at least one control session; and

receiving information regarding a user input from the first AV device through the UIBC.

15. The method of claim 14, wherein the information regarding the user input comprises at least one of a function code for controlling the second AV device, pointing information, and character data.

16. The method of claim 14, wherein the first AV device comprises a sink device and the second AV device comprises a source device.

17. The method of claim 14, further comprising establishing the UIBC, wherein the establishing the UIBC comprises:

transmitting a query related to a UIBC capability of the first AV device to the first AV device;

receiving a response related to the UIBC capability of the first AV device from the first AV device;

transmitting a UIBC establishment request to the first AV device, using the UIBC capability of the first AV device; and

receiving a response related to the UIBC establishing request from the first AV device.

18. The method of claim 17, wherein the information regarding the user input is transmitted to the second AV device through the UIBC using at least one of a real-time streaming protocol (RTSP), a real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

19. The method of claim 14, further comprising establishing the UIBC, wherein the establishing the UIBC comprises:

receiving a query related to a UIBC capability of the second AV device from the first AV device;

transmitting a response related to the UIBC capability of the second AV device to the first AV device;

receiving a UIBC establishment request from the first AV device using the UIBC capability of the second AV device; and

transmitting a response related to the UIBC establishment request to the first AV device.

20. The method of claim 19, wherein the information regarding the user input is transmitted to the second AV device through the UIBC using at least one of a real-time streaming protocol (RTSP), a real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

21. The method of claim 14, wherein the receiving of the information regarding the user input comprises receiving data and control information regarding the user input through the control session.

22. The method of claim 14, further comprising establishing the UIBC,

wherein the establishing the UIBC comprises setting up a data session of the UIBC by using the control session, and

wherein the receiving of the information regarding the user input comprises receiving data related to the user input through the data session of the UIBC.

23. The method of claim 22, wherein the receiving of the information regarding the user input further comprises receiving control information regarding the user input through the control session.

24. The method of claim 14, further comprising:

transmitting a UIBC disable request to the first AV device; and

receiving a response related to the UIBC disable request from the first AV device.

25. A second AV device configured to communicate with a first AV device by establishing at least one control session and at least one data session using a peer to peer standard, the second AV device comprising:

a communicator configured to;

transmit a request to enable a user input back channel (UIBC), to the first AV device, using the at least one control session, and

to receive information regarding a user input from the first AV device through the UIBC.

26. The second AV device of claim 25, wherein the communicator is further configured to receive data and information regarding the user input through the control session.

27. The second AV device of claim 25, further comprising a controller configured to set up the at least one control session and the at least one data session with the first AV device, and to establish the UIBC using the at least one control session,

wherein the communicator is further configured t receive information regarding the user input through data session of the UIBC.

28. The second AV device of claim 27, wherein the communicator is further configured to receive information regarding the user input through the at least one control session.

29. The second AV device of claim 25, wherein the second AV device comprises a source device and the first AV device comprises a sink device.