METHOD AND APPARATUS FOR PROVIDING USER INPUT BACK CHANNEL IN AUDIO/VIDEO SYSTEM

• US 20110107388A1
• Filed: 11/02/2010
• Published: 05/05/2011
• Est. Priority Date: 11/02/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: NA, Il-ju, LEE, Jae-min
• Granted Patent: US 9,264,670 B2
• Time in Patent Office: Days
• US Class Current: 725/118
• CPC Class Codes: H04L 65/1066 Session management
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

A method and apparatus for providing a user input back channel (UIBC) in an audio/video (AV) source device and an AV sink device communicating according to a wireless fidelity (Wi-Fi) display (WFD) standard is provided. The method includes: setting up an AV control session and an AV data session between the AV source devices according to the WFD standards; enabling the UIBC from the AV sink device to the AV source device by using the AV control session; and transmitting a user input from the AV sink device to the AV source device through the UIBC.

Claims

1. A method of communicating with an audio/video (AV) source device, wherein the method is performed by an AV sink device, the method comprising:

setting up, by the AV sink device, an AV control session and an AV data session with the AV source device according to a wireless fidelity (Wi-Fi) display (WFD) standard;

enabling a user input back channel (UIBC) to the AV source device, by using the AV control session; and

transmitting a user input to the AV source device through the UIBC.

2. The method of claim 1, wherein the user input comprises at least one of a function code for controlling the AV source device, pointing information, and character data.

3. The method of claim 1, wherein the AV control session is a real-time streaming protocol (RTSP) session.

4. The method of claim 1, wherein the enabling the UIBC comprises:

receiving a query from the AV source device related to a UIBC capability of the AV sink device;

transmitting a response related to the UIBC capability of the AV sink device to the AV source device;

receiving a UIBC enable request from the AV source device based on the UIBC capability of the AV sink device; and

transmitting a response related to the UIBC enable request to the AV source device.

5. The method of claim 4, wherein the UIBC capability of the AV sink device comprises at least one of a real-time streaming protocol (RTSP), a real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

6. The method of claim 1, wherein the enabling of the UIBC comprises:

transmitting, by the AV sink device, a query about UIBC capability of the AV source device to the AV source device;

receiving, from the AV source device, a response related to the UIBC capability of the AV source device;

transmitting a UIBC enable request to the AV source device based on the UIBC capability of the AV source device; and

receiving a response related to the UIBC enable request from the AV source device.

7. The method of claim 6, wherein the UIBC capability of the AV source device comprises at least one of real-time streaming protocol (RTSP), real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

8. The method of claim 1, wherein the transmitting of the user input comprises transmitting data and control information about the user input through the AV control session.

9. The method of claim 1, wherein the enabling of the UIBC comprises setting up a data session of the UIBC by using the AV control session, and

the transmitting the user input comprises transmitting data about the user input through the data session of the UIBC.

10. The method of claim 9, wherein the transmitting of the user input further comprises transmitting control information about the user input through the AV control session.

11. The method of claim 9, wherein the data session of the UIBC comprises at least one of a real-time transport protocol (RTP) session, a Bluetooth session, a Zigbee session, and a digital living network association (DLNA) session.

12. The method of claim 11, wherein the transmitting of the user input further comprises transmitting control information about the user input through the DLNA session.

13. The method of claim 1, further comprising notifying disablement of the UIBC to the AV source device.

14. A method of communicating with an audio/video (AV) sink device, wherein the method is performed by an AV source device, the method comprising:

setting up, by the AV source device, an AV control session and an AV data session with the AV sink device according to a wireless fidelity (Wi-Fi) display (WFD) standard;

enabling a user input back channel (UIBC) from the AV sink device, by using the AV control session; and

receiving a user input from the AV sink device through the UIBC.

15. The method of claim 14, wherein the user input comprises at least one of a function code for controlling the AV source device, pointing information, and character data.

16. The method of claim 14, wherein the AV control session is a real-time streaming protocol (RTSP) session.

17. The method of claim 14, wherein the enabling of the UIBC comprises:

transmitting a query related to a UIBC capability of the AV sink device to the AV sink device;

receiving about a response related to the UIBC capability of the AV sink device from the AV sink device;

transmitting a UIBC enable request to the AV sink device based on the UIBC capability of the AV sink device; and

receiving a response related to the UIBC enable request from the AV sink device.

18. The method of claim 17, wherein the UIBC capability of the AV sink device comprises at least one of real-time streaming protocol (RTSP), real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

19. The method of claim 14, wherein the enabling of the UIBC comprises:

receiving a query related to a UIBC capability of the AV source device from the AV sink device;

transmitting a response related to the UIBC capability of the AV source device to the AV sink device;

receiving a UIBC enable request from the AV sink device based on the UIBC capability of the AV source device; and

transmitting a response related to the UIBC enable request to the AV sink device.

20. The method of claim 19, wherein the UIBC capability of the AV source device comprises at least one of real-time streaming protocol (RTSP), real-time transport protocol (RTP), Bluetooth, Zigbee, and digital living network association (DLNA).

21. The method of claim 14, wherein the receiving of the user input comprises receiving data and control information about the user input through the AV control session.

22. The method of claim 14, wherein the enabling of the UIBC comprises setting up a data session of the UIBC by using the AV control session, and

the receiving of the user input comprises receiving data related to the user input through the data session of the UIBC.

23. The method of claim 22, wherein the receiving of the user input further comprises receiving control information about the user input through the AV control session.

24. The method of claim 22, wherein the data session of the UIBC comprises at least one of a real-time transport protocol (RTP) session, a Bluetooth session, a Zigbee session, and a digital living network association (DLNA) session.

25. The method of claim 24, wherein the receiving of the user input further comprises receiving control information about the user input through the DLNA session.

26. The method of claim 14, further comprising:

transmitting a UIBC disable request to the AV sink device; and

receiving a response related to the UIBC disable request from the AV sink device.

27. An audio/video (AV) sink device communicating with an AV source device, the AV sink device comprising:

a controller which sets up an AV control session and an AV data session with the AV source device according to a wireless fidelity (Wi-Fi) display (WFD) standard, and enables a user input back channel (UIBC) to the AV source device by using the AV control session; and

a communicator which transmits a user input to the AV source device through the UIBC.

28. The AV sink device of claim 27, wherein the communicator transmits data and control information related to the user input through the AV control session.

29. The AV sink device of claim 27, wherein the controller sets up a data session of the UIBC using the AV control session, and

the communicator transmits data related to the user input through the data session of the UIBC.

30. The AV sink device of claim 29, wherein the communicator transmits control information related to the user input through the AV control session.

31. An audio/video (AV) source device communicating with an AV sink device, the AV source device comprising:

a controller which sets up an AV control session and an AV data session with the AV sink device according to a wireless fidelity (Wi-Fi) display (WFD) standard, and enables a user input back channel (UIBC) from the AV sink device by using the AV control session; and

a communicator which receives a user input from the AV sink device through the UIBC.

32. The AV source device of claim 31, wherein the communicator receives data and control information related to the user input through the AV control session.

33. The AV source device of claim 31, wherein the controller sets up a data session of the UIBC by using the AV control session, and

the communicator receives data relating to the user input through the data session of the UIBC.

34. The AV source device of claim 33, wherein the communicator receives control information relating to the user input through the AV control session.

35. A communication system comprising:

an audio/video (AV) source device which transmits AV data; and

an AV sink device which receives AV data,

wherein the AV source device sets up an AV control session and an AV data session with the AV sink device, according to a wireless fidelity (Wi-Fi) display (WFD) standard, and enables a user input back channel (UIBC) from the AV sink device by using the AV control session, and

the AV sink device transmits a user input to the AV source device through the UIBC.

36. A computer readable recording medium having embodied thereon instructions, that when executed by a computer, causes the computer to perform a method of communicating with an audio/video (AV) source device, wherein the method is performed by an AV sink device, the method comprising:

setting up, by the AV sink device, an AV control session and an AV data session with the AV source device according to a wireless fidelity (Wi-Fi) display (WFD) standard;

enabling a user input back channel (UIBC) to the AV source device, by using the AV control session; and

transmitting a user input to the AV source device through the UIBC.

37. A computer readable recording medium having embodied thereon instructions that, when executed by a computer, causes the computer to perform a method of communicating with an audio/video (AV) sink device, wherein the method is performed by an AV source device, the method comprising:

setting up, by the AV source device, an AV control session and an AV data session with the AV sink device according to a wireless fidelity (Wi-Fi) display (WFD) standard;

enabling a user input back channel (UIBC) from the AV sink device, by using the AV control session; and

receiving a user input from the AV sink device through the UIBC.

38. A method of providing a user input back channel (UIBC) in an AV source device and an AV sink device, the method comprising:

transmitting, by the source device, a query related to UIBC capabilities of the AV sink device to the AV sink device;

receiving, by the AV source device, a response related to the UIBC capabilities of the AV sink device,

transmitting, to the AV sink device, a request to enable a desired UIBC, and

enabling the desired UIBC from the AV sink device.

39. The method of claim 38, wherein the UIBC capability is defined in a wireless fidelity (Wi-Fi) display (WFD) standard.

40. The method of claim 38, wherein the AV source device requests the AV sink device to enable at least one UIBC from among multiple UIBCs provided by the sink device.

41. The method of claim 40, wherein the AV source device receives a result of the enablement of the at least one UIBC from the AV sink device.

42. A method of providing a user input back channel (UIBC) in an AV source device and an AV sink device, the method comprising:

receiving, at the AV sink device, a query related to UIBC capabilities of the AV sink device from the AV source device;

transmitting, by the AV sink device, a response related to the UIBC capabilities to the AV source device,

receiving, a request to enable a desired UIBC, and

enabling the desired UIBC to the AV source device.

43. The method of claim 42, wherein the UIBC capability is defined in a wireless fidelity (Wi-Fi) display (WFD) standard.

44. The method of claim 42, wherein the AV sink device enables at least one UIBC from among multiple UIBCs provided by the AV sink device.

45. An audio/video (AV) source device comprising:

a controller which sets up an AV control session and an AV data session with an AV sink device according to a wireless fidelity (Wi-Fi) display (WFD) standard, and

a communicator which receives a user input from the AV sink device through a user input back channel (UIBC),

wherein the UIBC from the AV sink device is enabled using the AV control session.

46. The method of claim 45, wherein the user input comprises at least one of a function code for controlling the AV source device, pointing information, and character data.

47. The method of claim 45, wherein the AV control session is a real-time streaming protocol (RTSP) session.

48. An audio/video (AV) sink device comprising:

a controller which sets up an AV control session and an AV data session with an AV source device according to a wireless fidelity (Wi-Fi) display (WFD) standard, and

a communicator which transmits a user input to the AV source device through a user input back channel (UIBC),

wherein the UIBC to the AV source device is enabled using the AV control session.

49. The method of claim 48, wherein the user input comprises at least one of a function code for controlling the AV source device, pointing information, and character data.

50. The method of claim 48, wherein the AV control session is a real-time streaming protocol (RTSP) session.