Method and apparatus for transmitting metadata in WFD

• US 10,356,829 B2
• Filed: 08/10/2016
• Issued: 07/16/2019
• Est. Priority Date: 09/09/2015
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Park, Giwon, Kim, Dongcheol, Lee, Byungjoo, Jo, Youngjun, Lim, Taesung
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Boyd, Alexander
• Application Number:
  US15/754,475
• Publication Number:
  US 20180249512A1
• Time in Patent Office: 1,070 Days
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04W 76/10 Connection setup
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

Provided are a method and an apparatus for transmitting metadata in a WFD. More particularly, a WFD source transmits, to a WFD sink, a first transmission stream in which an audio stream and a video stream are superimposed and multiplexed. The WFD source receives, from the WFD sink, a first RTSP request message for requesting transmission of metadata for audio data and video data during the transmission of the first transmission stream. The WFD source transmits, to the WFD sink, a first RTSP response message in response to the first RTSP request message during the transmission of the first transmission stream. The WFD source transmits, to the WFD sink, a metadata stream including the metadata and a second transmission stream in which the audio stream and the video stream are superimposed and multiplexed.

Claims

1. A method for transmitting metadata in a WiFi display (WFD), the method comprising:

transmitting, by a WFD source to a WFD sink, a first transport stream in which an audio stream including audio data and a video stream including video data are superimposed and multiplexed;

receiving, by the WFD source from the WFD sink, a first real-time streaming protocol (RTSP) request message for requesting transmission of metadata for the audio data and the video data during the transmission of the first transport stream;

transmitting, by the WFD source to the WFD sink, a first RTSP response message, in response to the first RTSP request message, during the transmission of the first transport stream; and

transmitting, by the WFD source to the WFD sink, a metadata stream including the metadata and a second transport stream in which the audio stream and the video stream are superimposed and multiplexed,

wherein the first RTSP request message includes a control format indicating information on a resolution of a video and information on frames per second of the video controlled based on the metadata, and

wherein the information on the resolution of the video and the information on the frames per second of the video are streamed and included in the first transport stream.

2. The method of claim 1, wherein when the WFD sink receives the first transport stream, the WFD sink operates a metadata request timer.

3. The method of claim 2, wherein when the metadata request timer reaches a predetermined time, the WFD sink transmits the first RTSP request message to the WFD source.

4. The method of claim 1, further comprising:

transmitting, by the WFD source, a WFD service search request frame for searching for a service capability, to the WFD sink;

receiving, by the WFD source, a WFD service search response frame, in response to the WFD service search request frame, from the WFD sink;

establishing, by the WFD source, a WFD connection with the WFD sink based on the WFD service search response frame;

transmitting, by the WFD source, a second RTSP request message, to the WFD sink for a capability negotiation procedure with the WFD sink after establishing the WFD connection; and

transmitting, by the WFD source, a second RTSP response message, to the WFD sink in response to the second RTSP request message,

wherein the first transport stream is transmitted after the capability negotiation procedure.

5. The method of claim 1, wherein the second transport stream is created by superimposing and multiplexing a first packet stream acquired by packetizing the audio stream, a second packet stream acquired by packetizing the video stream, and a third stream acquired by packetizing the metadata stream.

6. A WiFi display (WFD) source for transmitting metadata in a WFD, the WFD source comprising:

a receiver and transmitter; and

a processor, operatively coupled to the receiver and transmitter, wherein the processor is configured to;

control the transmitter to transmit, to a WFD sink, a first transport stream in which an audio stream including audio data and a video stream including video data are superimposed and multiplexed,

control the receiver to receive, from the WFD sink, a first real-time streaming protocol (RTSP) request message for requesting transmission of metadata for the audio data and the video data during the transmission of the first transport stream,

control the transmitter to transmit, to the WFD sink, a first RTSP response message, in response to the first RTSP request message, during the transmission of the first transport stream, and

control the transmitter to transmit, to the WFD sink, a metadata stream including the metadata and a second transport stream in which the audio stream and the video stream are superimposed and multiplexed,

wherein the first RTSP request message includes a control format indicating information on a resolution of a video and information on frames per second of the video controlled based on the metadata, and

wherein the information on the resolution of the video and the information on the frames per second of the video are streamed and included in the first transport stream.

7. The WFD source of claim 6, wherein when the WFD sink receives the first transport stream, the WFD sink operates a metadata request timer.

8. The WFD source of claim 7, wherein when the metadata request timer reaches a predetermined time, the WFD sink transmits the first RTSP request message to the WFD source.

9. The WFD source of claim 6, wherein the processor is further configured to:

control the transmitter to transmit a WFD service search request frame for searching for a service capability, to the WFD sink,

control the receiver to receive a WFD service search response frame, in response to the WFD service search request frame, from the WFD sink,

establish a WFD connection with the WFD sink based on the WFD service search response frame,

control the transmitter to transmit a second RTSP request message, to the WFD sink, for a capability negotiation procedure with the WFD sink after establishing the WFD connection, and

control the transmitter to transmit a second RTSP response message, to the WFD sink, in response to the second RTSP request message,

wherein the first transport stream is transmitted after the capability negotiation procedure.

10. The WFD source of claim 6, wherein the second transport stream is created by superimposing and multiplexing a first packet stream acquired by packetizing the audio stream, a second packet stream acquired by packetizing the video stream, and a third stream acquired by packetizing the metadata stream.