MPEG-4 live unicast video streaming system in wireless network with end-to-end bitrate-based congestion control
First Claim
1. An MPEG-4 live unicast video streaming system for use in a wireless network including an end-to-end congestion control mechanism that can automatically and dynamically adjust a data-bitrate/transmission bitrate according to an available network bandwidth, the system comprising:
- (1) a rate adaptive MPEG-4 simple profile encoder for generating MPEG-4 simple profile live video data through an encoding process with an adjustable encoding bitrate, for transmitting the generated MPEG-4 simple profile live video data by HTTP/TCP through a LAN, and for adjusting the encoding bitrate in accordance with a bitrate control requirement;
(2) a streaming server;
(2a) a data receiver module provided in the streaming server for receiving the MPEG-4 simple profile live video data by HTTP/TCP from the rate adaptive MPEG-4 simple profile encoder through the LAN;
(2b) an RTSP server module provided in the streaming server for handling a streaming session;
(2c) an RTP/RTCP transport engine server module provided in the streaming server for segmentizing the MPEG-4 simple profile live video data received by the data receiver module on the basis of GOVs, for packetizing each GOV as payload of RTP packets, and for transmitting the RTP packets through a wireless network according to a bitrate of each GOV, whereas RTCP is implemented for transporting retransmission request and reply;
(2d) a bitrate adapter module provided in the streaming server for implementing a bitrate adaptation protocol and a network bandwidth polling protocol to allow the streaming server to proceed with bitrate control tasks, and forwarding an incoming bitrate control decision to the rate adaptive MPEG-4 simple profile encoder as the bitrate control requirement;
(2e) a data link buffer provided in the streaming server for storing the MPEG-4 simple profile live video data received by the data receiver module as MPEG-4 GOV data;
(3) a client;
(3a) a rate adaptive MPEG-4 simple profile decoder provided in the client for decoding received MPEG-4 GOV data and rendering pictures represented by the received MPEG-4 GOV data;
(3b) an RTSP client module provided in the client for handling the streaming session;
(3c) an RTP/RTCP transport engine client module provided in the client for receiving the RTP packets from the streaming server through the wireless network, for depacketizing and desegmentizing the payload of the received RTP packets to each GOV of MPEG-4 GOV data, whereas RTCP is implemented for transporting retransmission request and reply;
(3d) a bitrate adapter module provided in the client for implementing the bitrate adaptation protocol and the network bandwidth polling protocol to allow the client to proceed with bitrate control tasks, and for forwarding the bitrate control decision to the streaming server; and
(3e) a data link buffer provided in the client for storing the MPEG-4 GOV data generated by the RTP/RTCP transport engine client module, for collecting bitrate control information, and for forwarding the collected bitrate control information to the bitrate adapter module in the client.
1 Assignment
0 Petitions
Accused Products
Abstract
With end-to-end congestion control, in an MPEG-4 live unicast video streaming system in a wireless network, a streaming server provides real-time video-streaming to a client by using an RTP/UDP protocol. RTP/RTCP transport engines handle the segmentation/desegmentation and the packetization/depacketization of data as well as the transmission/retransmission of packets. A bitrate adaptation protocol and a network bandwidth polling protocol can automatically and dynamically adjust the data-bitrate/transmission-bitrate according to the available network bandwidth. Therefore, the continuous live video-streaming service is promised.
266 Citations
17 Claims
-
1. An MPEG-4 live unicast video streaming system for use in a wireless network including an end-to-end congestion control mechanism that can automatically and dynamically adjust a data-bitrate/transmission bitrate according to an available network bandwidth, the system comprising:
-
(1) a rate adaptive MPEG-4 simple profile encoder for generating MPEG-4 simple profile live video data through an encoding process with an adjustable encoding bitrate, for transmitting the generated MPEG-4 simple profile live video data by HTTP/TCP through a LAN, and for adjusting the encoding bitrate in accordance with a bitrate control requirement;
(2) a streaming server;
(2a) a data receiver module provided in the streaming server for receiving the MPEG-4 simple profile live video data by HTTP/TCP from the rate adaptive MPEG-4 simple profile encoder through the LAN;
(2b) an RTSP server module provided in the streaming server for handling a streaming session;
(2c) an RTP/RTCP transport engine server module provided in the streaming server for segmentizing the MPEG-4 simple profile live video data received by the data receiver module on the basis of GOVs, for packetizing each GOV as payload of RTP packets, and for transmitting the RTP packets through a wireless network according to a bitrate of each GOV, whereas RTCP is implemented for transporting retransmission request and reply;
(2d) a bitrate adapter module provided in the streaming server for implementing a bitrate adaptation protocol and a network bandwidth polling protocol to allow the streaming server to proceed with bitrate control tasks, and forwarding an incoming bitrate control decision to the rate adaptive MPEG-4 simple profile encoder as the bitrate control requirement;
(2e) a data link buffer provided in the streaming server for storing the MPEG-4 simple profile live video data received by the data receiver module as MPEG-4 GOV data;
(3) a client;
(3a) a rate adaptive MPEG-4 simple profile decoder provided in the client for decoding received MPEG-4 GOV data and rendering pictures represented by the received MPEG-4 GOV data;
(3b) an RTSP client module provided in the client for handling the streaming session;
(3c) an RTP/RTCP transport engine client module provided in the client for receiving the RTP packets from the streaming server through the wireless network, for depacketizing and desegmentizing the payload of the received RTP packets to each GOV of MPEG-4 GOV data, whereas RTCP is implemented for transporting retransmission request and reply;
(3d) a bitrate adapter module provided in the client for implementing the bitrate adaptation protocol and the network bandwidth polling protocol to allow the client to proceed with bitrate control tasks, and for forwarding the bitrate control decision to the streaming server; and
(3e) a data link buffer provided in the client for storing the MPEG-4 GOV data generated by the RTP/RTCP transport engine client module, for collecting bitrate control information, and for forwarding the collected bitrate control information to the bitrate adapter module in the client. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. An MPEG-4 live unicast video streaming system comprising:
-
an MPEG-4 encoder encoding an information signal into MPEG-4 data composed of successive GOVs at an adjustable encoding bitrate and outputting the GOVs, and adjusting the encoding bitrate in accordance with a bitrate control signal;
a streaming server receiving the GOVs from the MPEG-4 encoder;
first means provided in the streaming server for changing each received GOV into packets;
second means provided in the streaming server for wirelessly transmitting the packets generated by the first means;
a client wirelessly receiving the packets from the streaming server;
third means provided in the client for changing the received packets into each recovered GOV;
a buffer memory provided in the client for temporarily storing recovered GOVs generated by the third means;
fourth means for reading out each GOV from the buffer memory;
fifth means for calculating a remaining playback time corresponding to GOVs in the buffer memory which have not yet been read out by the fourth means;
sixth means provided in the client for generating the bitrate control signal in response to the remaining playback time calculated by the fifth means;
seventh means for wirelessly transmitting the bitrate control signal generated by the sixth means to the streaming server; and
eighth means for transmitting the bitrate control signal from the streaming server to the MPEG-4 encoder.
-
-
16. An MPEG-4 live unicast video streaming system as recited in 15, wherein the fourth means comprises an MPEG-4 decoder decoding each GOV read out from the buffer memory into a corresponding portion of an original information signal.
-
17. An MPEG-4 live unicast video streaming system as recited in 15, further comprising:
-
ninth means for deciding whether or not each GOV in the buffer memory is short of data and requires absent data;
tenth means for, when the ninth means decides that a GOV in the buffer memory is short of data and requires absent data, generating a retransmission packet loaded with the absent data in the streaming server;
eleventh means for wirelessly transmitting the retransmission packet from the streaming server to the client;
twelfth means provided in the client for extracting the absent data from the retransmission packet; and
thirteenth means provided in the client for inserting the absent data extracted by the twelfth means into the data-short GOV in the buffer memory.
-
Specification